Projection method, projection system, and program product

Abstract

This invention provides a projection method, projection system, and program product that suppresses the degradation of image quality after color correction compared to the image quality before color correction when a change occurs on a first display surface to which a first corrected image is projected. The projection method includes the following steps: measuring the reflection characteristics of reflected light from the first display surface using a first sensor; generating a plurality of first correction values ​​based on the reflection characteristics; performing color correction on input image data based on the plurality of first correction values ​​to generate first corrected image data; projecting a first corrected image based on the first corrected image data onto the first display surface; when a change in the first display surface is detected by a second sensor, performing color correction on the input image data based on a plurality of second correction values ​​to generate second corrected image data, wherein the plurality of second correction values ​​are obtained by changing at least a portion of the plurality of first correction values ​​to correction values ​​used to restore the color of the image projected onto the first display surface without color correction; and projecting a second corrected image based on the second corrected image data onto the first display surface.

Description

Technical Field

[0001] This invention relates to projection methods, projection systems, and program products. Background Technology

[0002] Patent Document 1 discloses a projector that performs color correction on image data based on a color correction table. In this projector, the aforementioned color correction table is generated based on the reflectivity of the color components of the reference projection surface of the projected image and the reflectivity of the color components of the specified projection surface of the image data projected immediately after the light source of the projector is turned on.

[0003] Patent Document 1: Japanese Patent Application Publication No. 2005-236528

[0004] According to the technology described in Patent Document 1, it is possible to project an image with a color that is easily visible and similar to the image projected onto the reference projection surface onto a specified projection surface that has a different color or surface condition than the reference projection surface. However, after generating the color correction table, if the relative positional relationship between the projected corrected image and the specified projection surface changes due to movement of the projector or the specified projection surface, the quality of the color-corrected image may be degraded compared to the quality of the image before color correction. Summary of the Invention

[0005] One projection method of the present invention includes the following steps: measuring the reflection characteristics of the color components of reflected light from a first display surface having a first color using a first sensor; generating a plurality of first correction values ​​based on the reflection characteristics, wherein the plurality of first correction values ​​are multiple correction values ​​for making the colors of a plurality of points in an image projected onto the first display surface approximate the colors of the image when it is projected onto a second display surface having a second color; performing color correction on input image data based on the plurality of first correction values ​​to generate first corrected image data; projecting a first corrected image based on the first corrected image data onto the first display surface; performing color correction on the input image data based on a plurality of second correction values ​​when a change in the first display surface is detected by a second sensor to generate second corrected image data, wherein the plurality of second correction values ​​are obtained by changing at least a portion of the plurality of first correction values ​​to correction values ​​for restoring or approximating the colors of an image projected onto the first display surface without color correction; and projecting a second corrected image based on the second corrected image data onto the first display surface.

[0006] One aspect of the projection system of the present invention comprises: a first sensor for measuring the reflectance characteristics of the color components of reflected light from a first display surface having a first color; a second sensor for detecting changes in the first display surface; a projector for projecting an image onto the first display surface; and one or more processors for controlling the projector, the one or more processors performing the following processing: measuring the reflectance characteristics of the color components of the reflected light from the first display surface by the first sensor; generating a plurality of first correction values ​​based on the reflectance characteristics, wherein the plurality of first correction values ​​are used to make the colors of a plurality of points in the image projected onto the first display surface approximate the colors of the image when the image is projected onto a second display surface having a second color. The process involves: generating a first corrected image data by performing color correction on the input image data based on the plurality of first correction values; projecting a first corrected image based on the first corrected image data onto the first display surface; and, in the event that a change in the first display surface is detected by a second sensor, performing color correction on the input image data based on a plurality of second correction values ​​to generate a second corrected image data, wherein the plurality of second correction values ​​are obtained by changing at least a portion of the plurality of first correction values ​​to correction values ​​used to restore or approximate the color of an image projected onto the first display surface without color correction; and projecting a second corrected image based on the second corrected image data onto the first display surface.

[0007] One aspect of the present invention involves a computer performing the following process: measuring the reflection characteristics of the color components of reflected light from a first display surface having a first color using a first sensor; generating a plurality of first correction values ​​based on the reflection characteristics, wherein the plurality of first correction values ​​are multiple correction values ​​for making the colors of a plurality of points in an image projected onto the first display surface approximate the colors of the image if the image were projected onto a second display surface having a second color; performing color correction on input image data based on the plurality of first correction values ​​to generate first corrected image data; projecting a first corrected image based on the first corrected image data onto the first display surface; performing color correction on the input image data based on a plurality of second correction values ​​if a change in the first display surface is detected by a second sensor to generate second corrected image data, wherein the plurality of second correction values ​​are obtained by changing at least a portion of the plurality of first correction values ​​to correction values ​​for restoring or approximating the colors of an image projected onto the first display surface without color correction; and projecting a second corrected image based on the second corrected image data onto the first display surface. Attached Figure Description

[0008] Figure 1 This is a block diagram schematically illustrating the structure of the projection system of this embodiment.

[0009] Figure 2 This is a flowchart illustrating the color correction process performed by the processor.

[0010] Figure 3 This is a diagram illustrating an example of projecting an input image based on input image data onto a first display surface.

[0011] Figure 4 This is a diagram illustrating an example of projecting a first corrected image based on first corrected image data onto a first display surface.

[0012] Figure 5 This is a diagram illustrating an example of how the quality of the first corrected image deteriorates when the relative positional relationship between the projected first corrected image and the first display surface changes.

[0013] Figure 6 This diagram illustrates an example of a situation where a second corrected image based on second corrected image data is projected onto a first display surface instead of a first corrected image.

[0014] Label Explanation

[0015] 10… Projection system, 11… Projector, 12… First sensor, 13… Second sensor, 14… Operating device, 15… Communication device, 16… Storage device, 17… Processor, 18… Communication bus, CL… Composite image light, 100… Image, 200… First display surface. Detailed Implementation

[0016] Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings. In the following drawings, the scale of each component may differ from the actual size in order to make each component identifiable.

[0017] Figure 1 This is a block diagram schematically illustrating the structure of the projection system 10 in this embodiment. For example... Figure 1 As shown, the projection system 10 includes a projector 11, a first sensor 12, a second sensor 13, an operating device 14, a communication device 15, a storage device 16, a processor 17, and a communication bus 18.

[0018] Projector 11 projects image 100 onto first display surface 200. In this embodiment, projector 11 is a three-panel projector using three liquid crystal panels as light modulation devices. The liquid crystal panels used as light modulation devices can be transmissive or reflective. Furthermore, the number of liquid crystal panels is not limited to three; it can also be one. Additionally, the light modulation device is not limited to liquid crystal panels; it can also be a DMD (Digital Micromirror Device). Since three-panel projectors are known in this embodiment, the structure of projector 11 will be briefly described below.

[0019] For example, the projector 11 includes: a light source that emits white light; a light-separating element that separates the white light emitted from the light source into red light, green light, and blue light; a first liquid crystal panel that modulates red light; a second liquid crystal panel that modulates green light; and a third liquid crystal panel that modulates blue light. Furthermore, the projector 11 also includes: a liquid crystal control circuit that controls the transmittance of the pixels contained in each of the three liquid crystal panels; a light combining element that combines the color image light emitted from the three liquid crystal panels; and a projection optical element that amplifies and projects the combined image light CL emitted from the light combining element.

[0020] An image 100 is displayed on the first display surface 200 by projecting a composite image light CL onto the first display surface 200. In this embodiment, the projection of the composite image light CL by the projector 11 onto the first display surface 200 has the same meaning as the projection of the image 100 by the projector 11 onto the first display surface 200. The liquid crystal control circuit is connected to the processor 17 via the communication bus 18 and controls the transmittance of the pixels contained in each of the three liquid crystal panels based on the image data supplied from the processor 17 at a predetermined frame rate. Thus, the image 100 based on the image data from the processor 17 is projected from the projector 11.

[0021] Projector 11 is not limited to a three-panel projector; it can also be a single-panel projector that uses a single LCD panel as the light modulation device. Alternatively, projector 11 can also be a type of projector that uses a device other than an LCD panel as the light modulation device.

[0022] The first sensor 12 receives reflected light from the first display surface 200 and measures the reflectivity of the color components of the received reflected light. For example, the first sensor 12 measures the tristimulus values ​​of the reflected light as the reflectivity of the color components of the reflected light. The first sensor 12 is connected to the processor 17 via the communication bus 18, and according to the instructions from the processor 17, measures the tristimulus values ​​of the received reflected light and outputs an electrical signal representing the measurement result of the tristimulus values ​​to the processor 17. For example, the first sensor 12 is a CCD (Charge Coupled Device) sensor.

[0023] The second sensor 13 detects changes in the first display surface 200. For example, the second sensor 13 detects changes in the relative positional relationship between the image 100 projected onto the first display surface 200 and the first display surface 200, as a change in the first display surface 200. The second sensor 13 is connected to the processor 17 via the communication bus 18 and outputs an electrical signal indicating that a change in the first display surface 200 has been detected to the processor 17. In this embodiment, the second sensor 13 is a different sensor from the first sensor 12. For example, the second sensor 13 is a distance sensor, an acceleration sensor, or an illuminance sensor. However, a single sensor can also function as both the first sensor 12 and the second sensor 13. Furthermore, the first sensor 12 and the second sensor 13 can also be the same type of sensor.

[0024] The operating device 14 is a device that accepts user operations. The operating device 14 includes multiple operation keys. For example, the operation keys include a power key, a menu key, directional keys, and an OK key. The operation keys can be hardware keys or software keys displayed on a touch panel. The operating device 14 is connected to the processor 17 via a communication bus 18, and outputs the electrical signals generated by the user operating the operation keys as operation signals to the processor 17.

[0025] The operating device 14 may also include a photoelectric conversion circuit that receives infrared light transmitted from the remote control (not shown) of the projector 11 and converts it into an electrical signal. The photoelectric conversion circuit outputs the electrical signal obtained from the infrared light as a remote operation signal to the processor 17. The remote control converts the electrical signals generated by the user operating the operation keys set on the remote control into infrared light and sends them to the projector 11. That is, the remote operation signal output from the photoelectric conversion circuit of the operating device 14 is substantially the same as the electrical signal generated by the user operating the operation keys of the remote control.

[0026] The communication device 15 communicates with an external device (not shown) via wired or wireless communication. For example, the external device may be a personal computer, a DVD (Digital Versatile Disc) player, a tablet computer, or an internet server. The communication device 15 is connected to the processor 17 via a communication bus 18, sending signals from the processor 17 to the external device and outputting signals received from the external device back to the processor 17.

[0027] Storage device 16 includes: non-volatile memory storing programs and various setting data required for processor 17 to perform various processes; and volatile memory used as a temporary data storage destination when processor 17 performs various processes. Storage device 16 is connected to processor 17 via communication bus 18, stores data according to write instruction signals from processor 17, and outputs specified data from the stored data to processor 17 according to read instruction signals from processor 17.

[0028] Processor 17 controls the overall operation of projection system 10 according to a program stored in storage device 16. For example, processor 17 may consist of one or more processors such as a CPU (Central Processing Unit). Part or all of the functionality of processor 17 may also be constructed from circuits such as DSP (Digital Signal Processor), ASIC (Application Specific Integrated Circuit), PLD (Programmable Logic Device), and FPGA (Field Programmable Gate Array). Processor 17 executes various processes in parallel or sequentially. Processor 17 is an example of a computer. This computer may also have external devices connected to projection system 10.

[0029] The following describes the color correction process performed by the processor 17 according to the program pre-stored in the storage device 16. Figure 2 This is a flowchart illustrating the color correction process performed by processor 17. Processor 17 performs this process by reading and executing a program from storage device 16. Figure 2 The color correction process shown.

[0030] like Figure 2 As shown, when the color correction process begins, the processor 17 first performs the following process: measuring the reflection characteristics of the color components of reflected light from the first display surface 200 having a first color using the first sensor 12 (step S1). The first color of the first display surface 200 is, for example, red. The first region 210, the left half of the area contained in the first display surface 200, is the region of the first color.

[0031] In this embodiment, the method described in Patent Document 1 is used as the method for measuring the reflectance characteristics of the color components of the reflected light from the first display surface 200. However, any method is acceptable as long as it is possible to measure the reflectance characteristics of the color components of the reflected light from the first display surface 200, and therefore the method is not limited to this. For details of the measurement method, please refer to Patent Document 1, but for a brief explanation of this embodiment, firstly, the processor 17 causes the projector 11 to project a sign image as image 100 using white light. Image data representing the sign image, i.e., sign image data, is pre-stored in the storage device 16. The processor 17 reads the sign image data from the storage device 16 and outputs the read sign image data to the liquid crystal control circuit of the projector 11. Based on the sign image data, the liquid crystal control circuit controls the transmittance of the pixels contained in each of the three liquid crystal panels. Thus, the sign image is projected from the projector 11 onto the first display surface 200 as image 100.

[0032] After the projector 11 projects the sign image, the processor 17 instructs the first sensor 12 to measure the reflectivity. Following the instruction from the processor 17, the first sensor 12 receives reflected light from the first display surface 200 on which the sign image is projected, measures the tristimulus values ​​of the received reflected light, and outputs an electrical signal representing the measurement result of the tristimulus values ​​to the processor 17. Based on the output signal of the first sensor 12, the processor 17 acquires the measurement result of the tristimulus values ​​as the measurement result of the reflectivity.

[0033] Next, the processor 17 performs the following processing: based on the obtained reflection characteristics, it generates a plurality of first correction values, which are multiple correction values ​​used to make the colors of multiple points in the mark image projected onto the first display surface 200 close to the colors of the mark image when it is projected onto a second display surface having a second color (step S2). In this embodiment, the multiple points respectively represent multiple pixels of the liquid crystal panel. However, it is not limited to this; a point may also be composed of multiple pixels, such as 4 pixels or 9 pixels, within a range where the user does not experience any disharmony in the color-corrected image. Furthermore, a point may also be one of a region within the captured image, divided by edge detection or the like.

[0034] In this embodiment, the method described in Patent Document 1 is used as the method for generating the first correction value based on the obtained reflection characteristics, i.e., the tristimulus values ​​of the reflected light. However, as long as the first correction value can be generated, the method for generating the correction value is not limited to this. For details of the method for generating the correction value, please refer to Patent Document 1, but for the present embodiment, it will be explained simply as follows: First, before using the projector 11, the projector 11 is turned on in a dark room, and images of each color (R, G, B, and bk) are projected onto the second display surface. The reflection characteristics of the reflected light in the second display surface output by the projector 11 are measured using the first sensor 12, the output voltage value of the first sensor 12 is converted into tristimulus values, a matrix representing the correspondence between the output voltage value of the first sensor 12 and the tristimulus values ​​is generated, and stored in the storage device 16. Then, based on the generated matrix, a correction value, i.e., a reference correction value, is generated, and the reference correction value is also stored in the storage device 16. The second color of the second display surface is, for example, white.

[0035] The processor 17, based on the matrix pre-stored in the storage device 16 as described above, converts the output voltage value output from the first sensor 12 into tristimulus values ​​when the projector 11 projects the sign image. Furthermore, the processor 17 generates a plurality of first correction values ​​based on the reference correction values ​​pre-stored in the storage device 16 as described above and the tristimulus values ​​of the reflected light from the sign image. These first correction values ​​are multiple correction values ​​corresponding one-to-one with the multiple points, used to make the colors of multiple points in the sign image projected onto the first display surface 200 having a first color close to the colors of the sign image when it is projected onto a second display surface having a second color.

[0036] Next, the processor 17 performs the following steps: generating first corrected image data by performing color correction on the input image data based on multiple first correction values ​​(step S3). Here, the input image data refers to the image data received by the processor 17 from an external device via the communication device 15.

[0037] Next, the processor 17 performs the following steps: projecting a first corrected image based on the first corrected image data onto the first display surface 200 (step S4). Specifically, the processor 17 outputs the first corrected image data to the liquid crystal control circuit of the projector 11. Based on the first corrected image data, the liquid crystal control circuit controls the transmittance of the pixels contained in each of the three liquid crystal panels. Thus, the first corrected image is projected from the projector 11 onto the first display surface 200 as image 100.

[0038] Figure 3This diagram illustrates an example of projecting an input image 300 based on input image data onto a first display surface 200 without performing color correction based on a first correction value. For example, the input image 300 is a white image. For example, the first region 210 in the left half of the area included by the first display surface 200 is a red region, and the second region 220 in the right half is a white region.

[0039] When a white input image 300 is projected onto a first display surface 200 containing a first region 210 and a second region 220 as described above, the color of the region 310 that overlaps with the first region 210 in the region contained in the input image 300 becomes a mixture of red and white.

[0040] Figure 4 This diagram illustrates an example of generating first corrected image data by performing color correction on input image data based on a first correction value, and projecting a first corrected image 400 based on the first corrected image data onto a first display surface 200. (Compared to...) Figure 3 Similarly, the first region 210 in the left half of the area included by the first display surface 200 is a red region, and the second region 220 in the right half is a white region. In the area included by the first corrected image 400, the color of the region 410 overlapping with the first region 210 is a color that makes red close to white, that is, cyan, a mixture of blue and green. In the area included by the first corrected image 400, the color of the region 420 other than the region 410 overlapping with the first region 210 is white.

[0041] When the first corrected image 400 is projected onto the first display surface 200, which includes the first region 210 and the second region 220, the region 410 overlapping with the first region 210 within the area contained in the first corrected image 400 is almost white. Thus, by performing color correction on the input image data based on a first correction value to generate first corrected image data, and by projecting the first corrected image 400 based on the first corrected image data onto the first display surface 200, an image with the same color as the input image 300, namely the first corrected image 400, can be displayed on the first display surface 200.

[0042] However, after the first correction value is generated, if the relative position of the projected first corrected image 400 and the first display surface 200 changes due to the movement of the projector 11 or the first display surface 200, the quality of the first corrected image 400 after color correction is sometimes worse than the quality of the input image 300 before color correction.

[0043] Figure 5This is a diagram illustrating an example of quality degradation of the first corrected image 400 when the relative positional relationship between the projected first corrected image 400 and the first display surface 200 changes. Figure 5 This illustrates a scenario where, after generating the first correction value, the projector 11 or the first display surface 200 moves laterally by a distance d. For example... Figure 5 As shown, after the first correction value is generated, when the projector 11 or the first display surface 200 moves a distance d in the horizontal direction, a cyan-colored banded region 430 appears inside the first corrected image 400 projected onto the first display surface 200.

[0044] In this embodiment, in order to suppress the image quality degradation that occurs when the relative positional relationship between the projected first corrected image 400 and the first display surface 200 changes, as described above, the processor 17 performs the processing described below. Hereinafter, returning to... Figure 2 Let me continue explaining.

[0045] like Figure 2 As shown, after the processor 17 performs the process of projecting the first corrected image based on the first corrected image data onto the first display surface 200, it determines whether a change in the first display surface 200 has been detected by the second sensor 13 (step S5). For example, the processor 17 determines whether a change in the relative positional relationship between the projected first corrected image 400 and the first display surface 200 has been detected as a change in the first display surface 200 based on the output signal of the distance sensor, which is the second sensor 13. Other examples include detecting the tilt angle of the projector as a change in the first display surface 200 when the second sensor 13 is an accelerometer; detecting natural light, such as sunlight, illuminating the first display surface 200 as a change in the first display surface 200 when the second sensor 13 is an illuminance sensor; and detecting a change in the color of the first display surface 200 as a change in the first display surface 200 when the second sensor 13 is a CCD sensor. For example, a change in the color of the first display surface 200 is a change in the image displayed on the liquid crystal display of the first display surface 200.

[0046] If no change is detected in the first display surface 200 by the second sensor 13 (step S5: No), the processor 17 repeatedly performs the processing of step S5 at constant time intervals while the projector 11 projects the first corrected image 400 onto the first display surface 200.

[0047] On the other hand, when a change in the first display surface 200 is detected by the second sensor 13 (step S5: Yes), the processor 17 performs the following steps: color correction of the input image data based on a plurality of second correction values ​​to generate second corrected image data, wherein the plurality of second correction values ​​are obtained by changing at least a portion of a plurality of first correction values ​​to correction values ​​for restoring or approximating the color of the image projected onto the first display surface 200 without color correction (step S8).

[0048] For example, the multiple second correction values ​​used to restore the colors of an image projected onto the first display surface 200 without color correction may each contain a correction value of zero. Alternatively, for example, to approximate the colors of an image projected onto the first display surface 200 without color correction, the multiple second correction values ​​may contain correction values ​​that are the average of multiple first correction values. These correction values ​​are correction data preset before color correction. Specifically, multiple second correction values ​​may be preset before color correction, or a method for calculating multiple second correction values ​​based on multiple first correction values ​​may be preset before color correction.

[0049] Then, the processor 17 performs the following steps: projecting a second corrected image based on the second corrected image data onto the first display surface 200 (step S9). Specifically, the processor 17 outputs the second corrected image data to the liquid crystal control circuit of the projector 11. Based on the second corrected image data, the liquid crystal control circuit controls the transmittance of the pixels contained in each of the three liquid crystal panels. Thus, the second corrected image is projected from the projector 11 onto the first display surface 200 as image 100. In other words, when the first display surface 200 changes, the processor 17 switches the image projected onto the first display surface 200 from the first corrected image that has undergone color correction to a second corrected image that restores or approximates the color of the image projected without color correction in at least a portion of the area.

[0050] Figure 6 This diagram illustrates an example of a situation where, in a case where the relative positional relationship between the projected first corrected image 400 and the first display surface 200 changes, a second corrected image 500 based on second corrected image data is projected onto the first display surface 200 instead of the first corrected image 400. Figure 3 Similarly, the first region 210 of the left half of the area included in the first display surface 200 is a red region, and the second region 220 of the right half is a white region.

[0051] Figure 6 An example is illustrated where the projector 11 or the first display surface 200 has moved a distance d in the lateral direction. Additionally, for example, Figure 6This illustrates a scenario where a second corrected image 500, generated based on second corrected image data where each of the multiple second corrected values ​​is zero, is projected onto a first display surface 200.

[0052] In this case, no color correction is performed on the input image data. Therefore, as Figure 6 As shown, a second corrected image 500, identical to the white input image 300, is projected onto a first display surface 200 comprising a first region 210 and a second region 220. In this case, within the area contained in the projected second corrected image 500, the color of the region 510 overlapping with the first region 210 is a mixture of red and white, but as... Figure 5 The cyan band-shaped area 430 shown disappears.

[0053] As described above, when the second sensor 13 detects a change in the first display surface 200, the processor 17, by executing steps S8 and S9, can suppress the quality of the second corrected image 500 projected onto the first display surface 200 in place of the first corrected image 400 from deteriorating compared to the quality of the first corrected image 400, even if the relative positional relationship between the projected first corrected image 400 and the first display surface 200 changes.

[0054] Below, return Figure 2 Let me continue explaining.

[0055] like Figure 2 As shown, before projecting the second corrected image 500 onto the first display surface 200, the processor 17 performs the following steps: performing color correction on the input image data based on a plurality of third correction values, thereby generating third corrected image data, wherein the plurality of third correction values ​​are obtained by changing at least a portion of a plurality of first correction values ​​to correction values ​​for approximating the color of the image when projected onto the first display surface 200 without color correction (step S6).

[0056] Furthermore, before projecting the second corrected image 500 onto the first display surface 200 and after generating the third corrected image data, the processor 17 performs the following step: projecting the third corrected image based on the third corrected image data onto the first display surface 200 (step S7). Here, the second corrected image 500 includes a portion of the color that is closer to the image projected onto the first display surface 200 without color correction compared to the third corrected image.

[0057] As described above, before the second corrected image 500 is projected onto the first display surface 200, a third corrected image based on the third corrected image data is projected onto the first display surface 200. As a result, the hue of the image projected onto the first display surface 200 changes in stages. Therefore, the user is less likely to feel any disharmony when the hue changes when the projected image is switched.

[0058] The above description relates to the color correction process executed by the processor 17 according to the program stored in the storage device 16. The projection method of this embodiment is realized by the processor 17 executing the color correction process.

[0059] That is, the projection method of this embodiment includes the following steps: measuring the reflection characteristics of the color components of reflected light from a first display surface 200 having a first color using a first sensor 12; generating a plurality of first correction values ​​based on the reflection characteristics, wherein the plurality of first correction values ​​are multiple correction values ​​used to make the colors of a plurality of points in an image projected onto the first display surface 200 close to the colors of the image when it is projected onto a second display surface having a second color; performing color correction on input image data based on the plurality of first correction values ​​to generate first corrected image data; projecting a first corrected image 400 based on the first corrected image data onto the first display surface 200; performing color correction on input image data based on a plurality of second correction values ​​when a change in the first display surface 200 is detected by a second sensor 13 to generate second corrected image data, wherein the plurality of second correction values ​​are obtained by changing at least a portion of the plurality of first correction values ​​to correction values ​​used to restore or approximate the colors of an image projected onto the first display surface 200 without color correction; and projecting a second corrected image 500 based on the second corrected image data onto the first display surface 200.

[0060] As described above, after the first corrected image 400 based on the first corrected image data is projected onto the first display surface 200, and a change in the first display surface 200 is detected by the second sensor 13, color correction of the input image data is performed based on a plurality of second correction values, thereby generating second corrected image data. The plurality of second correction values ​​are obtained by changing at least a portion of the plurality of first correction values ​​to correction values ​​for restoring or approximating the color of the image when it is projected onto the first display surface 200 without color correction. Furthermore, by projecting the second corrected image 500 based on the second corrected image data onto the first display surface 200, even if the relative positional relationship between the first projected first corrected image 400 and the first display surface 200 changes, it is possible to suppress the degradation of the quality of the second corrected image 500 projected onto the first display surface 200 instead of the first corrected image 400 compared to the quality of the first corrected image 400.

[0061] In the projection method of this embodiment, each correction value included in the plurality of second correction values ​​may be zero.

[0062] According to this embodiment, when the condition of the first display surface 200 on which the first corrected image 400 is projected changes, the correction that causes the user to feel a sense of disharmony disappears.

[0063] In the projection method of this embodiment, each correction value included in the plurality of second correction values ​​may be the average value of the plurality of first correction values.

[0064] According to this embodiment, compared to setting each correction value of the plurality of second correction values ​​to zero based on the color of the first display surface 200, the user's perception of disharmony in the tone of the first display surface 200 is reduced.

[0065] The projection method of this embodiment further includes the following steps before projecting the second corrected image 500 onto the first display surface 200: performing color correction on the input image data based on a plurality of third correction values ​​to generate third corrected image data, wherein the plurality of third correction values ​​are obtained by changing at least a portion of a plurality of first correction values ​​to correction values ​​that make a portion of the image closer to the color of the image projected onto the first display surface 200 without color correction; and projecting the third corrected image based on the third corrected image data onto the first display surface 200. The second corrected image 500 includes a portion of the image whose color is closer to that of the image projected onto the first display surface 200 without color correction compared to the third corrected image.

[0066] According to this embodiment, before the second corrected image 500 is projected onto the first display surface 200, a third corrected image based on the third corrected image data is projected onto the first display surface 200. As a result, the hue of the image projected onto the first display surface 200 changes in stages. Therefore, the user is less likely to feel any disharmony when the hue changes when the projected image is switched.

[0067] In this embodiment, the second sensor 13 may also be a different sensor from the first sensor 12.

[0068] According to this embodiment, by configuring a sensor suitable for detecting changes in the first display surface 200, switching between the correction value and the correction image can be performed only under specific conditions, thus suppressing the degradation of the projected image quality. For example, by using an accelerometer as the second sensor 13, if it can be determined that the projector 11 or the first display surface 200 has returned to its original position due to slight shaking, etc., it is possible to take measures such as not switching the correction value.

[0069] In this embodiment, the second sensor 13 may also be configured on the first display surface 200.

[0070] According to this embodiment, there is no reaction to objects inserted between the first display surface 200 and the projector 11, and the correction value is changed only when there are changes in the first display surface 200 itself. Therefore, the discomfort felt by the user due to frequent changes in the correction value caused by inserted objects can be reduced.

[0071] The projection system 10 of this embodiment includes: a first sensor 12 that measures the reflection characteristics of the color component of reflected light from a first display surface 200 having a first color; a second sensor 13 that detects changes in the first display surface 200; a projector 11 that projects an image 100 onto the first display surface 200; and one or more processors 17 that control the projector 11. One or more processors 17 perform the following processes: measuring the reflection characteristics of the color components of reflected light from the first display surface 200 using a first sensor 12; generating a plurality of first correction values ​​based on the reflection characteristics, wherein the plurality of first correction values ​​are multiple correction values ​​used to make the colors of a plurality of points in an image projected onto the first display surface 200 approximate the colors when the image is projected onto a second display surface having a second color; performing color correction on input image data based on the plurality of first correction values ​​to generate first corrected image data; projecting a first corrected image 400 based on the first corrected image data onto the first display surface 200; in the event that a change in the first display surface 200 is detected by a second sensor 13, performing color correction on input image data based on a plurality of second correction values ​​to generate second corrected image data, wherein the plurality of second correction values ​​are obtained by changing at least a portion of the plurality of first correction values ​​to correction values ​​used to restore or approximate the colors of an image projected onto the first display surface 200 without color correction; and projecting a second corrected image 500 based on the second corrected image data onto the first display surface 200.

[0072] According to the projection system 10 of this embodiment, even if the relative positional relationship between the first corrected image 400 and the first display surface 200 changes, it is possible to suppress the degradation of the quality of the second corrected image 500 projected onto the first display surface 200 instead of the first corrected image 400 compared to the quality of the first corrected image 400.

[0073] The program of this embodiment causes a computer (processor 17) to perform the following processes: measuring the reflection characteristics of the color components of reflected light from a first display surface 200 having a first color using a first sensor 12; generating a plurality of first correction values ​​based on the reflection characteristics, wherein the plurality of first correction values ​​are multiple correction values ​​used to make the colors of a plurality of points in an image projected onto the first display surface 200 close to the colors when the image is projected onto a second display surface having a second color; performing color correction on input image data based on the plurality of first correction values ​​to generate first corrected image data; projecting a first corrected image 400 based on the first corrected image data onto the first display surface 200; performing color correction on input image data based on a plurality of second correction values ​​when a change in the first display surface 200 is detected by a second sensor 13 to generate second corrected image data, wherein the plurality of second correction values ​​are obtained by changing at least a portion of the plurality of first correction values ​​to correction values ​​used to restore or approximate the colors of an image projected onto the first display surface 200 without color correction; and projecting a second corrected image 500 based on the second corrected image data onto the first display surface 200.

[0074] According to the procedure of this embodiment, even if the relative positional relationship between the first corrected image 400 and the first display surface 200 changes, it is possible to suppress the degradation of the quality of the second corrected image 500 projected onto the first display surface 200 instead of the first corrected image 400 compared to the quality of the first corrected image 400.

[0075] The embodiments of this disclosure have been described above, but the technical scope of this disclosure is not limited to the above embodiments, and various modifications can be made without departing from the spirit of this disclosure.

[0076] This is a summary of the disclosure.

[0077] The following is a summary published in this note.

[0078] (Appendix 1) A projection method comprising the following steps: measuring the reflection characteristics of the color components of reflected light from a first display surface having a first color using a first sensor; generating a plurality of first correction values ​​based on the reflection characteristics, wherein the plurality of first correction values ​​are multiple correction values ​​for making the colors of a plurality of points in an image projected onto the first display surface approximate the colors of the image when it is projected onto a second display surface having a second color; performing color correction on input image data based on the plurality of first correction values ​​to generate first corrected image data; projecting a first corrected image based on the first corrected image data onto the first display surface; performing color correction on the input image data based on a plurality of second correction values ​​when a change in the first display surface is detected by a second sensor to generate second corrected image data, wherein the plurality of second correction values ​​are obtained by changing at least a portion of the plurality of first correction values ​​to correction values ​​for restoring or approximating the colors of an image projected onto the first display surface without color correction; and projecting a second corrected image based on the second corrected image data onto the first display surface.

[0079] As described in Appendix 1, after projecting a first corrected image based on the first corrected image data onto the first display surface, if a change in the first display surface is detected by the second sensor, color correction of the input image data is performed based on a plurality of second correction values, thereby generating second corrected image data. By projecting the second corrected image based on the second corrected image data onto the first display surface, even if the relative positional relationship between the first projected first corrected image and the first display surface changes, it is possible to suppress the degradation of the quality of the second corrected image projected onto the first display surface in place of the first corrected image compared to the quality of the first corrected image. The plurality of second correction values ​​are obtained by changing at least a portion of the plurality of first correction values ​​to correction values ​​used to restore or approximate the color of the image projected onto the first display surface without color correction.

[0080] (Note 2) According to the projection method described in Note 1, each of the plurality of second correction values ​​contains a correction value of zero.

[0081] According to Appendix 2, if the condition of the first display surface on which the first corrected image is projected changes, the correction that causes the user to feel a sense of disharmony disappears.

[0082] (Note 3) According to the projection method described in Note 1, each of the plurality of second correction values ​​is the average of the plurality of first correction values.

[0083] According to Appendix 3, compared to setting each correction value contained in the plurality of second correction values ​​to zero based on the color of the first display surface, the user's perception of disharmony in the tone of the first display surface is reduced.

[0084] (Appendix 4) According to any one of Appendices 1 to 3, the projection method further includes the following steps before projecting the second corrected image onto the first display surface: performing color correction on the input image data based on a plurality of third correction values ​​to generate third corrected image data, wherein the plurality of third correction values ​​are obtained by changing at least a portion of the plurality of first correction values ​​to correction values ​​for approximating the color of an image projected onto the first display surface without color correction; and projecting the third corrected image based on the third corrected image data onto the first display surface, wherein the second corrected image includes a portion of the color that is closer to the color of an image projected onto the first display surface without color correction than the third corrected image.

[0085] According to Appendix 4, before the second corrected image is projected onto the first display surface, a third corrected image based on the third corrected image data is projected onto the first display surface. As a result, the hue of the image projected onto the first display surface changes in stages. Therefore, the user is less likely to feel any disharmony when the hue changes when the projected image is switched.

[0086] (Note 5) The projection method according to any one of Notes 1 to 4, wherein the second sensor is a different sensor from the first sensor.

[0087] According to Appendix 5, by configuring a sensor suitable for detecting changes in the first display surface, switching between the correction value and the correction image can be performed only under specific conditions, thus suppressing the degradation of the projected image quality. For example, by using an accelerometer as a second sensor, if it can be determined that the projector or the first display surface has returned to its original position due to slight shaking, etc., it is possible to respond without switching the correction value.

[0088] (Note 6) According to the projection method described in Note 5, the second sensor is disposed on the first display surface.

[0089] According to Appendix 6, there is no response to objects inserted between the first display surface and the projector; the calibration value is only changed when there are changes in the first display surface itself. This reduces the discomfort experienced by the user caused by frequent changes in calibration values ​​due to inserted objects.

[0090] (Appendix 7) A projection system comprising: a first sensor for measuring the reflectance characteristics of a color component of reflected light from a first display surface having a first color; a second sensor for detecting changes in the first display surface; a projector for projecting an image onto the first display surface; and one or more processors for controlling the projector, the one or more processors performing the following processing: measuring the reflectance characteristics of a color component of reflected light from the first display surface using the first sensor; generating a plurality of first correction values ​​based on the reflectance characteristics, wherein the plurality of first correction values ​​are used to make the colors of a plurality of points in the image projected onto the first display surface approximate the case where the image is projected onto a second display surface having a second color. The process involves: obtaining multiple correction values ​​for the color of the input image data; performing color correction on the input image data based on the multiple first correction values ​​to generate first corrected image data; projecting the first corrected image based on the first corrected image data onto the first display surface; and, upon detecting a change in the first display surface via a second sensor, performing color correction on the input image data based on multiple second correction values ​​to generate second corrected image data, wherein the multiple second correction values ​​are obtained by changing at least a portion of the multiple first correction values ​​to correction values ​​used to restore or approximate the color of the image projected onto the first display surface without color correction; and projecting the second corrected image based on the second corrected image data onto the first display surface.

[0091] According to Appendix 7, even if the relative positional relationship between the first projected corrected image and the first display surface changes, it is possible to suppress the degradation of the quality of the second corrected image projected onto the first display surface in place of the first corrected image compared to the quality of the first corrected image.

[0092] (Appendix 8) A program product that causes a computer to perform the following processing: measuring the reflection characteristics of the color components of reflected light from a first display surface having a first color via a first sensor; generating a plurality of first correction values ​​based on the reflection characteristics, wherein the plurality of first correction values ​​are multiple correction values ​​for making the colors of a plurality of points in an image projected onto the first display surface approximate the colors of the image when it is projected onto a second display surface having a second color; performing color correction on input image data based on the plurality of first correction values ​​to generate first corrected image data; projecting a first corrected image based on the first corrected image data onto the first display surface; performing color correction on the input image data based on a plurality of second correction values ​​upon detecting a change in the first display surface via a second sensor to generate second corrected image data, wherein the plurality of second correction values ​​are obtained by changing at least a portion of the plurality of first correction values ​​to correction values ​​for restoring or approximating the colors of an image projected onto the first display surface without color correction; and projecting a second corrected image based on the second corrected image data onto the first display surface.

[0093] According to Appendix 8, even if the relative positional relationship between the first corrected image projected first and the first display surface changes, it is possible to suppress the quality of the second corrected image projected onto the first display surface in place of the first corrected image from being inferior to that of the first corrected image.

Claims

1. A projection method comprising the following steps: The reflection characteristics of the color components of reflected light from a first display surface having a first color are measured using a first sensor; Based on the reflection characteristics, a plurality of first correction values ​​are generated, wherein the plurality of first correction values ​​are multiple correction values ​​used to make the colors of a plurality of points in the image projected onto the first display surface close to the colors of the image when it is projected onto a second display surface having a second color; Color correction of the input image data is performed based on the plurality of first correction values, thereby generating first corrected image data; A first corrected image based on the first corrected image data is projected onto the first display surface; Upon detecting a change in the first display surface via a second sensor, color correction is performed on the input image data based on a plurality of second correction values ​​to generate second corrected image data. The plurality of second correction values ​​are obtained by modifying at least a portion of the plurality of first correction values ​​to correction values ​​used to restore or approximate the color of an image projected onto the first display surface without color correction. A second corrected image based on the second corrected image data is projected onto the first display surface.

2. The projection method according to claim 1, wherein, Each of the plurality of second correction values ​​contains a correction value of zero.

3. The projection method according to claim 1, wherein, Each of the plurality of second correction values ​​is the average of the plurality of first correction values.

4. The projection method according to claim 1, wherein, Before projecting the second corrected image onto the first display surface, the projection method further includes the following steps: Color correction of the input image data is performed based on a plurality of third correction values ​​to generate third corrected image data, wherein the plurality of third correction values ​​are obtained by modifying at least a portion of the plurality of first correction values ​​to correction values ​​that approximate the color of an image projected onto the first display surface without color correction; and The third corrected image, based on the third corrected image data, is projected onto the first display surface. The second corrected image contains a portion of the color that is closer to the color of the image when it is projected onto the first display surface without color correction than the third corrected image.

5. The projection method according to any one of claims 1 to 4, wherein, The second sensor is a different sensor from the first sensor.

6. The projection method according to claim 5, wherein, The second sensor is disposed on the first display surface.

7. A projection system comprising: A first sensor measures the reflectance characteristics of the color components of reflected light from a first display surface having a first color; The second sensor detects changes in the first display surface; A projector that projects an image onto the first display surface; and One or more processors that control the projector. The one or more processors perform the following processing: The reflection characteristics of the color components of the reflected light from the first display surface are measured using the first sensor; Multiple first correction values ​​are generated based on the aforementioned reflection characteristics, wherein, The plurality of first correction values ​​are multiple correction values ​​used to make the colors of a plurality of points in the image projected onto the first display surface close to the colors of the image when it is projected onto a second display surface having a second color; Color correction of the input image data is performed based on the plurality of first correction values, thereby generating first corrected image data; A first corrected image based on the first corrected image data is projected onto the first display surface; When a change in the first display surface is detected by the second sensor, color correction of the input image data is performed based on a plurality of second correction values ​​to generate second corrected image data, wherein the plurality of second correction values ​​are obtained by changing at least a portion of the plurality of first correction values ​​to correction values ​​for restoring or approximating the color of the image projected onto the first display surface without color correction; as well as A second corrected image based on the second corrected image data is projected onto the first display surface.

8. A program product that causes a computer to perform the following processes: The reflection characteristics of the color components of reflected light from a first display surface having a first color are measured using a first sensor; Multiple first correction values ​​are generated based on the aforementioned reflection characteristics, wherein, The plurality of first correction values ​​are multiple correction values ​​used to make the colors of a plurality of points in an image projected onto the first display surface close to the colors of the image when it is projected onto a second display surface having a second color; Color correction of the input image data is performed based on the plurality of first correction values, thereby generating first corrected image data; A first corrected image based on the first corrected image data is projected onto the first display surface; When a change in the first display surface is detected by the second sensor, color correction of the input image data is performed based on a plurality of second correction values ​​to generate second corrected image data, wherein the plurality of second correction values ​​are obtained by changing at least a portion of the plurality of first correction values ​​to correction values ​​for restoring or approximating the color of the image projected onto the first display surface without color correction; as well as A second corrected image based on the second corrected image data is projected onto the first display surface.

Images