Control method, electronic device, and program

Abstract

To enable a user to easily understand that a plurality of images of one pattern should be taken when distortion correction is performed based on an image captured by a camera of a pattern projected from a projector onto a projection target.SOLUTION: An electronic device 10, which communicates with a projector 20 that projects a projection image onto a projection target SC, includes a camera 130, a display 140, and a processing apparatus 110. The processing apparatus 110 causes the projector 20 to project a first adjustment pattern for adjusting the outer shape of the projection image toward the projection target SC. The processing apparatus 110 then displays on the display 140 an image of the first adjustment pattern captured by the camera 130 and at least one prompt image that prompts a user to acquire a plurality of captured images.SELECTED DRAWING: Figure 3

Description

[Technical Field]

[0001] The present disclosure relates to a control method, an electronic device, and a program. [Background technology]

[0002] An example of an image display device is a projector that displays an image by projecting it onto an object such as a projection screen. Depending on the shape of the object or the positional relationship between the object and the image display device, distortions such as trapezoidal distortion may occur in the image displayed on the object by the image display device. Various techniques for correcting this distortion have been proposed, one example of which is the technique disclosed in Patent Document 1.

[0003] Patent Document 1 discloses an invention of a display system having an image display device and a mobile terminal that communicates with the image display device. The image display device in Patent Document 1 includes a measurement pattern generating unit, a projection unit, a first communication unit, and a distortion correction unit. The measurement pattern generating unit generates a plurality of measurement patterns. The projection unit projects the plurality of measurement patterns generated by the measurement pattern generating unit. The first communication unit communicates with the mobile terminal and receives information related to image distortion correction from the mobile terminal. The distortion correction unit corrects distortion in the image projected by the projection unit based on the information related to image distortion correction received from the mobile terminal.

[0004] The mobile terminal in Patent Document 1 has a camera unit, a control unit, and a second communication unit. The camera unit captures multiple measurement patterns displayed on the video display device. The control unit generates information related to image distortion correction based on the multiple measurement patterns captured by the camera unit. The second communication unit communicates with the first communication unit and transmits the information related to image distortion correction generated by the control unit to the video display device. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] International Publication No. 2017 / 179111 Summary of the Invention [Problem to be solved by the invention]

[0006] In distortion correction using a measurement pattern, it is desirable to take multiple images of one measurement pattern in order to improve correction accuracy, but it is difficult for users to grasp this fact. [Means for solving the problem]

[0007] One aspect of the control method of the present disclosure is a control method for an electronic device that includes a camera capable of capturing a projection image projected from a projector onto a projection target, a display, and is capable of communicating with the projector, and includes having the projector project a first adjustment pattern for adjusting the outer shape of the projection image as the projection image, and displaying at least one prompt image on the display that prompts the camera to acquire the multiple captured images.

[0008] One aspect of the electronic device disclosed herein includes a communication device that communicates with a projector, a camera that can capture a projection image projected from the projector onto a projection target, a display, and a processing device, wherein the processing device causes the projector to project a first adjustment pattern for adjusting the outer shape of the projection image as the projection image, and displays on the display an image of the first adjustment pattern captured by the camera and at least one prompt image that prompts the user to obtain multiple captured images.

[0009] One aspect of the program disclosed herein causes a computer to project a first adjustment pattern from the projector for adjusting the outline of a projection image projected from the projector onto a projection target, and to display on a display an image of the first adjustment pattern captured by a camera capable of capturing the projection image projected from the projector onto the projection target, and at least one prompt image prompting the computer to acquire a plurality of the captured images. [Brief explanation of the drawings]

[0010] [Figure 1] 1 is a diagram showing an example of the configuration of a display system 1 including an electronic device 10 according to an embodiment of the present disclosure. [Figure 2] 10 is a diagram showing an example of an adjustment pattern (first adjustment pattern) projected from the projector 20 onto the projection target SC. FIG. [Figure 3] 1 is a diagram illustrating an example of the configuration of an electronic device 10. FIG. [Figure 4] FIG. 10 is a diagram showing an example of a rectangle confirmation screen G10. [Figure 5] FIG. 10 is a diagram showing an example of an adjustment method explanation screen G20. [Figure 6] FIG. 10 is a diagram showing an example of an imaging start screen G30. [Figure 7] FIG. 10 is a diagram showing an example of a processing screen G40. [Figure 8] FIG. 10 is a diagram showing another example of the processing screen G40. [Figure 9] 10 is a flowchart showing the flow of processing in a control method executed by a processing device 110 according to a program PR1. [Figure 10] 10 is a diagram showing an example of a second adjustment pattern projected from the projector 20 onto the projection target SC. FIG. [Figure 11] FIG. 10 is a diagram showing an example of an unevenness confirmation screen G50. DETAILED DESCRIPTION OF THE INVENTION

[0011] The embodiments described below are subject to various technically preferable limitations, but the embodiments of the present disclosure are not limited to the following embodiments.

[0012] 1. Embodiment 1 is a diagram showing an example configuration of a display system 1 including an electronic device 10 according to an embodiment of the present disclosure. In addition to the electronic device 10, the display system 1 includes a projector 20 that communicates with the electronic device 10 via a network NW. Specific examples of the network NW include a wired or wireless LAN (Local Area Network), a wired or wireless USB, or Bluetooth (registered trademark).

[0013] The projector 20 projects a projection image GA onto a projection target SC. In this embodiment, the projection target SC is, for example, one of the interior walls of the room of the user of the display system 1. The projector 20 has a generation unit (described later) such as a liquid crystal panel.

[0014] The wall surface of a room is not flat like a screen, and distortion may occur in the projected image GA displayed on the wall surface by the projector 20 due to depressions or protrusions in the wall surface. Furthermore, distortion may also occur in the projected image GA displayed on the wall surface by the projector 20 when the projection lens of the projector 20 is not directly facing the wall surface. In this embodiment, the image distortion is corrected using an adjustment pattern as in the conventional case. Although details will be described later, in this embodiment, a dot pattern shown in FIG. 2 is used to adjust the outer shape of the projected image projected from the projector 20 onto the projection target SC to a rectangle. The dot pattern shown in FIG. 2 is an example of a first adjustment pattern in the present disclosure.

[0015] The electronic device 10 is, for example, a smartphone. Fig. 3 is a diagram showing an example configuration of the electronic device 10. As shown in Fig. 3, the electronic device 10 includes a processing device 110, a communication device 120, a camera 130, a display 140, an input device 150, and a storage device 160. In the electronic device 10, the communication device 120, the camera 130, the display 140, the input device 150, and the storage device 160 are each connected to the processing device 110 via a bus 170.

[0016] The processing device 110 is one or more processors. The processing device 110 is, for example, a CPU (Central Processing Unit). The processing device 110 functions as a control center of the electronic device 10 by operating in accordance with a program PRA stored in the storage device 160.

[0017] The communication device 120 is a device that performs wireless communication with other devices, and includes, for example, an interface circuit. A specific example of another device that communicates with the communication device 120 is the projector 20.

[0018] The camera 130 is, for example, a video camera. The camera 130 includes an imaging lens (not shown) and an imaging element (not shown) on which light from the imaging lens forms an image. The imaging element is, for example, a CMOS (Complementary Metal-Oxide-Semiconductor) sensor, but is not particularly limited to this. The camera 130 is a device for capturing a projection image projected onto an object from the projector 20. The camera 130 captures images within its imaging field of view as needed, and transfers image data representing the captured image to the processing device 110.

[0019] The display 140 includes a panel display such as a liquid crystal display, a plasma display, or an organic EL display, and a drive circuit for the panel display. The display 140 displays various images under the control of the processing device 110. The input device 150 is a transparent pressure-sensitive sensor provided to cover the display area of ​​the display 140. The input device 150 may include multiple controls. The input device 150 receives a user's operation and outputs operation content data indicating the received operation to the processing device 110. In this way, the user's operation on the input device 150 is transmitted to the processing device 110.

[0020] The storage device 160 is a recording medium readable by the processing device 110. The storage device 160 includes, for example, a nonvolatile memory and a volatile memory. The nonvolatile memory is, for example, a read-only memory (ROM), an erasable programmable read-only memory (EPROM), or an electrically erasable programmable read-only memory (EEPROM). The volatile memory is, for example, a random access memory (RAM). Various programs are stored in the nonvolatile memory. Examples of the various programs stored in the nonvolatile memory include a kernel program and a program PRA. The kernel program is not illustrated in FIG. 3. The kernel program is a program that causes the processing device 110 to implement an operating system (OS). When the electronic device 10 is powered on, the processing device 110 reads the kernel program from the nonvolatile memory to the volatile memory and begins executing the read kernel program. When an instruction to start executing another program is received via an operation on the input device 150, the processing device 110, operating according to the kernel program, begins executing the other program.

[0021] For example, when an instruction to start execution of program PR1 is issued via an operation on input device 150, processing device 110 reads program PR1 from non-volatile memory to volatile memory and starts executing program PR1 read into volatile memory. Processing device 110 operating in accordance with program PR1 functions as first control unit 111, second control unit 112, third control unit 113, determination unit 114, and adjustment unit 115 shown in FIG. 3. In other words, each of first control unit 111, second control unit 112, third control unit 113, determination unit 114, and adjustment unit 115 shown in FIG. 3 is a software module realized by operating processing device 110 in accordance with program PR1. The roles of each of first control unit 111, second control unit 112, third control unit 113, determination unit 114, and adjustment unit 115 shown in FIG. 3 are as follows: Processing device 110 is composed of one or more processors. The plurality of processors correspond to, for example, the first control unit 111, the second control unit 112, the third control unit 113, the determination unit 114, and the adjustment unit 115, respectively.

[0022] The first control unit 111 displays an image of a UI screen that prompts the user to execute the control method of the present disclosure on the display 140. Specific examples of UI screens that are displayed on the display 140 under the control of the first control unit 111 include a rectangle confirmation screen G10, an adjustment method explanation screen G20, an imaging start screen G30, and a processing screen G40, which will be described below.

[0023] FIG. 4 is a diagram showing an example of a rectangular confirmation screen G10. The rectangular confirmation screen G10 includes an image G12 representing an image of a projection image projected by the projector 20 onto the projection target SC when the outer shape of the projection image has not been adjusted (for example, an image of a projection image having a trapezoidal outer shape), and an image G11 representing an image of a projection image having a rectangular outer shape. The image G12 is an example of a first image in the present disclosure. When the rectangular confirmation screen G10 is displayed on the display 140, the user can perform an operation to select the image G11 or the image G12 by operating the input device 150. In other words, the image G11 and the image G12 are images that can be selected by the user, and the image G12 is an example of a first image in the present disclosure.

[0024] If the outer shape of the projection image projected by the projector 20 onto the projection target SC is rectangular, the user selects image G11. When image G11 is selected, the electronic device 10 ends the control method of the present disclosure without calculating a geometric correction value for shape correction. On the other hand, when the outer shape of the projection image projected by the projector 20 onto the projection target SC is not rectangular, the user selects image G12. When image G12 is selected, the first control unit 111 displays an image of the adjustment method explanation screen G20 on the display 140.

[0025] FIG. 5 is a diagram illustrating an example of an adjustment method explanation screen G20. The adjustment method explanation screen G20 is an image that provides an explanation regarding the adjustment of the contour of a projection image. The image of the adjustment method explanation screen G20 in this embodiment includes an image G21 of text that describes the adjustment of the contour of a projection image, an image G22 that schematically illustrates capturing an adjustment pattern using the electronic device 10, and an image G23 of a button that instructs the user to perform the adjustment. Because the adjustment method explanation screen G20 includes the image G21 of text that describes the adjustment of the contour of a projection image and the image G22 that schematically illustrates capturing an adjustment pattern using the electronic device 10, the user can easily understand how the contour is adjusted from the display content of the adjustment method explanation screen G20. The image of the adjustment method explanation screen G20 is an example of a third image in the present disclosure. While the adjustment method explanation screen G20 is displayed on the display 140, the user can select the image G23 by operating the input device 150. When the image G23 is selected by operating the input device 150, the first control unit 111 displays on the display 140 an image of the imaging start screen G30.

[0026] FIG. 6 is a diagram illustrating an example of an image capture start screen G30. The image capture start screen G30 includes an image G31 of text notifying the user to start capturing an adjustment pattern; an image G32 that, like image G22, schematically illustrates capturing an adjustment pattern using the electronic device 10; and an image G33 of a button for instructing the user to start projecting and capturing an adjustment pattern for adjusting the outer shape. While the image capture start screen G30 is displayed on the display 140, the user can select image G33 by operating the input device 150. According to this embodiment, the user can project the adjustment pattern onto the projection target SC at any desired timing by operating the input device 150. When image G33 is selected by operating the input device 150, the second control unit 112 (described later) controls the projector 20 to project the adjustment pattern and causes the camera 130 to capture the adjustment pattern. The first control unit 111 then displays a processing screen G40 on the display 140.

[0027] FIG. 7 is a diagram illustrating an example of a processing screen G40. The processing screen G40 includes an image G41 containing an adjustment pattern captured by the camera 130, prompt images G42A and G42B prompting the user to capture multiple captured images, a button image G43 for instructing the user to capture captured images, and a gauge image G44. In this embodiment, the prompt image G42A is an image of text prompting the user to "move left and right to capture images from various angles while fitting all of the adjustment patterns." While the processing screen G40 is displayed, the electronic device 10 is held in a landscape orientation so that all of the adjustment patterns can be fitted, and therefore the image on the processing screen G40 is also a landscape image. The prompt image G42B is an image of a camera icon that moves in a swinging motion left and right on the display surface of the display 140. That is, the prompt image G42B moves back and forth on the processing screen G40. The prompt image G42B continues to move back and forth until the number of captured images reaches the target number. The target number is set to a value that ensures the accuracy of the analysis results of the adjustment pattern based on simulations and experiments performed in advance. In this embodiment, the swing of the prompt image G42B represents moving left and right to capture images of the adjustment pattern from various angles. If the electronic device 10 has an acceleration sensor, the first control unit 111 may analyze the output of the acceleration sensor to determine the direction and speed of movement of the electronic device 10, and swing the prompt image G42B in synchronization with the speed and direction of movement. The processing screen G40 is required to include at least one prompt image, and may not include images such as G41.

[0028] Prompt image G42A and prompt image G42B prompt the user to acquire a first captured image at a first position and a second captured image at a second position different from the first position. In this embodiment, the user can easily understand that at least one captured image should be acquired by checking image G41, which facilitates improving the accuracy of the contour adjustment. Prompt image G42B is an example of a fourth image in the present disclosure. Gauge image G44 represents the number of successfully acquired captured images out of the total number of captured images captured by camera 130. In other words, gauge image G44 indicates the progress of the task of acquiring successfully captured images. In this embodiment, gauge image G44 has, for example, 10 cells whose color can change from white to black. While the number of cells is not particularly limited, two or more is preferable. With each successfully acquired captured image, one more cell changes to black in FIG. 7. The user can easily grasp the progress of acquiring multiple captured images through the changes in gauge image G44. Furthermore, the user can easily understand through the change in the gauge image G44 whether the cumulative number of normal captured images is sufficient relative to the number of cells (10) prepared in advance, i.e., the total number (target number) of normal captured images to be captured by the camera 130, and thus understand that multiple captured images should be captured until the number of normal captured images reaches 10. Therefore, the gauge image G44 can be considered one of at least one prompt image. Note that in this embodiment, the gauge image G44 has 10 discrete cells, but the design of the gauge image G44 is not particularly limited as long as the user can understand whether the cumulative number of normal captured images is sufficient. The gauge image G44 may be, for example, a continuous bar indicating the ratio of the number of normal captured images to the target number of normal captured images to be captured by the camera 130.

[0029] For example, if only one captured image is acquired, the accuracy of the geometric correction of the projection image GA calculated by the processing device 110 based on the single captured image may be reduced. Specifically, when the processing device 110 calculates a projective transformation matrix that converts from one of the coordinate system of the single captured image and the coordinate system of the projector 20 to the other and performs homography decomposition processing on the projective transformation matrix, an incorrect normal vector of the projection target SC may be obtained. Furthermore, if the accuracy of the projective transformation matrix is ​​reduced due to noise contained in the captured image, a phenomenon may occur in which geometric correction parameters calculated to be correct in the coordinate system of the camera 130 are incorrect in the coordinate system of the projector 20. In contrast, in this embodiment, prompt images G42A and G42B that prompt the user to acquire multiple captured images make it easier to acquire multiple captured images. This allows the correct normal vector of the projection target SC to be obtained from each of the multiple captured images and multiple projection transformation matrices that convert from one coordinate system of the projector 20 to the other, and even if one of the multiple captured images contains noise, the effect of the noise can be compensated for by the other captured images, thereby preventing a decrease in the accuracy of the geometric correction.

[0030] In the present embodiment, the prompt image is an image of text prompting the user to "move left and right to capture images from various angles while fitting all of the adjustment patterns" and an image of a camera icon that swings left and right on the display surface of display 140, but either one of these may be used. Also, instead of prompt image G42B, as shown in FIG. 8, an arrow image G42C instructing the user on the direction of movement and checkbox images G42D, G42E, and G42F indicating the success or failure of capturing captured images at each of the right, center, and left positions may be used. Images 42C, 42D, 42E, and 42F are also examples of at least one prompt image.

[0031] For example, if the determination unit 114 (described later) determines that the captured image at the right position was normally acquired, the first control unit 111 displays the image G42D with hatching on the display 140. On the other hand, if the determination unit 114 (described later) determines that the captured image at the right position was not normally acquired, the first control unit 111 displays the image G42D without hatching on the display 140. That is, in this embodiment, if the determination unit 114 (described later) determines that either the first captured image or the second captured image was normally acquired, the first control unit 111 displays the corresponding check boxes on the display 140 in a first display mode (a display mode in which none of the check boxes are hatched). On the other hand, if the determination unit 114 (described later) determines that both the first captured image and the second captured image were normally acquired, the first control unit 111 displays the corresponding check boxes on the display 140 in a second display mode (a display mode in which all of the check boxes are hatched). In the mode in which the processing-in-progress screen G40 shown in FIG. 8 is displayed, the user can easily know whether or not the captured image has been acquired normally by checking the change in the display mode of the prompt image.

[0032] The second control unit 112 communicates with the projector 20 via the communication device 120, thereby causing the projector 20 to project the adjustment pattern described above.

[0033] The third control unit 113 controls the camera 130 to capture an image including the adjustment pattern projected onto the projection target SC.

[0034] The determination unit 114 determines whether the captured image captured by the camera 130 was properly acquired in response to a user instruction. More specifically, the determination unit 114 attempts to detect the first adjustment pattern in the captured image captured by the camera 130, and determines that the image has been properly acquired if the detection is successful. The determination unit 114 calculates the spectral distribution of the captured image, for example, by performing a fast Fourier transform on the first adjustment pattern. The determination unit 114 then calculates the magnitude of high-frequency components based on the results of analyzing the spectral distribution. The magnitude of the high-frequency components is an example of an index indicating the clarity of the captured image. The greater the blur of the captured image, the smaller the high-frequency components. There is no particular limitation on which frequencies are considered high-frequency, as long as they are sufficient to analyze the first adjustment pattern. The determination unit 114 determines that the captured image has been properly acquired if the high-frequency components are equal to or greater than a predetermined threshold, and determines that the captured image has not been properly acquired if they are less than the threshold. The above describes a determination based on the blur of the captured image, but the determination method is not particularly limited. The determination unit 114 may determine whether the captured image has been acquired normally based on the color distribution of the captured image, the degree of distortion, etc. The determination unit 114 stores the captured image that has been acquired normally in the volatile memory of the storage device 160.

[0035] The adjustment unit 115 calculates geometric correction values ​​for adjusting the outer shape based on the multiple captured images stored in the volatile memory, and transmits the geometric correction values ​​to the projector 20, causing the projector 20 to perform the outer shape adjustment. Note that the adjustment unit 115 may select two captured images captured at positions farthest apart from the multiple captured images, and if the distance between the captured positions is equal to or greater than a threshold, calculate geometric correction values ​​based on the multiple captured images, and if the distance between the captured positions is less than the threshold, prompt the user to continue capturing images. This is because using captured images captured from positions as far apart as possible contributes to improving correction accuracy.

[0036] Furthermore, the processing device 110 operating in accordance with the program PR1 executes a control method embodying the features of the present disclosure. Fig. 9 is a flowchart showing the processing flow of this control method. As shown in Fig. 9, this control method includes a display control process SA110, a projection control process SA120, an acquisition process SA130, and an adjustment process SA140.

[0037] In the display control process SA110, the processing device 110 functions as a first control unit. In the display control process SA110, the processing device 110 first displays the above-mentioned rectangle confirmation screen G10 on the display 140. Then, when the processing device 110 receives an operation to select the image G12, it displays an adjustment method explanation screen G20 on the display 140. Then, after displaying the adjustment method explanation screen G20 on the display 140, when an operation is performed on the button image G23, the processing device 110 displays an imaging start screen G30 on the display 140 and waits for an operation on the button image G33. When an operation is performed on the button image G33, the processing device 110 executes the projection control process SA120.

[0038] In the projection control process SA120, the processing device 110 functions as the second control unit 112 and the third control unit 113, and causes the projector 20 to project the above-mentioned adjustment pattern, and also causes the camera 130 to capture an image of the adjustment pattern projected onto the projection target SC.

[0039] In the acquisition process SA130, the processing device 110 functions as a first control unit 111 and a determination unit 114. In the acquisition process SA130, the processing device 110 first displays a processing-in-progress screen G40 on the display 140. Then, in response to an operation on the button image G43, the processing device 110 acquires a captured image by the camera 130. Each time a captured image is acquired, the processing device 110 determines whether the captured image was acquired correctly. If the processing device 110 determines that the captured images from multiple positions were acquired correctly, the processing device 110 executes an adjustment process SA140 (described later) and terminates the execution of this control method. On the other hand, if the processing device 110 determines that the captured image was not acquired correctly, the processing device 110 prompts the user to retake the image. For example, in a mode in which the image shown in FIG. 8 is used as the processing-in-progress screen G40, check boxes corresponding to the positions are displayed on the display 140 in the first display mode described above, prompting the user to recapture the captured image.

[0040] In the adjustment process SA140, the processing device 110 functions as the adjustment unit 115. In the adjustment process SA140, the processing device 110 calculates a geometric correction value for correcting distortion of the projection image based on the multiple captured images acquired in the acquisition process SA130, and transmits the geometric correction value to the projector 20. Thereafter, the projector 20 performs geometric correction to correct the outline of the projection image in accordance with the geometric correction value received from the electronic device 10, and projects the projection image with the adjusted outline onto the projection target SC.

[0041] As described above, according to this embodiment, the user can easily understand from the prompt images G42A and G42B that they should acquire multiple captured images taken from different positions while checking image G41, making it easier to improve the accuracy of the outer shape adjustment.

[0042] 2. Variations The above embodiments can be modified as follows. (1) After displaying the adjustment method explanation screen G20 on the display 140, the first control unit 111 may display on the display 140, prior to displaying the image capture start screen G30, a fourth image that recommends the camera position (in other words, the position of the electronic device 10) when capturing an image of the first adjustment pattern with the camera 130. According to this embodiment, the user can easily understand the position in which to capture the image of the first adjustment pattern. Note that the same effect can be achieved by projecting the fourth image from the projector 20 instead of displaying it on the display 140.

[0043] (2) After performing the adjustment of the outer shape, the second control unit 112 may cause the projector 20 to project a second adjustment pattern in which a plurality of figures are arranged, in order to allow the user to determine whether or not adjustment of unevenness in the projected image is necessary. A specific example of the second adjustment pattern is the grid pattern shown in FIG. 10 . The presence or absence of unevenness in the projected image is determined visually by the user, but if the projected image is a monochrome image or a natural image, it is difficult to visually determine the presence or absence of unevenness. Note that the grid spacing of the grid pattern is preferably the same as or larger than the correction point spacing of the correction circuit that performs geometric correction in the projector 20. By making the grid spacing of the grid pattern the same as or larger than the correction point spacing of the correction circuit that performs geometric correction in the projector 20, unnecessary correction can be avoided when there are unevenness that is too small to be corrected.

[0044] In this case, the first control unit 111 may display an unevenness check screen G50 shown in FIG. 11 on the display 140 to guide the user in adjusting the unevenness of the projected image. As shown in FIG. 11, the unevenness check screen G50 includes an image G52 showing a state in which the arrangement of multiple figures is distorted and an image G51 showing a state in which the arrangement of the multiple figures is not distorted. Image G52 indicates that unevenness has occurred in the projected image. Image G52 is an example of a fifth image in the present disclosure, and image G51 is an example of a sixth image in the present disclosure. While the unevenness check screen G50 is displayed on the display 140, the electronic device 10 accepts an operation to select image G51 or image G52. When the first control unit 111 accepts an operation to select image G52, it displays a seventh image on the display 140 that provides instructions on adjusting the unevenness of the projected image. According to this aspect, displaying the seventh image can guide the user to further adjust the projected image.

[0045] (3) In the above embodiment, the first control unit 111, the second control unit 112, the third control unit 113, the determination unit 114, and the adjustment unit 115 are all software modules. However, any one, any two, any three, any four, or all of the first control unit 111, the second control unit 112, the third control unit 113, the determination unit 114, and the adjustment unit 115 may be a hardware module such as an ASIC (Application Specific Integrated Circuit). Even if any one, any two, any three, any four, or all of the first control unit 111, the second control unit 112, the third control unit 113, the determination unit 114, and the adjustment unit 115 are hardware modules, the same effects as those of the above embodiment can be achieved.

[0046] (4) The program PR1 may be manufactured as a standalone product or provided free of charge or for a fee. Specific examples of providing the program PR1 include providing the program PR1 by writing it to a computer-readable recording medium such as a flash ROM, or providing the program PR1 by downloading it via a telecommunications line such as the Internet. By operating a general computer in accordance with the program PR1 provided in these ways, it becomes possible to cause the computer to execute the display method of the present disclosure.

[0047] 3. Summary of this disclosure The present disclosure is not limited to the above-described embodiments and modifications, and can be realized in various forms without departing from the spirit thereof. For example, the present disclosure can also be realized in the following forms. The technical features in the above embodiments corresponding to the technical features in each form described below can be replaced or combined as appropriate to solve some or all of the problems of the present disclosure or to achieve some or all of the effects of the present disclosure. Furthermore, if a technical feature is not described as essential in this specification, it can be deleted as appropriate. A summary of this disclosure is provided below.

[0048] (Appendix 1) A control method according to one aspect of the present disclosure is a control method for an electronic device that includes a camera capable of capturing a projection image projected from a projector onto a projection target and a display and is capable of communicating with the projector, the control method including: causing the projector to project a first adjustment pattern for adjusting an outer shape of the projection image as the projection image; and displaying at least one prompt image on the display that prompts the camera to capture multiple captured images. According to the control method of this aspect, a user can easily understand that multiple captured images should be captured, making it easier to improve the accuracy of the outer shape adjustment.

[0049] (Appendix 2) A more preferred embodiment of the control method is the control method described in (Supplementary Note 1), in which, in displaying the at least one prompt image on the display, a captured image of the first adjustment pattern is displayed together with the at least one prompt image. According to this embodiment of the control method, the user can easily understand that multiple captured images should be acquired while checking the captured image by the camera, making it easier to improve the accuracy of the outer shape adjustment.

[0050] (Appendix 3) In a more preferred embodiment of the control method, the plurality of captured images include a first captured image and a second captured image different from the first captured image, and the control method includes determining whether each of the first captured image and the second captured image has been successfully acquired, and the displaying of the at least one prompt image on the display includes displaying the at least one prompt image in a first display mode when it is determined that one of the first captured image and the second captured image has been successfully acquired, and displaying the at least one prompt image in a second display mode when it is determined that both the first captured image and the second captured image have been successfully acquired. According to this embodiment of the control method, a user can easily determine whether the captured images have been successfully acquired by checking a change in the display mode of the at least one prompt image.

[0051] (Appendix 4) A further preferred embodiment of the control method is the control method described in (Supplementary Note 3), further including storing successfully acquired captured images from the plurality of captured images, and wherein the at least one prompt image includes a gauge image indicating the number of successfully acquired captured images. According to this embodiment, the user can easily grasp the number of successfully acquired captured images relative to the total number of captured images captured by the camera.

[0052] (Appendix 5) Another preferred embodiment of the control method is the control method described in any one of (Supplementary Note 1) to (Supplementary Note 4), in which the plurality of captured images include a first captured image and a second captured image different from the first captured image, and the at least one prompt image is an image that prompts the user to acquire the first captured image at a first position and also acquire the second captured image at a second position different from the first position.It is known that the accuracy of adjusting the outer shape can be improved by using captured images captured at mutually different positions rather than acquiring multiple captured images.According to this embodiment, at least one prompt image can guide the user to acquire multiple captured images that improve the accuracy of adjusting the outer shape.

[0053] (Appendix 6) In another preferred embodiment of the control method, the at least one prompt image includes an image showing the electronic device, and the position of the image on the display is moved. According to this embodiment, the configuration makes it easier for a user to understand that a plurality of captured images should be acquired while moving an electronic device having a camera.

[0054] (Appendix 7) According to one aspect of the present disclosure, an electronic device includes a communication device that communicates with a projector, a camera that can capture a projection image projected from the projector onto a projection target, a display, and a processing device, wherein the processing device causes the projector to project a first adjustment pattern for adjusting the outer shape of the projection image as the projection image, and displays, on the display, an image of the first adjustment pattern captured by the camera and at least one prompt image that prompts the user to capture multiple captured images. With this aspect of the electronic device, a user can easily understand that multiple captured images should be captured while checking the image captured by the camera, making it easier to improve the accuracy of the outer shape adjustment.

[0055] (Appendix 8) A program according to an aspect of the present disclosure includes causing a computer to project, from a projector, a first adjustment pattern for adjusting an outer shape of a projection image projected from the projector onto a projection target; and displaying on a display an image of the first adjustment pattern captured by a camera capable of capturing a projection image projected from the projector onto the projection target, and at least one prompt image prompting the user to capture a plurality of the captured images. According to this aspect of the program, the user can easily understand that a plurality of captured images should be captured while checking the image captured by the camera, making it easier to improve the accuracy of the adjustment of the outer shape. [Explanation of symbols]

[0056] 1...display system, 10...electronic device, 20...projector, 110...processing device, 111...first control unit, 112...second control unit, 113...third control unit, 114...adjustment unit, 120...communication device, 130...camera, 140...display, 150...input device, 160...storage device, 170...bus, PR1...program.

Claims

1. A control method for an electronic device that includes a camera capable of capturing a projection image projected from a projector onto a projection target, and a display, and that is capable of communicating with the projector, comprising: causing the projector to project, as the projection image, a first adjustment pattern for adjusting an outer shape of the projection image; displaying at least one prompt image on the display prompting the camera to capture a plurality of captured images; A control method comprising:

2. and displaying the at least one prompt image on the display, the captured image of the first adjustment pattern together with the at least one prompt image. The control method according to claim 1 .

3. the plurality of captured images include a first captured image and a second captured image different from the first captured image, determining whether the first captured image and the second captured image have each been normally acquired; Displaying the at least one prompt image on the display includes: When it is determined that one of the first captured image and the second captured image has been normally acquired, displaying the at least one prompt image on the display in a first display mode; and when it is determined that both the first captured image and the second captured image have been normally acquired, displaying the display mode of the at least one prompt image on the display in a second display mode. The control method according to claim 1 .

4. and storing the captured images that are normally acquired among the plurality of captured images. the at least one prompt image includes a gauge image representing the number of successfully acquired captured images. The control method according to claim 3 .

5. the plurality of captured images include a first captured image and a second captured image different from the first captured image, the at least one prompt image is an image that prompts the user to acquire the first captured image at a first position and the second captured image at a second position different from the first position. The control method according to claim 1 .

6. The method of claim 5 , wherein the at least one prompt image includes an image showing the electronic device, and the position of the image on the display moves.

7. a communication device that communicates with the projector; a camera capable of capturing a projection image projected from the projector onto a projection target; The display and a processing device; The processing device includes: causing the projector to project, as the projection image, a first adjustment pattern for adjusting an outer shape of the projection image; and displaying on the display an image of the first adjustment pattern captured by the camera and at least one prompt image prompting the user to acquire a plurality of the captured images. electronic equipment.

8. On the computer, causing a projector to project a first adjustment pattern for adjusting an outer shape of a projection image projected from the projector onto a projection target; displaying, on a display, captured images of the first adjustment pattern by a camera capable of capturing a projection image projected from the projector onto the projection target, and at least one prompt image prompting the user to acquire a plurality of the captured images; A program that executes the following.

Images