Control method, electronic device, and program product

Abstract

The present invention provides a control method, an electronic apparatus, and a program product, in which a user can easily grasp that one pattern should be imaged a plurality of times when distortion correction is performed on a captured image of the pattern projected from a projector to a projection object based on a camera. An electronic device (10) that communicates with a projector (20) that projects a projection image to a projection object (SC) includes a camera (130), a display (140), and a processing device (110). The processing device (110) causes the display (140) to display at least one cue image that causes a user to acquire a plurality of captured images of the first adjustment pattern using the camera (130). The first adjustment pattern is a pattern projected from a projector (20) to a projection object (SC) and used to adjust the outer shape of the projection image.

Description

Technical Field

[0001] The present disclosure relates to a control method, an electronic device, and a program product. Background Art

[0002] An example of an image display device is a projector that displays an image by projecting it onto an object such as a projection screen. Depending on the shape of the object or the positional relationship between the object and the image display device, the image displayed on the object by the image display device may suffer from distortion, such as keystone distortion. Various techniques for correcting this distortion have been proposed, and one example is the technique disclosed in Patent Document 1.

[0003] Patent Document 1 discloses an invention of a display system comprising an image display device and a portable terminal communicating with the image display device. The image display device in Patent Document 1 includes a measurement pattern generator, a projection unit, a first communication unit, and a distortion correction unit. The measurement pattern generator generates multiple measurement patterns. The projection unit projects the multiple measurement patterns generated by the measurement pattern generator. The first communication unit communicates with the portable terminal and receives information related to image distortion correction from the portable terminal. The distortion correction unit corrects distortion in the image projected by the projection unit based on the information received from the portable terminal.

[0004] The portable terminal disclosed in Patent Document 1 includes a camera unit, a control unit, and a second communication unit. The camera unit captures multiple measurement patterns displayed on an image display device. The control unit generates information related to image distortion correction based on the multiple measurement patterns captured by the camera unit. The second communication unit communicates with the first communication unit and transmits the information related to image distortion correction generated by the control unit to the image display device.

[0005] Patent Document 1: International Publication No. 2017 / 179111

[0006] In distortion correction using a measurement pattern, it is desirable to capture one measurement pattern multiple times in order to improve correction accuracy, but this is difficult for the user to grasp. Summary of the Invention

[0007] One aspect of the control method disclosed herein is a method for controlling an electronic device having a display and a camera capable of capturing an image projected from a projector onto a projection object, and capable of communicating with the projector. The method includes displaying at least one prompt image on the display, wherein the at least one prompt image prompts a user to obtain a plurality of captured images of a first adjustment pattern using the camera. The first adjustment pattern is a pattern projected from the projector and used to adjust the shape of the projected image.

[0008] One embodiment of the electronic device disclosed herein includes: a communication device that communicates with a projector; a camera that can capture an image projected from the projector onto a projection object; a display; and a processing device that causes the display to display at least one prompt image, wherein the at least one prompt image prompts a user to use the camera to obtain a plurality of captured images of a first adjustment pattern. The first adjustment pattern is a pattern projected from the projector and used to adjust the shape of the projected image.

[0009] One aspect of the program disclosed herein causes a computer to execute the following processing: causing a display to display at least one prompt image that prompts a user to obtain multiple images of a first adjustment pattern using a camera. The first adjustment pattern is a pattern projected from a projector and used to adjust the shape of a projected image projected from the projector. BRIEF DESCRIPTION OF THE DRAWINGS

[0010] Figure 1 1 is a diagram showing a configuration example of a display system 1 including an electronic device 10 according to an embodiment of the present disclosure.

[0011] Figure 2 1 is a diagram showing an example of an adjustment pattern (first adjustment pattern) projected from the projector 20 onto the projection target SC.

[0012] Figure 3 1 is a diagram showing a configuration example of the electronic device 10 .

[0013] Figure 4 1 is a diagram showing an example of the rectangle confirmation screen G10 .

[0014] Figure 5 1 is a diagram showing an example of the adjustment method explanation screen G20.

[0015] Figure 6 1 is a diagram showing an example of the imaging start screen G30 .

[0016] Figure 7 This is a diagram showing an example of the in-process screen G40.

[0017] Figure 8 This is a diagram showing another example of the in-process screen G40.

[0018] Figure 9 1 is a flowchart showing the flow of processing in the control method executed by the processing device 110 according to the program PR1.

[0019] Figure 10 1 is a diagram showing an example of a second adjustment pattern projected from the projector 20 onto the projection target SC.

[0020] Figure 11 1 is a diagram showing an example of the concave-convex confirmation screen G50 .

[0021] Description of labels

[0022] 1: Display system; 10: Electronic device; 20: Projector; 110: Processing device; 111: First control unit; 112: Second control unit; 113: Third control unit; 114: Adjustment unit; 120: Communication device; 130: Camera; 140: Display; 150: Input device; 160: Storage device; 170: Bus; PR1: Program. DETAILED DESCRIPTION

[0023] Various technically preferred limitations are added to the embodiments described below. However, the embodiments of the present disclosure are not limited to the following embodiments.

[0024] 1. Implementation Method

[0025] Figure 1 1 is a diagram illustrating a configuration example of a display system 1 including an electronic device 10 according to an embodiment of the present disclosure. Display system 1 includes, in addition to electronic device 10, a projector 20 that communicates with electronic device 10 via a network NW. Specific examples of network NW include a wired or wireless LAN (Local Area Network), a wired or wireless USB, or Bluetooth (registered trademark).

[0026] The projector 20 projects a projection image GA onto a projection target SC. The projection target SC in this embodiment is, for example, one of the inner walls of a room of a user of the display system 1. The projector 20 includes a generating unit (described later) such as a liquid crystal panel.

[0027] The wall of a room is not as flat as a screen. Due to the depressions or protrusions of the wall, the projected image GA displayed on the wall by the projector 20 may be distorted. In addition, if the projection lens of the projector 20 is not directly facing the wall, the projected image GA displayed on the wall by the projector 20 may also be distorted. In this embodiment, the above-mentioned image distortion is corrected using an adjustment pattern as in the conventional method. In this embodiment, in order to adjust the outer shape of the projected image projected from the projector 20 to the projection object SC to be rectangular, an adjustment pattern is used. Figure 2 The dot pattern shown will be described in detail later. Figure 2 The dot pattern shown is an example of the first adjustment pattern in the present disclosure.

[0028] The electronic device 10 is, for example, a smartphone. Figure 3 1 is a diagram showing a configuration example of the electronic device 10. Figure 3As shown, electronic device 10 includes processing device 110, communication device 120, camera 130, display 140, input device 150, and storage device 160. In electronic device 10, communication device 120, camera 130, display 140, input device 150, and storage device 160 are connected to processing device 110 via bus 170.

[0029] The processing device 110 is one or more processors. The processing device 110 is, for example, a CPU (Central Processing Unit). The processing device 110 operates according to a program PR1 stored in the storage device 160 , thereby functioning as a control center of the electronic device 10 .

[0030] The communication device 120 is a device that performs wireless communication with other devices, and includes, for example, an interface circuit. A specific example of another device that communicates with the communication device 120 is the projector 20.

[0031] Camera 130 is, for example, a video camera. It includes an imaging lens (not shown) and an imaging element (not shown) that forms an image of light from the lens. The imaging element is, for example, a CMOS (Complementary Metal-Oxide-Semiconductor) sensor, but is not particularly limited thereto. Camera 130 is a device for capturing images projected from projector 20 onto an object. Camera 130 constantly captures images within its field of view and transmits image data representing the captured images to processing device 110.

[0032] Display 140 includes, for example, a panel display such as a liquid crystal display, a plasma display, or an organic EL display, and its driver circuit. Display 140 displays various images under the control of processing device 110. Input device 150 is a transparent pressure-sensitive sensor provided to cover the display area of ​​display 140. Input device 150 may also include multiple operating elements. Input device 150 receives user operations and outputs operation data indicating the received operations to processing device 110. Thus, user operations on input device 150 are transmitted to processing device 110.

[0033] The storage device 160 is a recording medium that can be read by the processing device 110. The storage device 160 includes, for example, a non-volatile memory and a volatile memory. The non-volatile memory is, for example, a ROM (Read Only Memory), an EPROM (Erasable Programmable Read Only Memory), or an EEPROM (Electrically Erasable Programmable Read Only Memory). The volatile memory is, for example, a RAM (Random Access Memory). Various programs are stored in the non-volatile memory. As an example of various programs stored in the non-volatile memory, a kernel program and a program PR1 can be cited. In Figure 3 The kernel program is omitted from the illustration. The kernel program is a program that enables the processing device 110 to implement the operating system (OS). When the electronic device 10 is powered on, the processing device 110 reads the kernel program from the non-volatile memory to the volatile memory and begins executing the read kernel program. The processing device 110, operating according to the kernel program, begins executing another program when an instruction to start execution of the program is given through an operation of the input device 150.

[0034] For example, when the start of execution of the program PR1 is instructed by operating the input device 150, the processing device 110 reads the program PR1 from the non-volatile memory to the volatile memory and starts executing the program PR1 read from the volatile memory. The processing device 110 that operates according to the program PR1 is a Figure 3 The first control unit 111, the second control unit 112, the third control unit 113, the determination unit 114, and the adjustment unit 115 shown in FIG. Figure 3 The first control unit 111 , the second control unit 112 , the third control unit 113 , the determination unit 114 , and the adjustment unit 115 are software modules implemented by causing the processing device 110 to operate according to the program PR1 . Figure 3 The functions of the first control unit 111, second control unit 112, third control unit 113, determination unit 114, and adjustment unit 115 are as follows. The processing device 110 is composed of one or more processors. For example, the processors correspond to the first control unit 111, second control unit 112, third control unit 113, determination unit 114, and adjustment unit 115, respectively.

[0035] The first control unit 111 causes the display 140 to display a UI screen image that prompts the user to execute the control method of the present disclosure. Specific examples of the UI screens displayed on the display 140 under the control of the first control unit 111 include the rectangular confirmation screen G10, the adjustment method explanation screen G20, the shooting start screen G30, and the processing screen G40 described below.

[0036] Figure 4 is a diagram showing an example of a rectangle confirmation screen G10. Rectangle confirmation screen G10 includes image G12 representing a graphic of a projected image projected by projector 20 onto projection target SC when the shape of the projected image has not been adjusted (for example, a graphic of a projected image having a trapezoidal shape), and image G11 representing a graphic of a projected image having a rectangular shape. Image G12 is an example of a first image in the present disclosure. While rectangle confirmation screen G10 is displayed on display 140, the user can select image G11 or image G12 by operating input device 150. In other words, image G11 and image G12 are images that can be selected by the user, and image G12 is an example of a first image in the present disclosure.

[0037] If the projected image projected by the projector 20 onto the projection object SC has a rectangular shape, the user selects image G11. If image G11 is selected, the electronic device 10 does not calculate geometric correction values ​​for shape correction and terminates the control method of the present disclosure. In contrast, if the projected image projected by the projector 20 onto the projection object SC does not have a rectangular shape, the user selects image G12. If image G12 is selected, the first control unit 111 displays the adjustment method explanation screen G20 on the display 140.

[0038] Figure 5This figure shows an example of an adjustment method instruction screen G20. Adjustment method instruction screen G20 is an image that displays instructions related to adjusting the projected image's shape. In this embodiment, the image of adjustment method instruction screen G20 includes an image G21 that displays a string of instructions related to adjusting the projected image's shape, an image G22 that schematically depicts an adjustment pattern captured using the electronic device 10, and an image G23 of a button for the user to instruct the user to execute the adjustment. The image G21 that displays a string of instructions related to adjusting the projected image's shape and the image G22 that schematically depicts an adjustment pattern captured using the electronic device 10 allow the user to easily understand how to adjust the shape based on the displayed content of adjustment method instruction screen G20. This image of adjustment method instruction screen G20 is an example of the third image in the present disclosure. While adjustment method instruction screen G20 is displayed on display 140, the user can select image G23 by operating input device 150. When the image G23 is selected by operating the input device 150 , the first control unit 111 displays an image of a photographing start screen G30 on the display 140 .

[0039] Figure 6 is a diagram illustrating an example of a shooting start screen G30. Shooting start screen G30 includes an image G31 of a character string notifying the user of the start of shooting an adjustment pattern; an image G32, similar to image G22, schematically illustrating shooting the adjustment pattern using the electronic device 10; and an image G32 of a button for the user to instruct the start of projection and shooting of the adjustment pattern used to adjust the external shape. While shooting start screen G30 is displayed on display 140, the user can select an image G33 by operating input device 150. According to this embodiment, by selecting image G33 at a desired timing, the user can project the adjustment pattern onto the projection object SC at a desired timing. When image G33 is selected by operating input device 150, the second control unit 112, described later, controls the projector 20 to project the adjustment pattern and the camera 130 to capture the adjustment pattern. The first control unit 111 then displays a processing screen G40 on display 140.

[0040] Figure 7This figure shows an example of an ongoing screen G40. The ongoing screen G40 includes an image G41 showing an adjustment pattern captured by camera 130; prompt images G42A and G42B prompting the user to acquire multiple captured images; a button image G43 for instructing the user to acquire captured images; and a meter image G44. In this embodiment, prompt image G42A is an image of a text string prompting the user to "Enter the entire adjustment pattern, move left and right, and capture images from various angles." When the ongoing screen G40 is displayed, the electronic device 10 is held in a horizontally long position so that the entire adjustment pattern is entered, resulting in the image in the ongoing screen G40 also being horizontally long. Prompt image G42B is an image of a camera icon moving in a horizontally oscillating motion on the display screen of display 140. In other words, prompt image G42B reciprocates within the ongoing screen G40. This reciprocating movement of prompt image G42B continues until the target number of captured images is reached. The target number is set to a value that ensures the accuracy of the analysis results of the adjustment pattern based on pre-conducted simulations, experiments, etc. In this embodiment, the adjustment pattern is captured from various angles by swinging the prompt image G42B to indicate left and right movement. In addition, if the electronic device 10 has an accelerometer, the first control unit 111 can also specify the movement direction and speed for the electronic device 10 by analyzing the output of the accelerometer, causing the prompt image G42B to swing synchronously with the movement speed and direction. In addition, the processing screen G40 may include at least one prompt image, or may not include images G41, etc.

[0041] The prompt image G42A and the prompt image G42B are images that prompt the acquisition of a first captured image at a first position and a second captured image at a second position different from the first position. In the present embodiment, the user can easily grasp the situation in which at least one captured image should be acquired while confirming the image G41, and the accuracy of the adjustment of the shape can be easily improved. The prompt image G42B is an example of the fourth image in the present disclosure. The metering image G44 indicates the number of normally acquired captured images in the total number of captured images captured by the camera 130. That is, the metering image G44 indicates the progress of the operation of acquiring normal captured images. In the present embodiment, the metering image G44 has, for example, 10 units whose color can change from white to black. The number of units is not particularly limited, and is preferably 2 or more. Whenever the number of normally acquired captured images increases by one, in Figure 7The units that change to black in the meter image G44 increase one by one. The user can easily grasp the degree of progress related to the acquisition of multiple captured images through the changes in the meter image G44. In addition, the user can confirm whether the cumulative number of normal captured images is sufficient relative to the number of pre-prepared units (10), that is, the total number (target number) of normal captured images to be acquired by the camera 130, through the changes in the meter image G44, so that the user can simply grasp that multiple captured images should be acquired until the number of normal captured images reaches 10. Therefore, the meter image G44 can be said to be one of at least one prompt image. In addition, in the present embodiment, the meter image G44 has 10 discrete units, but as long as the user can grasp whether the cumulative number of normal captured images is sufficient, the design of the meter image G44 is not particularly limited. The meter image G44 can also be, for example, a continuous bar representing the ratio of the number of normal captured images to the target number of normal captured images to be acquired by the camera 130.

[0042] For example, when only a single captured image is acquired, the accuracy of the geometric correction of the projected image GA calculated by the processing device 110 based on that single captured image may be reduced. Specifically, if the processing device 110 calculates a projection transformation matrix that transforms from one of the coordinate systems of the single captured image and the projector 20 coordinate system to the other, and then performs Homography decomposition on that projection transformation matrix, an incorrect normal vector for the projected object SC may be obtained. Furthermore, if the accuracy of the projection transformation matrix is ​​reduced due to noise contained in the captured image, geometric correction parameters calculated to be correct in the camera 130 coordinate system may be incorrect in the projector 20 coordinate system. In contrast, in this embodiment, by using prompt images G42A and G42B that prompt the acquisition of multiple captured images, it is easier to acquire multiple captured images. Thus, based on multiple projection transformation matrices transformed from one direction to another in the coordinate system of each of the multiple captured images and the projector 20, the correct normal vector of the projection object SC is obtained, or even if noise is contained in one of the multiple captured images, the influence of the noise can be compensated by other captured images, so that the reduction in the accuracy of geometric correction can be suppressed.

[0043] The prompt image in this embodiment is an image of a character string prompting the user to "enter the adjustment pattern completely, move left and right, and shoot from various angles" and an image of a camera icon moving left and right on the display surface of the display 140, but it can also be either one of them. Figure 8As shown, instead of prompt image G42B, an arrow image G42C indicating the direction of movement to the user and checkbox images G42D, G42E, and G42F indicating whether the acquisition of the captured image at the right, center, and left positions was successful may be used. Images G42C, G42D, G42E, and G42F are also examples of at least one prompt image.

[0044] For example, when the determination unit 114 described later determines that the captured image at the right position is normally acquired, the first control unit 111 applies a shadow to the image G42D and displays it on the display 140. In contrast, when the determination unit 114 described later determines that the captured image at the right position is not normally acquired, the first control unit 111 displays the image G42D on the display 140 without applying a shadow. That is, in the present embodiment, when the determination unit 114 described later determines that either the first captured image or the second captured image is normally acquired, the first control unit 111 displays the corresponding check box on the display 140 in the first display mode (a display mode in which no shadow is applied to a check box). In contrast, when the determination unit 114 described later determines that both the first captured image and the second captured image are normally acquired, the first control unit 111 displays the corresponding check box on the display 140 in the second display mode (a display mode in which shadows are applied to all check boxes). Figure 8 In the form of the processing screen G40 shown, the user can easily understand whether the captured image has been normally acquired by confirming the change in the display form of the presentation image.

[0045] The second control unit 112 communicates with the projector 20 via the communication device 120 , thereby causing the projector 20 to project the adjustment pattern.

[0046] The third control unit 113 controls the camera 130 to capture an image including the adjustment pattern projected onto the projection object SC.

[0047] Determination unit 114 determines whether the captured image captured by camera 130 was acquired normally in accordance with the user's instructions. More specifically, determination unit 114 attempts to detect the first adjustment pattern on the captured image captured by camera 130. If detection is successful, determination unit 114 determines that the captured image was acquired normally. Determination unit 114 calculates the spectral distribution of the captured image by, for example, performing a fast Fourier transform on the first adjustment pattern. Based on the results of the spectral distribution analysis, determination unit 114 then calculates the magnitude of the high-frequency component. The magnitude of the high-frequency component is one example of an indicator of the sharpness of the captured image. The greater the blurring of the captured image, the smaller the high-frequency component. There is no particular limitation on which of all frequencies is designated as high-frequency, as long as it is sufficient for analysis of the first adjustment pattern. If the high-frequency component is above a predetermined threshold, determination unit 114 determines that the captured image was acquired normally. If the high-frequency component is below the predetermined threshold, determination unit 114 determines that the captured image was not acquired normally. While the above description describes determination based on image blurring, the determination method is not particularly limited. The determination unit 114 may determine whether the captured image is normally acquired based on the color distribution of the captured image, the magnitude of distortion, etc. The determination unit 114 stores the captured image that is normally acquired in the volatile memory of the storage device 160 .

[0048] Adjustment unit 115 calculates geometric correction values ​​for shape adjustment based on the multiple captured images stored in volatile memory and transmits these geometric correction values ​​to projector 20, causing projector 20 to perform shape adjustment. Furthermore, adjustment unit 115 may select two captured images from the multiple captured images that were captured at the farthest locations from each other. If the distance between these capture locations is greater than a threshold, adjustment unit 115 calculates geometric correction values ​​based on these multiple captured images. If the distance between the capture locations is less than the threshold, adjustment unit 115 urges the user to continue capturing. This is because using images captured from the farthest possible locations helps improve correction accuracy.

[0049] Furthermore, the processing device 110 operating in accordance with the program PR1 executes a control method that significantly illustrates the characteristics of the present disclosure. Figure 9 FIG. 1 is a flow chart showing the processing flow in the control method. Figure 9 As shown, the control method includes a display control process SA110 , a projection control process SA120 , an acquisition process SA130 , and an adjustment process SA140 .

[0050] In display control process SA110, processing device 110 functions as a first control unit. In display control process SA110, processing device 110 first displays the aforementioned rectangular confirmation screen G10 on display 140. Then, upon receiving an operation to select image G12, processing device 110 displays adjustment method explanation screen G20 on display 140. After displaying adjustment method explanation screen G20 on display 140, if an operation is performed on button image G23, processing device 110 displays shooting start screen G30 on display 140 and waits for an operation on button image G33. If an operation is performed on button image G33, processing device 110 executes projection control process SA120.

[0051] In projection control processing SA120, processing device 110 functions as second control unit 112 and third control unit 113, causing projector 20 to project the adjustment pattern and camera 130 to capture the adjustment pattern projected onto projection target SC. Projection control processing SA120 may also be omitted from the flowchart illustrating the process flow of this control method. In this case, the adjustment pattern is projected based on user operation of projector 20, independent of control by electronic device 10.

[0052] In the acquisition process SA130, the processing device 110 functions as the first control unit 111 and the determination unit 114. In the acquisition process SA130, the processing device 110 first causes the display 140 to display the processing screen G40. Then, the captured image of the camera 130 is acquired by operating the button image G43. Moreover, the processing device 110 determines whether the captured image is acquired normally each time the captured image is acquired. In the case where it is determined that the captured images from multiple positions are acquired normally, the processing device 110 executes the adjustment process SA140 described later and ends the execution of the present control method. In contrast, in the case where it is determined that the captured image is not acquired normally, the user is urged to retake the image. For example, when using Figure 8 In the form of the image shown as the processing screen G40 , check boxes corresponding to respective positions are displayed on the display 140 in the first display form described above, prompting the user to acquire captured images again.

[0053] In the adjustment process SA140, the processing device 110 functions as the adjustment unit 115. In the adjustment process SA140, the processing device 110 calculates geometric correction values ​​for correcting distortion of the projected image based on the multiple captured images acquired in the acquisition process SA130, and transmits these geometric correction values ​​to the projector 20. The projector 20 then performs geometric correction to correct the external shape of the projected image according to the geometric correction values ​​received from the electronic device 10, and projects the projected image with the adjusted external shape onto the projection target SC.

[0054] As described above, according to this embodiment, the user can easily understand from the presented images G42A and G42B that a plurality of images captured from different positions should be acquired while checking the image G41, thereby easily improving the accuracy of adjusting the outer shape.

[0055] 2. Modification

[0056] The above-mentioned embodiments can be modified as follows.

[0057] (1) After displaying the adjustment method explanation screen G20 on the display 140 and before displaying the shooting start screen G30, the first control unit 111 may display a fourth image on the display 140 that recommends the camera posture (in other words, the posture of the electronic device 10) when shooting the first adjustment pattern with the camera 130. This method allows the user to easily understand which posture is best for shooting the first adjustment pattern. Furthermore, the same effect can be achieved even if the fourth image is not displayed on the display 140 but the projector 20 is used to project the image.

[0058] (2) After the shape adjustment is performed, in order to allow the user to determine whether the projection image needs to be adjusted, the second control unit 112 may also cause the projector 20 to project a second adjustment pattern having a plurality of graphics arranged therein. Specific examples of the second adjustment pattern include: Figure 10 The grid pattern shown is shown. This is because the user visually determines whether there are bumps or not in the projected image, but if the projected image is a monochrome image or a natural image, visually determining the presence of bumps or not is difficult. Furthermore, it is preferable that the grid spacing of the grid pattern is the same as or larger than the calibration point spacing of the correction circuit performing geometric correction in projector 20. This is because by making the grid spacing of the grid pattern the same as or larger than the calibration point spacing of the correction circuit performing geometric correction in projector 20, unnecessary correction can be avoided for subtle bumps or not that cannot be corrected.

[0059] In this case, the first control unit 111 may also cause the display 140 to display Figure 11 The concave-convex confirmation screen G50 shown in FIG. 1 is used to guide the user to adjust the concave-convex in the projected image. Figure 11As shown, the concave-convex confirmation screen G50 includes an image G52 indicating a distorted arrangement of multiple graphics and an image G51 indicating an undistorted arrangement of the multiple graphics. Image G52 indicates that concave-convexity has occurred in the projected image. Image G52 is an example of the fifth image in the present disclosure, and image G51 is an example of the sixth image in the present disclosure. The electronic device 10, which displays the concave-convex confirmation screen G50 on the display 140, accepts an operation to select either image G51 or image G52. Upon accepting the operation to select image G52, the first control unit 111 displays a seventh image on the display 140 that provides instructions for adjusting the concave-convexity in the projected image. According to this embodiment, by displaying the seventh image, the user can be guided to further adjust the projected image.

[0060] (3) In the above embodiment, the first control unit 111, the second control unit 112, the third control unit 113, the determination unit 114, and the adjustment unit 115 are all software modules. However, any one, any two, any three, any four, or all of the first control unit 111, the second control unit 112, the third control unit 113, the determination unit 114, and the adjustment unit 115 may be hardware modules such as an ASIC (Application Specific Integrated Circuit). Even if any one, any two, any three, any four, or all of the first control unit 111, the second control unit 112, the third control unit 113, the determination unit 114, and the adjustment unit 115 are hardware modules, the same effects as those in the above embodiment are achieved.

[0061] (4) The program PR1 may be independently manufactured or provided for a fee or free of charge. Specific methods for providing the program PR1 include providing the program PR1 by writing it on a computer-readable recording medium such as a flash ROM, or providing the program PR1 by downloading it via a telecommunications line such as the Internet. By operating a general computer according to the program PR1 provided in these methods, the computer can be caused to execute the display method of the present disclosure.

[0062] 3. Summary of the Disclosure

[0063] The present disclosure is not limited to the above-mentioned embodiments and variations, and can be implemented in various ways without departing from its main purpose. For example, the present disclosure can also be implemented in the following ways. In order to solve part or all of the problems of the present disclosure, or to achieve part or all of the effects of the present disclosure, the technical features in the above-mentioned embodiments corresponding to the technical features in the various methods described below can be appropriately replaced or combined. In addition, if its technical features are not described as essential features in this specification, they can be appropriately deleted.

[0064] The following is a summary of the present disclosure.

[0065] (Note 1)

[0066] One embodiment of the present disclosure provides a control method for an electronic device having a display and a camera capable of capturing an image projected from a projector onto a projection object, and capable of communicating with the projector. The control method includes displaying at least one prompt image on the display, wherein the at least one prompt image prompts a user to use the camera to obtain multiple captured images of a first adjustment pattern, the first adjustment pattern being a pattern projected from the projector and used to adjust the shape of the projected image. This control method allows the user to easily understand that multiple captured images should be obtained, thereby easily improving the accuracy of shape adjustment.

[0067] (Note 2)

[0068] In a more preferred embodiment of the control method according to Supplementary Note 1, in the step of displaying the at least one prompt image on the display, a captured image of the first adjustment pattern is displayed together with the at least one prompt image. This control method allows the user to easily understand that multiple captured images should be acquired while confirming the image captured by the camera, thereby easily improving the accuracy of shape adjustment.

[0069] (Note 3)

[0070] According to the control method described in Supplement 1 or Supplement 2, in a more preferred embodiment, the plurality of captured images include a first captured image and a second captured image different from the first captured image, and the control method includes the following steps: determining whether the first captured image and the second captured image were each normally acquired, and the step of displaying the at least one prompt image on the display includes the following steps: displaying the at least one prompt image on the display in a first display mode when it is determined that one of the first captured image and the second captured image was normally acquired; and displaying the at least one prompt image on the display in a second display mode when it is determined that both the first captured image and the second captured image were normally acquired. According to this embodiment of the control method, the user can easily understand whether the captured images were normally acquired by confirming the change in the display mode of the at least one prompt image.

[0071] (Note 4)

[0072] In a more preferred embodiment of the control method according to Supplementary Note 3, the control method further includes the step of storing the normally acquired images among the plurality of captured images, wherein the at least one prompt image includes a meter image indicating the number of the normally acquired images. According to this embodiment, the user can easily grasp the number of normally acquired images relative to the total number of images captured by the camera.

[0073] (Note 5)

[0074] According to any one of Supplementary Notes 1 to 4, in another preferred embodiment of the control method, the multiple captured images include a first captured image and a second captured image different from the first captured image, and the at least one prompt image is an image that prompts the user to obtain the first captured image at a first position and the second captured image at a second position different from the first position. It is known that the accuracy of shape adjustment can be improved by using images captured at different positions rather than by obtaining multiple captured images. According to this embodiment, the at least one prompt image can guide the user to obtain multiple captured images that improve the accuracy of shape adjustment.

[0075] (Note 6)

[0076] In another preferred embodiment of the control method according to any one of Supplementary Notes 1 to 5, the at least one prompt image includes an image showing the electronic device, wherein the position of the image on the display is moved. According to this embodiment, the above-described configuration allows the user to easily grasp the need to acquire multiple captured images while moving the electronic device having a camera.

[0077] (Note 7)

[0078] An electronic device according to one embodiment of the present disclosure includes: a communication device for communicating with a projector; a camera capable of capturing an image projected from the projector onto a projection object; a display; and a processing device configured to cause the display to display at least one prompt image, wherein the at least one prompt image prompts a user to use the camera to obtain multiple captured images of a first adjustment pattern, the first adjustment pattern being a pattern projected from the projector and used to adjust the shape of the projected image. This electronic device allows the user to easily grasp the need to obtain multiple captured images while confirming the images captured by the camera, thereby easily improving the accuracy of shape adjustment.

[0079] (Note 8)

[0080] A program according to one aspect of the present disclosure causes a computer to execute the following processing: causing a display to display at least one prompt image, the at least one prompt image prompting a user to use a camera to acquire multiple images of a first adjustment pattern, the first adjustment pattern being a pattern projected from a projector and used to adjust the shape of a projected image. This program allows the user to easily grasp the need to acquire multiple images while confirming the images captured by the camera, thereby easily improving the accuracy of shape adjustment.

Claims

1. A control method for an electronic device having a display and a camera capable of capturing a projection image projected from a projector onto a projection object, wherein the electronic device is capable of communicating with the projector. The control method includes: displaying at least one prompt image on the display, wherein the at least one prompt image prompts the user to obtain a plurality of photographic images of the first adjustment pattern by using the camera, The first adjustment pattern is a pattern projected from the projector and used to adjust the outer shape of the projected image.

2. The control method according to claim 1, wherein: In the step of displaying the at least one prompt image on the display, the captured image of the first adjustment pattern is displayed together with the at least one prompt image.

3. The control method according to claim 1, wherein: The plurality of photographed images include a first photographed image and a second photographed image different from the first photographed image, The control method includes the following steps: determining whether the first captured image and the second captured image are acquired normally, The step of displaying the at least one prompt image on the display comprises the following steps: If it is determined that one of the first captured image and the second captured image is normally acquired, displaying the at least one prompt image on the display in a first display mode; and When it is determined that both the first captured image and the second captured image are normally acquired, the at least one presentation image is displayed on the display in a second display format.

4. The control method according to claim 3, wherein: The control method further includes the steps of: storing the normally acquired captured images among the plurality of captured images; The at least one presentation image includes a meter image indicating the number of the normally acquired captured images.

5. The control method according to claim 1, wherein: The plurality of photographed images include a first photographed image and a second photographed image different from the first photographed image, The at least one prompt image is an image that prompts the user to obtain the first captured image at a first position and to obtain the second captured image at a second position different from the first position.

6. The control method according to claim 5, wherein: The at least one prompt image includes an image showing the electronic device, and a position of the image in the display is moved.

7. An electronic device comprising: a communication device for communicating with the projector; a camera capable of capturing a projection image projected from the projector onto a projection object; Display; and processing device, The processing device performs the following processing: causing the display to display at least one prompt image, wherein: The at least one prompt image prompts the user to obtain a plurality of photographic images of the first adjustment pattern by using the camera, The first adjustment pattern is a pattern projected from the projector and used to adjust the outer shape of the projected image.

8. A program product, The computer is caused to execute the following processing: causing the display to display at least one prompt image, the at least one prompt image prompting the user to obtain a plurality of photographic images of the first adjustment pattern by using a camera, The first adjustment pattern is a pattern that is projected from the projector and is used to adjust the outer shape of a projection image projected from the projector.

Images