Control method, electronic device, and program

The control method addresses user confusion about image distortion correction by providing explanatory images within the electronic device's interface, enhancing user understanding and adjustment accuracy.

JP2025132199APending Publication Date: 2025-09-10SEIKO EPSON CORP
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
JP2024029608
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2024-02-29
Publication Date
2025-09-10

AI Technical Summary

Technical Problem

Users may not understand distortion correction in image display devices, such as projectors, leading to confusion about how to adjust the outer shape of projected images.

Method used

A control method for electronic devices that includes displaying a first image showing an unadjusted projection image, allowing user selection, and then displaying a third image providing an explanation on how to adjust the outer shape when the first image is selected.

Benefits of technology

The method enables users to easily understand the adjustment process for correcting image distortions, improving user experience and accuracy in shape adjustments.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2025132199000001_ABST
    Figure 2025132199000001_ABST
Patent Text Reader

Abstract

To enable a user to understand what distortion correction is like that is based on an image captured by a camera of a pattern projected from a projector onto a projection target.SOLUTION: An electronic device 10, which communicates with a projector 20 that projects a projection image onto a projection target SC, includes a display 140 and a processing apparatus 110. The processing apparatus 110 displays on the display a first image that is selectable by a user and that shows an image of the projection image when the outer shape of the projection image is not adjusted, and displays on the display 140 a third image that shows an explanation regarding the adjustment of the outer shape when an operation to select the first image is received.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] The present disclosure relates to a control method, an electronic device, and a program. [Background technology]

[0002] An example of an image display device is a projector that displays an image by projecting it onto an object such as a projection screen. Depending on the shape of the object or the positional relationship between the object and the image display device, distortions such as trapezoidal distortion may occur in the image displayed on the object by the image display device. Various techniques for correcting this distortion have been proposed, one example of which is the technique disclosed in Patent Document 1.

[0003] Patent Document 1 discloses an invention of a display system having an image display device and a mobile terminal that communicates with the image display device. The image display device in Patent Document 1 includes a measurement pattern generating unit, a projection unit, a first communication unit, and a distortion correction unit. The measurement pattern generating unit generates a plurality of measurement patterns. The projection unit projects the plurality of measurement patterns generated by the measurement pattern generating unit. The first communication unit communicates with the mobile terminal and receives information related to image distortion correction from the mobile terminal. The distortion correction unit corrects distortion in the image projected by the projection unit based on the information related to image distortion correction received from the mobile terminal.

[0004] The mobile terminal in Patent Document 1 has a camera unit, a control unit, and a second communication unit. The camera unit captures multiple measurement patterns displayed on the video display device. The control unit generates information related to image distortion correction based on the multiple measurement patterns captured by the camera unit. The second communication unit communicates with the first communication unit and transmits the information related to image distortion correction generated by the control unit to the video display device. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] International Publication No. 2017 / 179111 Summary of the Invention [Problem to be solved by the invention]

[0006] Users may not understand distortion correction, for example, what kind of function it is or what steps to take, and it is necessary to help users understand these things. [Means for solving the problem]

[0007] One aspect of the control method of the present disclosure is a control method for an electronic device that has a display and is capable of communicating with a projector that projects a projection image onto a projection target, and includes displaying on the display a first image that shows an image of the projection image when the outer shape of the projection image is not adjusted and is selectable by a user, and when an operation to select the first image is received, displaying on the display a third image that shows an explanation regarding the adjustment of the outer shape.

[0008] One aspect of the electronic device disclosed herein includes a display, a communication device that communicates with a projector that projects a projection image onto a projection target, and a processing device, wherein the processing device performs the following: displaying on the display a first image that shows an image of the projection image when the outer shape of the projection image is not adjusted and that is selectable by a user; and, when an operation to select the first image is received, displaying on the display a third image that shows an explanation regarding the adjustment of the outer shape.

[0009] One aspect of the program disclosed herein causes a computer to perform the following: displaying on a display a first image that shows an image of a projection image projected from a projector onto a projection target when the outer shape of the projection image is not adjusted, and that can be selected by a user; and, when an operation to select the first image is received, displaying on the display a third image that provides an explanation regarding the adjustment of the outer shape. [Brief explanation of the drawings]

[0010] [Figure 1] 1 is a diagram showing an example of the configuration of a display system 1 including an electronic device 10 according to an embodiment of the present disclosure. [Figure 2] 10 is a diagram showing an example of an adjustment pattern (first adjustment pattern) projected from the projector 20 onto the projection target SC. FIG. [Figure 3] 1 is a diagram illustrating an example of the configuration of an electronic device 10. FIG. [Figure 4] FIG. 10 is a diagram showing an example of a rectangle confirmation screen G10. [Figure 5] FIG. 10 is a diagram showing an example of an adjustment method explanation screen G20. [Figure 6] FIG. 10 is a diagram showing an example of an imaging start screen G30. [Figure 7] FIG. 10 is a diagram showing an example of a processing screen G40. [Figure 8] FIG. 10 is a diagram showing another example of the processing screen G40. [Figure 9] 10 is a flowchart showing the flow of processing in a control method executed by a processing device 110 according to a program PR1. [Figure 10] 10 is a diagram showing an example of a second adjustment pattern projected from the projector 20 onto the projection target SC. FIG. [Figure 11] FIG. 10 is a diagram showing an example of an unevenness confirmation screen G50. DETAILED DESCRIPTION OF THE INVENTION

[0011] The embodiments described below are subject to various technically preferable limitations, but the embodiments of the present disclosure are not limited to the following embodiments.

[0012] 1. Embodiment 1 is a diagram showing an example configuration of a display system 1 including an electronic device 10 according to an embodiment of the present disclosure. In addition to the electronic device 10, the display system 1 includes a projector 20 that communicates with the electronic device 10 via a network NW. Specific examples of the network NW include a wired or wireless LAN (Local Area Network), a wired or wireless USB, or Bluetooth (registered trademark).

[0013] The projector 20 projects a projection image GA onto a projection target SC. In this embodiment, the projection target SC is, for example, one of the interior walls of the room of the user of the display system 1. The projector 20 has a generation unit (described later) such as a liquid crystal panel.

[0014] The wall surface of a room is not flat like a screen, and distortion may occur in the projected image GA displayed on the wall surface by the projector 20 due to depressions or protrusions in the wall surface. Furthermore, distortion may also occur in the projected image GA displayed on the wall surface by the projector 20 when the projection lens of the projector 20 is not directly facing the wall surface. In this embodiment, the image distortion is corrected using an adjustment pattern as in the conventional case. Although details will be described later, in this embodiment, a dot pattern shown in FIG. 2 is used to adjust the outer shape of the projected image projected from the projector 20 onto the projection target SC to a rectangle. The dot pattern shown in FIG. 2 is an example of a first adjustment pattern in the present disclosure.

[0015] The electronic device 10 is, for example, a smartphone. Fig. 3 is a diagram showing an example configuration of the electronic device 10. As shown in Fig. 3, the electronic device 10 includes a processing device 110, a communication device 120, a camera 130, a display 140, an input device 150, and a storage device 160. In the electronic device 10, the communication device 120, the camera 130, the display 140, the input device 150, and the storage device 160 are each connected to the processing device 110 via a bus 170.

[0016] The processing device 110 is one or more processors. The processing device 110 is, for example, a CPU (Central Processing Unit). The processing device 110 functions as a control center of the electronic device 10 by operating in accordance with a program PRA stored in the storage device 160.

[0017] The communication device 120 is a device that performs wireless communication with other devices, and includes, for example, an interface circuit. A specific example of another device that communicates with the communication device 120 is the projector 20.

[0018] The camera 130 is, for example, a video camera. The camera 130 includes an imaging lens (not shown) and an imaging element (not shown) on which light from the imaging lens forms an image. The imaging element is, for example, a CMOS (Complementary Metal-Oxide-Semiconductor) sensor, but is not particularly limited to this. The camera 130 is a device for capturing a projection image projected onto an object from the projector 20. The camera 130 captures images within its imaging field of view as needed, and transfers image data representing the captured image to the processing device 110.

[0019] The display 140 includes a panel display such as a liquid crystal display, a plasma display, or an organic EL display, and a drive circuit for the panel display. The display 140 displays various images under the control of the processing device 110. The input device 150 is a transparent pressure-sensitive sensor provided to cover the display area of ​​the display 140. The input device 150 may include multiple controls. The input device 150 receives a user's operation and outputs operation content data indicating the received operation to the processing device 110. In this way, the user's operation on the input device 150 is transmitted to the processing device 110.

[0020] The storage device 160 is a recording medium readable by the processing device 110. The storage device 160 includes, for example, a nonvolatile memory and a volatile memory. The nonvolatile memory is, for example, a read-only memory (ROM), an erasable programmable read-only memory (EPROM), or an electrically erasable programmable read-only memory (EEPROM). The volatile memory is, for example, a random access memory (RAM). Various programs are stored in the nonvolatile memory. Examples of the various programs stored in the nonvolatile memory include a kernel program and a program PRA. The kernel program is not illustrated in FIG. 3. The kernel program is a program that causes the processing device 110 to implement an operating system (OS). When the electronic device 10 is powered on, the processing device 110 reads the kernel program from the nonvolatile memory to the volatile memory and begins executing the read kernel program. When an instruction to start executing another program is received via an operation on the input device 150, the processing device 110, operating according to the kernel program, begins executing the other program.

[0021] For example, when an instruction to start execution of program PR1 is issued via an operation on input device 150, processing device 110 reads program PR1 from non-volatile memory to volatile memory and starts executing program PR1 read into volatile memory. Processing device 110 operating in accordance with program PR1 functions as first control unit 111, second control unit 112, third control unit 113, determination unit 114, and adjustment unit 115 shown in FIG. 3. In other words, each of first control unit 111, second control unit 112, third control unit 113, determination unit 114, and adjustment unit 115 shown in FIG. 3 is a software module realized by operating processing device 110 in accordance with program PR1. The roles of each of first control unit 111, second control unit 112, third control unit 113, determination unit 114, and adjustment unit 115 shown in FIG. 3 are as follows.

[0022] The first control unit 111 displays an image of a UI screen that prompts the user to execute the control method of the present disclosure on the display 140. Specific examples of UI screens that are displayed on the display 140 under the control of the first control unit 111 include a rectangle confirmation screen G10, an adjustment method explanation screen G20, an imaging start screen G30, and a processing screen G40, which will be described below.

[0023] FIG. 4 is a diagram showing an example of a rectangular confirmation screen G10. The rectangular confirmation screen G10 includes an image G12 representing an image of a projection image projected by the projector 20 onto the projection target SC when the outer shape of the projection image has not been adjusted (for example, an image of a projection image having a trapezoidal outer shape), and an image G11 representing an image of a projection image having a rectangular outer shape. The image G12 is an example of a first image in the present disclosure. When the rectangular confirmation screen G10 is displayed on the display 140, the user can perform an operation to select the image G11 or the image G12 by operating the input device 150. In other words, the image G11 and the image G12 are images that can be selected by the user, and the image G12 is an example of a first image in the present disclosure.

[0024] If the outer shape of the projection image projected by the projector 20 onto the projection target SC is rectangular, the user selects image G11. When image G11 is selected, the electronic device 10 ends the control method of the present disclosure without calculating a geometric correction value for shape correction. On the other hand, when the outer shape of the projection image projected by the projector 20 onto the projection target SC is not rectangular, the user selects image G12. When image G12 is selected, the first control unit 111 displays an image of the adjustment method explanation screen G20 on the display 140.

[0025] FIG. 5 is a diagram illustrating an example of an adjustment method explanation screen G20. The adjustment method explanation screen G20 is an image that provides an explanation regarding the adjustment of the contour of a projection image. The image of the adjustment method explanation screen G20 in this embodiment includes an image G21 of text that describes the adjustment of the contour of a projection image, an image G22 that schematically illustrates capturing an adjustment pattern using the electronic device 10, and an image G23 of a button that instructs the user to perform the adjustment. Because the adjustment method explanation screen G20 includes the image G21 of text that describes the adjustment of the contour of a projection image and the image G22 that schematically illustrates capturing an adjustment pattern using the electronic device 10, the user can easily understand how the contour is adjusted from the display content of the adjustment method explanation screen G20. The image of the adjustment method explanation screen G20 is an example of a third image in the present disclosure. While the adjustment method explanation screen G20 is displayed on the display 140, the user can select the image G23 by operating the input device 150. When the image G23 is selected by operating the input device 150, the first control unit 111 displays on the display 140 an image of the imaging start screen G30.

[0026] FIG. 6 is a diagram illustrating an example of an image capture start screen G30. The image capture start screen G30 includes an image G31 of text notifying the user to start capturing an adjustment pattern; an image G32 that, like image G22, schematically illustrates capturing an adjustment pattern using the electronic device 10; and an image G33 of a button for instructing the user to start projecting and capturing an adjustment pattern for adjusting the outer shape. While the image capture start screen G30 is displayed on the display 140, the user can select image G33 by operating the input device 150. According to this embodiment, the user can project the adjustment pattern onto the projection target SC at any desired timing by operating the input device 150. When image G33 is selected by operating the input device 150, the second control unit 112 (described later) controls the projector 20 to project the adjustment pattern and causes the camera 130 to capture the adjustment pattern. The first control unit 111 then displays a processing screen G40 on the display 140.

[0027] FIG. 7 is a diagram illustrating an example of a processing screen G40. The processing screen G40 includes an image G41 containing an adjustment pattern captured by the camera 130, prompt images G42A and G42B prompting the user to capture multiple captured images, a button image G43 for instructing the user to capture captured images, and a gauge image G44. In this embodiment, the prompt image G42A is an image of text prompting the user to "move left and right to capture images from various angles while fitting all of the adjustment patterns." While the processing screen G40 is displayed, the electronic device 10 is held in a landscape orientation so that all of the adjustment patterns can be fitted, and therefore the image on the processing screen G40 is also a landscape image. The prompt image G42B is an image of a camera icon that moves in a swinging motion from left to right on the display surface of the display 140. In this embodiment, the swinging of the prompt image G42B indicates that the adjustment pattern is captured from various angles by moving left and right. In addition, if the electronic device 10 has an acceleration sensor, the first control unit 111 may determine the movement direction and movement speed of the electronic device 10 by analyzing the output of the acceleration sensor, and swing the prompt image G42B in synchronization with this movement speed and movement direction.

[0028] Prompt image G42A and prompt image G42B are images that prompt the user to acquire a first captured image at a first position and a second captured image at a second position different from the first position. In this embodiment, the user can easily understand that at least one captured image should be acquired while checking image G41, making it easier to improve the accuracy of the outer shape adjustment. Prompt image G42B is an example of a fourth image in the present disclosure. Gauge image G44 represents the number of successfully acquired captured images relative to the total number of captured images captured by camera 130. The user can easily understand the degree of progress in acquiring multiple captured images through changes in gauge image G44.

[0029] In the present embodiment, the prompt image is an image of text prompting the user to "move left and right to capture images from various angles while fitting all of the adjustment patterns" and an image of a camera icon that moves in a swinging manner left and right on the display surface of display 140, but it may be either one of these. Also, instead of prompt image G42B, as shown in Fig. 8, an arrow image G42C instructing the user on the movement direction and check box images G42D, G42E, and G42F indicating the success or failure of capturing captured images at each of the right, center, and left positions may be used.

[0030] For example, if the determination unit 114 (described later) determines that the captured image at the right position was normally acquired, the first control unit 111 displays the image G42D with hatching on the display 140. On the other hand, if the determination unit 114 (described later) determines that the captured image at the right position was not normally acquired, the first control unit 111 displays the image G42D without hatching on the display 140. That is, in this embodiment, if the determination unit 114 (described later) determines that either the first captured image or the second captured image was normally acquired, the first control unit 111 displays the corresponding check boxes on the display 140 in a first display mode (a display mode in which none of the check boxes are hatched). On the other hand, if the determination unit 114 (described later) determines that both the first captured image and the second captured image were normally acquired, the first control unit 111 displays the corresponding check boxes on the display 140 in a second display mode (a display mode in which all of the check boxes are hatched). In the mode in which the processing-in-progress screen G40 shown in FIG. 8 is displayed, the user can easily know whether or not the captured image has been acquired normally by checking the change in the display mode of the prompt image.

[0031] The second control unit 112 communicates with the projector 20 via the communication device 120, thereby causing the projector 20 to project the adjustment pattern described above.

[0032] The third control unit 113 controls the camera 130 to capture an image including the adjustment pattern projected onto the projection target SC.

[0033] The determination unit 114 determines whether the captured image captured by the camera 130 has been normally acquired in accordance with a user's instruction. More specifically, the determination unit 114 attempts to detect the first adjustment pattern in the captured image captured by the camera 130, and determines that the image has been normally acquired if the detection is successful. The determination unit 114 stores the normally acquired captured image in the volatile memory of the storage device 160.

[0034] The adjustment unit 115 calculates geometric correction values ​​for adjusting the outer shape based on the multiple captured images stored in the volatile memory, and transmits the geometric correction values ​​to the projector 20, causing the projector 20 to perform the outer shape adjustment. Note that the adjustment unit 115 may select two captured images captured at positions farthest apart from the multiple captured images, and if the distance between the captured positions is equal to or greater than a threshold, calculate geometric correction values ​​based on the multiple captured images, and if the distance between the captured positions is less than the threshold, prompt the user to continue capturing images. This is because using captured images captured from positions as far apart as possible directly leads to improved correction accuracy.

[0035] Furthermore, the processing device 110 operating in accordance with the program PR1 executes a control method embodying the features of the present disclosure. Fig. 9 is a flowchart showing the processing flow of this control method. As shown in Fig. 9, this control method includes a display control process SA110, a projection control process SA120, an acquisition process SA130, and an adjustment process SA140.

[0036] In the display control process SA110, the processing device 110 functions as a first control unit. In the display control process SA110, the processing device 110 first displays the above-mentioned rectangle confirmation screen G10 on the display 140. Then, when the processing device 110 receives an operation to select the image G12, it displays an adjustment method explanation screen G20 on the display 140. Then, after displaying the adjustment method explanation screen G20 on the display 140, when an operation is performed on the button image G23, the processing device 110 displays an imaging start screen G30 on the display 140 and waits for an operation on the button image G33. When an operation is performed on the button image G33, the processing device 110 executes the projection control process SA120.

[0037] In the projection control process SA120, the processing device 110 functions as the second control unit 112 and the third control unit 113, and causes the projector 20 to project the above-mentioned adjustment pattern, and also causes the camera 130 to capture an image of the adjustment pattern projected onto the projection target SC.

[0038] In the acquisition process SA130, the processing device 110 functions as a first control unit 111 and a determination unit 114. In the acquisition process SA130, the processing device 110 first displays a processing-in-progress screen G40 on the display 140. Then, in response to an operation on the button image G43, the processing device 110 acquires a captured image by the camera 130. Each time a captured image is acquired, the processing device 110 determines whether the captured image was acquired correctly. If the processing device 110 determines that the captured images from multiple positions were acquired correctly, the processing device 110 executes an adjustment process SA140 (described later) and terminates the execution of this control method. On the other hand, if the processing device 110 determines that the captured image was not acquired correctly, the processing device 110 prompts the user to retake the image. For example, in a mode in which the image shown in FIG. 8 is used as the processing-in-progress screen G40, check boxes corresponding to the positions are displayed on the display 140 in the first display mode described above, prompting the user to recapture the captured image.

[0039] In the adjustment process SA140, the processing device 110 functions as the adjustment unit 115. In the adjustment process SA140, the processing device 110 calculates a geometric correction value for correcting distortion of the projection image based on the multiple captured images acquired in the acquisition process SA130, and transmits the geometric correction value to the projector 20. Thereafter, the projector 20 performs geometric correction to correct the outline of the projection image in accordance with the geometric correction value received from the electronic device 10, and projects the projection image with the adjusted outline onto the projection target SC.

[0040] As described above, according to this embodiment, the adjustment method explanation screen G20 that is displayed when image G12 is selected includes image G21 of text that shows explanatory text regarding the adjustment of the external shape of the projected image, and image G22 that schematically shows capturing an adjustment pattern using electronic device 10, so that the user can easily understand what the external shape adjustment is.

[0041] 2. Transformation The above embodiments can be modified as follows. (1) After displaying the adjustment method explanation screen G20 on the display 140, the first control unit 111 may display on the display 140, prior to displaying the image capture start screen G30, a fourth image that recommends the camera position (in other words, the position of the electronic device 10) when capturing an image of the first adjustment pattern with the camera 130. According to this embodiment, the user can easily understand the position in which to capture the image of the first adjustment pattern. Note that the same effect can be achieved by projecting the fourth image from the projector 20 instead of displaying it on the display 140.

[0042] (2) After performing the adjustment of the outer shape, the second control unit 112 may cause the projector 20 to project a second adjustment pattern in which a plurality of figures are arranged, in order to allow the user to determine whether or not adjustment of unevenness in the projected image is necessary. A specific example of the second adjustment pattern is the grid pattern shown in FIG. 10 . The presence or absence of unevenness in the projected image is determined visually by the user, but if the projected image is a monochrome image or a natural image, it is difficult to visually determine the presence or absence of unevenness. Note that the grid spacing of the grid pattern is preferably the same as or larger than the correction point spacing of the correction circuit that performs geometric correction in the projector 20. By making the grid spacing of the grid pattern the same as or larger than the correction point spacing of the correction circuit that performs geometric correction in the projector 20, unnecessary correction can be avoided when there are unevenness that is too small to be corrected.

[0043] In this case, the first control unit 111 may display an unevenness check screen G50 shown in FIG. 11 on the display 140 to guide the user in adjusting the unevenness of the projected image. As shown in FIG. 11, the unevenness check screen G50 includes an image G52 showing a state in which the arrangement of multiple figures is distorted and an image G51 showing a state in which the arrangement of the multiple figures is not distorted. Image G52 indicates that unevenness has occurred in the projected image. Image G52 is an example of a fifth image in the present disclosure, and image G51 is an example of a sixth image in the present disclosure. While the unevenness check screen G50 is displayed on the display 140, the electronic device 10 accepts an operation to select image G51 or image G52. When the first control unit 111 accepts an operation to select image G52, it displays a seventh image on the display 140 that provides instructions on adjusting the unevenness of the projected image. According to this aspect, displaying the seventh image can guide the user to further adjust the projected image.

[0044] (3) In the above embodiment, the first control unit 111, the second control unit 112, the third control unit 113, the determination unit 114, and the adjustment unit 115 are all software modules. However, any one, any two, any three, any four, or all of the first control unit 111, the second control unit 112, the third control unit 113, the determination unit 114, and the adjustment unit 115 may be a hardware module such as an ASIC (Application Specific Integrated Circuit). Even if any one, any two, any three, any four, or all of the first control unit 111, the second control unit 112, the third control unit 113, the determination unit 114, and the adjustment unit 115 are hardware modules, the same effects as those of the above embodiment can be achieved.

[0045] (4) The program PR1 may be manufactured as a standalone product or provided free of charge or for a fee. Specific examples of providing the program PR1 include providing the program PR1 by writing it to a computer-readable recording medium such as a flash ROM, or providing the program PR1 by downloading it via a telecommunications line such as the Internet. By operating a general computer in accordance with the program PR1 provided in these ways, it becomes possible to cause the computer to execute the display method of the present disclosure.

[0046] 3. Summary of this disclosure The present disclosure is not limited to the above-described embodiments and modifications, and can be realized in various forms without departing from the spirit thereof. For example, the present disclosure can also be realized in the following forms. The technical features in the above embodiments corresponding to the technical features in each form described below can be replaced or combined as appropriate to solve some or all of the problems of the present disclosure or to achieve some or all of the effects of the present disclosure. Furthermore, if a technical feature is not described as essential in this specification, it can be deleted as appropriate. A summary of this disclosure is provided below.

[0047] (Appendix 1) A control method according to one aspect of the present disclosure is a control method for an electronic device that includes a display and is capable of communicating with a projector that projects a projection image onto a projection target, the control method including: displaying, on the display, a first image that shows an image of the projection image when the outer shape of the projection image is not adjusted and that is selectable by a user; and, when an operation to select the first image is received, displaying, on the display, a third image that provides an explanation regarding the adjustment of the outer shape. According to this control method, the user can easily understand what the outer shape adjustment will be based on the third image that is displayed when the first image is selected.

[0048] (Appendix 2) In a more preferred embodiment of the control method, the electronic device includes a camera capable of capturing the projection image, and after displaying the third image, the control method further includes displaying on the display or having a projector project a fourth image that recommends the orientation of the electronic device when capturing, as the projection image, a first adjustment pattern for adjusting the external shape with the camera. According to this embodiment of the control method, the user can easily understand what orientation the electronic device should be in when capturing the first adjustment pattern.

[0049] (Appendix 3) Another preferred embodiment of the control method is the control method described in (Supplementary Note 1), which includes, after displaying the third image, displaying on the display an image of a button for starting to project, as the projection image, a first adjustment pattern for adjusting the outer shape onto the projection target, and accepting an operation on the image of the button. According to the control method of this embodiment, the user can operate the button at any time to project the first adjustment pattern onto the projection target at any time.

[0050] (Appendix 4) Another preferred embodiment of the control method is the control method described in (Supplementary Note 1), in which the electronic device includes a camera capable of capturing the projection image, and after displaying the third image, causes the projector to project a first adjustment pattern for adjusting the outer shape as the projection image, and displays on the display an image including the first adjustment pattern captured by the camera capable of capturing the projection image, and at least one prompt image prompting the user to capture an image by capturing the first adjustment pattern. According to the control method of this embodiment, the user can easily understand that at least one captured image should be captured while checking the image, making it easier to improve the accuracy of the adjustment of the outer shape.

[0051] (Appendix 5) Another preferred embodiment of the control method is the control method described in (Supplementary Note 4), which includes determining whether the captured image has been acquired normally, causing the projector to adjust the outer shape if it is determined that the captured image has been acquired normally, and displaying the at least one prompt image on the display if it is determined that the captured image has not been acquired normally. According to this embodiment of the control method, by displaying at least one prompt image on the display if it is determined that at least one captured image has not been acquired normally, it becomes easier for the user to understand that re-capturing is necessary.

[0052] (Appendix 6) Another preferred embodiment of the control method is the control method described in (Supplementary Note 5), which includes, after performing the adjustment of the outer shape, projecting a second adjustment pattern in which a plurality of figures are arranged from the projector, displaying on the display a fifth image showing a state in which the arrangement of the plurality of figures is distorted and a sixth image showing a state in which the arrangement of the plurality of figures is not distorted, accepting an operation to select the fifth image or the sixth image, and, when an operation to select the fifth image is accepted, displaying on the display a seventh image showing an explanation regarding the adjustment of the distortion. According to the control method of this embodiment, by displaying the seventh image, it is possible to guide the user to further adjust the projected image.

[0053] (Appendix 7) An electronic device according to one aspect of the present disclosure includes a communication device that communicates with a projector that projects a projection image onto a projection target, a display, and a processing device, wherein the processing device executes the following: displaying on the display a first image that shows an image of the projection image when the outer shape of the projection image is not adjusted and that is selectable by a user; and, when an operation to select the first image is received, displaying on the display a third image that provides an explanation regarding the adjustment of the outer shape. According to the electronic device of this aspect, the user can easily understand what the outer shape adjustment will be like based on the third image that is displayed when the first image is selected.

[0054] (Appendix 8) A program according to one aspect of the present disclosure causes a computer to: display on a display a first image, selectable by a user, that shows an image of a projection image projected from a projector onto a projection target when the outer shape of the projection image is not adjusted; and, when an operation to select the first image is received, display on the display a third image that provides an explanation regarding the adjustment of the outer shape. According to the program of this aspect, the user can easily understand what the outer shape adjustment will be like based on the third image that is displayed when the first image is selected. [Explanation of symbols]

[0055] 1...display system, 10...electronic device, 20...projector, 110...processing device, 111...first control unit, 112...second control unit, 113...third control unit, 114...adjustment unit, 120...communication device, 130...camera, 140...display, 150...input device, 160...storage device, 170...bus, PR1...program.

Claims

1. A control method for an electronic device that is equipped with a display and is capable of communicating with a projector that projects a projection image onto a projection target, comprising: displaying on the display a first image selectable by a user, the first image showing an image of the projected image when the outline of the projected image is not adjusted; When an operation of selecting the first image is received, a third image showing an explanation regarding the adjustment of the outer shape is displayed on the display; A control method comprising:

2. the electronic device includes a camera capable of capturing the projected image; and after displaying the third image, displaying on the display or projecting by a projector a fourth image as the projection image, the fourth image recommending the posture of the electronic device when capturing an image of a first adjustment pattern for adjusting the outer shape by the camera. The control method according to claim 1 .

3. After displaying the third image, displaying on the display an image of a button for starting to project, as the projection image, a first adjustment pattern for adjusting the outer shape onto the projection target; and receiving an operation on the image of the button. The control method according to claim 1 .

4. After displaying the third image, causing the projector to project a first adjustment pattern for adjusting the outer shape as the projection image; and displaying on the display an image including the first adjustment pattern captured by a camera capable of capturing the projection image and at least one prompt image prompting the user to acquire the captured image by the camera. The control method according to claim 1 .

5. determining whether the captured image has been acquired normally; causing the projector to adjust the outer shape when it is determined that the captured image has been normally acquired; displaying the at least one prompt image on the display when it is determined that the captured image has not been normally acquired; The control method of claim 4 , comprising:

6. After performing the contour adjustment, projecting a second adjustment pattern in which a plurality of figures are arranged by the projector; displaying, on the display, a fifth image showing a state in which the arrangement of the plurality of figures is distorted and a sixth image showing a state in which the arrangement of the plurality of figures is not distorted; accepting an operation to select the fifth image or the sixth image; The control method according to claim 5 , further comprising: displaying, on the display, a seventh image showing an explanation regarding distortion adjustment, when an operation to select the fifth image is accepted.

7. The display and a communication device that communicates with a projector that projects a projection image onto a projection target; a processing device, The processing device includes: displaying on the display a first image selectable by a user, the first image showing an image of the projected image when the outline of the projected image is not adjusted; When an operation of selecting the first image is received, a third image showing an explanation regarding the adjustment of the outer shape is displayed on the display. electronic equipment.

8. On the computer, displaying on a display a first image selectable by a user, the first image showing an image of a projection image projected from a projector onto a projection target when the outer shape of the projection image is not adjusted; when an operation of selecting the first image is received, displaying a third image showing an explanation regarding the adjustment of the outer shape on the display. program.

Citation Information

Patent Citations

  • Display system and information processing method

    WO2017179111A1