Control method, program, and information processing apparatus

Abstract

To improve operational feeding for a user.SOLUTION: A control method includes receiving input of information on changing the aspect ratio of a content image from a first aspect ratio to a second aspect ratio, and displaying a first adjustment point, a second adjustment point, and a third adjustment point on a projection surface in an arrangement based on the information. The first adjustment point is an adjustment point for adjusting the position of a first corner of a projection image. The second adjustment point is an adjustment point for adjusting the position of a second corner of the projection image. The third adjustment point is an adjustment point for adjusting the position of a third corner of the projection image. The arrangement based on the information is an arrangement by which the ratio of the distance between the first adjustment point and the third adjustment point to the distance between the first adjustment point and the second adjustment point on the projection surface becomes closer to the second aspect ratio than the first aspect ratio.SELECTED DRAWING: Figure 4

Description

[Technical Field]

[0001] The present disclosure relates to a control method, a program, and an information processing device. [Background technology]

[0002] For example, Patent Document 1 discloses a method for adjusting an entire image, which includes projecting an adjustment image in which multiple adjustment points for performing geometric correction on a partial image are arranged in a matrix in a first direction and a second direction. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-147132 Summary of the Invention [Problem to be solved by the invention]

[0004] In the technology described in Patent Document 1, there are cases where the user already knows the aspect ratio of the content to be projected after geometric correction is complete. In such cases, it is easier for the user to visualize how the multiple adjustment points will move if they are positioned taking into account the aspect ratio of the content. However, Patent Document 1 does not take this into consideration, and there is room for improvement in the user experience. [Means for solving the problem]

[0005] A control method according to one aspect of the present disclosure is a control method for controlling driving of a projection device that projects a projection image including a first side and a second side intersecting the first side onto a projection surface, the control method including: receiving input of information for changing the aspect ratio of a content image from a first aspect ratio to a second aspect ratio; and displaying first adjustment points, second adjustment points, and third adjustment points on the projection surface in an arrangement based on the information, the first adjustment points being adjustment points for adjusting the position of a first corner including an intersection point of the first side and the second side in the projection image. the second adjustment point is an adjustment point for adjusting the position of a second corner including the end opposite to the intersection point of the first side in the projected image, and the third adjustment point is an adjustment point for adjusting the position of a third corner including the end opposite to the intersection point of the second side in the projected image, and the arrangement based on the information is an arrangement in which the ratio of the distance between the first adjustment point and the third adjustment point to the distance between the first adjustment point and the second adjustment point on the projection surface is closer to the second aspect ratio than the first aspect ratio.

[0006] A program according to one aspect of the present disclosure is a program for controlling the driving of a projection device that projects a projection image including a first side and a second side intersecting the first side onto a projection surface, the program causing a computer to execute the following steps: accepting input of information for changing the aspect ratio of a content image from a first aspect ratio to a second aspect ratio; and displaying first adjustment points, second adjustment points, and third adjustment points on a display surface in an arrangement based on the information; the first adjustment point adjusting a position of a first corner in the projection image that includes an intersection point between the first side and the second side. the second adjustment point is an adjustment point for adjusting the position of a second corner including an end of the first side opposite the intersection point in the projected image, the third adjustment point is an adjustment point for adjusting the position of a third corner including an end of the second side opposite the intersection point in the projected image, and the arrangement based on the information is an arrangement in which a ratio of a distance between the first adjustment point and the third adjustment point to a distance between the first adjustment point and the second adjustment point on the display surface is closer to the second aspect ratio than the first aspect ratio.

[0007] An information processing device according to one aspect of the present disclosure is an information processing device used in a projection device that projects a projection image including a first side and a second side intersecting the first side onto a projection surface, the information processing device including a processing device, the processing device receiving input of information for changing the aspect ratio of a content image from a first aspect ratio to a second aspect ratio, and displaying first adjustment points, second adjustment points, and third adjustment points on a display surface in an arrangement based on the information, the first adjustment point adjusting a position of a first corner including an intersection point of the first side and the second side in the projection image. the second adjustment point is an adjustment point for adjusting the position of a second corner including an end opposite to the intersection point of the first side in the projected image, the third adjustment point is an adjustment point for adjusting the position of a third corner including an end opposite to the intersection point of the second side in the projected image, and the arrangement based on the information is an arrangement in which the ratio of the distance between the first adjustment point and the third adjustment point to the distance between the first adjustment point and the second adjustment point on the display surface is closer to the second aspect ratio than the first aspect ratio. [Brief explanation of the drawings]

[0008] [Figure 1] FIG. 1 is a diagram illustrating an outline of a system used in a control method according to an embodiment. [Figure 2] FIG. 1 is a block diagram of a projection device according to an embodiment. [Figure 3] 3A and 3B are diagrams for explaining the relationship between a display panel and a projected image. [Figure 4] 3 is a flowchart showing the flow of a control method according to the embodiment. [Figure 5] 10 is an example of a display used to input the aspect ratio of a content image. [Figure 6] FIG. 10 is a diagram for explaining a frame line. [Figure 7] FIG. 10 is a diagram for explaining adjustment points. [Figure 8] FIG. 10 is a diagram for explaining movement of an adjustment point. [Figure 9] FIG. 10 is a diagram showing an example of a display of a confirmation image for confirming adjustment using adjustment points. DETAILED DESCRIPTION OF THE INVENTION

[0009] Preferred embodiments of the present disclosure will be described below with reference to the accompanying drawings. Note that the dimensions and scale of each part in the drawings may differ from the actual dimensions and are shown schematically to facilitate understanding. Furthermore, the scope of the present disclosure is not limited to these embodiments unless otherwise specified in the following description to the effect that the present disclosure is limited.

[0010] 1. First embodiment 1-1. Overview of multi-projection systems 1 is a diagram showing an outline of a system 100 used in a control method according to an embodiment. The system 100 is a multi-projection system that projects an entire image GG composed of a projection image G1 and a projection image G2 onto a projection surface SC.

[0011] The projection surface SC is the surface of an object such as a screen. In the example shown in Fig. 1, the projection surface SC is a flat surface. However, the projection surface SC is not limited to a flat surface and may be, for example, a curved surface.

[0012] As shown in FIG. 1 , the system 100 includes a projection device 10-1, a projection device 10-2, and a terminal device 30. Hereinafter, the projection device 10-1 may be referred to as the projection device 10 without distinguishing between the projection device 10-1 and the projection device 10-2. Note that, although the present embodiment illustrates an example in which the system 100 includes two projection devices 10, the present invention is not limited to this example, and the number may be three or more. In other words, the entire image GG may include images projected from three or more projection devices 10.

[0013] The projection device 10-1 is a display device that projects a projection image G1 representing a content image indicated by video data IMG1 output from the terminal device 30 onto a projection surface SC. On the other hand, the projection device 10-2 is a display device that projects a projection image G2 representing a content image indicated by video data IMG2 output from the terminal device 30 onto the projection surface SC.

[0014] The projected image G1 and the projected image G2 are arranged in this order in the first direction DR1 to form a whole image GG. The projected image G1 and the projected image G2 are projected onto the projection surface SC in a joined state so that the whole image GG displays a single image. In the example shown in FIG. 1, the whole image GG forms a rectangle with the first direction DR1 as its horizontal direction and a second direction DR2 intersecting the first direction DR1 as its vertical direction. The projected image G1 is projected onto the left region of the projection surface SC in FIG. 1, while the projected image G2 is projected onto the right region of the projection surface SC in FIG. 1. A portion of the projected image G1 including the right edge in FIG. 1 and a portion of the projected image G2 including the left edge in FIG. 1 are joined together. That is, a portion of the projected image G1 including the right edge in FIG. 1 overlaps with a portion of the projected image G2 including the left edge in FIG. 1. The first direction DR1 and the second direction are typically perpendicular to each other, but may intersect at an angle within the range of 85° to 95°.

[0015] A part of the projected image G1 and a part of the projected image G2 overlap each other in an overlapping region R. The overlapping region R is an area where a blending process is performed to make the seam between the projected image G1 and the projected image G2 less noticeable.

[0016] In this embodiment, projection device 10-1 is the main device and controls the operation of projection device 10-2, which is the sub-device. Note that projection device 10-2 may have a different configuration from projection device 10-1 as long as its operation can be controlled by projection device 10-1. When the system 100 has three or more projection devices 10, one of the three or more projection devices 10 is the main device and the other two or more projection devices 10 are sub-devices.

[0017] The terminal device 30 is a device that has the function of dividing video data showing one image into multiple video data to be projected by multiple projection devices 10, and the function of supplying each of the video data obtained by the division process to the corresponding projection device 10.

[0018] The terminal device 30 of this embodiment divides video data showing one image into video data IMG1 and video data IMG2, and then supplies the video data IMG1 to the projection device 10-1 and the video data IMG2 to the projection device 10-2.

[0019] 1, the terminal device 30 is a notebook computer. However, the terminal device 30 is not limited to a notebook computer and may be, for example, a desktop computer, a smartphone, a tablet terminal, a video playback device, a DVD (Digital Versatile Disk) player, a Blu-ray Disc player, a hard disk recorder, a television tuner device, a CATV (Cable television) set-top box, a video game console, etc.

[0020] 1-2.Projector FIG. 2 is a block diagram of a projection device 10-1 according to an embodiment. In addition to the projection device 10-1, FIG. 2 also shows the connection state of the projection device 10-2 and the terminal device 30 to the projection device 10-1. While FIG. 2 representatively shows the configuration of the projection device 10-1, the configuration of the projection device 10-2 is the same as that of the projection device 10-1 except that it is a sub-device. In the following description of the components of the projection device 10, the components of the projection device 10-1 and the components of the projection device 10-2 may be distinguished from each other by adding the suffix "-1" to the reference numerals of the components of the projection device 10-1 and the suffix "-2" to the reference numerals of the components of the projection device 10-2.

[0021] 2, the projection device 10-1 has a storage device 11, a processing device 12, a communication device 13, an image processing circuit 14, an optical device 15, an operation device 16, and an imaging device 17. These are connected to each other so that they can communicate with each other. The processing device 12 is an example of an "information processing device" and a "computer."

[0022] The storage device 11 is a storage device that stores programs executed by the processing device 12 and data processed by the processing device 12. The storage device 11 includes, for example, a hard disk drive or a semiconductor memory. Note that part or all of the storage device 11 may be provided in an external storage device or server outside the projection device 10-1.

[0023] The storage device 11 stores a program PR1 and setting information D1.

[0024] The program PR1 is a program for controlling the driving of the projection devices 10-1 and 10-2. The setting information D1 is information indicating the correspondence between a plurality of pixels of a display panel 15b (to be described later) and a plurality of pixels of a content image indicated by the video data IMG1.

[0025] The processing device 12 has the function of controlling each part of the projection device 10-1 and the function of processing various data. The processing device 12 includes, for example, a processor such as a CPU (Central Processing Unit). The processing device 12 may be configured with a single processor or multiple processors. Some or all of the functions of the processing device 12 may be realized by hardware such as a DSP (Digital Signal Processor), an ASIC (Application Specific Integrated Circuit), a PLD (Programmable Logic Device), or an FPGA (Field Programmable Gate Array). The processing device 12 may also be integrated with the image processing circuit 14.

[0026] The communication device 13 is a communication device capable of communicating with various devices, and communicates with the terminal device 30 and the projection device 10-2. For example, the communication device 13 is a wired communication device such as a wired local area network (LAN), a universal serial bus (USB), or a high definition multimedia interface (HDMI), or a wireless communication device such as a low power wide area (LPWA), a wireless LAN including Wi-Fi, or Bluetooth. "HDMI," "Wi-Fi," and "Bluetooth" are all registered trademarks.

[0027] The image processing circuit 14 performs necessary processing on the video data IMG1 input from the terminal device 30 via the communication device 13 and inputs the data to the optical device 15. The image processing circuit 14 has, for example, a frame memory (not shown), and loads the video data IMG1 into the frame memory, appropriately performs various processes such as resolution conversion, resizing, and distortion correction, and inputs the data to the optical device 15. Here, the image processing circuit 14 performs processing to adjust the outer shape of the content image represented by the video data IMG1 based on the setting information D1 stored in the storage device 11. Note that the image processing circuit 14 also performs processing such as OSD (On Screen Display) processing, which generates image information for menu display or operation guides, etc., and combines it with the video data IMG1, as necessary.

[0028] The optical device 15 is a device that projects image light onto the projection surface SC, and includes a light source 15a, a display panel 15b, and an optical system 15c.

[0029] The light source 15a includes a light source such as a halogen lamp, a xenon lamp, an ultra-high pressure mercury lamp, an LED (Light Emitting Diode), or a laser light source, and emits red, green, and blue light, respectively. The display panel 15b renders an image based on video data IMG1 supplied from the terminal device 30. The display panel 15b is an optical modulator including three light modulation elements corresponding to red, green, and blue. Each light modulation element includes, for example, a transmissive liquid crystal panel, a reflective liquid crystal panel, or a DMD (Digital Mirror Device), and generates image light of each color by modulating light of the corresponding color. The image light of each color generated by the display panel 15b is combined by a color combining optical system to become full-color image light. The optical system 15c is a projection optical system including a projection lens that focuses and projects the full-color image light from the display panel 15b onto the projection surface SC. The image rendered on the display panel 15b, i.e., the rendered image, is projected onto the projection surface SC via the projection lens.

[0030] The operation device 16 is a device that accepts operations from the user. For example, the operation device 16 includes an operation panel and a remote control light receiving unit, both not shown. The operation panel is provided on the exterior housing of the projection device 10-1, and outputs a signal based on an operation from the user. The remote control light receiving unit receives an infrared signal from a remote control, also not shown, decodes the infrared signal, and outputs a signal based on the operation of the remote control.

[0031] The imaging device 17 is a digital camera having an imaging element such as a CCD (Charge Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor). The imaging device 17 captures an image of an area including an area of image light projected onto the projection surface SC from the optical device 15. Here, an imaging coordinate system, which is a coordinate system set in the imaging device 17, is associated with a display coordinate system, which is a coordinate system set in the display panel 15b, by calibration.

[0032] In the above-described projection device 10-1, the processing device 12 functions as the setting unit 12a by executing the program PR1 stored in the storage device 11. In this way, the processing device 12 includes the setting unit 12a.

[0033] The setting unit 12a sets a correspondence between a plurality of pixels of the display panel 15b and a plurality of pixels of the content image shown by the video data IMG1. This setting is performed by appropriately communicating with the terminal device 30 via the communication device 13 and controlling the operations of the image processing circuit 14 and the optical device 15. This setting generates setting information D1.

[0034] 1-3. Relationship between display panel and projected image Fig. 3 is a diagram illustrating the relationship between the display panels 15b-1 and 15b-2 and the projected images G1 and G2. Fig. 3 shows a state in which the entire image GG is displayed by displaying the projected image G1 using the entire area of the display panel 15b-1 and the projected image G2 using the entire area of the display panel 15b-2. Here, the aspect ratio of the entire image GG is the ratio (H / W) of the vertical length H to the horizontal length W of the entire image GG. Furthermore, the projected images G1 and G2 overlap each other in an overlapping region R of width X.

[0035] As shown in FIG. 3, the projected image G1 includes a first side S1-1, a second side S2-1, a third side S3-1, and a fourth side S4-1, forming a rectangle. The first side S1-1 is the top side of the projected image G1 in the figure and extends along a first direction DR1. The second side S2-1 is the left side of the projected image G1 in the figure and extends along a second direction DR2 that intersects with the first direction DR1. The third side S3-1 is the bottom side of the projected image G1 in the figure and extends along the first direction DR1. The fourth side S4-1 is the right side of the projected image G1 in the figure and extends along the second direction DR2.

[0036] Here, the first side S1-1 and the second side S2-1 intersect with each other to form a first angle C1-1 including their intersection point. The first angle C1-1 includes one end of the first side S1-1 and one end of the second side S2-1. The first side S1-1 and the fourth side S4-1 intersect with each other to form a second angle C2-1 including their intersection point. The second angle C2-1 includes the other end of the first side S1-1 and one end of the fourth side S4-1. The second side S2-1 and the third side S3-1 intersect with each other to form a third angle C3-1 including their intersection point. The third angle C3-1 includes the other end of the second side S2-1 and one end of the third side S3-1. The third side S3-1 and the fourth side S4-1 intersect with each other to form a fourth angle C4-1 including their intersection point. The fourth corner C4-1 includes the other end of the third side S3-1 and the other end of the fourth side S4-1. Thus, the projected image G1 includes the first corner C1-1, the second corner C2-1, the third corner C3-1, and the fourth corner C4-1.

[0037] Similarly, the projected image G2 includes a first side S1-2, a second side S2-2, a third side S3-2, and a fourth side S4-2, forming a rectangle. The first side S1-2 is the top side of the projected image G2 in the drawing and extends along the first direction DR1. The second side S2-2 is the right side of the projected image G2 in the drawing and extends along the second direction DR2. The third side S3-2 is the bottom side of the projected image G2 in the drawing and extends along the first direction DR1. The fourth side S4-2 is the left side of the projected image G2 in the drawing and extends along the second direction DR2.

[0038] Here, the first side S1-2 and the second side S2-2 intersect with each other and form a first angle C1-2 including their intersection point. The first angle C1-2 includes one end of the first side S1-2 and one end of the second side S2-2. The first side S1-2 and the fourth side S4-2 intersect with each other and form a second angle C2-2 including their intersection point. The second angle C2-2 includes the other end of the first side S1-2 and one end of the fourth side S4-2. The second side S2-2 and the third side S3-2 intersect with each other and form a third angle C3-2 including their intersection point. The third angle C3-2 includes the other end of the second side S2-2 and one end of the third side S3-2. The third side S3-2 and the fourth side S4-2 intersect with each other and form a fourth angle C4-2 including their intersection point. The fourth corner C4-2 includes the other end of the third side S3-2 and the other end of the fourth side S4-2. Thus, the projected image G2 includes the first corner C1-2, the second corner C2-2, the third corner C3-2, and the fourth corner C4-2.

[0039] When projecting the above-described projection images G1 and G2 onto the projection surface SC, it is necessary to adjust the outer shapes of the projection images G1 and G2 to match the shape of the projection surface SC, depending on the installation state of the projection device 10 and the shape of the projection surface SC. For example, it is necessary to arrange the first corners C1-1 and C1-2, the second corners C2-1 and C2-2, the third corners C3-1 and C3-2, and the fourth corners C4-1 and C4-2 so that they fit the outer shape of the projection surface SC.

[0040] This adjustment is performed by adjusting the installation state of the projection device 10, changing the correspondence between the multiple pixels of the content image represented by the video data IMG1 and the multiple pixels of the display panel 15b-1, and changing the correspondence between the multiple pixels of the content image represented by the video data IMG2 and the multiple pixels of the display panel 15b-2.

[0041] Here, the change in the correspondence between the plurality of pixels of the content image and the plurality of pixels of the display panel 15b is performed based on the result of a movement operation on a plurality of adjustment points Pa, which will be described later, displayed on the projection surface SC.

[0042] When the aspect ratio of the content image represented by the video data IMG1 and IMG2 matches the aspect ratio of the display panel 15b, the initial positions of the multiple adjustment points Pa, which will be described later, correspond to the corners of the display panel 15b, making it easier for the user to visually and intuitively understand the relationship between the outline of the content image and the shape of the projection surface SC. The aspect ratio that matches the aspect ratio of the display panel 15b is an example of a "first aspect ratio." The aspect ratio of the display panel 15b is the ratio (Ha / Wa) of the vertical length Ha of the display panel 15b to the horizontal length Wa.

[0043] However, there are cases where the aspect ratio of the content images represented by the video data IMG1 and IMG2 does not match the aspect ratio of the display panel 15b. For example, there are cases where the aspect ratio of the content images is 16:9 while the aspect ratio of the display panel 15b is 16:10. Here, an aspect ratio different from the aspect ratio of the display panel 15b is an example of a "second aspect ratio."

[0044] In this way, when the aspect ratio of the content image is the second aspect ratio, if the initial positions of the multiple adjustment points Pa described below are set in the same way as when the aspect ratio of the content image is the first aspect ratio, the multiple adjustment points Pa will be positioned away from the outer shape of the content image, making it difficult for the user to visually and intuitively understand the relationship between the outer shape of the content image and the shape of the projection surface SC.

[0045] Therefore, the system 100 can receive input of information for changing the aspect ratio of the content image from the first aspect ratio to the second aspect ratio, and changes the initial positions of a plurality of adjustment points Pa, which will be described later, based on the result of this reception.

[0046] 1-4.Control method 4 is a flowchart showing the flow of a control method according to the embodiment. The control method is performed by the processing device 12 executing the program PR1 using the above-described system 100. As shown in FIG. 4, the control method includes steps S10 to S90. That is, the processing device 12 of the projection device 10-1 executes steps S10 to S90. Furthermore, the program PR1 causes the processing device 12, which is an example of a computer, to execute steps S10 to S90.

[0047] Specifically, first, in step S10, the setting unit 12a determines whether or not input of information for changing the aspect ratio of the content image from the first aspect ratio to the second aspect ratio has been received. The information is input using an image UI shown in Fig. 5, which will be described later. Step S10 is repeated until the information is input (step S10: NO).

[0048] If input of information for changing the aspect ratio of the content image is accepted (step S10: YES), in step S20, the setting unit 12a executes the process of displaying a frame line LF shown in FIG. 6, which will be described later.

[0049] After step S20, in step S30, the setting unit 12a executes the process of displaying a placement adjustment message, which is a message that prompts the user to adjust at least one of the positions, attitudes, and optical systems of the projection devices 10-1 and 10-2. In this embodiment, the message is displayed by projection onto the projection surface SC, as will be described later with reference to FIG. 6. Note that the display of the message is not limited to being displayed by projection onto the projection surface SC, and may be displayed, for example, by a display device (not shown) of the terminal device 30.

[0050] After step S30, in step S40, the setting unit 12a determines whether the placement adjustment, which is the adjustment of the position, attitude, and optical system of the projection devices 10-1 and 10-2, has been completed. For example, if an operation indicating that the placement adjustment has been completed is performed on a UI image (not shown), the setting unit 12a determines that the placement adjustment has been completed (step S40: YES). Step S40 is repeatedly executed until it is determined that the placement adjustment has been completed (step S40: NO).

[0051] If it is determined that the layout adjustment is complete (step S40: YES), in step S50, the setting unit 12a executes the process of displaying a plurality of adjustment points Pa, which will be described later, on the projection surface SC in a layout based on the input information received in step S10. Details of this layout will be described later with reference to FIG.

[0052] After step S50, in step S60, the setting unit 12a determines whether or not a movement operation has been performed, which is an operation for moving the position of at least one adjustment point Pa among a plurality of adjustment points Pa described below on the projection surface SC. Details of this movement operation will be described later with reference to FIG.

[0053] If a movement operation has been received (step S60: YES), in step S70, the setting unit 12a executes the movement of the position of at least one adjustment point Pa in accordance with the movement operation in step S60.

[0054] After step S70, or if the move operation is not received (step S60: NO), the setting unit 12a determines in step S80 whether the move operation is completed. For example, if an operation indicating that the move operation is completed is performed on a UI image (not shown), the setting unit 12a determines that the move operation is completed (step S80: YES).

[0055] If the movement operation is not to be completed (step S80: NO), the setting unit 12a returns to step S60, which makes it possible to accept the movement operation of the adjustment point Pa.

[0056] If the movement operation is completed (step S80: YES), in step S90, the setting unit 12a displays confirmation images G1-A and G2-A (described later) showing images after adjustment based on the movement operation on the projection surface SC. At this time, the setting unit 12a generates setting information D1 based on the result of the movement operation, and generates the confirmation images G1-A and G2-A using the setting information D1. Details of this display will be described later with reference to FIG. 9.

[0057] Thereafter, the setting unit 12a ends the process based on a predetermined operation on a UI image (not shown).

[0058] 5 shows an example of a display used for inputting the aspect ratio of a content image. In step S10, the setting unit 12a causes an image UI to be displayed on a display device (not shown) of the terminal device 30 via the communication device 13. The image UI is an interface image for accepting input of information for changing the aspect ratio of the content image from the first aspect ratio to the second aspect ratio. Note that this display may be performed by projection onto the projection surface SC by the projection device 10.

[0059] The image UI includes a pull-down menu B1 and buttons B2, B3, and B4.

[0060] The pull-down menu B1 is a display that accepts an operation to select one aspect ratio from multiple aspect ratios of the content image. The pull-down menu B1 can display a list box that displays multiple aspect ratios that can be selected alternatively. Here, the aspect ratio that has already been selected corresponds to the first aspect ratio, and if an aspect ratio different from the first aspect ratio is selected, the selected aspect ratio corresponds to the second aspect ratio. In the example shown in FIG. 5, the first aspect ratio is 16:10, and the second aspect ratio is 16:9.

[0061] Button B2 is a display for accepting an operation to change the number of adjustment points Pa, which will be described later. Although not shown, when button B2 is operated, a display appears for specifying, for example, the number of adjustment points Pa or the positions of adjustment points Pa. Note that button B2 may be provided as needed and may be omitted.

[0062] The button B3 is a display that accepts an operation to decide to set the aspect ratio selected in the pull-down menu B1. When the button B3 is operated, in step S10, the setting unit 12a determines that input of information to change the aspect ratio of the content image from the first aspect ratio to the second aspect ratio has been accepted (step S10: YES).

[0063] The button B4 is a display that accepts an operation to stop the process of the above-mentioned step S 10. When the button B4 is operated, the setting unit 12a ends the process.

[0064] Fig. 6 is a diagram illustrating the frame line LF. Fig. 6 shows the correspondence between the frame line LF, the projection surface SC, and the display panels 15b-1 and 15b-2 during execution of steps S20 and S30 when the aspect ratio of the content image is increased, for example, when the aspect ratio of the content image is changed from 16:10 to 16:9. For ease of explanation, Fig. 6 shows this correspondence in the display coordinate system of display panel 15b.

[0065] In step S20, the setting unit 12a projects the frame line LF onto the projection surface SC by controlling the operations of the image processing circuit 14 and the optical device 15. Fig. 6 shows a state in which the projection position of the frame line LF is misaligned with respect to the projection surface SC.

[0066] The aspect ratio of the frame line LF is an aspect ratio according to the second aspect ratio. That is, the aspect ratio of the frame line LF is closer to the second aspect ratio than the first aspect ratio. More specifically, the aspect ratio of the frame line LF is larger than the aspect ratio of the entire image GG shown in FIG. 3 above.

[0067] In step S30, the setting unit 12a executes the process of displaying a message ME that prompts the user to adjust at least one of the position and attitude of the projection device 10 and the optical system 15c so that the area surrounded by the frame line LF overlaps the projection surface SC. In the example shown in Fig. 6, the message ME reads, "Please overlap the area within the frame on the projection surface." Note that the content of the message ME is not limited to the example shown in Fig. 6 and may be arbitrary.

[0068] Adjusting the position of the projection device 10 involves adjusting the position of the projection device 10 relative to the projection surface SC. Adjusting the attitude of the projection device 10 involves adjusting the attitude of the projection device 10 relative to the projection surface SC. Adjusting the optical system 15c of the projection device 10 involves adjusting the magnification ratio of the optical system 15c, etc. By performing at least one of these adjustments, it is possible to maximize the overlap between the area enclosed by the frame line LF and the projection surface SC.

[0069] After such layout adjustment, if an operation indicating that the layout adjustment has been completed is performed on a UI image (not shown), the setting unit 12a determines that the layout adjustment has been completed (step S40: YES).

[0070] FIG. 7 is a diagram for explaining the first adjustment point Pa-1 to the sixth adjustment point Pa-6. FIG. 7 shows the correspondence between the first adjustment point Pa-1 to the sixth adjustment point Pa-6, the frame line LF, the projection surface SC, and the display panels 15b-1 and 15b-2 during execution of step S50. For ease of explanation, FIG. 7 shows the correspondence in the display coordinate system of the display panel 15b. In this specification, the first adjustment point Pa-1 to the sixth adjustment point Pa-6 may be referred to as the adjustment point Pa without distinction. Step S50

[0071] The first adjustment point Pa-1 is an adjustment point Pa for adjusting the position of the first corner C1-1 of the aforementioned projected image G1. The second adjustment point Pa-2 is an adjustment point Pa for adjusting the position of the second corner C2-1 of the aforementioned projected image G1. The third adjustment point Pa-3 is an adjustment point Pa for adjusting the position of the third corner C3-1 of the aforementioned projected image G1. The fourth adjustment point Pa-4 is an adjustment point Pa for adjusting the position of the fourth corner C4-1 of the aforementioned projected image G1. The fifth adjustment point Pa-5 is an adjustment point Pa for adjusting the position of the first corner C1-2 of the aforementioned projected image G2. The sixth adjustment point Pa-6 is an adjustment point Pa for adjusting the position of the third corner C3-2 of the aforementioned projected image G2.

[0072] The first adjustment point Pa-1, the second adjustment point Pa-2, the third adjustment point Pa-3, and the fourth adjustment point Pa-4 are projected onto the projection surface SC by the projection device 10-1, while the fifth adjustment point Pa-5 and the sixth adjustment point Pa-6 are projected onto the projection surface SC by the projection device 10-2.

[0073] The ratio (L2 / L1) of the distance L2 between the first adjustment point Pa-1 and the third adjustment point Pa-3 to the distance L1 between the first adjustment point Pa-1 and the second adjustment point Pa-2 on the projection surface SC is closer to the second aspect ratio than the first aspect ratio. This allows the first adjustment point Pa-1, the second adjustment point Pa-2, and the third adjustment point Pa-3 to be positioned on the projection surface SC so that the ratio (L2 / L1) approaches the aspect ratio of the content image. This makes it easier for the user to visually and intuitively understand the relationship between the first adjustment point Pa-1, the second adjustment point Pa-2, and the third adjustment point Pa-3 and the content image. As a result, the user's operational feel can be improved.

[0074] Here, the distance between the third adjustment point Pa-3 and the fourth adjustment point Pa-4 on the projection surface SC is equal to the distance L1. Similarly, the distance between the second adjustment point Pa-2 and the fifth adjustment point Pa-5 on the projection surface SC is equal to the distance L1. The distance between the fourth adjustment point Pa-4 and the sixth adjustment point Pa-6 on the projection surface SC is equal to the distance L1. The distance between the fifth adjustment point Pa-5 and the sixth adjustment point Pa-6 on the projection surface SC is equal to the distance L2. Therefore, because these adjustment points Pa are arranged to indicate the outline of the content image with the changed aspect ratio, the relationship between these adjustment points Pa and the content image can be easily understood visually and intuitively by the user.

[0075] In step S50, the multiple adjustment points Pa are arranged along the frame line LF based on the input information received in step S10. This makes it possible to optimize the arrangement of the multiple adjustment points Pa depending on the shape or arrangement of the projection surface SC, etc.

[0076] In the example shown in FIG. 7 , the first adjustment point Pa-1 is positioned over the corner of the four corners of the frame line LF that corresponds to the first corner C1-1. The second adjustment point Pa-2 is positioned over the midpoint of the side of the four sides of the frame line LF that corresponds to the second corner C2-1. The third adjustment point Pa-3 is positioned over the corner of the four corners of the frame line LF that corresponds to the third corner C3-1. The fourth adjustment point Pa-4 is positioned over the midpoint of the side of the four sides of the frame line LF that corresponds to the fourth corner C4-1. The fifth adjustment point Pa-5 is positioned over the corner of the four corners of the frame line LF that corresponds to the first corner C1-2. The sixth adjustment point Pa-6 is positioned over the corner of the four corners of the frame line LF that corresponds to the third corner C3-2.

[0077] In this way, by arranging the multiple adjustment points Pa so that they overlap the frame line LF, it is possible for the user to easily grasp the situation at the start of adjustment using the multiple adjustment points Pa. Note that the initial positions of the multiple adjustment points Pa are not limited to the example shown in Fig. 7, and may be any position in which the ratio (L2 / L1) is closer to the second aspect ratio than to the first aspect ratio.

[0078] In step S60, the setting unit 12a executes receiving a movement operation, which is an operation for moving the position of at least one adjustment point Pa among the plurality of adjustment points Pa on the projection surface SC. This movement operation is not particularly limited, but may be, for example, an operation using the operation device 16, an operation on the projection surface SC based on an image captured by the imaging device 17, or an operation on the terminal device 30.

[0079] Fig. 8 is a diagram for explaining the movement of adjustment point Pa. Fig. 8 shows an example of the correspondence relationships between first adjustment point Pa-1 to sixth adjustment point Pa-6, frame line LF, projection surface SC, and display panels 15b-1 and 15b-2 after the movement in step S70. Note that for ease of explanation, Fig. 8 shows these correspondence relationships in the display coordinate system of display panel 15b.

[0080] In the example shown in FIG. 8, all adjustment points Pa after movement in step S70 are positioned so as to overlap the outer edge of the projection surface SC. More specifically, the first adjustment point Pa-1 after movement in step S70 is positioned so as to overlap the upper left corner of the four corners of the outer edge of the projection surface SC. The second adjustment point Pa-2 is positioned so as to overlap the midpoint of the upper side of the four sides of the outer edge of the projection surface SC. The third adjustment point Pa-3 is positioned so as to overlap the lower left corner of the four corners of the outer edge of the projection surface SC. The fourth adjustment point Pa-4 is positioned so as to overlap the midpoint of the lower side of the four sides of the outer edge of the projection surface SC. The fifth adjustment point Pa-5 is positioned so as to overlap the upper right corner of the four corners of the outer edge of the projection surface SC. The sixth adjustment point Pa-6 is positioned so as to overlap the lower right corner of the four corners of the outer edge of the projection surface SC.

[0081] In this way, in step S70, the setting unit 12a executes the movement of the position of at least one adjustment point Pa inside the frame line LF on the projection surface SC in response to the movement operation in step S60. This allows the position of the adjustment point Pa to be adjusted by the movement operation by the user.

[0082] Here, in step S70, moving the position of at least one adjustment point Pa from inside to outside the frame line LF is not permitted regardless of the movement operation. In other words, each adjustment point Pa can only be moved within the frame line LF. This makes it easier for the user to understand the movement limits of the adjustment points Pa.

[0083] Fig. 9 is a diagram showing an example of display of confirmation images G1-A and G2-A for confirming adjustment using adjustment point Pa. Fig. 9 shows an example of the correspondence between confirmation images G1-A and G2-A, projection surface SC, and display panels 15b-1 and 15b-2 when step S90 is performed. Note that for ease of explanation, Fig. 9 shows this correspondence in the display coordinate system of display panel 15b.

[0084] Confirmation image G1-A is projected image G1 corrected using setting information D1. Confirmation image G2-A is projected image G2 corrected using setting information D1. In the example shown in Fig. 9, each of confirmation images G1-A and G2-A includes an indication of the center position and an indication of the degree of overlap of overlap region R. Note that the display contents of confirmation images G1-A and G2-A are not limited to the example shown in Fig. 9 and may be any image.

[0085] As described above, in the system 100, by arranging a plurality of adjustment points Pa so as to approximate the aspect ratio of the content image, it is possible to improve the operational feel for the user.

[0086] 3. Variations The above-described embodiments can be modified in various ways. Specific modifications that can be applied to the above-described embodiments are exemplified below. Two or more embodiments arbitrarily selected from the following examples can be combined as appropriate within the scope of not mutually contradictory.

[0087] 3-1. Variation 1 In the above-described embodiment, the projected image G1 and the projected image G2 are arranged horizontally, but the present invention is not limited to this. For example, the projected image G1 and the projected image G2 may be arranged vertically. That is, the first direction DR1 is not limited to the horizontal direction and may be, for example, the vertical direction. Furthermore, the first direction DR1 is not limited to the horizontal direction of the projected image G1 or the projected image G2 and may be, for example, the vertical direction of the projected image G1 or the projected image G2.

[0088] 3-2. Variation 2 In the above embodiment, an example in which two projection devices 10 are used is shown, but the present invention is not limited to this example, and the projection device 10-2 may be omitted. In this case, the projection of the projection image G2 is omitted.

[0089] 3-3. Variation 3 In the above-described embodiment, an example in which the number of adjustment points Pa is six is shown, but this is not limitative and any number is possible. For example, the number of adjustment points Pa corresponding to projection device 10-1 may be three or five or more, and the number of adjustment points Pa corresponding to projection device 10-2 may be three or more.

[0090] 3-4. Variation 4 In the above-described embodiment, a mode in which the frame line LF is used is exemplified, but the present invention is not limited to this mode, and the frame line LF may be used as needed or may be omitted.

[0091] 4. Notes A summary of this disclosure is provided below.

[0092] (Supplementary Note 1) A first aspect, which is a preferred example of the control method of the present disclosure, is a control method for controlling the driving of a projection device that projects a projection image including a first side and a second side intersecting the first side onto a projection surface, the control method including: receiving input of information for changing the aspect ratio of a content image from a first aspect ratio to a second aspect ratio; and displaying a first adjustment point, a second adjustment point, and a third adjustment point on the projection surface in an arrangement based on the information, the first adjustment point adjusting the position of a first corner including an intersection point of the first side and the second side in the projection image. the second adjustment point is an adjustment point for adjusting the position of a second corner including an end opposite to the intersection point of the first side in the projected image, the third adjustment point is an adjustment point for adjusting the position of a third corner including an end opposite to the intersection point of the second side in the projected image, and the arrangement based on the information is an arrangement in which the ratio of the distance between the first adjustment point and the third adjustment point to the distance between the first adjustment point and the second adjustment point on the projection surface is closer to the second aspect ratio than the first aspect ratio.

[0093] In the above aspect, the first adjustment point, the second adjustment point, and the third adjustment point can be positioned on the projection surface so that the ratio of the distance between the first adjustment point and the third adjustment point on the projection surface to the distance between the first adjustment point and the second adjustment point on the projection surface approaches the aspect ratio of the content image. This makes it easier for the user to visually and intuitively understand the relationship between the first adjustment point, the second adjustment point, and the third adjustment point and the content image. As a result, the user's operational feel can be improved.

[0094] (Supplementary Note 2) In a second aspect, which is a preferred example of the first aspect, the display includes displaying a frame line of an aspect ratio corresponding to the second aspect ratio, and displaying a message prompting the user to adjust at least one of the position, attitude, and optical system of the projection device so that the area enclosed by the frame line overlaps with the projection surface, and the arrangement based on the information is an arrangement along the frame line. In the above aspect, the arrangement of the first adjustment point, the second adjustment point, and the third adjustment point can be optimized depending on the shape or arrangement of the projection surface, etc.

[0095] (Supplementary Note 3) In the third aspect, which is a preferred example of the second aspect, the arrangement along the frame line is an arrangement in which the first adjustment point, the second adjustment point, and the third adjustment point are superimposed on the frame line. In the above aspect, it is possible to make it easier for the user to grasp the situation at the start of adjustment using the first adjustment point, the second adjustment point, and the third adjustment point.

[0096] (Supplementary Note 4) In a fourth aspect, which is a preferred example of the third aspect, the method includes receiving a movement operation that moves the position of at least one of the first adjustment point, the second adjustment point, and the third adjustment point on the projection surface, and moving the position of the at least one adjustment point inside the frame line on the projection surface in accordance with the movement operation. In the above aspect, the position of the adjustment point can be adjusted by the movement operation by the user.

[0097] (Supplementary Note 5) In the fifth aspect, which is a preferred example of the fourth aspect, moving the position of the at least one adjustment point includes not allowing the position of the at least one adjustment point to be moved from inside to outside the frame line without the movement operation. In the above aspect, the movement limits of the adjustment points are easy for the user to understand.

[0098] (Supplementary Note 6) A sixth aspect, which is a preferred example of the program of the present disclosure, is a program for controlling the driving of a projection device that projects a projection image including a first side and a second side intersecting the first side onto a projection surface, the program causing a computer to execute the following: accepting input of information for changing the aspect ratio of a content image from a first aspect ratio to a second aspect ratio; and displaying a first adjustment point, a second adjustment point, and a third adjustment point on a display surface in an arrangement based on the information; the first adjustment point being at the position of a first angle including an intersection point of the first side and the second side in the projection image. the second adjustment point is an adjustment point for adjusting the position of a second corner including an end of the first side opposite the intersection point in the projected image, the third adjustment point is an adjustment point for adjusting the position of a third corner including an end of the second side opposite the intersection point in the projected image, and the arrangement based on the information is an arrangement in which a ratio of a distance between the first adjustment point and the third adjustment point to a distance between the first adjustment point and the second adjustment point on the display surface is closer to the second aspect ratio than the first aspect ratio.

[0099] In the above aspect, the first adjustment point, the second adjustment point, and the third adjustment point can be positioned on the display surface so that the ratio of the distance between the first adjustment point and the third adjustment point on the display surface to the distance between the first adjustment point and the second adjustment point on the display surface approaches the aspect ratio of the content image. This makes it easier for the user to visually and intuitively understand the relationship between the first adjustment point, the second adjustment point, and the third adjustment point and the content image. As a result, the user's operational feel can be improved.

[0100] (Supplementary Note 7) A seventh aspect, which is a preferred example of the information processing device of the present disclosure, is an information processing device used in a projection device that projects a projection image including a first side and a second side intersecting the first side onto a projection surface, the information processing device including a processing device, the processing device receiving input of information for changing the aspect ratio of a content image from a first aspect ratio to a second aspect ratio, and displaying first adjustment points, second adjustment points, and third adjustment points on a display surface in an arrangement based on the information, the first adjustment points being at a first angle including an intersection of the first side and the second side in the projection image. the second adjustment point is an adjustment point for adjusting the position of a second corner including the end opposite the intersection of the first side in the projected image, and the third adjustment point is an adjustment point for adjusting the position of a third corner including the end opposite the intersection of the second side in the projected image, and the arrangement based on the information is an arrangement in which the ratio of the distance between the first adjustment point and the third adjustment point to the distance between the first adjustment point and the second adjustment point on the display surface is closer to the second aspect ratio than the first aspect ratio.

[0101] In the above aspect, the first adjustment point, the second adjustment point, and the third adjustment point can be positioned on the display surface so that the ratio of the distance between the first adjustment point and the third adjustment point on the display surface to the distance between the first adjustment point and the second adjustment point on the display surface approaches the aspect ratio of the content image. This makes it easier for the user to visually and intuitively understand the relationship between the first adjustment point, the second adjustment point, and the third adjustment point and the content image. As a result, the user's operational feel can be improved. [Explanation of symbols]

[0102] 10...projection device, 10-1...projection device, 10-2...projection device, 11...storage device, 12...processing device, 12a...setting unit, 13...communication device, 14...image processing circuit, 15...optical device, 15a...light source, 15b...display panel, 15b-1...display panel, 15b-2...display panel, 15c...optical system, 16...operation device, 17...imaging device, 30...terminal device, 100...system, B 1...Pull-down menu, B2...Button, B3...Button, B4...Button, C1-1...1st corner, C1-2...1st corner, C2-1...2nd corner, C2-2...2nd corner, C3-1...3rd corner, C3-2...3rd corner, C4-1...4th corner, C4-2...4th corner, D1...Setting information, DR1...1st direction, DR2...2nd direction, G1...Projected image, G1-A...Confirmation image, G2...Projected image, G2-A ...Confirmation image, GG...Full image, IMG1...Video data, IMG2...Video data, L1...Distance, L2...Distance, LF...Frame line, ME...Message, PR1...Program, Pa...Adjustment point, Pa-1...1st adjustment point, Pa-2...2nd adjustment point, Pa-3...3rd adjustment point, Pa-4...4th adjustment point, Pa-5...5th adjustment point, Pa-6...6th adjustment point, R...Superimposition area, S1-1...1st side , S1-2...first side, S2-1...second side, S2-2...second side, S3-1...third side, S3-2...third side, S4-1...fourth side, S4-2...fourth side, S10...step, S20...step, S30...step, S40...step, S50...step, S60...step, S70...step, S80...step, S90...step, SC...projection surface, UI...image, X...width.

Claims

1. 1. A control method for controlling driving of a projection device that projects a projection image including a first side and a second side intersecting the first side onto a projection surface, the method comprising: Accepting input of information for changing the aspect ratio of the content image from the first aspect ratio to the second aspect ratio; displaying a first adjustment point, a second adjustment point, and a third adjustment point on the projection surface in an arrangement based on the information; the first adjustment point is an adjustment point for adjusting the position of a first corner including an intersection point between the first side and the second side in the projected image, the second adjustment point is an adjustment point for adjusting the position of a second corner including an end of the first side opposite to the intersection point in the projected image, the third adjustment point is an adjustment point for adjusting the position of a third corner including an end of the second side opposite to the intersection point in the projected image, the arrangement based on the information is an arrangement in which a ratio of a distance between the first adjustment point and the third adjustment point to a distance between the first adjustment point and the second adjustment point on the projection surface is closer to the second aspect ratio than to the first aspect ratio; Control method.

2. displaying a frame line having an aspect ratio corresponding to the second aspect ratio; displaying a message prompting the user to adjust at least one of the position, attitude, and optical system of the projection device so that the area surrounded by the frame line overlaps the projection surface; The arrangement based on the information is an arrangement along the frame line. The control method according to claim 1 .

3. the arrangement along the frame line is an arrangement in which the first adjustment point, the second adjustment point, and the third adjustment point overlap the frame line; The control method according to claim 2 .

4. receiving a movement operation that is an operation for moving a position of at least one of the first adjustment point, the second adjustment point, and the third adjustment point on the projection surface; and moving a position of the at least one adjustment point inside the frame line on the projection surface in response to the movement operation. The control method according to claim 3 .

5. moving the position of the at least one adjustment point includes not allowing the position of the at least one adjustment point to be moved from inside to outside the frame line without the movement operation. The control method according to claim 4.

6. A program for controlling driving of a projection device that projects a projection image including a first side and a second side intersecting the first side onto a projection surface, the program comprising: Accepting input of information for changing the aspect ratio of the content image from the first aspect ratio to the second aspect ratio; displaying the first adjustment point, the second adjustment point, and the third adjustment point on a display surface in an arrangement based on the information; the first adjustment point is an adjustment point for adjusting the position of a first corner including an intersection point between the first side and the second side in the projected image, the second adjustment point is an adjustment point for adjusting the position of a second corner including an end of the first side opposite to the intersection point in the projected image, the third adjustment point is an adjustment point for adjusting the position of a third corner including an end of the second side opposite to the intersection point in the projected image, the arrangement based on the information is an arrangement in which a ratio of a distance between the first adjustment point and the third adjustment point to a distance between the first adjustment point and the second adjustment point on the display surface is closer to the second aspect ratio than to the first aspect ratio. program.

7. An information processing device used in a projection device that projects a projection image including a first side and a second side intersecting the first side onto a projection surface, a processing device; The processing device includes: Accepting input of information for changing the aspect ratio of the content image from the first aspect ratio to the second aspect ratio; displaying the first adjustment point, the second adjustment point, and the third adjustment point on the display surface in an arrangement based on the information; the first adjustment point is an adjustment point for adjusting the position of a first corner including an intersection point between the first side and the second side in the projected image, the second adjustment point is an adjustment point for adjusting the position of a second corner including an end of the first side opposite to the intersection point in the projected image, the third adjustment point is an adjustment point for adjusting the position of a third corner including an end of the second side opposite to the intersection point in the projected image, the arrangement based on the information is an arrangement in which a ratio of a distance between the first adjustment point and the third adjustment point to a distance between the first adjustment point and the second adjustment point on the display surface is closer to the second aspect ratio than to the first aspect ratio. Information processing device.

Images