Display method, display device and program

Abstract

To provide a display method that improves a user's convenience.SOLUTION: A second control section 250 of an information processing apparatus 200 executes receiving first operation for dividing a region of a pattern image 300 including a plurality of control points into a plurality of regions including a first region 310 and a second region 320, receiving second operation for changing a number of control points included in at least one of the first region 310 and the second region 320, receiving third operation including selection of one or more control points moving in positions in the pattern image 300 and designation of positions after the movement of the one or more control points in at least one region of the first region 310 and the second region 320, correcting a display image on the basis of positions in the pattern image 300 before the movement of the moving one or more control points and positions after the movement of the one or more control points in the pattern image 300, and causing a projector 100A to display the display image on a projection surface 30.SELECTED DRAWING: Figure 3

Description

[Technical field]

[0001] The present invention relates to a display method, a display device, and a program. [Background technology]

[0002] 2. Description of the Related Art Conventionally, there are known devices that have a function for correcting local distortion of an image displayed on a display device. For example, the projector disclosed in Patent Document 1 divides an image based on image information into a plurality of quadrilateral regions, and moves a selected selection control point among the vertices of each divided quadrilateral region based on an input operation. The projector also transforms a quadrilateral region that included the selected control point before the movement as one of its vertices into a shape that includes the moved selection control point as a vertex, and corrects the image information corresponding to the quadrilateral region before the transformation so that it fits into the transformed quadrilateral region. Furthermore, the projector can change the number of control points by changing the size of the quadrilateral region. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2013-78001 A Summary of the Invention [Problem to be solved by the invention]

[0004] However, while the more control points there are, the more complex the shape of the projection surface can be, the more work and effort the user has to do, which increases the burden on the user. For this reason, there is room for improvement in user convenience. [Means for solving the problem]

[0005] The display method of the present disclosure includes receiving a first operation for dividing a region of a first image including a plurality of control points into a plurality of regions including a first region and a second region, receiving a second operation for changing the number of control points included in at least one of the first region and the second region, selecting one or more control points in at least one of the first region and the second region to move a position in the first image, and Note 1 Position after moving the above control points Specify And, include Accepting a third operation and transferring the second image to the previous Note 1 The positions of the control points in the first image before and after the movement of the control points Note 1 The display method includes: performing correction based on the positions of the control points after the control points are moved; and displaying the second image on a display surface by a display device.

[0006] The display device of the present disclosure includes a display panel that displays an image on a display surface, and receives a first operation for dividing an area of ​​a first image including a plurality of control points into a plurality of areas including a first area and a second area, receives a second operation for changing the number of control points included in at least one of the first area and the second area, selects one or more control points that move a position in the first image in at least one of the first area and the second area, and selects a control point from the first area to the previous area. Note 1 Position after moving the above control points Specify And, include Accepting a third operation and transferring the second image to the previous Note 1 The positions of the control points in the first image before the movement and the Note 1 and one or more processors that perform correction based on the positions of the control points in the first image after they have been moved, and display the second image on the display surface using the display panel.

[0007] The program of the present disclosure includes the steps of: receiving a first operation for dividing an area of ​​a first image including a plurality of control points into a plurality of areas including a first area and a second area; receiving a second operation for changing the number of control points included in at least one of the first area and the second area; selecting one or more control points in at least one of the first area and the second area that move a position in the first image; Note 1 Position after moving the above control points Specify And, include Accepting a third operation and transferring the second image to the previous Note 1 The positions of the control points in the first image before the movement and the Note 1 The program executes the following operations: performing correction based on the positions of the control points in the first image after the control points have been moved; and displaying the second image on a display surface by a display device. [Brief description of the drawings]

[0008] [Figure 1] FIG. 1 is a diagram showing a system configuration of a display system. [Diagram 2] FIG. 1 is a block diagram showing the configuration of a projector according to a first embodiment. [Diagram 3] FIG. 1 is a block diagram showing a configuration of an information processing device. [Figure 4] FIG. 11 is a diagram showing an example of a pattern image displayed on an application screen. [Diagram 5] 11A to 11C are diagrams showing an area setting operation by a mouse operation. [Figure 6] FIG. 13 is a diagram showing a second area set by a mouse operation. [Figure 7] FIG. 13 is a diagram showing an example of setting an undesirable second region. [Figure 8] A diagram showing auxiliary lines displayed on an app screen. [Figure 9] FIG. 4 is a diagram showing a first area and a second area set by an area setting operation. [Figure 10] FIG. 4 is a diagram showing a first area and a second area set by an area setting operation. [Figure 11] FIG. 11 is a diagram showing a second region in which the number of control points has been changed. [Figure 12] FIG. 11 is a diagram showing a second region in which the number of control points has been changed. [Figure 13] 4 is a flowchart showing the operation of the information processing device. [Figure 14] 4 is a flowchart showing the operation of the information processing device. [Figure 15] FIG. 11 is a block diagram showing the configuration of a projector according to a second embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] [1. System configuration of the first embodiment] Hereinafter, an embodiment of the present invention will be described with reference to the accompanying drawings. FIG. 1 is a diagram showing a system configuration of a display system 1. As shown in FIG. The display system 1 includes a projector 100A, which is a display device, and an information processing device 200 that supplies a display image to be displayed on the projector 100A. The projector 100A and the information processing device 200 are connected by a cable 10. Although Fig. 1 shows a configuration in which the projector 100A and the information processing device 200 are connected by the cable 10, the projector 100A and the information processing device 200 may be connected wirelessly.

[0010] The projector 100A generates image light based on a display image supplied from the information processing device 200. The projector 100A enlarges and projects the generated image light onto the projection surface 30. As a result, the display image is displayed on the projection surface 30.

[0011] The information processing device 200 supplies a display image to the projector 100A and corrects local distortion of the display image to be displayed on the projector 100A. For example, a personal computer such as a desktop computer, a notebook computer, or a tablet computer is used as the information processing device 200. Also, a mobile terminal such as a smartphone may be used as the information processing device 200.

[0012] [2. Configuration of the projector according to the first embodiment] FIG. 2 is a block diagram showing the configuration of the projector 100A. The configuration of the projector 100A will be described with reference to FIG. The projector 100A includes a first communication interface 110, an image processing unit 120, a frame memory 125, an image projection unit 130, and a first control unit 150. Hereinafter, the interface is abbreviated to I / F. The image projection unit 130 corresponds to a display unit.

[0013] The first communication I / F 110 is connected to the information processing device 200 via a cable 10, and performs mutual data communication with the information processing device 200. The first communication I / F 110 is a wired interface having a connection terminal such as a Universal Serial Bus (USB) connector or an Ethernet connector, and an interface circuit. Ethernet is a registered trademark. The first communication I / F 110 may be a wireless communication interface.

[0014] A frame memory 125 is connected to the image processing unit 120. The frame memory 125 includes a plurality of banks. Each bank has a storage capacity capable of writing one frame of display image. The frame memory 125 is configured, for example, with a Synchronous Dynamic RAM (SDRAM). The image processing unit 120 expands the display image input from the first communication I / F 110 in the frame memory 125.

[0015] The image processing unit 120 performs image processing on the display image expanded in the frame memory 125. The image processing performed by the image processing unit 120 includes, for example, resolution conversion processing or resizing processing, distortion correction, shape correction processing, digital zoom processing, and adjustment of image color and brightness. The image processing unit 120 executes processing specified by the first control unit 150, and performs processing using parameters input from the first control unit 150 as necessary. Of course, the image processing unit 120 can also execute a combination of multiple image processes from the above.

[0016] The image processing unit 120 and the frame memory 125 are configured, for example, by an integrated circuit. The integrated circuit includes a large scale integration (LSI), an application specific integrated circuit (ASIC), a programmable logic device (PLD), a field programmable gate array (FPGA), a system on a chip (SoC), etc. An analog circuit may be included as part of the configuration of the integrated circuit, or the first control unit 150 may be configured in combination with an integrated circuit.

[0017] The image projection unit 130 includes a light source 131 , a light modulation device 133 , and an optical unit 135 .

[0018] The light source 131 includes a discharge type light source lamp such as an extra-high pressure mercury lamp or a metal halide lamp, or a solid-state light source such as a light-emitting diode or a semiconductor laser.

[0019] The light modulation device 133 includes a transmissive liquid crystal panel in which liquid crystal is sealed between a pair of transparent substrates as a light modulation element that modulates the light emitted from the light source 131. The liquid crystal panel is not shown. The liquid crystal panel includes a panel region consisting of a plurality of pixels arranged in a matrix. The light modulation device 133 applies a driving voltage corresponding to a display image input from the image processing unit 120 to each pixel in the panel region, and changes the light transmittance of each pixel to a transmittance corresponding to the display image. The light emitted from the light source 131 is modulated by transmitting through the liquid crystal panel, and image light corresponding to the display image is generated. The light modulation device 133 and the liquid crystal panel are an example of a display panel.

[0020] The light modulation element included in the light modulation device 133 is not limited to a transmissive liquid crystal panel, but may be, for example, a reflective liquid crystal panel or a DMD (Digital Micromirror Device). In this case, the DMD is an example of a display panel.

[0021] The optical unit 135 includes a projection lens (not shown) and projects the image light modulated by the light modulation device 133 onto the projection surface 30 in an enlarged manner. As a result, a display image that is an image corresponding to the image light is displayed on the projection surface 30.

[0022] The first control unit 150 is a computer device including a first storage unit 160 and a first processor 170.

[0023] The first storage unit 160 includes a RAM (Random Access Memory) and a ROM (Read Only Memory). The RAM is used for temporary storage of various data and the like, and the ROM stores a control program 165 that controls the operation of the projector 100A, various setting information, and the like.

[0024] The first processor 170 is an arithmetic processing device configured with a CPU (Central Processing Unit) and an MPU (Micro Processor Unit). The first processor 170 executes a control program to control each part of the projector 100A. The first processor 170 may be configured with a single processor, or may be configured with multiple processors. The first processor 170 may be configured with a part or all of the first storage unit 160, or with a system-on-a-chip (SoC) integrated with other circuits. The first processor 170 may be configured with a combination of a CPU that executes a program and a DSP (Digital Signal Processing) that executes a predetermined arithmetic processing. Furthermore, all of the functions of the first processor 170 may be implemented in hardware, or may be configured using a programmable device.

[0025] [3. Configuration of the information processing device of the first embodiment] FIG. 3 is a block diagram showing the configuration of the information processing device 200. As shown in FIG. The configuration of the information processing device 200 will be described with reference to FIG. The information processing device 200 includes a second communication I / F 210, a touch panel 220, an operation unit 230, and a second control unit 250. The second control unit 250 corresponds to a control unit.

[0026] The second communication I / F 210 is a wired interface having a connection terminal, such as a USB connector or an Ethernet connector, and an interface circuit, and performs mutual data communication with the projector 100A via the cable 10.

[0027] The touch panel 220 includes a display panel and a touch sensor. The display panel and the touch sensor are not shown in the drawings. The display panel may be, for example, a liquid crystal panel or an organic EL (Electro Luminescence) panel. The touch sensor detects a touch operation on the display panel. The touch sensor detects a position on the display panel that is touched by a pointing object such as an electronic pen or a user's finger. in Touch Controls of The touch sensor outputs to second control unit 250 an operation signal including coordinate information indicating the position on the display panel where the touch operation was detected.

[0028] The operation unit 230 includes input devices such as a mouse and a keyboard, and receives operations from a user. The operation unit 230 outputs to the second control unit 250 an operation signal corresponding to the received operation.

[0029] The second control unit 250 includes a second memory unit 260 and a second processor 270 .

[0030] The second storage unit 260 includes a RAM and a ROM. The second storage unit 260 may also include an auxiliary storage device such as a solid state drive (SSD) or a hard disk drive (HDD). The RAM is used for temporary storage of various data and the like, and the ROM stores control programs such as an OS (Operating System) 261 and an application program 263 that control the operation of the information processing device 200, as well as various setting information. The application program 263 is hereinafter referred to as an APP 263.

[0031] The second processor 270 is an arithmetic processing device configured with a CPU and an MPU. The second processor 270 executes the OS 261 and the APP 263 to control each unit of the information processing device 200. The second processor 270 may be configured with a single processor, or may be configured with multiple processors.

[0032] The second control unit 250 that executes the APP 263 has a point correction function that corrects local distortion of the display image that is displayed by the projector 100A. The second control unit 250 generates correction parameters for correcting the display image to be displayed by the projector 100A using the point correction function. The second control unit 250 corrects the display image using the generated correction parameters, and transmits the corrected display image to the projector 100A.

[0033] The operation of the second control unit 250 for generating the correction parameters will be described below. In order to generate the correction parameters, the second control unit 250 first causes the touch panel 220 of the information processing device 200 to display a pattern image 300 corresponding to the first image.

[0034] FIG. 4 is a diagram showing an example of a pattern image 300 displayed on the application screen 225. As shown in FIG. The application screen 225 is a screen that is displayed on the touch panel 220 when the second control unit 250 executes the APP 263. 4 is an axis parallel to the horizontal direction of touch panel 220, and the Y axis is an axis parallel to the vertical direction of touch panel 220. In FIG. Furthermore, pattern image 300 is a rectangular image, and J line segments are arranged at equal intervals in the X-axis direction of pattern image 300, and K line segments are arranged at equal intervals in the Y-axis direction of pattern image 300. J and K are any natural numbers.

[0035] A control point is set at each intersection of J line segments arranged in the X-axis direction of pattern image 300 and K line segments arranged in the Y-axis direction of pattern image 300. The control point is a point whose position on pattern image 300 can be changed by a touch operation performed by the user or an operation of operation unit 230 in point correction. Correction parameters are generated based on the position of the control point on pattern image 300 before the position is changed and the position of the control point on pattern image 300 after the position is changed.

[0036] When the second control unit 250 displays the pattern image 300 on the application screen 225, the second control unit 250 accepts an area setting operation for dividing the area of ​​the pattern image 300 into a plurality of areas including a first area 310 and a second area 320. The area setting operation corresponds to a first operation. In this embodiment, for the sake of simplicity, a case will be described in which the pattern image 300 is set by a region setting operation into two regions, a first region 310 and a second region 320. The region setting operation may be an operation of dividing the pattern image 300 into three or more regions including the first region 310, the second region 320, and a third region.

[0037] The user sets the first region 310 and the second region 320 based on the shape of the projection surface 30. Specifically, the user operates the touch panel 220 or the operation unit 230 of the information processing device 200 while visually checking the shape of the projection surface 30 to divide the pattern image 300 into the first region 310 and the second region 320. For example, assuming that the pattern image 300 is displayed on the projection surface 30 when a part of the projection surface 30 includes a complex shape such as a curved surface or a convex shape, the user divides the pattern image 300 into the first region 310 and the second region 320 so that the region of the projection surface 30 with the complex shape is included in the second region 320.

[0038] FIG. 5 is a diagram showing an area setting operation by using a mouse. FIG. 6 is a diagram showing a second area 320 that is set by operating the mouse. 5, the region setting operation may be, for example, an operation in which the user drags the mouse of operation unit 230 and moves cursor 230A so as to surround all of the control points included in the region that the user wishes to set in second region 320. Alternatively, the region setting operation may be, for example, an operation in which the user touches touch panel 220 with a finger and moves the touching finger so as to surround all of the control points included in the region that the user wishes to set in second region 320.

[0039] When a drag operation of the mouse is input, the second control unit 250 sets the second region 320 based on the input drag operation. The second control unit 250 detects the control points located at the top left, top right, bottom left, and bottom right among the control points included in the range surrounded by the drag operation. In Fig. 5, the control point located at the top left is indicated by a black circle 241, the control point located at the top right is indicated by a black circle 243, the control point located at the bottom left is indicated by a black circle 245, and the control point located at the bottom right is indicated by a black circle 247. The second control unit 250 sets a second area 320 having the positions of the detected control points located at the top left, top right, bottom left, and bottom right as four vertices.

[0040] FIG. 7 is a diagram showing an example of setting the undesirable second region 320. As shown in FIG. 7 shows an example in which a range enclosed by a mouse drag operation is set as second region 320. In this case, the vertices of second region 320 do not coincide with the control points of first region 310. Therefore, the control points located at the vertices of second region 320 do not coincide with the control points of first region 310. As shown in Fig. 6, when the vertices of the second region 320 coincide with the control points of the first region 310, the positions of the control points of the first region 310 and the second region 320 can be changed simultaneously. However, as shown in Fig. 7, when the positions of the vertices of the second region 320 deviate from the positions of the control points of the first region 310, the number of control points of the first region 310 that are hidden by the second region 320 and cannot be changed increases. Black squares 301, 302, 303, and 304 shown in Fig. 7 indicate the control points of the first region 310 that are hidden by the second region 320 and cannot be changed.

[0041] FIG. 8 is a diagram showing an auxiliary line 400 displayed on the application screen 225. As shown in FIG. The region setting operation may be a process in which an auxiliary line 400 parallel to the X-axis or Y-axis is displayed on the application screen 225, and the display position of the auxiliary line 400 is changed by a touch operation or a drag operation with a mouse. The dashed line in FIG. 8 corresponds to the auxiliary line 400. In addition, in FIG. 8, it is assumed that the region of the pattern image 300 on the left side of the auxiliary line 400 in the drawing view is set as the first region 310, and the region of the pattern image 300 on the right side of the auxiliary line 400 in the drawing view is set as the second region 320. The user operates the mouse of the operation unit 230 to place the cursor 230A on the auxiliary line 400, and moves the display position of the auxiliary line 400 to the right or left in the drawing view by a drag operation, as shown by the arrow in FIG. 8. As a result, the range of the first region 310 and the range of the second region 320 in the pattern image 300 are changed.

[0042] The movement of the display position of the auxiliary line 400 is not limited to this method, and may be moved, for example, by operating the keyboard of the operation unit 230. More specifically, the position of the auxiliary line 400 may be moved a predetermined amount in a corresponding direction by pressing a directional key on the keyboard that corresponds to a direction in which the user wants to move the auxiliary line 400. The predetermined amount is, for example, the distance between adjacent control points in the X-axis direction or the Y-axis direction.

[0043] Also, the display position of the auxiliary line 400 may be set by selecting any one of the control points by a touch operation or a mouse click operation. For example, the auxiliary line 400 may be set at a position passing through the selected control point. In this case, a region including the selected control point and all control points located to the right of the selected control point is set as the second region 320. A region including the selected control point and all control points located to the left of the selected control point may be set as the first region 310. Also, since the auxiliary line 400 cannot be set at a position that divides the first region 310 and the second region 320, a control point located at a vertex of the pattern image 300 may not be set as the display position of the auxiliary line 400.

[0044] 9 and 10 are diagrams showing a first region 310 and a second region 320 set by a region setting operation. In Fig. 9 and Fig. 10, the range of the pattern image 300 corresponding to the second region 320 is shown hatched. Fig. 9 shows an example in which a pattern image 300 is divided in a direction parallel to the Y axis into two regions, a first region 310 and a second region 320. In the example shown in Fig. 9, the region on the left side of the pattern image 300 is set as the first region 310, and the region on the right side of the pattern image 300 is set as the second region 320. 10 shows an example in which the pattern image 300 is divided into a first region 310 and a second region 320 such that the second region 320 is included within the first region 310. In FIG.

[0045] When the second control unit 250 divides the area of ​​the pattern image 300 into the first area 310 and the second area 320, the second control unit 250 changes the display manner of the first area 310 and the second area 320. For example, the second control unit 250 may detect a line included in the first region 310. minutes and , the line included in the second region 320 minutes and may be displayed in different colors. Furthermore, the second control unit 250 may display the entire area of ​​the first area 310 and the entire area of ​​the second area 320 in different colors.

[0046] In addition, a graphic such as a circle, polygon, star, or the like may be placed at the position of each control point included in the pattern image 300, and at least one of the shape, color, or size of this graphic may be changed between the first region 310 and the second region 320.

[0047] Next, the second control unit 250 accepts an operation to change the number of control points. This operation to change the number of control points included in at least one of the first region 310 and the second region 320. The operation to change the number corresponds to a second operation. First, the second control unit 250 accepts an area selection operation for selecting either the first area 310 or the second area 320. When either the first area 310 or the second area 320 is selected, the second control unit 250 displays an operation menu for changing the number of control points included in the selected first area 310 or second area 320. The operation menu may display, for example, an input field for inputting the number of control points of the selected first area 310 or second area 320. The user inputs the number of control points in the X-axis direction and the number of control points in the Y-axis direction into the number input field by a touch operation or a keyboard or mouse operation. The second control unit 250 may display a list of preset numbers of control points in the X-axis direction and the Y-axis direction as an operation menu. The user selects one from the list of numbers of control points displayed in the operation menu.

[0048] 11 and 12 are diagrams showing the second region 320 after the number of control points has been changed. Fig. 11 shows a state after changing the number of control points in the second region 320 of the pattern image 300 shown in Fig. 9. More specifically, Fig. 11 shows an example in which the number of control points in the Y-axis direction in the second region 320 is increased compared to the number of control points in the Y-axis direction in the first region 310. The first region 310 contacts the second region 320 at a right side 311 of the first region 310 as viewed in the drawing. That is, the right side 311 is the boundary line with the second region 320. The right side 311 of the first region 310 corresponds to the first side. As viewed in the drawing, the second region 320 contacts the first region 310 at a left side 321 of the second region 320. That is, the left side 321 is the boundary line with the first region 310. The left side 321 of the second region 320 corresponds to the second side. The number of control points on the right side 311 of the first region 310 is 12. The number of control points on the left side 321 of the second region 320 is 23.

[0049] When an operation to change the number of control points is input, the second control unit 250 counts the number of control points on the side where the first area 310 and the second area 320 meet, and determines whether the relationship in equation (1) below is satisfied. N = TM-1 (1)

[0050] The variable N in the formula (1) indicates the number of control points on the left side 321, which is the side of the second region 320 that is in contact with the first region 310. The variable M in the formula (1) indicates the number of control points on the right side 311 , which is the side of the first region 310 that contacts the second region 320 . T in the formula (1) is an arbitrary natural number. 11, the number of control points on right side 311 of first region 310 is 12, and the number of control points on left side 321 of second region 320 is 23. Therefore, the value of T is 2.

[0051] The second control unit 250 accepts an operation to change the number of control points when the number of control points on the right side 311 of the first region 310 and the number of control points on the left side 321 of the second region 320 satisfy the above formula (1). Moreover, the second control unit 250 does not accept an operation to change the number of control points when the number of control points on the right side 311 of the first region 310 and the number of control points on the left side 321 of the second region 320 do not satisfy the above formula (1). In other words, the number of control points in the second region 320 is not changed.

[0052] FIG. 11 shows a case where the number of control points in the second region 320 is increased, but the operation of changing the number of control points may also be an operation of decreasing the number of control points in the second region 320 below the number of control points in the first region 310. In this case, the second control unit 250 determines whether the number of control points on the right side 311 of the first region 310 and the number of control points on the left side 321 of the second region 320 satisfy the relationship of formula (2). M = TN-1 (2)

[0053] The second control unit 250 accepts an operation to change the number of control points when the number of control points on the right side 311 of the first region 310 and the number of control points on the left side 321 of the second region 320 satisfy the above formula (2). Moreover, the second control unit 250 does not accept an operation to change the number of control points when the number of control points on the right side 311 of the first region 310 and the number of control points on the left side 321 of the second region 320 do not satisfy the above formula (2).

[0054] Also, FIG. 11 shows an example in which the pattern image 300 is divided into the first region 310 and the second region 320 by a line segment parallel to the Y-axis, but the pattern image 300 may also be divided into the first region 310 and the second region 320 by a line segment parallel to the X-axis.

[0055] In addition, in the example shown in Figure 11, a case is illustrated in which the number of control points in the second area 320 is changed, but the operation of changing the number may also be an operation of increasing or decreasing the number of control points in the first area 310. When an operation to increase the number of control points in the first area 310 is input as an operation to change the number of control points, the second control unit 250 determines whether the number of control points on the right side 311 of the first area 310 and the number of control points on the left side 321 of the second area 320 satisfy the above formula (2). In addition, when an operation to decrease the number of control points in the first region 310 is input as an operation to change the number of control points, the second control unit 250 determines whether the number of control points on the right side 311 of the first region 310 and the number of control points on the left side 321 of the second region 320 satisfy the above formula (1).

[0056] Fig. 12 shows a state after changing the number of control points of the second region 320 of the pattern image 300 shown in Fig. 10. Specifically, Fig. 12 shows an example in which the number of control points in the X-axis direction of the second region 320 included in the first region 310 is changed. In the example shown in FIG. 12, the boundary between first region 310 and second region 320 is line segment 313 of first region 310 and upper side 323 of second region 320. The number of control points on the line segment 313 of the first region 310 is seven. The number of control points on the top side 323 of the second region 320 is thirteen. Even if the second area 320 is included in the first area 310, if the relationship of the above formula (1) or (2) is not satisfied, the second control unit 250 does not accept the operation to change the input number. In the example shown in FIG. 12, 13=2×7−1 satisfies the relationship of formula (1).

[0057] In addition, the second control unit 250 may cause the alarm unit to perform an alarm operation if the number of control points in the first area 310 and the second area 320 after the number change operation is input does not satisfy the relationship of the above-mentioned formula (1) or formula (2). For example, the touch panel 220 may be used as a notification unit, and the second control unit 250 may cause the touch panel 220 to display a message indicating that the operation to change the number is not accepted. Department The second control unit 250 may output a voice from a speaker to inform the user that the operation to change the number is not accepted.

[0058] In addition, even if an operation to change the number of control points in both the first area 310 and the second area 320 is input, the second control unit 250 will not accept the number change operation if the relationship in the above formula (1) or formula (2) is not satisfied. In this case, when an operation to change the number of control points in the first area 310 and an operation to change the number of control points in the second area 320 are input and then a confirmation operation is received, the second control unit 250 determines whether the relationship of the above formula (1) or (2) is satisfied.

[0059] When the operation to change the number of control points in at least one of the first area 310 and the second area 320 is received, the second control unit 250 then receives an operation to select a control point. The control point selection operation includes selecting a control point to be moved on the pattern image 300 in at least one of the first region 310 and the second region 320, and changing the position of the selected control point after the movement. Specify And, include Includes operations. An operation including the selection of a control point and the specification of a position of the control point after it has been moved corresponds to a third operation. The user selects a control point whose position is to be changed according to the shape of the projection surface 30, such as a curved surface or a convex shape, by touch operation or mouse operation. For example, the user touches a control point whose position the user wishes to move. Next, the user moves the control point to a position to which the user wishes to move the control point without removing the touching finger from the touch panel 220. When the user moves the finger to a position to which the user wishes to move the control point, the user removes the finger that touched the touch panel 220 from the touch panel 220. The same applies to the operation of a mouse. When the user's finger is released from the touch panel 220, the second control unit 250 stores the coordinates of the control point before the movement and the coordinates of the control point after the movement in the second storage unit 260. These coordinates are in a coordinate system set in the pattern image 300, and indicate a position on the pattern image 300.

[0060] The user performs a control point selection operation on all control points whose positions on pattern image 300 the user wishes to move. When the user inputs a control point selection operation on all control points whose positions on pattern image 300 the user wishes to move, the user inputs an instruction operation to execute point correction. For example, a button corresponding to the instruction operation for point correction is displayed on application screen 225. When the user presses this button, the instruction operation for point correction is input.

[0061] Control points choice The control point selected by an operation is hereinafter referred to as a selected control point. When a point correction instruction operation is input, the second control unit 250 generates correction parameters based on the coordinates of the selected control point before and after the movement. The second control unit 250 generates first correction parameters based on the coordinates of the selected control point included in the first area 310 before and after the movement. The second control unit 250 also generates second correction parameters based on the coordinates of the selected control point included in the second area 320 before and after the movement.

[0062] Next, the second control unit 250 divides the area of ​​a display image, which is an image to be displayed by the projector 100A. The display image corresponds to a second image. The second control unit 250 divides the display image into a third area and a fourth area based on the settings of the first area 310 and the second area 320 in the pattern image 300. For example, when the size of the pattern image 300 and the display image are the same, the second control unit 250 divides the display image using the same settings as the settings of the first region 310 and the second region 320 into which the pattern image 300 is divided, to generate the third region and the fourth region. When the pattern image 300 and the display image are similar in size, the display image is divided to generate a third region and a fourth region based on the settings of a first region 310 and a second region 320 into which the pattern image 300 is divided and the similarity ratio between the pattern image 300 and the display image.

[0063] Next, the second control unit 250 corrects the third region using the first correction parameter, and the second control unit 250 corrects the fourth region using the second correction parameter. Next, the second control unit 250 synthesizes the corrected third region and the corrected fourth region to generate a display image.

[0064] When the second control unit 250 generates the display image, it transmits the generated display image to the projector 100A. Table Generates image light based on the displayed image The generated image light is projected onto the projection surface 30. As a result, a display image corrected using the first and second correction parameters is displayed on the projection surface 30.

[0065] [4. Operation of the Information Processing Device of the First Embodiment] 13 and 14 are flowcharts showing the operation of the information processing device 200. The operation of the information processing device 200 will be described with reference to the flowcharts shown in FIGS. When the second control unit 250 receives an operation to select the APP 263 through the touch panel 220 or the operation unit 230, it executes the APP 263 (step S1) and causes the touch panel 220 to display the application screen 225. Furthermore, when point correction is selected by a menu operation on the application screen 225, the second control unit 250 causes the application screen 225 to display a pattern image 300 (step S2).

[0066] Next, the second control unit 250 judges whether or not a region setting operation for dividing the pattern image 300 into a plurality of regions has been received (step S3). If the region setting operation has not been received (step S3 / NO), the second control unit 250 proceeds to the judgment of step S13 shown in FIG.

[0067] When the second control unit 250 receives an operation for setting an area (step S3 / YES), the second control unit 250 divides the pattern image 300 into a first area 310 and a second area 320 in accordance with the received operation (step S4). Next, the second control unit 250 changes the display mode of the first area 310 and the second area 320. The second control unit 250 changes the display color of the second area 320 or the control content included in the second area 320. Points , the control point is displayed in a color different from the display color of the first region 310 or the display color of the control points included in the first region 310 (step S5).

[0068] Next, the second control unit 250 determines whether or not an area selection operation has been received (step S6). That is, the second control unit 250 determines whether or not an operation to select either the first area 310 or the second area 320 has been received. If the second control unit 250 has not received an area selection operation (step S6 / NO), the process proceeds to the determination of step S13 shown in FIG.

[0069] When the second control unit 250 accepts the area selection operation (step S6 / YES), it displays on the application screen 225 an operation menu that allows the number of control points of the first area 310 or the second area 320 selected by this area selection operation to be changed (step S7).

[0070] Next, the second control unit 250 judges whether or not an operation to change the number has been accepted from the operation menu displayed in step S7 (step S8). The second control unit 250 judges whether or not an operation to change the number of control points included in the first area 310 or the second area 320 selected in step S6 has been accepted. For example, if a back button or the like displayed on the application screen 225 is pressed and an operation to change the number of control points has not been accepted (step S8 / NO), the second control unit 250 returns to the judgment of step S6.

[0071] When the second control unit 250 receives the operation to change the number (step S8 / YES), it then judges whether or not the confirmation operation has been received (step S9). For example, when the back button or the like displayed on the application screen 225 is pressed and the confirmation operation has not been received (step S9 / NO), the second control unit 250 returns to the judgment of step S6.

[0072] Furthermore, when the second control unit 250 receives the confirmation operation (step S9 / YES), it determines whether or not the relationship of the above-mentioned formula (1) or (2) is satisfied. For example, assume that the area of ​​the pattern image 300 is divided into a first area 310 and a second area 320 shown in Fig. 11, and the number of control points of the second area 320 is changed. In this case, the second control unit 250 identifies each side that is the boundary between the first area 310 and the second area 320, and counts the number of control points on each identified side. 11, the side that is the boundary of the first region 310 is the right side 311 in the drawing, and the side that is the boundary of the second region 320 is the left side 321 in the drawing. The number of control points on the right side 311 is 12, and the number of control points on the left side 321 is 23. Therefore, the second control unit 250 determines that the number of control points of the second region 320 after the change satisfies the relationship of the above-mentioned formula (1) (step S10 / YES), permits the change in the number of control points of the second region 320, and changes the number of control points of the second region 320 (step S12).

[0073] Furthermore, if the number of control points of the second region 320 after the change does not satisfy the relationship of the above-mentioned formula (1) or (2) (step S10 / NO), the second control unit 250 does not permit the change in the number of control points of the second region 320. In other words, the second control unit 250 does not accept the change in the number of control points of the second region 320 (step S11), and returns to the judgment of step S6.

[0074] The operation of the information processing device 200 will be further described with reference to the flowchart shown in FIG. Next, the second control unit 250 determines whether or not a selection operation of a control point has been received (step S13). The second control unit 250 selects a control point whose position on the pattern image 300 is to be moved, and determines the position of the selected control point after the movement. of designation and If the selection operation of the control point is not received (step S13 / NO), the second control unit 250 determines whether an end operation for ending the APP 263 is received by the touch panel 220 or the operation unit 230 (step S14).

[0075] When the second control unit 250 receives an end operation for ending the APP 263 (step S14 / YES), the second control unit 250 ends the APP 263 and ends this processing flow. Moreover, when the second control unit 250 has not received an end operation for ending the APP 263 (step S14 / NO), the second control unit 250 returns to the determination in step S3 and determines whether or not an area setting operation has been received (step S3).

[0076] When the second control unit 250 receives a selection operation of a control point (step S13 / YES), it changes the position of the control point in the pattern image 300 that has been changed by the selection operation of this control point (step S15). Next, the second control unit 250 judges whether or not an instruction operation to instruct execution of point correction has been received (step S16). If the second control unit 250 has not received an instruction operation to instruct execution of point correction (step S16 / NO), the process returns to the judgment of step S13.

[0077] Furthermore, when the second control unit 250 receives an instruction operation to perform point correction (step S16 / YES), it generates correction parameters based on the positions of the control points in the pattern image 300 before the change and the positions of the control points in the pattern image 300 after the change. Here, when the pattern image 300 is divided into the first region 310 and the second region 320 in step S4, the second control unit 250 generates a first correction parameter based on the pre-movement and post-movement positions of the control points included in the first region 310. The second control unit 250 also generates a second correction parameter based on the pre-movement and post-movement positions of the control points included in the second region 320.

[0078] Next, the second control unit 250 determines whether or not a plurality of correction parameters have been generated in step S17 (step S18). That is, the second control unit 250 determines whether or not a first correction parameter and a second correction parameter have been generated.

[0079] If multiple correction parameters have not been generated in step S17 (step S18 / NO), the second control unit 250 corrects the display image using the correction parameters generated in step S17 (step S19). The second control unit 250 transmits the corrected display image to the projector 100A (step S20), and causes the projector 100A to display the display image. After that, the second control unit 250 returns to the determination in step S3.

[0080] Furthermore, when a plurality of correction parameters are generated in step S17 (step S18 / YES), the second control unit 250 divides the display image into a third region and a fourth region (step S21). The second control unit 250 divides the display image into the third region and the fourth region based on the settings of the first region 310 and the second region 320 in the pattern image 300.

[0081] Next, the second control unit 250 corrects the third region using the first correction parameter (step S22), and the second control unit 250 corrects the fourth region using the second correction parameter (step S23).

[0082] Next, the second control unit 250 synthesizes the corrected third and fourth regions to generate a display image (step S24). Table The second control unit 250 then transmits the display image to the projector 100A (step S25), and causes the projector 100A to display the display image. After that, the second control unit 250 returns to the determination in step S3.

[0083] [5. Configuration of the projector according to the second embodiment] In the first embodiment described above, the information processing device 200 displays a pattern image 300, accepts an operation to divide the pattern image 300 into a plurality of regions and an operation to change the position of a control point, and generates correction parameters based on the positions of the control points before and after the change. In the second embodiment, the processing performed by the information processing device 200 is executed by the projector 100B.

[0084] FIG. 15 is a block diagram showing the configuration of a projector 100B according to the second embodiment. The configuration of the projector 100B will be described with reference to Fig. 15. Note that a description of the same configuration as the projector 100A shown in Fig. 2 will be omitted. The projector 100B includes a transmission section 180 and an imaging section 190. Furthermore, the projector 100B detects the pointed position on the projection surface 30 pointed to by the electronic pen 5 from the captured image captured by the imaging section 190.

[0085] The transmitter 180 includes a light source such as an LED (Light-Emitting Diode) and a control device that controls turning the light source on and off. The control device can be configured with, for example, an ASIC or an FPGA. The light source and the control device are not shown in the drawings. The transmission unit 180 outputs a first signal light 181 which is a signal for synchronizing the light emission timing of the electronic pen 5 with the imaging timing of the imaging unit 190. The first signal light 181 is a near-infrared light signal which can be received by the electronic pen 5. The transmission unit 180 periodically transmits the first signal light 181 while the projector 100B is running.

[0086] The first signal light 181 is a control signal instructing the timing to cause the electronic pen 5 to transmit the second signal light 183. The second signal light 183 is near-infrared light having a predetermined emission pattern. The electronic pen 5 emits the second signal light 183, for example, in synchronization with the timing of receiving the first signal light 181. The projector 100B causes the imaging unit 190 to capture an image in accordance with the timing at which the electronic pen 5 emits the second signal light 183.

[0087] The imaging unit 190 is a camera equipped with an imaging element (not shown), such as a CCD (Charge Coupled Device) sensor or a CMOS (Complementary Metal Oxide Semiconductor) sensor. The imaging unit 190 has an infrared transmission filter that absorbs visible light and transmits infrared light, and captures an image of infrared light emitted from the electronic pen 5 through the infrared transmission filter. The imaging unit 190 repeats capturing images of the projection surface 30 under the control of the first control unit 150, and sequentially outputs the captured images, which are the captured results, to the first control unit 150.

[0088] The first control unit 150 detects infrared light emitted by the electronic pen 5 from the captured image input from the imaging unit 190. The first control unit 150 considers an image of infrared light contained in the captured image, which has a brightness equal to or greater than a predetermined threshold and a size within a predetermined range, as light emitted by the electronic pen 5. The first control unit 150 detects the position of the projection surface 30 indicated by the electronic pen 5 based on the position of the light emitted by the electronic pen 5 in the captured image. The first control unit 150 also determines the light emission sequence of the electronic pen 5 based on the captured images acquired multiple times, and detects whether the projection surface 30 is touched.

[0089] The electronic pen 5 repeatedly blinks in a predetermined light emission sequence while the electronic pen 5 is operating. The electronic pen 5 also changes the light emission sequence depending on whether or not there is a touch on the projection surface 30. Therefore, the projector 100B can identify whether or not there is a touch by the electronic pen 5 based on the light emission sequence of the light-emitting unit.

[0090] The first control unit 150 detects the position on the projection surface 30 designated by the electronic pen 5, and detects the operation input by the electronic pen 5. The operations detected by the first control unit 150 include the area setting operation in step S3 shown in the flowchart of FIG. 13, the area selection operation in step S6, the number change operation in step S8, the control point selection operation in step S13, and the point correction operation in step S16. instructions Although the configuration in which operations are input using the electronic pen 5 has been exemplified, the present invention is not limited to this, and a configuration in which operations are input using a remote control (not shown) may also be used.

[0091] The first control unit 150 executes processing according to the flowcharts shown in Fig. 13 and Fig. 14 to generate a first correction parameter and a second correction parameter. When the first control unit 150 receives a display image from the information processing device 200, the first control unit 150 divides the received display image into a third region and a fourth region. The first control unit 150 corrects the divided third region using the first correction parameter, and corrects the divided fourth region using the second correction parameter.

[0092] The first control unit 150 generates a display image by combining the corrected third region and fourth region. The first control unit 150 generates image light based on the generated display image using the image projection unit 130, and projects the generated image light onto the projection surface 30. As a result, the display image that has been subjected to point correction is displayed on the projection surface 30.

[0093] 6. Summary of this Disclosure The following is a summary of this disclosure. (Appendix 1) Receiving a first operation for dividing a region of a first image including a plurality of control points into a plurality of regions including a first region and a second region; receiving a second operation for changing the number of control points included in at least one of the first region and the second region; selecting one or more control points in at least one of the first region and the second region, the control points being moved in position in the first image; Note 1 Position after moving the above control points Specify And, include Accepting a third operation and transferring the second image to the previous Note 1 The positions of the control points in the first image before and after the movement of the control points Note 1 performing correction based on the positions of the control points after the control points are moved; and displaying the second image on a display surface by a display device.

[0094] This changes the number of control points included in at least one of the first and second regions. Therefore, when correcting the second image displayed on the display surface by the display device by changing the positions of the control points included in the first image, it is possible to set the optimal number of control points according to the shape of the display surface. This improves user convenience.

[0095] (Appendix 2) 2. The display method according to claim 1, further comprising displaying the first area and the second area in different display modes.

[0096] This allows the first area and the second area to be displayed in different display modes, making it easier for a user viewing the first image to distinguish between the first area and the second area.

[0097] (Appendix 3) 3. The display method according to claim 1 or 2, further comprising displaying a plurality of control points included in the first region and a plurality of control points included in the second region in different display modes.

[0098] As a result, the multiple control points included in the first region and the multiple control points included in the second region are displayed in different display modes, making it easier for a user viewing the first image to distinguish between the first region and the second region.

[0099] (Appendix 4) A display method according to any one of appendices 1 to 3, wherein accepting the first operation includes accepting an operation to divide an area of ​​the first image into the second area and the first area, which is an area of ​​the first image other than the second area.

[0100] This divides the area of ​​the first image into two areas, a first area and a second area, and thus when correcting the second image displayed on the display surface by the display device by changing the positions of the control points included in the first image, it is possible to divide the first image into the first area and the second area according to the shape of the display surface.

[0101] (Appendix 5) The display method of claim 4, wherein accepting the first operation includes accepting a selection of a control point of the second area from the plurality of control points, setting the second area in the first image based on an arrangement of the control points of the second area in the first image, and setting the first area in the first image based on an arrangement of control points other than the control point of the second area in the first image.

[0102] This allows the first control point to be selected from among multiple control points. 2 The first region and the second region are set by selecting the control points of the regions. Therefore, the first region and the second region can be set by a single operation of selecting the control point of the second region. Determine This makes it possible to simplify the operation.

[0103] (Appendix 6) The display method according to Appendix 4 or 5, wherein correcting the second image includes generating first correction parameters based on the one or more moving control points included in the first area and positions after movement of the one or more moving control points included in the first area, generating second correction parameters based on the one or more moving control points included in the second area and positions after movement of the one or more moving control points included in the second area, dividing the second image into a third area and a fourth area based on the first area and the second area in the first image, correcting the third area using the first correction parameter, correcting the fourth area using the second correction parameter, and combining the third area and the fourth area.

[0104] This makes it possible to generate correction parameters for each divided region of the first image, thereby improving the accuracy of correction of the second image.

[0105] (Appendix 7) The display method described in any one of Appendix 1 to 6, wherein the first area and the second area are adjacent to each other at a first side of the first area and a second side of the second area, and accepting the second operation includes accepting an operation to change the number of control points of the second area so as to satisfy the relationship of the following formula (1), where the number of control points of the second area changed by the second operation on the second side is N, the number of control points on the first side of the first area is M, and T is any natural number. N=TM-1 or M=TN-1(1)

[0106] This makes it possible to eliminate the misalignment between the control point on the first side of the first region and the control point on the second side of the second region at the boundary between the first region and the second region. This makes it possible to change the position of the control point on the first side of the first region when changing the position of the control point on the second side of the second region. Also, when changing the position of the control point on the first side of the first region, the position of the control point on the second side of the second region is also changed.

[0107] (Appendix 8) The display method described in any one of Appendix 1 to 6, wherein the second area is contained within the first area, and the first area and the second area are adjacent to each other at a line segment of the first area and a second side of the second area, and accepting the second operation includes accepting an operation to change the number of control points of the second area so as to satisfy the relationship of the following formula (1), where the number of control points of the second area changed by the second operation on the second side is N, the number of control points on the line segment of the first area is M, and T is any natural number. N=TM-1 or M=TN-1(1)

[0108] This makes it possible to eliminate the misalignment between the control points on the line segment of the first region and the control points on the second side of the second region at the boundary between the first region and the second region. This allows the positions of the control points on the line segment of the first region to be changed when the positions of the control points on the second side of the second region are changed as well. Also, when the positions of the control points on the line segment of the first region are changed as well, the positions of the control points on the second side of the second region are changed as well.

[0109] (Appendix 9) The display method according to claim 7 or 8, wherein accepting the second operation includes not accepting an operation that does not satisfy the relationship of formula (1) as the second operation.

[0110] This makes it possible to not accept, as the second operation, an operation in which at least a part of the control points on the second side of the second region do not match with a control point on the first side of the first region. Also, it is possible to not accept, as the second operation, an operation in which at least a part of the control points on the first side of the first region do not match with a control point on the second side of the second region.

[0111] (Appendix 10) 9. The display method according to claim 7, wherein accepting the second operation includes performing a notification action when an operation that does not satisfy the relationship of formula (1) is input.

[0112] This allows the notification unit to notify an operation in which at least a part of a control point on the second side of the second region does not match a control point on the first side of the first region. Also, the notification unit can notify an operation in which at least a part of a control point on the first side of the first region does not match a control point on the second side of the second region.

[0113] A display panel for displaying an image on a display surface, receiving a first operation for dividing an area of ​​a first image including a plurality of control points into a plurality of areas including a first area and a second area, receiving a second operation for changing the number of control points included in at least one of the first area and the second area, selecting one or more control points in at least one of the first area and the second area to move a position in the first image, and Note 1 Position after moving the above control points Specify And, include Accepting a third operation and transferring the second image to the previous Note 1 The positions of the control points in the first image before the movement and the Note 1 and one or more processors that perform correction based on the positions of the control points in the first image after the control points are moved, and display the second image on the display surface by the display panel.

[0114] This changes the number of control points included in at least one of the first and second regions. Therefore, when correcting the second image displayed on the display surface by the display device by changing the positions of the control points included in the first image, it is possible to set the optimal number of control points according to the shape of the display surface. This improves user convenience.

[0115] The method includes the steps of: receiving a first operation for dividing an area of ​​a first image including a plurality of control points into a plurality of areas including a first area and a second area; receiving a second operation for changing the number of control points included in at least one of the first area and the second area; selecting one or more control points in at least one of the first area and the second area that move a position in the first image; Note 1Position after moving the above control points Specify And, include Accepting a third operation and transferring the second image to the previous Note 1 The positions of the control points in the first image before the movement and the Note 1 A program that executes correction based on the positions of the control points in the first image after the control points are moved, and displays the second image on a display surface by a display device.

[0116] This changes the number of control points included in at least one of the first and second regions. Therefore, when correcting the second image displayed on the display surface by the display device by changing the positions of the control points included in the first image, it is possible to set the optimal number of control points according to the shape of the display surface. This improves user convenience.

[0117] 7. Other embodiments The above-described embodiment is a preferred embodiment of the present invention, however, the present invention is not limited to the above-described embodiment and various modifications are possible without departing from the spirit of the present invention. For example, in the above-described first and second embodiments, a method of dividing the area of ​​the pattern image 300 so that the first area 310 and the second area 320 have a rectangular shape has been described, but the shapes of the first area 310 and the second area 320 are not limited to a rectangle. For example, they can be set to any shape, such as a circle or a polygon. 4 to 12 show the pattern image 300 in which a plurality of control points are arranged in a grid pattern, but the arrangement of the plurality of control points does not have to be in a grid pattern. For example, the intervals between the control points in the first region 310 or the second region 320 may be different.

[0118] Further, each functional unit of the information processing device 200 shown in FIG. 3 indicates a functional configuration, and the specific implementation form is not particularly limited. In other words, it is not necessarily necessary to implement hardware corresponding to each functional unit individually, and it is of course possible to implement a configuration in which one processor executes a program to realize the functions of multiple functional units. Furthermore, some of the functions realized by software in the above embodiment may be realized by hardware, and some of the functions realized by hardware may be realized by software. In addition, the specific detailed configurations of other units of the projector can also be arbitrarily changed within the scope of the present invention.

[0119] Moreover, each functional unit of the projectors 100A and 100B shown in FIG. 2 and FIG. 15 indicates a functional configuration, and the specific implementation form is not particularly limited. In other words, it is not necessarily necessary to implement hardware corresponding to each functional unit individually, and it is of course possible to configure the configuration so that one processor executes a program to realize the functions of multiple functional units. Also, some of the functions realized by software in the above embodiment may be realized by hardware, and some of the functions realized by hardware may be realized by software. In addition, the specific detailed configuration of each other unit of the projector can also be changed arbitrarily within the scope of the present invention.

[0120] 13 and 14 are divided according to the main processing contents in order to facilitate understanding of the processing of the information processing device 200. The present invention is not limited by the manner of division or names of the processing units shown in the flowcharts of FIG. 13 and 14. Furthermore, the processing of the second control unit 250 can be divided into more processing units according to the processing contents, or one processing unit can be divided so as to include more processes. Furthermore, the processing order of the above flowcharts is not limited to the example shown in the figures.

[0121] In addition, in the above-described first embodiment, the projector 100A is used as the display device, but the present invention is not limited to this. For example, the display device may be a display such as a liquid crystal display, an organic EL display, or a plasma display. When using these displays, the display may be provided with a transmitting unit 180 and an imaging unit 190, and the display may detect the position of the electronic pen 5. The display surface of the liquid crystal panel, organic EL panel, or the like may be configured as a touch panel including a display panel and a touch sensor, and the touch position on the display surface may be detected.

[0122] In addition, when the display method is realized using a computer included in the information processing device 200 or a computer included in the projector 100B, it is also possible to configure the program executed by these computers in the form of a recording medium. Or, it is also possible to configure the program executed by these computers in the form of a transmission medium for transmitting the program. The recording medium can be a magnetic or optical recording medium or a semiconductor memory device. Specifically, portable or fixed recording media such as a flexible disk, HDD, CD-ROM, DVD (Digital Versatile Disc), Blu-ray Disc, magneto-optical disk, flash memory, and card-type recording medium can be mentioned. In addition, the recording medium may be a non-volatile storage device such as RAM, ROM, and HDD, which are internal storage devices included in the server device. Blu-ray is a registered trademark.

[0123] In the above-described embodiment, as shown in step S10, the number of control points on the side where the first region 310 and the second region 320 meet is counted, and a change in the number of control points is accepted after determining whether the relationship of formula (1) or formula (2) is satisfied, but this is not limiting. For example, the number of control points may be changed without performing the determination of step S10, including cases where the relationship of formula (1) or formula (2) is not satisfied. When the relationship of formula (1) or formula (2) is satisfied, at least a portion of each control point group on the side between the first region 310 and the second region 320 coincides with a portion of the other control point group, making it possible to correspond the movements of these control points. Therefore, the configuration of the above-described embodiment is more preferable, but it is of course also possible to configure the system so as not to perform the judgment of step S10 depending on the user's intended use. [Explanation of symbols]

[0124] 1...display system, 5...electronic pen, 10...cable, 30...projection surface, 100A, 100B...projector, 110...first communication I / F, 120...image processing unit, 125...frame memory, 130...image projection unit, 131...light source, 133...light modulation device, 135...optical unit, 150...first control unit, 160...first storage unit, 165...control program, 170...first processor, 180...transmission unit, 181...first signal light, 183...first 2 Signal light, 190...imaging unit, 200...information processing device, 210...second communication I / F, 220...touch panel, 225...application screen, 230...operation unit, 230A...cursor, 241, 243, 245, 247...black circle, 250...second control unit, 260...second memory unit, 261...OS, 263...APP, 270...second processor, 300...pattern image, 310...first area, 311...right side, 313...line segment, 320...second area, 321...left side, 323...top side, 400...auxiliary line.

Claims

1. receiving a first operation to divide a region of a first image including a plurality of control points into a plurality of regions including a first region and a second region; receiving a second operation to change a number of control points included in at least one of the first region and the second region; receiving a third operation in at least one of the first area and the second area, the third operation specifying a selection of one or more control points to be moved in the first image and a position of the one or more control points to be moved after the selection; correcting a second image based on positions of the one or more moving control points in the first image before the movement and positions of the one or more moving control points in the first image after the movement; displaying the second image on a display surface by a display device; Including, Receiving the first operation includes: receiving an operation to divide an area of ​​the first image into the second area and the first area, which is an area of ​​the first image other than the second area; receiving an operation to select a control point for defining the second region from the plurality of control points; setting the second region in the first image based on an arrangement of the selected control points in the first image; setting the first area in the first image based on an arrangement of control points in the first image other than the control points of the second area; Including, how to display.

2. Displaying the first area and the second area in different display modes; The display method of claim 1 , further comprising:

3. Displaying a plurality of control points included in the first region and a plurality of control points included in the second region in different display modes; The display method according to claim 1 or 2, further comprising:

4. Correcting the second image includes: generating a first correction parameter based on the one or more moving control points included in the first region and positions of the one or more moving control points included in the first region after the movement; generating second correction parameters based on the one or more moving control points included in the second region and positions of the one or more moving control points included in the second region after the movement; Dividing the second image into a third region and a fourth region based on the first region and the second region in the first image; correcting the third region using the first correction parameter; correcting the fourth region using the second correction parameter; combining the third region with the fourth region; The display method of claim 1 , comprising:

5. The first region and the second region are in contact with each other at a first side of the first region and a second side of the second region, Receiving the second operation includes: The number of control points on the second side of the second area that are changed by the second operation is set to N, 2. The display method according to claim 1, further comprising accepting an operation to change the number of control points of the second region so as to satisfy the relationship of the following formula (1), where M is the number of control points on the first side of the first region and T is any natural number. N = T M -1, or M = T N -1 (1)

6. the second region is included within the first region, and the first region and the second region are in contact with each other at a line segment of the first region and a second side of the second region; Receiving the second operation includes: The number of control points on the second side of the second area that are changed by the second operation is set to N, 2. The display method according to claim 1, further comprising accepting an operation to change the number of control points of the second region so as to satisfy the following formula (1), where M is the number of control points on the line segment of the first region and T is an arbitrary natural number: N = T M -1, or M = T N -1 (1)

7. Receiving the second operation includes: The display method according to claim 5 , further comprising the step of: not accepting, as the second operation, an operation that does not satisfy the relationship of the formula (1).

8. Receiving the second operation includes: The display method according to claim 5 or 6, further comprising performing a notification action when an operation that does not satisfy the relationship of the formula (1) is input.

9. a display panel for displaying an image on a display surface; receiving a first operation to divide a region of a first image including a plurality of control points into a plurality of regions including a first region and a second region; receiving a second operation to change a number of control points included in at least one of the first region and the second region; receiving a third operation in at least one of the first area and the second area, the third operation specifying a selection of one or more control points to be moved in the first image and a position of the one or more control points to be moved after the selection; correcting a second image based on positions of the one or more moving control points in the first image before the one or more moving control points are moved and positions of the one or more moving control points in the first image after the one or more moving control points are moved; causing the display panel to display the second image on the display surface; and one or more processors executing Equipped with Receiving the first operation includes: receiving an operation to divide an area of ​​the first image into the second area and the first area, which is an area of ​​the first image other than the second area; receiving an operation to select a control point for defining the second region from the plurality of control points; setting the second region in the first image based on an arrangement of the selected control points in the first image; setting the first area in the first image based on an arrangement of control points in the first image other than the control points of the second area; A display device comprising:

10. On the computer, receiving a first operation to divide a region of a first image including a plurality of control points into a plurality of regions including a first region and a second region; receiving a second operation to change a number of control points included in at least one of the first region and the second region; receiving a third operation in at least one of the first area and the second area, the third operation specifying a selection of one or more control points to be moved in the first image and a position of the one or more control points to be moved after the selection; correcting a second image based on positions of the one or more moving control points in the first image before the one or more moving control points are moved and positions of the one or more moving control points in the first image after the one or more moving control points are moved; displaying the second image on a display surface by a display device; Run the command, Receiving the first operation includes: receiving an operation to divide an area of ​​the first image into the second area and the first area, which is an area of ​​the first image other than the second area; receiving an operation to select a control point for defining the second region from the plurality of control points; setting the second region in the first image based on an arrangement of the selected control points in the first image; setting the first area in the first image based on an arrangement of control points in the first image other than the control points of the second area; Including, the program.

Images