Display method, projector and program

Abstract

To provide a display method which increases operability and improves convenience for a user.SOLUTION: A second control unit 250 executes processing including: displaying a pattern image 300 including a plurality of control points, and a plurality of segments connecting the control points of the plurality of control points; receiving input indicating a first position of the pattern image 300; selecting at least two vertices of a minimum first polygon overlapping with the first position, among polygons constituted by the plurality of segments; and displaying a mark image 50 indicating that at least two vertices have been selected.SELECTED DRAWING: Figure 2

Description

[Technical field]

[0001] The present invention relates to a display method, a projector, and a program. [Background technology]

[0002] 2. Description of the Related Art Conventionally, devices having a function for correcting local distortion of an image displayed by a projector are known. For example, the information processing device disclosed in Patent Document 1 acquires an image obtained by capturing a projection image from an imaging device, and displays the acquired image on a display unit. When setting the position of an adjustment point on the displayed captured image according to designated coordinates specified by a user's cursor operation, the information processing device sets a search range centered on the designated coordinates. Furthermore, if the set search range includes any of the characteristic parts of an edge, a straight line, or an intersection of straight lines, the information processing device sets the position of the adjustment point to the position of the characteristic part, Position Set adjustment The projector is adjusted to deform the projected image into a shape that corresponds to the points. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2021-136502 A Summary of the Invention [Problem to be solved by the invention]

[0004] However, it is not possible to search for feature parts outside the search range, and if the search range is carelessly widened, a feature part that is not actually desired may be selected. For this reason, it is difficult to select multiple feature parts in response to a user's operation to select one position. [Means for solving the problem]

[0005] The present disclosure is a display method including: displaying a first image including a point cloud and a group of line segments connecting points included in the point cloud; accepting an input indicating a first position of the first image; selecting at least two vertices of a smallest first polygon formed by the group of line segments that overlaps with the first position; and displaying a mark indicating that the at least two vertices have been selected.

[0006] The present disclosure relates to a projector comprising an optical device and a processor that uses the optical device to display a first image including a point cloud and a group of line segments connecting points included in the point cloud, accepts input indicating a first position of the first image, selects at least two vertices of a smallest polygon formed by the group of line segments that overlaps with the first position, and displays, using the optical device, a mark indicating that the at least two vertices have been selected.

[0007] The present disclosure is a program that causes a computer to perform the following operations: display a first image including a point cloud and a group of line segments connecting points included in the point cloud; accept an input indicating a first position of the first image; select at least two vertices of a smallest polygon formed by the group of line segments that overlaps with the first position; and display a mark indicating that the at least two vertices have been selected. [Brief description of the drawings]

[0008] [Figure 1] FIG. 1 is a diagram showing a system configuration of a display system. [Diagram 2] FIG. 2 is a block diagram showing the configuration of a projector and an information processing device. [Diagram 3] FIG. 4 is a diagram showing an example of a pattern image. [Figure 4] 13 is a diagram showing a case where a rectangular shape overlaps with the click position. [Diagram 5] FIG. 13 is a diagram showing a display state of a pattern image after a click operation. [Figure 6]13A and 13B are diagrams showing a case where a line segment of a rectangular shape overlaps with a click operation position. [Figure 7] FIG. 13 is a diagram showing a display state of a pattern image after a click operation. [Figure 8] This indicates the drag range on the pattern image specified by a drag operation. [Figure 9] 13A and 13B are diagrams showing a display state of a pattern image after a drag operation. [Figure 10] 13A and 13B are diagrams showing a case where a rectangular shape overlaps with a click operation position. [Figure 11] FIG. 13 is a diagram showing a display state of a pattern image after a click operation. [Figure 12] FIG. 13 is a diagram showing a display state of a pattern image when a rectangular shape is selected again. [Figure 13] FIG. 13 is a diagram showing a state in which the rectangular shape on which the mark image is displayed is selected again. [Figure 14] FIG. 13 is a diagram showing a display state of the pattern image after the rectangular shape is selected again. [Figure 15] 4 is a flowchart showing the operation of the information processing device. [Figure 16] 4 is a flowchart showing the operation of the information processing device. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] [1. System configuration] Hereinafter, an embodiment of the present invention will be described with reference to the accompanying drawings. FIG. 1 is a diagram showing a system configuration of a display system 1. As shown in FIG. The display system 1 includes a projector 100 which is a display device, and an information processing device 200 which supplies the projector 100 with a display image which is an image to be displayed on a projection surface 30 by the projector 100. The projector 100 and the information processing device 200 are connected by a cable 10. Although Fig. 1 shows a configuration in which the projector 100 and the information processing device 200 are connected by the cable 10, the projector 100 and the information processing device 200 may be connected wirelessly.

[0010] The projector 100 generates image light based on a display image supplied from the information processing device 200. The projector 100 enlarges and projects the generated image light onto the projection surface 30. As a result, the display image is displayed on the projection surface 30.

[0011] The information processing device 200 supplies a display image to the projector 100 and corrects local distortion of the display image to be displayed on the projector 100. For example, a personal computer such as a desktop computer, a notebook computer, or a tablet computer is used as the information processing device 200. In addition, a mobile terminal such as a smartphone may be used as the information processing device 200.

[0012] [2. Projector configuration] FIG. 2 is a block diagram showing the configurations of the projector 100 and the information processing device 200. As shown in FIG. First, the configuration of the projector 100 will be described. The projector 100 includes a touch panel 105, a first communication interface 110, an image processing unit 120, a frame memory 125, an image projection unit 130, and a first control unit 150. Hereinafter, the interface is abbreviated to I / F. The image projection unit 130 corresponds to an optical device.

[0013] The touch panel 105 includes a display panel and a touch sensor. The display panel and the touch sensor are not shown. For example, a liquid crystal panel or an organic EL (Electro Luminescence) panel is used for the display panel. The touch sensor detects a touch operation on the touch panel 105. The touch sensor detects a touch operation performed by a pointing device such as an electronic pen. Yata Position of touch panel 105 The touch of the user's finger against as a touch operation. The touch sensor outputs an operation signal including coordinate information indicating the position on the touch panel where the touch operation was detected to the first control unit 150. When the first processor 170 included in the projector 100 corresponds to a processor, the touch panel 105 corresponds to an optical device.

[0014] The first communication I / F 110 is connected to the information processing device 200 via the cable 10, and receives a display image from the information processing device 200. The first communication I / F 110 outputs the received display image to the image processing unit 120. The first communication I / F 110 is a wired interface having a connection terminal such as a Universal Serial Bus (USB) connector or an Ethernet connector, and an interface circuit. Ethernet is a registered trademark. The first communication I / F 110 may be a wireless communication interface.

[0015] A frame memory 125 is connected to the image processing unit 120. The frame memory 125 includes a plurality of banks. Each bank has a storage capacity capable of writing one frame of display image. The frame memory 125 is configured, for example, with a Synchronous Dynamic RAM (SDRAM). The image processing unit 120 expands the display image input from the first communication I / F 110 in the frame memory 125.

[0016] The image processing unit 120 performs image processing on the display image expanded in the frame memory 125. The image processing performed by the image processing unit 120 includes, for example, resolution conversion processing or resizing processing, distortion correction, shape correction processing, digital zoom processing, and adjustment of image color and brightness. The image processing unit 120 executes processing specified by the first control unit 150, and performs processing using parameters input from the first control unit 150 as necessary. Of course, the image processing unit 120 can also execute a combination of multiple image processes from the above.

[0017] The image processing unit 120 and the frame memory 125 are configured, for example, by an integrated circuit. The integrated circuit includes a large scale integration (LSI), an application specific integrated circuit (ASIC), a programmable logic device (PLD), a field programmable gate array (FPGA), a system on a chip (SoC), etc. An analog circuit may be included as part of the configuration of the integrated circuit, or the first control unit 150 may be configured in combination with an integrated circuit.

[0018] The image projection unit 130 includes a light source 131 , a light modulation device 133 , and an optical unit 135 .

[0019] The light source 131 includes a discharge type light source lamp such as an extra-high pressure mercury lamp or a metal halide lamp, or a solid-state light source such as a light-emitting diode or a semiconductor laser.

[0020] The light modulation device 133 includes a transmissive liquid crystal panel in which liquid crystal is sealed between a pair of transparent substrates as a light modulation element that modulates the light emitted from the light source 131. The liquid crystal panel is not shown. The liquid crystal panel includes a panel region consisting of a plurality of pixels arranged in a matrix. The light modulation device 133 applies a drive voltage corresponding to a display image input from the image processing unit 120 to each pixel in the panel region, and changes the light transmittance of each pixel to a transmittance corresponding to the display image. The light emitted from the light source 131 is modulated by transmitting through the liquid crystal panel, and image light corresponding to the display image is generated.

[0021] The light modulation element included in the light modulation device 133 is not limited to a transmissive liquid crystal panel, but may be, for example, a reflective liquid crystal panel or a DMD (Digital Micromirror Device).

[0022] The optical unit 135 includes a projection lens (not shown) and projects the image light modulated by the light modulation device 133 onto the projection surface 30 in an enlarged manner. As a result, a display image that is an image corresponding to the image light is displayed on the projection surface 30.

[0023] The first control unit 150 is a computer device including a first storage unit 160 and a first processor 170.

[0024] The first storage unit 160 includes a RAM (Random Access Memory) and a ROM (Read Only Memory). The RAM is used for temporary storage of various data and the like, and the ROM stores a control program 165 that controls the operation of the projector 100, various setting information, and the like.

[0025] The first processor 170 is an arithmetic processing device configured with a CPU (Central Processing Unit) and an MPU (Micro Processor Unit). The first processor 170 executes a control program to control each section of the projector 100. The first processor 170 may be configured with a single processor, or may be configured with multiple processors. The first processor 170 may also be configured with a part or all of the first storage section 160 or a system-on-a-chip (SoC) integrated with other circuits. The first processor 170 is configured with a CPU that executes a program and a DSP (Digital Signal Processor) that executes predetermined arithmetic processing. or ) In addition, all of the functions of the first processor 170 may be implemented in hardware, or may be configured using a programmable device.

[0026] [3. Configuration of information processing device] Next, the configuration of the information processing device 200 will be described. The information processing device 200 includes a second communication I / F 210, a touch panel 220, an operation unit 230, and a second control unit 250.

[0027] The second communication I / F 210 is, for example, a wired interface having a connection terminal such as a USB connector or an Ethernet connector and an interface circuit, and performs mutual data communication with the projector 100 via the cable 10. The second communication I / F 210 may be a wireless communication interface.

[0028] The touch panel 220 includes a display panel and a touch sensor. The display panel and the touch sensor are not shown. For example, a liquid crystal panel or an organic EL panel is used for the display panel. The touch sensor detects a touch operation on the touch panel 220. The touch sensor detects a touch operation performed by a pointing device such as an electronic pen. Yata Position of Touch Panel 220 The touch of the user's finger against The touch sensor detects this as a touch operation. The touch sensor outputs to the second control unit 250 an operation signal including coordinate information indicating the position on the touch panel 220 where the touch operation was detected.

[0029] The operation unit 230 includes input devices such as a mouse and a keyboard, and receives operations from a user. The operation unit 230 outputs to the second control unit 250 an operation signal corresponding to the received operation.

[0030] The second control unit 250 includes a second memory unit 260 and a second processor 270 .

[0031] The second storage unit 260 includes a RAM and a ROM. The second storage unit 260 may also include an auxiliary storage device such as a solid state drive (SSD) or a hard disk drive (HDD). The RAM is used for temporary storage of various data and the like, and the ROM stores control programs such as an OS (Operating System) 261 and an application program 263 that control the operation of the information processing device 200, as well as various setting information. The application program 263 is hereinafter referred to as an APP 263.

[0032] The second processor 270 is an arithmetic processing device configured with a CPU and an MPU. The second processor 270 executes the OS 261 and the APP 263 to control each unit of the information processing device 200. The second processor 270 may be configured with a single processor, or may be configured with multiple processors.

[0033] The second control unit 250 that executes the APP 263 has a point correction function that corrects local distortion of the display image that is displayed on the projector 100. The second control unit 250 generates correction parameters for correcting the display image to be displayed on the projector 100 by the point correction function. The second control unit 250 corrects the display image using the generated correction parameters, and transmits the corrected display image to the projector 100. The display image corresponds to the second image.

[0034] The operation of the second control unit 250 for generating the correction parameters will be described below. In order to generate the correction parameters, the second control unit 250 first causes the touch panel 220 of the information processing device 200 to display a pattern image 300 corresponding to the first image.

[0035] FIG. 3 is a diagram showing an example of a pattern image 300 displayed on the APP screen 225. As shown in FIG. The APP screen 225 is a screen that is displayed on the touch panel 220 when the second control unit 250 executes the APP 263. 3 is an axis parallel to the horizontal direction of touch panel 220, and the Y axis is an axis parallel to the vertical direction of touch panel 220. In FIG.

[0036] In the pattern image 300, M vertical lines are arranged at equal intervals in the X-axis direction, and N horizontal lines are arranged at equal intervals in the Y-axis direction. M and N are any natural numbers. The pattern image 300 is a rectangular shape, and the smallest area bounded by two vertical lines and two horizontal lines is AreaThis is a rectangular shape. A rectangle, which is the smallest small area, corresponds to the smallest polygon. Hereinafter, the smallest small area bounded by two vertical lines and two horizontal lines will be referred to as a rectangular shape.

[0037] A control point is set at each intersection of M vertical lines arranged in the X-axis direction of pattern image 300 and N horizontal lines arranged in the Y-axis direction of pattern image 300. The multiple control points set at each intersection correspond to a point group. Adjacent control points are connected by some line segments of the vertical or horizontal lines described above. The multiple line segments connecting adjacent control points correspond to a line group.

[0038] A control point is a point whose position on pattern image 300 can be changed in point correction by a touch operation on touch panel 220 performed by the user or by operation of operation unit 230. Correction parameters are generated based on the position of the control point on pattern image 300 before the position is changed and the position of the control point on pattern image 300 after the position is changed. In the following explanation, a case will be described in which operations such as selection of a control point and movement of a control point are performed using a mouse provided in operation unit 230.

[0039] When the pattern image 300 is displayed on the touch panel 220, the user specifies a position or area on the pattern image 300 by clicking or dragging the mouse. The operation unit 230 detects mouse click and drag operations, and outputs operation signals including coordinate information indicating the position and range of these detected operations to the second control unit 250. The second control unit 250 acquires the coordinate information from the input operation signal. When the acquired coordinate information indicates a position on the touch panel 220, the second control unit 250 determines an image that overlaps the position indicated by the coordinate information.

[0040] Fig. 4 is a diagram showing a case where rectangular figure 310 overlaps with a designated position designated by a click operation. The designated position of cursor 301 shown in Fig. 4 indicates the position designated by a click operation of the mouse. The position designated by the click operation corresponds to the first position. Moreover, inputting coordinate information indicating the designated position designated by a click operation by second control unit 250 corresponds to receiving an input indicating the first position. When a rectangular graphic 310 overlaps with a position on the touch panel 220 indicated by the coordinate information, the second control unit 250 selects control points located at least two vertices of the rectangular graphic 310 and sets them in a selected state. More specifically, when the position on touch panel 220 indicated by the coordinate information does not overlap any line segment constituting the side of rectangular graphic 310 and indicates a position within rectangular graphic 310, second control unit 250 selects control points located at the four vertices of rectangular graphic 310. In the example shown in Fig. 4, upper left control point 311, upper right control point 312, lower left control point 313, and lower right control point 314 of rectangular graphic 310 are selected as viewed from the drawing.

[0041] FIG. 5 is a diagram showing a display state of the pattern image 300 after a click operation. When the second control unit 250 selects control points 311, 312, 313, and 314 located at the four vertices of the rectangular figure 310, it causes mark images 50 to be displayed at the positions of these control points 311, 312, 313, and 314. By causing mark images 50 to be displayed at the positions of the control points 311, 312, 313, and 314, the user can recognize that the control points 311, 312, 313, and 314 are in a selected state. 5 shows a rectangular mark image 50, the shape and color of the mark image 50 are arbitrary as long as the user can recognize that the display states of the control points 311, 312, 313, and 314 are different from the display states of the other control points. The mark image 50 corresponds to a mark.

[0042] Fig. 6 is a diagram showing a position designated by a click operation on a pattern image 300. In particular, Fig. 6 is a diagram showing a case where a line segment 315 constituting a side of a rectangular figure 310 overlaps with the designated position of a click operation indicated by a cursor 301. When line segment 315 constituting a side of rectangular figure 310 overlaps with a position on touch panel 220 indicated by the coordinate information, second control unit 250 selects and sets the control points located at both ends of line segment 315 to a selected state. In the example shown in Fig. 6, control point 311 located at the vertex at the left end of line segment 315 and control point 312 located at the vertex at the right end of line segment 315 are selected in the drawing.

[0043] Fig. 7 is a diagram showing a display state of the pattern image 300 after a click operation. In particular, Fig. 7 is a diagram showing a state in which the mark images 50 are displayed on both ends of the line segment 315 selected by the click operation. When the second control unit 250 selects the control points 311 and 312 located at both ends of the line segment 315, it displays the mark image 50 at the positions of these control points 311 and 312. This allows the user to recognize that the control points 311 and 312 with the mark image 50 superimposed thereon are in a selected state. 6 and 7, line segment 315 parallel to the X-axis is selected by a click operation, and therefore control points 311 and 312 at the left and right ends of line segment 315 are selected. For example, when line segment 316 parallel to the Y-axis is selected by a click operation, control points 312 and 314 at the top and bottom ends of line segment 316 are selected and enter a selected state.

[0044] Fig. 8 is a diagram showing a drag range specified by a drag operation on the pattern image 300. The range indicated by the dashed line in Fig. 8 indicates a drag range 303 selected by a drag operation of the mouse. When the second control unit 250 acquires drag range 303, which is coordinate information indicating a range, from the operation signal, it selects rectangular shapes at least a part of which is included within this drag range 303. In the example shown in Fig. 8, the second control unit 250 selects rectangular shapes 310, 320, 330, and 340. Rectangular shape 320 is located to the right of rectangular shape 310 in the drawing view. Rectangular shape 330 is located below rectangular shape 310 in the drawing view. Rectangular shape 340 is located below rectangular shape 320 in the drawing view.

[0045] FIG. 9 is a diagram showing a display state of the pattern image 300 after the drag operation. When the second control unit 250 selects the rectangular figures 310, 320, 330, and 340, it selects the control points located at all vertices of these four rectangular figures 310, 320, 330, and 340, and displays the mark image 50 superimposed on the selected control points. This allows the user to recognize that the control points superimposed with the mark image 50 have been selected.

[0046] 10 is a diagram showing a state in which rectangular graphic 340 overlaps with a position designated by a click operation indicated by cursor 301, and mark image 50 is displayed on at least some of the control points on rectangular graphic 340. The position designated by the click operation corresponds to the second position. Rectangular graphic 340 corresponds to the first polygon. Inputting coordinate information indicating the position designated by the click operation to second control unit 250 corresponds to receiving an input indicating the second position. When the second control unit 250 determines the rectangular graphic 340 that overlaps with the position of the touch panel 220 indicated by the coordinate information, it determines whether or not the mark image 50 is displayed at the control point on this rectangular graphic 340. 10 shows a state in which a mark image 50 is displayed at a control point on a rectangular graphic 330 that is in contact with the rectangular graphic 340 on the left side of the rectangular graphic 340 as viewed from the drawing. As viewed from the drawing, control points 332 and 334 located on the right side of the rectangular graphic 330 and control points 341 and 343 located on the left side of the rectangular graphic 340 overlap and are displayed at the same position. As viewed from the drawing, the control point 332 is a control point located at the upper right vertex of the rectangular graphic 330, and the control point 334 is a control point located at the lower right vertex of the rectangular graphic 330. As viewed from the drawing, the control point 341 is a control point located at the upper left vertex of the rectangular graphic 340, and the control point 343 is a control point located at the lower left vertex of the rectangular graphic 340.

[0047] Fig. 11 is a diagram showing a display state of the pattern image 300 after a click operation. In particular, Fig. 11 shows a state in which the display of the mark image 50 displayed at the control points 341 and 343 on the rectangular figure 340 has been erased. When mark images 50 are displayed at some of the control points 341, 343 on the rectangular graphic 340 selected by a click operation, the second control unit 250 erases all of the mark images 50 displayed at the control points 341, 343 on the rectangular graphic 340. In other words, the second control unit 250 cancels the selection state of the control points on the rectangular graphic 340, and brings about a state in which the mark images 50 are not displayed on the control points.

[0048] FIG. 12 is a diagram showing the display state of the pattern image 300 when a rectangular shape 340 that has been selected once is selected again. When the rectangular graphic 340 is selected again after erasing the mark image 50 on the rectangular graphic 340, the second control unit 250 selects all control points on the selected rectangular graphic 340 and displays the mark image 50 superimposed on the selected control points. Since the mark image 50 is not displayed on the control points on the rectangular graphic 340, the second control unit 250 displays the mark image 50 superimposed on the control points located at the four vertices of the rectangular graphic 340. As a result, the mark image 50 is displayed superimposed on the control points located at the six vertices of the rectangular graphic 330 and the rectangular graphic 340.

[0049] In the above description, when the mark image 50 is displayed at some of the control points on the rectangular graphic 340 selected by a click operation, the mark image 50 displayed at this control point is erased. As other operations, a selection mode for selecting a control point and a deselection mode for deselecting a control point may be provided, and the second control unit 250 may select and deselect a control point based on the operation mode. When the selection mode is selected as the operating mode and a rectangular figure 340 having a mark image 50 displayed at some of the control points is selected by a click operation, the second control unit 250 selects the remaining control points on the rectangular figure 340 and displays the mark image 50 superimposed on the selected control points. Furthermore, when the release mode is selected as the operation mode and a rectangular graphic 340 having mark images 50 displayed at some of its control points is selected by a click operation, the second control unit 250 displays the mark image 50 and releases the selection of the control points on the selected rectangular graphic 340. Furthermore, the second control unit 250 erases the mark images 50 displayed at the control points on the deselected rectangular graphic 340. The position selected by the click operation corresponds to the third position, the rectangular figure 330 corresponds to the first polygon displaying the mark, and the rectangular figure 340 corresponds to the second polygon adjacent to the first polygon. Inputting the coordinate information indicating the position selected by the click operation to the second control unit 250 corresponds to receiving an input indicating the third position.

[0050] Fig. 13 is a diagram showing a state in which the rectangular figure 330 on which the mark image 50 is displayed is selected again by a click operation, and Fig. 14 is a diagram showing a display state of the pattern image 300 after the rectangular figure 330 is selected again by a click operation. When the rectangular graphic 330, which has already had the mark image 50 displayed at its four vertices, is selected again by a click operation, the second control unit 250 cancels the selection of the control points of the four vertices on the selected rectangular graphic 330. Then, as shown in Fig. 14, the second control unit 250 erases the display of the mark image 50 that was displayed superimposed on the control points of the four vertices of the rectangular graphic 330. This allows the user to erase the mark image 50 that was once displayed by a click operation.

[0051] After that, the second control unit 250 accepts a movement operation for moving the position of the selected control point. Through this movement operation, the second control unit 250 acquires the amount of movement for moving the control point and the movement direction for moving the control point. Next, the second control unit 250, for example, 225 When the second control unit 250 receives an instruction operation to execute point correction via a menu icon or the like displayed on the projector 100, the point correction is started. The second control unit 250 calculates the coordinates of the selected control point after the movement based on the acquired movement amount and movement direction. Next, the second control unit 250 generates correction parameters based on the coordinates of the control point before the movement and the coordinates of the control point after the movement. The second control unit 250 corrects the display image using the generated correction parameters. The second control unit 250 transmits the corrected display image to the projector 100, and causes the projector 100 to display the display image on the projection surface 30.

[0052] [4. Operation of information processing device] 15 and 16 are flowcharts showing the operation of the information processing device 200. The operation of the information processing device 200 will be described with reference to the flowcharts shown in FIGS. When the second control unit 250 receives an operation to select the APP 263 through the touch panel 220 or the operation unit 230, it executes the APP 263 (step S1) and causes the APP screen 225 to be displayed on the touch panel 220. In addition, when point correction is selected by a menu operation on the APP screen 225, the second control unit 250 causes the pattern image 300 to be displayed on the APP screen 225 (step S2).

[0053] Next, the second control unit 250 accepts an operation to set a control point to be a correction target of the point correction (step S3). Details of the process of step S3 will be described with reference to the flowchart shown in FIG.

[0054] When the control point to be corrected in the point correction is set, the second control unit 250 judges whether or not a move operation for moving the position of the set control point has been received (step S4). This move operation may be an operation using a mouse or an operation using a cross key provided on a keyboard. If the second control unit 250 does not receive a move operation (step S4 / NO) and receives, for example, an operation of a back button displayed on the APP screen 225, the second control unit 250 judges whether or not a move operation for moving the position of the set control point has been received (step S4 / NO). Setting Then, the process returns to step S3.

[0055] Furthermore, when the second control unit 250 receives a movement operation (step S4 / YES), it moves the position of the set control point in the pattern image 300 based on the movement direction and movement amount indicated by the received movement operation (step S5).

[0056] Next, the second control unit 250 judges whether or not an instruction operation for instructing execution of point correction has been received (step S6). If the instruction operation for point correction has not been received (step S6 / NO), the second control unit 250 returns to the judgment of step S4 and judges whether or not a movement operation has been further received (step S4).

[0057] Furthermore, when the second control unit 250 receives an instruction operation for point correction (step S6 / YES), it generates correction parameters (step S7). The second control unit 250 generates the correction parameters based on the coordinates indicating the position of the selected control point in the pattern image 300 before the movement and the coordinates indicating the position of the selected control point in the pattern image 300 after the movement (step S7).

[0058] Next, the second control unit 250 corrects the second image to be displayed on the projector 100 using the generated correction parameters (step S8). The second control unit 250 transmits the corrected second image to the projector 100 (step S9).

[0059] Next, the second control unit 250 determines whether or not an operation to end the APP 263 has been received (step S10). If the second control unit 250 has not received an operation to end the APP 263 (step S10 / NO), the second control unit 250 returns to step S2 and displays the pattern image 300 on the touch panel 220. If the second control unit 250 has received an operation to end the APP 263 (step S10 / YES), the second control unit 250 ends this processing flow.

[0060] FIG. 16 is a flowchart showing the details of step S3 shown in FIG. Details of step S3 will be described with reference to FIG. First, the second control unit 250 judges whether or not a mouse operation has been received (step S301). If the mouse operation has not been received (step S301 / NO), the second control unit 250 waits until a mouse operation is received.

[0061] When the second control unit 250 receives a mouse operation (step S301 / YES), it determines whether the received operation is a click operation (step S302). If the received operation is a mouse click operation (step S302 / YES), the second control unit 250 acquires coordinate information indicating the position of the pattern image 300 where the click operation was received (step S303).

[0062] Next, the second control unit 250 judges whether or not the position of the pattern image 300 indicated by the acquired coordinate information is a position on a line segment (step S304). If the position indicated by the coordinate information is a position on a line segment (step S304 / YES), the second control unit 250 selects two control points connected by this line segment (step S305). The second control unit 250 then selects the two selected control points. controlThe second control unit 250 then displays a mark image 50 indicating that the point has been selected (step S306). After that, the second control unit 250 proceeds to the determination in step S4.

[0063] Furthermore, if the position of the pattern image 300 indicated by the acquired coordinate information is not on a line segment (step S304 / NO), the second control unit 250 selects the smallest rectangular shape that includes the position indicated by the coordinate information inside (step S307).The second control unit 250 determines whether the mark image 50 has been displayed at the control point located at the vertex of the selected rectangular shape (step S308).

[0064] If the second control unit 250 has displayed the mark image 50 at at least one of the control points located at the vertices of the selected rectangular shape (step S308 / YES), it erases the displayed mark image 50 (step S310) and returns to the judgment of step S301. If the second control unit 250 has not displayed the mark image 50 at the control points located at the vertices of the selected rectangular shape (step S308 / NO), it displays the mark image 50 at the control points located at the four vertices of the rectangular shape (step S309). After that, the second control unit 250 proceeds to the judgment of step S4.

[0065] Furthermore, if the operation received in step S301 is not a click operation (step S302 / NO), the second control unit 250 judges whether the received operation is a drag operation (step S311). If the received operation is a drag operation (step S311 / YES), the second control unit 250 selects all rectangular shapes at least a part of which is included in the drag range of the drag operation (step S312). The second control unit 250 displays mark images 50 at the four vertices of all selected rectangular shapes (step S313). After that, the second control unit 250 proceeds to the judgment of step S4.

[0066] Furthermore, if the operation accepted in step S301 is not a drag operation (step S311 / NO) but a menu operation or the like displayed on the APP screen 225, the second control unit 250 executes a process corresponding to the accepted operation (step S314). After that, the second control unit 250 proceeds to the determination in step S301.

[0067] 4. Summary of this Disclosure The following is a summary of this disclosure. (Appendix 1) A display method comprising: displaying a first image including a point cloud and a group of line segments connecting points included in the point cloud; accepting an input indicating a first position of the first image; selecting at least two vertices of a smallest first polygon that overlaps with the first position among polygons formed by the group of line segments; and displaying a mark indicating that the at least two vertices have been selected.

[0068] As a result, by designating a first position on the first image, at least two vertices of the smallest first polygon that overlaps with the first position are selected. This makes it possible to select multiple vertices of the first polygon by a single operation of designating the first position, thereby improving user convenience.

[0069] (Appendix 2) receiving an operation to change positions of the at least two vertices in the first image; generating correction parameters based on the pre-modification positions and the post-modification positions of the at least two vertices; correcting a second image to be displayed on a display surface based on the correction parameters; displaying the second image on the display surface by a display device; The display method described in Appendix 1, including:

[0070] This improves operability when correcting the second image by selecting vertices of a polygon included in the first image and changing the positions of the selected vertices, thereby enhancing user convenience.

[0071] (Appendix 3) Displaying the mark includes: if the first position overlaps with a line segment constituting a side of the first polygon, two vertices of the first polygon connected by the line segment are selected, and the mark is displayed at the two vertices. The display method according to appendix 1 or 2, including the above.

[0072] This allows the user to select two vertices of the first polygon connected by the specified line segment by specifying the line segment that constitutes the first polygon as the first position, thereby improving operability and enhancing user convenience.

[0073] (Appendix 4) Displaying the mark includes: if the first position does not overlap with a line segment that constitutes a side of the first polygon, selecting all vertices that constitute the first polygon, and displaying the marks on all of the vertices. The display method according to any one of appendixes 1 to 3, comprising:

[0074] This makes it possible to select all vertices of the first polygon that overlap with the first position by specifying a position that does not overlap with the line segments that form the first polygon as the first position, thereby improving operability and enhancing user convenience.

[0075] (Appendix 5) accepting an input indicating a second location of the first image; A display method according to any one of appendix 1 to 4, further comprising, when the second position overlaps the first polygon, deselecting a vertex of the first polygon and erasing the mark.

[0076] This allows the mark displayed at the vertex of the first polygon to be erased by specifying a position that overlaps with the first polygon displaying the mark as the second position. This allows the selection of a vertex that was once selected to be cancelled, improving operability and enhancing user convenience.

[0077] (Appendix 6) accepting an input indicating a third location of the first image; The display method described in Appendix 5 further includes, when the third position is a position that overlaps with a smallest second polygon among the polygons that overlaps with the second position adjacent to the first polygon, selecting a vertex of the second polygon other than the vertex that overlaps with a vertex of the first polygon, and displaying a mark indicating that the vertex other than the vertex that overlaps with the vertex of the first polygon has been selected.

[0078] This allows marks to be displayed on vertices that do not have marks even when selecting a second polygon with marks displayed on some of the vertices, improving operability and enhancing user convenience.

[0079] (Appendix 7) receiving range information indicating a range of the first image; Displaying the mark includes: selecting all vertices of a polygon that is at least partially included in the range indicated by the range information; displaying a mark indicating that all vertices of the polygon have been selected; The display method according to any one of appendixes 1 to 6, including:

[0080] This makes it possible to select all vertices of a polygon that is partially included within a range of the first image by specifying the range of the first image, thereby improving operability and enhancing user convenience.

[0081] (Appendix 8) An optical device; Displaying a first image including a point cloud and a line segment group connecting points included in the point cloud using the optical device; accepting an input indicating a first position of the first image; selecting at least two vertices of a smallest polygon that overlaps with the first position from among polygons formed by the group of line segments; displaying, using the optical device, a mark indicating that the at least two vertices have been selected; and A processor executing A projector comprising:

[0082] As a result, by designating a first position on the first image, at least two vertices of the smallest first polygon that overlaps with the first position are selected. This makes it possible to select multiple vertices of the first polygon by a single operation of designating the first position, thereby improving user convenience.

[0083] (Appendix 9) On the computer, Displaying a first image including a point cloud and a line segment group connecting points included in the point cloud; accepting an input indicating a first position of the first image; selecting at least two vertices of a smallest polygon that overlaps with the first position from among polygons formed by the group of line segments; displaying an indicia indicating that the at least two vertices have been selected; and A program that executes the following.

[0084] As a result, by designating a first position on the first image, at least two vertices of the smallest first polygon that overlaps with the first position are selected. This makes it possible to select multiple vertices of the first polygon by a single operation of designating the first position, thereby improving user convenience.

[0085] 7. Other Embodiments The above-described embodiment is a preferred embodiment of the present invention, however, the present invention is not limited to the above-described embodiment and various modifications are possible without departing from the spirit of the present invention. For example, in the above-described embodiment, the pattern image 300 was described as having M line segments arranged in the X-axis direction and N line segments arranged in the Y-axis direction, so the shape of the polygon was rectangular. However, the shape of the polygon is not limited to a rectangle, and may be a triangle, pentagon, hexagon, etc.

[0086] Also, in the above-described embodiment, a case has been described in which the information processing device 200 executes the process corresponding to the display method. The device that executes the display method is not limited to the information processing device 200. For example, in the case where the projector 100 includes the touch panel 105, the first control unit 150 may execute the process corresponding to the display method based on a touch operation on the touch panel 105. In other words, the first control unit 150 of the projector 100 may execute the process of the flowcharts shown in FIGS. 15 and 16.

[0087] 15 and 16, the operations shown in the flowcharts of FIG. 15 and FIG. 16 are performed using a mouse and a keyboard provided in the operation unit 230. However, the operations shown in the flowcharts of FIG. 15 and FIG. 16 may be performed using a touch panel. 220 This may be done by a touch operation.

[0088] Further, each functional unit of the information processing device 200 and the projector 100 shown in FIG. 2 shows a functional configuration, and the specific implementation form is not particularly limited. In other words, it is not necessarily necessary to implement hardware corresponding to each functional unit individually, and it is of course possible to implement a configuration in which one processor executes a program to realize the functions of multiple functional units. Furthermore, some of the functions realized by software in the above embodiment may be realized by hardware, and some of the functions realized by hardware may be realized by software. In addition, the specific detailed configurations of other units of the information processing device 200 and the projector 100 can also be arbitrarily changed within the scope of the present invention.

[0089] 15 and 16 are divided according to the main processing contents in order to facilitate understanding of the processing of the information processing device 200. The present invention is not limited by the manner of division or names of the processing units shown in the flowcharts of FIG. 15 and 16. Furthermore, the processing of the second control unit 250 can be divided into more processing units according to the processing contents, or one processing unit can be divided so as to include more processes. Furthermore, the processing order of the above flowcharts is not limited to the example shown in the figures.

[0090] In addition, when the display method is realized using a computer included in the information processing device 200 or a computer included in the projector 100, the program executed by these computers can be configured in the form of a recording medium. Alternatively, the display method can be configured in the form of a transmission medium for transmitting the program executed by these computers. The recording medium can be a magnetic or optical recording medium or a semiconductor memory device. Specifically, portable or fixed recording media such as a flexible disk, HDD, CD-ROM, DVD (Digital Versatile Disc), Blu-ray Disc, magneto-optical disk, flash memory, and card-type recording medium can be mentioned. In addition, the recording medium may be a non-volatile storage device such as RAM, ROM, and HDD, which are internal storage devices included in the server device. Blu-ray is a registered trademark. [Explanation of symbols]

[0091] 1...display system, 10...cable, 30...projection surface, 50...mark image, 100...projector, 105...touch panel, 110...first communication I / F, 120...image processing unit, 125...frame memory, 130...image projection unit, 131...light source, 133...light modulation device, 135...optical unit, 150...first control unit, 160...first storage unit, 165...control program, 170...first processor Ser, 200...information processing device, 210...second communication I / F, 220...touch panel, 225...APP screen, 230...operation unit, 250...second control unit, 260...second memory unit, 261...OS, 263...APP, 270...second processor, 300...pattern image, 303...drag range, 311, 312, 313, 314...control point, 315...line segment, 332, 334, 341, 343...control point.

Claims

1. The display device displays a first image including a point cloud and a line segment group connecting points included in the point cloud. Displaying the The information processing device receives an input indicating a first position of the first image; The information processing device detects a polygon formed by the group of line segments that overlaps with the first position. selecting at least two vertices of a first polygon that is the smallest possible first polygon; The display device displays a mark indicating that the at least two vertices have been selected. And, The information processing device changes positions of the at least two vertices in the first image. and accepting an operation to The display device displays a position of the at least two vertices before and after the change. displaying the corrected second image on a display surface; Including, how to display.

2. Displaying the mark includes: When the first position overlaps with a line segment that constitutes a side of the first polygon, the information processing device selects two vertices of the first polygon connected by the line segment, and the display device Displaying the mark at the two vertices; The display method of claim 1 , comprising:

3. Displaying the mark includes: If the first position does not overlap with a line segment that constitutes a side of the first polygon, the information processing The device selects all vertices that make up the first polygon, and the display device displays all of the vertices. Displaying the mark at the apex of The display method of claim 1 , comprising:

4. The information processing device receives an input indicating a second position of the first image; When the second position overlaps with the first polygon, the information processing device The display device further includes deselecting the vertices of the shape and erasing the mark. The display method according to claim 1.

5. the information processing device accepts an input indicating a third position of the first image; The third position overlaps with the second position of the polygon adjacent to the first polygon. If the position overlaps with the smallest second polygon, the information processing device vertices other than the vertices overlapping with the vertices of the first polygon are selected from the Displaying a mark indicating that a vertex other than the vertex overlapping with the vertex of the first polygon has been selected The display method of claim 4 , further comprising:

6. The information processing device further receives range information indicating a range of the first image. Including, Displaying the mark includes: The information processing device detects all polygons at least a part of which is included in the range indicated by the range information. Selecting all vertices in The display device displays a mark indicating that all vertices of the polygon have been selected. And, The display method of claim 1 , comprising:

7. An optical device; A first image including a point cloud and a line segment group connecting points included in the point cloud is captured by the optical device. Displaying the product using a position accepting an input indicating a first location of the first image; Among the polygons formed by the group of line segments, the smallest polygon that overlaps the first position is Selecting at least two vertices; A mark indicating that the at least two vertices have been selected is displayed using the optical device. To show, and accepting an operation to change positions of the at least two vertices in the first image. And, A second vertex is corrected based on the positions before and after the change of the at least two vertices. Displaying the two images on a display surface; A processor executing A projector comprising:

8. On the computer, Displaying a first image including a point cloud and a line segment group connecting points included in the point cloud. and, accepting an input indicating a first location of the first image; Among the polygons formed by the group of line segments, the smallest polygon that overlaps the first position is Selecting at least two vertices; displaying an indicia indicating that the at least two vertices have been selected; and accepting an operation to change positions of the at least two vertices in the first image. And, A second vertex is corrected based on the positions before and after the change of the at least two vertices. Displaying the two images on a display surface; A program that executes the following.

Images