Indication position detection device, indication position detection method, storage medium, and projection system
By integrating a processor and an accelerometer into the projection device and combining them with wireless communication technology, the indicator position in the projected image is detected, solving the problem of insufficient detection accuracy in the prior art and achieving high-precision indicator position detection.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-03-03
- Publication Date
- 2026-03-17
AI Technical Summary
In existing technologies, it is difficult to effectively detect the position of the pointer based on the pointer in the projected image, especially in complex environments, which leads to inconvenience in operation and insufficient accuracy.
By integrating a processor into the projection device, the movement of the indicator is acquired, and a set image is projected onto the projection image. Combined with the operator's input, the indicator position is detected, and the precise positioning of the indicator position is achieved using an accelerometer and wireless communication technology.
It enables high-precision detection of indicated positions in projected images, simplifies the operation process, and improves the system's positioning accuracy and user experience.
Smart Images

Figure CN115989541B_ABST
Abstract
Description
Technical Field
[0001] This invention relates to an indication position detection device, an indication position detection method, a storage medium, and a projection system. Background Technology
[0002] Patent Document 1 describes a structure that uses a hybrid tracking system consisting of an optical tracking subsystem and a motion / direction sensing subsystem to detect the position of the projection point of an indicating device. Patent Document 2 describes a structure that transmits data on the position coordinates of the projected image read by the pen (which cannot be visually confirmed) and data sensed by a built-in 3-axis accelerometer to a data projector device, where a CPU calculates the point position based on the aforementioned data. Patent Document 3 describes a structure that, in addition to transmitting or receiving data from an infrared module, uses motion detection elements such as an accelerometer to detect the position of the scanning pen.
[0003] Previous technical documents
[0004] Patent documents
[0005] Patent Document 1: International Publication No. 2018 / 020497
[0006] Patent Document 2: Japanese Patent Application Publication No. 2012-216928
[0007] Patent Document 3: Japanese Patent Application Publication No. 2010-538400 Summary of the Invention
[0008] One embodiment of the present invention provides an indicator position detection device, indicator position detection method, storage medium, and projection system capable of detecting the indicator position based on an indicator in an image used in projection.
[0009] means for solving technical problems
[0010] An embodiment of the present invention includes a pointer position detection device comprising a processor that performs the following control: acquiring the movement amount of a pointer capable of detecting the movement amount of the pointer position; projecting an image from a projection device including a setting image for setting the origin of the pointer position based on the pointer; acquiring an input result of a setting operation by an operator while the pointer indicates the position represented by the setting image in the projected image; and detecting the pointer position based on the pointer in the image based on the position of the setting image in the image and the movement amount after acquiring the input result of the setting operation.
[0011] In one embodiment of the indication position detection method of the present invention, the processor of the indication position detection device performs the following control: acquiring the movement amount of the indicator body capable of detecting the movement amount of the indication position, and projecting an image including a setting image for setting the origin of the indication position based on the indicator body from a projection device; while the indicator body indicates the position represented by the setting image in the projected image, acquiring the input result of the operator's setting operation, and detecting the indication position based on the indicator body in the image according to the position of the setting image in the image and the movement amount after acquiring the input result of the setting operation.
[0012] The present invention relates to an embodiment of an indication position detection program, which is used to cause the processor of an indication position detection device to perform the following control process: acquiring the movement amount of an indicator capable of detecting the movement amount of the indication position; projecting an image from a projection device including a setting image for setting the origin of the indication position based on the indicator; acquiring an input result of an operator's setting operation while the indicator indicates the position represented by the setting image in the projected image; and detecting the indication position based on the indicator in the image based on the indicator according to the position of the setting image in the image and the movement amount after acquiring the input result of the setting operation.
[0013] The projection system of the present invention includes: a projection device; and an indication position detection device, which performs control to acquire the movement amount of an indicator capable of detecting the movement amount of the indication position, and to project an image including a setting image for setting the origin of the indication position based on the indicator from the projection device. In a state where the indicator indicates the position represented by the setting image in the projected image, the device acquires the input result of the operator's setting operation, and detects the indication position based on the indicator in the image based on the position of the setting image in the image and the movement amount after acquiring the input result of the setting operation.
[0014] Invention Effects
[0015] According to the present invention, an indicator position detection device, indicator position detection method, indicator position detection program, and projection system capable of detecting the indicator position based on an indicator in an image used in projection can be provided. Attached Figure Description
[0016] Figure 1 This is a schematic diagram showing the general structure of the projection device 10, which applies the indicated position detection device of the embodiment.
[0017] Figure 2 It means Figure 1 A schematic diagram of an example of the internal structure of the projection section 1 shown.
[0018] Figure 3 This is a schematic diagram showing the external structure of the projection device 10.
[0019] Figure 4 yes Figure 3 A cross-sectional schematic diagram of the optical unit 106 of the projection device 10 shown.
[0020] Figure 5 This is a specific example (Figure 1) showing the setting image and the origin setting operation used to set the origin.
[0021] Figure 6 Figure 2 is a specific example 1 showing the setting image and origin setting operation used to set the origin.
[0022] Figure 7 This is Figure 2 (of the 1st example) showing the setting image and the specific example of the origin setting operation.
[0023] Figure 8 This is Figure 2 (the second example) showing the setting image and the specific example of the origin setting operation.
[0024] Figure 9 This is a specific example (Figure 1) illustrating the setting image, the first setting operation, and the second setting operation used to generate the first information.
[0025] Figure 10 Figure 2 is a specific example of a setting image, a first setting operation, and a second setting operation used to generate the first information.
[0026] Figure 11 Figure 3 shows a specific example of a setting image, a first setting operation, and a second setting operation used to generate the first information.
[0027] Figure 12 Figure (1) is a specific example 2 illustrating the setting image, the first setting operation, and the second setting operation used to generate the first information.
[0028] Figure 13 Figure 2 is a specific example of a setting image, a first setting operation, and a second setting operation used to generate the first information.
[0029] Figure 14 Figure 3 is a specific example 2 illustrating the setting image, the first setting operation, and the second setting operation used to generate the first information.
[0030] Figure 15 This is a specific example 3 (Figure 1) illustrating the setting image, the first setting operation, and the second setting operation used to generate the first information.
[0031] Figure 16 Figure 3 (the second figure) shows a specific example of the setting image, the first setting operation, and the second setting operation used to generate the first information.
[0032] Figure 17 This is a specific example 3 (Figure 3) illustrating the setting image, the first setting operation, and the second setting operation used to generate the first information.
[0033] Figure 18 Figure 4 is a specific example 3 illustrating the setting image, the first setting operation, and the second setting operation used to generate the first information.
[0034] Figure 19 This is a flowchart illustrating an example of processing based on control device 4.
[0035] Figure 20 This is a diagram illustrating an example of controlling the position of a set image based on the detection results of the indicated location.
[0036] Figure 21 This diagram illustrates an example of controlling the position of a set image based on the setting state of the projection device 10. Detailed Implementation
[0037] Hereinafter, an example of an embodiment of the present invention will be described with reference to the accompanying drawings.
[0038] <Schematic structure of the projection device 10 of the indicated position detection device according to the embodiment>
[0039] Figure 1 This is a schematic diagram showing the general structure of the projection device 10, which applies the indicated position detection device of the embodiment.
[0040] The projection device 10 includes a projection unit 1, a control unit 4, and an operation receiving unit 2. The projection unit 1 is, for example, a liquid crystal projector or an LCOS (Liquid Crystal On Silicon) projector. In the following description, the projection unit 1 will be described as a liquid crystal projector.
[0041] The control device 4 controls the projection based on the projection device 10. Furthermore, the control device 4 is an example of the indication position detection device of the present invention. The control device 4 comprises a control unit that centrally controls the projection unit 1, consisting of various processors; a communication interface (not shown) for communicating with each unit; and a storage medium 4a such as a hard disk, SSD (Solid State Drive), or ROM (Read Only Memory). The various processors serving as the control unit of the control device 4 include general-purpose processors that execute programs to perform various processes, such as CPUs (Central Processing Units), FPGAs (Field Programmable Gate Arrays), and programmable logic devices (PLDs) whose circuit structures can be changed after manufacturing, or dedicated circuits such as ASICs (Application Specific Integrated Circuits) with circuit structures specifically designed for performing specific processes.
[0042] More specifically, these various processors are structured as circuits composed of semiconductor elements and other circuit components. The control unit of the control device 4 can be composed of one of the various processors, or it can be composed of a combination of two or more processors of the same or different types (e.g., a combination of multiple FPGAs or a combination of a CPU and an FPGA).
[0043] The operation receiving unit 2 receives various operations from the user and detects instructions from the user (user instructions). The operation receiving unit 2 may be a button, key, joystick, or other similar device installed on the control device 4, or it may be a receiving unit that receives signals from a remote controller that performs remote operation of the control device 4.
[0044] The object to be projected 6 is an object such as a screen having a projection surface that displays the projected image through the projection unit 1. Figure 1 In the example shown, the projection surface of the projected object 6 is a rectangular plane. Figure 1 The top, bottom, left, and right sides of the projected object 6 are set to the actual top, bottom, left, and right sides of the projected object 6.
[0045] The projection area 11, illustrated by a single-dot-dash line, is the area in the projected object 6 illuminated by projection light emanating from the projection unit 1. Figure 1 In the example described, the projection area 11 is rectangular. The projection area 11 is part or all of the projectable range that can be projected by the projection unit 1.
[0046] Furthermore, the projection unit 1, the control device 4, and the operation receiving unit 2 are implemented, for example, by a single device (see, for example, reference). Figure 3 , Figure 4 Alternatively, the projection unit 1, the control device 4, and the operation receiving unit 2 can be separate devices that cooperate by communicating with each other.
[0047] < Figure 1 The internal structure of the projection section 1 shown >
[0048] Figure 2 It means Figure 1 A schematic diagram of an example of the internal structure of the projection section 1 shown.
[0049] like Figure 2 As shown, the projection unit 1 includes a light source 21, a light modulation unit 22, a projection optical system 23, and a control circuit 24.
[0050] The light source 21 includes light-emitting elements such as lasers or LEDs (Light Emitting Diodes), for example, emitting white light.
[0051] The light modulation unit 22 consists of three liquid crystal panels. These liquid crystal panels modulate the light emitted from the light source 21, which has been separated into red, blue, and green colors by a color separation mechanism (not shown), according to image information, to emit images of each color. Red, blue, and green filters can be mounted on the three liquid crystal panels respectively, and each liquid crystal panel can modulate the white light emitted from the light source 21 to emit images of each color.
[0052] The projection optical system 23 is used to receive light from the light source 21 and the light modulation unit 22, and is composed of, for example, a relay optical system including at least one lens. The light passing through the projection optical system 23 is projected onto the object 6 to be projected.
[0053] The area of the object 6 illuminated by light that passes through the light modulation unit 22 becomes the projectable area that can be projected by the projection unit 1. The area within this projectable area illuminated by light that actually passes through the light modulation unit 22 becomes the projection area 11. For example, by controlling the size, position, and shape of the area through which light passes in the light modulation unit 22, the size, position, and shape of the projection area 11 within the projectable area can be changed.
[0054] The control circuit 24 controls the light source 21, the light modulation unit 22, and the projection optical system 23 based on the display data input from the control device 4, thereby projecting an image based on the display data onto the object 6. The display data input to the control circuit 24 consists of three types: red display data, blue display data, and green display data.
[0055] Furthermore, the control circuit 24 modifies the projection optical system 23 according to the command input from the control device 4, thereby projecting the projection area 11 of the projection unit 1 (see reference). Figure 1 The projection area 11 of the projection unit 1 can be moved by changing the projection optical system 23 according to the operation received from the user through the operation receiving unit 2.
[0056] Furthermore, the projection device 10 has a displacement mechanism that maintains the image ring of the projection optical system 23 while mechanically or optically moving the projection area 11. The image ring of the projection optical system 23 is the area where the projection light incident on the projection optical system 23 passes through the projection optical system 23 appropriately from points such as light intensity reduction, color separation, and peripheral curvature.
[0057] The displacement mechanism is implemented by at least one of an optical system displacement mechanism for performing optical system displacement and an electronic displacement mechanism for performing electronic displacement.
[0058] The optical system displacement mechanism is, for example, a mechanism that moves the projection optical system 23 in a direction perpendicular to the optical axis (e.g., see reference). Figure 3 , Figure 4 Alternatively, a mechanism can be used to move the movable light modulation unit 22 in a direction perpendicular to the optical axis instead of moving the projection optical system 23. Furthermore, the optical system displacement mechanism can be combined to move both the projection optical system 23 and the light modulation unit 22.
[0059] The electronic displacement mechanism is a mechanism that simulates the displacement of the projection area 11 by changing the light transmission range in the light modulation unit 22.
[0060] Furthermore, the projection device 10 may include a projection direction changing mechanism that moves the projection area 11 together with the image ring of the projection optical system 23. The projection direction changing mechanism is a mechanism that changes the projection direction of the projection unit 1 by mechanically rotating it to change its orientation (for example, see reference...). Figure 3 , Figure 4 ).
[0061] <Mechanical Structure of Projection Device 10>
[0062] Figure 3 This is a schematic diagram showing the external structure of the projection device 10. Figure 4 yes Figure 3 A cross-sectional schematic diagram of the optical unit 106 of the projection device 10 shown. Figure 4 Indicates from Figure 3 The cross-section of the surface along the light path of the light emitted from the main body 101 shown.
[0063] like Figure 3As shown, the projection device 10 includes a main body 101 and an optical unit 106 protruding from the main body 101. Figure 3 In the structure shown, the operation receiving unit 2, the control device 4, the light source 21, the light modulation unit 22, and the control circuit 24 in the projection unit 1 are disposed in the main body 101. The projection optical system 23 in the projection unit 1 is disposed in the optical unit 106.
[0064] The optical unit 106 includes: a first component 102 supported by the main body 101; and a second component 103 supported by the first component 102.
[0065] Alternatively, it can be a component that integrates the first part 102 and the second part 103. The optical unit 106 can be configured (in other words, configured to be interchangeable) to be freely mounted and detached from the main body 101.
[0066] The main body 101 has an opening 15a (reference) formed in the portion connected to the optical unit 106 for the passage of light. Figure 4 ) frame 15 (reference) Figure 4 ).
[0067] like Figure 3 As shown, a light source 21 and a light modulation unit 12 are disposed inside the frame 15 of the main body 101. The light modulation unit 12 includes a light modulation section 22 (see reference) that spatially modulates the light emitted from the light source 21 according to the input image data to generate an image. Figure 2 ).
[0068] Light emitted from the light source 21 is incident on the light modulation section 22 of the light modulation unit 12 and is spatially modulated by the light modulation section 22 before being emitted.
[0069] like Figure 4 As shown, an image formed by light spatially modulated by the light modulation unit 12 is incident on the optical unit 106 through the opening 15a of the frame 15 and projected onto the object 6, which is the object of projection, so that the observer can visually recognize the image G1.
[0070] like Figure 4 As shown, the optical unit 106 includes: a first component 102 having a hollow portion 2A connected to the interior of the main body 101; a second component 103 having a hollow portion 3A connected to the hollow portion 2A; a first optical system 121 and a reflective component 122 disposed in the hollow portion 2A; a second optical system 31, a reflective component 32, a third optical system 33, and a lens 34 disposed in the hollow portion 3A; a displacement mechanism 105; and a projection direction changing mechanism 104.
[0071] The first component 102 is a rectangular component with a cross-sectional shape, and openings 2a and 2b are formed on mutually perpendicular surfaces. The first component 102 is supported by the main body 101 with opening 2a positioned opposite to opening 15a. Light emitted from the light modulation section 22 of the light modulation unit 12 in the main body 101 enters the hollow portion 2A of the first component 102 through openings 15a and 2a.
[0072] The incident direction of light from the main body 101 to the hollow part 2A is recorded as direction X1, the opposite direction of direction X1 is recorded as direction X2, and directions X1 and X2 are collectively recorded as direction X. Furthermore, in Figure 4 In this diagram, the direction from the front of the paper toward the inside and the opposite direction are recorded as direction Z. Within direction Z, the direction from the front of the paper toward the inside is recorded as direction Z1, and the direction from the inside of the paper toward the front is recorded as direction Z2.
[0073] Furthermore, the direction perpendicular to both direction X and direction Z is recorded as direction Y. Within direction Y, [the following will be included / distributed]. Figure 4 The direction upwards is recorded as direction Y1, and will be... Figure 4 The direction downwards is recorded as direction Y2. Figure 4 In the example, the projection device 10 is configured such that direction Y2 is the vertical direction.
[0074] Figure 2 The projection optical system 23 shown consists of a first optical system 121, a reflective component 122, a second optical system 31, a reflective component 32, a third optical system 33, and a lens 34. Figure 4 The optical axis K of the projection optical system 23 is shown. The first optical system 121, the reflective component 122, the second optical system 31, the reflective component 32, the third optical system 33, and the lens 34 are arranged sequentially along the optical axis K from the light modulation unit 22 side.
[0075] The first optical system 121 includes at least one lens that guides light incident from the main body 101 onto the first component 102 and traveling in the direction X1 to the reflective component 122.
[0076] The reflecting member 122 reflects light incident from the first optical system 121 in the direction Y1. The reflecting member 122 is, for example, a mirror. In the first component 102, an opening 2b is formed in the optical path of the light reflected by the reflecting member 122, and the reflected light travels through the opening 2b toward the hollow portion 3A of the second component 103.
[0077] The second component 103 has a generally T-shaped cross-section, and an opening 3a is formed in the first component 102 opposite to the opening 2b. Light from the main body 101 passing through the opening 2b of the first component 102 enters the hollow portion 3A of the second component 103 through the opening 3a. Furthermore, the cross-sectional shape of either the first component 102 or the second component 103 is arbitrary and not limited to the above.
[0078] The second optical system 31 includes at least one lens that guides light incident from the first component 102 to the reflective component 32.
[0079] The reflecting component 32 reflects light incident from the second optical system 31 in the direction X2 and guides it to the third optical system 33. The reflecting component 32 is, for example, a mirror.
[0080] The third optical system 33 includes at least one lens that guides light reflected by the reflecting component 32 to the lens 34.
[0081] Lens 34 is disposed at the end of the second component 103 such that it closes the opening 3c formed at the end on the X2 side. Lens 34 projects light incident from the third optical system 33 onto the object 6 to be projected.
[0082] The projection direction changing mechanism 104 is a rotating mechanism that rotatably connects the second component 103 to the first component 102. Through this projection direction changing mechanism 104, the second component 103 is configured to rotate freely about a rotation axis (specifically, the optical axis K) extending in the Y direction. Furthermore, the projection direction changing mechanism 104 is not limited to any mechanism that can rotate the optical system. Figure 4 The configuration positions are shown. Furthermore, the number of rotating mechanisms is not limited to one; multiple mechanisms can be configured.
[0083] The displacement mechanism 105 is used to move the optical axis K of the projection optical system (in other words, the optical unit 106) along a direction perpendicular to its optical axis K. Figure 4 The displacement mechanism 105 is configured to change the position of the first component 102 relative to the main body 101 in the direction Y. In addition to moving the first component 102 manually, the displacement mechanism 105 can also move the first component 102 electrically.
[0084] Figure 4 This indicates that the first component 102 has moved to its maximum extent in the direction Y1 via the displacement mechanism 105. Figure 4In the state shown, the first component 102 moves in the direction Y2 via the displacement mechanism 105, thereby changing the relative position of the center of the image formed by the light modulation unit 22 (in other words, the center of the display surface) with the optical axis K, and enabling the image G1 projected onto the object 6 to be displaced (parallel moved) in the direction Y2.
[0085] Alternatively, the displacement mechanism 105 can be a mechanism that moves the light modulation unit 22 in the Y direction instead of the mechanism that moves the optical unit 106 in the Y direction. In this case, the image G1 projected onto the object 6 can also be moved in the Y direction.
[0086] <Setting image for setting the origin and origin setting operation based on operator 51>
[0087] Figure 5 and Figure 6 This is a diagram illustrating a specific example 1 of setting the origin image and the origin setting operation. Figure 5 , Figure 6 The operator 51 shown holds the pointer 52 and can use the pointer 52 to indicate various parts of the projected object 6. The pointer 52 is, for example, rod-shaped and can be used for tip-based pointing.
[0088] The indicator 52 has a sensor capable of detecting movement of the indicated position based on the indicator 52. Detection of the movement of the indicated position includes detection of the direction of movement and detection of the amount of movement. This sensor may include, for example, an accelerometer capable of measuring three-dimensional acceleration, and may be disposed at the top of the indicator 52.
[0089] Using the indicator 52, an origin setting operation can be performed to set the position indicated by the indicator 52 as an input value to the control device 4. This origin setting operation is an example of the setting operation of the present invention. For example, if a sensor (touch sensor) that senses contact with the projected object 6 is provided at the top of the indicator 52, the origin setting operation is an operation in which the top of the indicator 52 contacts the projected object 6, that is, an operation in which the top of the indicator 52 touches the projected object 6. This origin setting operation (touch) is an example of an operation that inputs data to an input section (e.g., a touch sensor) provided on the indicator 52.
[0090] Furthermore, the indicator 52 directly or indirectly transmits information such as the movement detection result, the origin setting operation, and the reception result of the first setting operation or the second setting operation described later to the control device 4. For example, the indicator 52 can communicate with the operation receiving unit 2 of the control device 4 via wireless communication such as short-range wireless communication, and transmit information to the control device 4 via wireless communication with the operation receiving unit 2.
[0091] For example, the indicator 52 detects movement at a predetermined cycle and sends the detection results to the control device 4, and sends the receiving results of each set operation to the control device 4 at the time of receiving the set operation.
[0092] Alternatively, the indicator 52 can perform movement detection and accumulate detection results at a predetermined cycle, and at the time of receiving setting operations such as origin setting operations, send the received result of the setting operation and the accumulated movement detection results to the control device 4 together. In this case, the indicator 52 can send all the accumulated movement detection results to the control device 4, and send the result of accumulating the accumulated movement detection results to the control device 4.
[0093] The control device 4 receives information sent from the indicator 52 to obtain information indicating movement (movement direction and amount) based on the indicated position of the indicator 52. Furthermore, the control device 4 performs the following control: projects an image 50, including a setting image 50a for setting the origin based on the indicated position of the indicator 52, from the projection unit 1 onto the projection area 11.
[0094] Image 50a is set to become a marked image for operator 51. Figure 5 In the example, the asterisk is positioned at the origin in image 50. Furthermore, the shape of image 50a can be arbitrarily determined. The position of image 50a in image 50 can be arbitrarily determined in advance.
[0095] In addition, if the projection area 11 is large, the setting image 50a can be configured in the lower part of the image 50 so that the operator 51 can easily touch the projected setting image 50a through the indicator 52.
[0096] Thus, the control device 4 projects an image 50, including the setting image 50a, from the projection unit 1, urging the operator 51 to perform the origin setting operation while the setting image 50a is indicated by the indicator 52. At this time, the control device 4 can output a message urging the operator 51 to perform the origin setting operation while the indicator 52 is indicated, through sound output, screen display, or projection based on the projection device 10.
[0097] In contrast, operator 51 performs the origin setting operation while the setting image 50a is indicated by indicator 52. Specifically, as follows: Figure 6 As shown, the operator 51 performs an origin setting operation by touching the part of the projection object 6 on which the setting image 50a is projected by the top of the indicator 52.
[0098] The control device 4 acquires the input result of the origin setting operation, and detects the indication position based on the indicator 52 in the image 50 according to the position of the setting image 50a in the image 50 and the movement (movement direction and movement amount) of the indication position based on the indicator 52 after acquiring the input result of the origin setting operation.
[0099] That is, in the control device 4, the position indicated by the indicator 52 at the moment when the origin setting operation occurs is identified as the position of the setting image 50a in the image 50. Then, the position of the setting image 50a in the image 50 is set as the origin, and the position indicated by the indicator 52 in the image 50 is detected based on the movement (movement direction and movement amount) of the position indicated by the indicator 52. The position indicated by the indicator 52 in the image 50 is represented, for example, by the pixel position within the image 50.
[0100] For example, the control device 4 accumulates the detection results of the movement of the indicated position based on the indicator 52 during the period after the origin setting operation, and corrects the position (origin) of the setting image 50a in the image 50 by the accumulated results when a specific event occurs (e.g., a touch that is the same as the origin setting operation), and detects the indicated position based on the indicator 52 in the image 50 when the event occurs.
[0101] Furthermore, the detection results of the movement of the indicator position include the detection results of the movement direction and the amount of movement. The accumulation of the detection results of the movement of the indicator position is performed by offsetting the amount of movement through the difference in the movement direction. For example, if the indicator position moves 2cm to the right and then moves 1cm to the left, the accumulated result of the detection results of the movement of the indicator position is "1cm to the right".
[0102] Alternatively, the control device 4 can sequentially correct the position of the setting image 50a in the image 50 by detecting the movement of the indicator 52 during the period after the origin setting operation, thereby enabling detection to follow the indicated position of the indicator 52 in the image 50.
[0103] Therefore, for example, without capturing the projected image 50 and the indicator 52 using a camera device, it is possible to detect the indication position in the image 50 based on the indicator 52. Thus, it is possible to achieve the detection of the indication position based on the indicator 52 while reducing the manufacturing cost of the projection device 10 or the projection system including the projection device 10.
[0104] When the control device 4 detects the indicated position in the image 50 based on the detection result of the movement of the indicated position based on the indicator 52 and the position of the set image 50a in the image 50, in order to convert the amount of movement based on the indicated position of the indicator 52 into the amount of movement on the image 50, it uses the first information indicating the relationship between the size of the projected image in the projected object 6 and the size of the image 50.
[0105] The size of image 50 is the size of the image projected by projection device 10. It can be the number of pixels in the image or the size of the image in light modulation unit 22 (the size of the liquid crystal panel of light modulation unit 22). The first information is, for example, the ratio of the size of image 50 projected onto object 6 to the size of the image projected by projection device 10.
[0106] The first information is, for example, pre-stored in the storage medium 4a of the control device 4 based on the measured result of the size of the projection area 11. Alternatively, the control device 4 can generate the first information based on the operation relative to the indicator 52 (e.g., referring to...). Figures 9-18 ).
[0107] Figure 7 and Figure 8 This is a diagram illustrating a specific example 2 of the setting image and origin setting operation used to set the origin. Figure 5 , Figure 6 In the example shown, a setting image 50a, which is the position of the origin in the image 50, is described as a setting image for setting the origin of the indicator position based on the indicator body 52, but the setting image is not limited to this.
[0108] For example, such as Figure 7 As shown, the control device 4 can perform the following control: projecting an image 50, including a setting image 50b for setting the origin based on the indicator position of the indicator 52, from the projection unit 1 onto the projection area 11. Figure 7 In the example, image 50b is defined as four arrows pointing to the location in image 50 that becomes the origin. For example... Figure 8 As shown, the operator 51 performs an origin setting operation by touching the part pointed to by the setting image 50b in the projection object 6 with the top of the indicator 52.
[0109] That is, the setting image used to set the origin of the indication position based on the indicator body 52 is not limited to an image configured at the origin of the indication position based on the indicator body 52, but can be an image that indirectly represents the origin of the indication position based on the indicator body 52.
[0110] <Operator-based first and second operations of projection device 10>
[0111] Figures 9-11This is a diagram illustrating a specific example 1 of the setting image, the first setting operation, and the second setting operation used to generate the first information. Figure 5 , Figure 6 Before the state shown, as Figure 9 As shown, the control device 4 can project an image 50 containing setting images 50c and 50d for generating the first information from the projection device 10. Setting images 50c and 50d are pentagonal shapes representing the first and second positions within the image 50, respectively. The first and second positions within the image 50 are predetermined positions of the setting image 50a. Furthermore, the shapes of the setting images 50c and 50d can be arbitrarily determined.
[0112] Thus, the control device 4 projects an image 50 containing setting images 50c and 50d from the projection unit 1, prompting the operator 51 to perform a first setting operation when the pointer 52 indicates the first position in the projected image (the projected image 50), and then to perform a second setting operation when the pointer 52 indicates the second position in the projected image. At this time, the control device 4 can output a message to the operator 51 via sound output, screen display, or projection based on the projection device 10, urging the operator to perform a second setting operation when the pointer 52 indicates the second position in the projected image, after the first setting operation is performed when the pointer 52 indicates the first position.
[0113] In contrast, after performing a first setting operation while the indicator 52 indicates a first position in the projected image, the operator 51 performs a second setting operation while the indicator 52 indicates a second position in the projected image. The first and second setting operations can be the same as the origin setting operation or different from it. In this example, both the first and second setting operations can be the same as the origin setting operation, and both involve touching the projected object 6 with the tip of the indicator 52.
[0114] For example, such as Figure 10 As shown, the operator 51 performs a first setting operation by touching the portion of the projection object 6 where the setting image 50c is projected, with the tip of the indicator 52 touching the part of the projection object 6. Afterwards, as... Figure 11 As shown, the operator 51 performs a second setting operation by touching the part of the projection object 6 on which the setting image 50d is projected by the tip of the indicator 52.
[0115] The control device 4 obtains the first information, which indicates the relationship between the size of the projected image in the projected object 6 and the size of the image 50, based on the detection result of the movement of the indicator position of the indicator 52 from the detection of the first setting operation to the detection of the second setting operation.
[0116] For example, the control device 4 can derive the distance between the first position of the projected setting image 50c and the second position of the projected setting image 50d in the projected object 6 by accumulating the detection results of the movement of the indicated position based on the indicator 52 from the detection of the first setting operation to the detection of the second setting operation. Furthermore, the distance (e.g., the number of pixels) between the setting images 50c and 50d within the image 50 is known in the control device 4.
[0117] Therefore, the control device 4 can derive the ratio of the distance between the derived first position and the second position to the distance between the known set images 50c and 50d as first information representing the relationship between the size of the projected image in the projected object 6 and the size of the image 50.
[0118] Moreover, control device 4, for example Figure 5 The image 50 shown is projected from the projection device 10, including the set image 50a, according to... Figure 6 The origin setting operation shown sets the origin based on the indicated position of the indicator body 52, and detects the subsequent indicated position based on the indicator body 52 according to the acquired first information.
[0119] Furthermore, for example, the setting image 50d representing the second position ( Figures 9-11 The setting image 50a also acts on the setting origin. Figure 5 etc.), the second setting operation ( Figure 11 It can also be used for origin setting operations. Figure 6 (etc.). That is, control device 4 is performing... Figure 11 During the second setting operation shown, the second position shown in the setting image 50d can be set as the origin based on the indication position of the indicator body 52. In this case, the operator 51 does not need to perform the origin setting operation separately from the second setting operation.
[0120] Figures 12-14 This is a diagram illustrating a specific example 2 of the setting image, the first setting operation, and the second setting operation used to generate the first information. For example, as shown... Figure 12 As shown, the control device 4 can first perform the following control: project an image 50 containing the set image 50c but not the set image 50d from the projection unit 1 onto the projection area 11. For example... Figure 13 As shown, the operator 51 performs the first setting operation by touching the portion of the projection setting image 50c in the projection object 6 with the top of the indicator 52.
[0121] When detecting the first setting operation, such as Figure 14 As shown, the control device 4 performs the following control: projects an image 50, which includes the set image 50d but does not include the set image 50c, from the projection unit 1 onto the projection area 11. For example... Figure 14As shown, the operator 51 performs a second setting operation by touching the part of the projection object 6 on which the setting image 50d is projected by the tip of the indicator 52.
[0122] Thus, after the control device 4 projects an image 50 from the projection device 10 containing a setting image 50c indicating a first position within the image 50, it then projects an image 50 from the projection device 10 containing a setting image 50d indicating a second position within the image 50. This allows the operator 51 to be prompted to perform a first setting operation while the indicator 52 indicates the first position in the projected image (the projected image 50), and then to perform a second setting operation while the indicator 52 indicates the second position in the projected image. In this case, the control device 4 also... Figures 9-11 The example shown is the same, and the first information is obtained based on the movement of the indicator position of the indicator body 52 from the detection of the first setting operation to the detection of the second setting operation.
[0123] Figures 15-18 This is a diagram illustrating a specific example 3 of the setting image, the first setting operation, and the second setting operation used to generate the first information. For example, as shown... Figure 15 As shown, the control device 4 can perform the following control: projecting an image 50 containing a setting image 50e for generating the first information from the projection unit 1 to the projection area 11.
[0124] Image 50e is set via a horizontal rectangular connection. Figures 9-11 The diagram shows the shapes of the setting images 50c and 50d. The first end (pentagonal portion) of the setting image 50e represents the first position, and the second end (pentagonal portion) of the setting image 50e represents the second position.
[0125] like Figure 16 As shown, operator 51 performs a first setting operation by touching the first end of the projection object 6, on which the setting image 50e is projected, with the tip of the indicator 52. Then, as a second setting operation, as... Figure 17 As shown, with the top of the indicator 52 in contact with the projected object 6, the operator 51 moves the indicator position of the indicator 52 from the first end of the set image 50e to the second end of the set image 50e, as follows: Figure 18 As shown, the top of the indicator 52 is separated from the projected object 6.
[0126] The control device 4 obtains the first information, which indicates the relationship between the size of the projected image in the projected object 6 and the size of the image 50, based on the detection result of the movement of the indicator 52 according to the indicated position of the indicator 52 from the moment the top of the indicator 52 touches the projected object 6 (the first setting operation is detected) until the top of the indicator 52 is separated from the projected object 6 (the second setting operation is detected).
[0127] Thus, the second setting operation in the state where the indicator 52 indicates the second position can be an operation that separates the top of the indicator 52 from the projected object 6 from the state where the top of the indicator 52 is in contact with the part corresponding to the second position in the projected object 6.
[0128] <Processing based on control device 4>
[0129] Figure 19 This is a flowchart illustrating an example of processing based on control device 4. Control device 4 executes [the following steps] when it begins detecting the indicated position. Figure 19 The processing shown. Figure 19 The process shown is divided into a process for generating the first information (steps S191 to S195) and a process for detecting the indicated position based on the first information (steps S196 to S199).
[0130] First, the control device 4 projects an image 50 containing a setting image for generating the first information from the projection device 10 (step S191). As an example, such as... Figure 9 As shown, the control device 4 projects an image 50 containing set images 50c and 50d from the projection device 10.
[0131] Next, the control device 4 remains in standby mode until the first setting operation is sensed (step S192). For example, the control device 4 remains in standby mode until the first setting operation detects the first touch of the tip of the indicator 52 onto the projected object 6 (e.g., referring to...). Figure 10 Until then. When the control device 4 senses the first setting operation, it begins to accumulate the detection results based on the movement of the indicated position of the indicator 52 (step S193).
[0132] Next, the control device 4 remains on standby until the second setting operation is sensed (step S194). For example, the control device 4 detects a second touch of the projected object 6 based on the tip of the indicator 52 as the second setting operation (e.g., referring to...). Figure 11 The system remains in standby mode until the second setting operation is detected. When the control device 4 detects the second setting operation, it generates the first information based on the detection results accumulated from step S193 (step S195).
[0133] Next, the control device 4 projects an image 50 from the projection device 10, which includes a setting image for setting the origin based on the indicated position of the indicator 52 (step S196). As an example, such as... Figure 5 As shown, the control device 4 projects an image 50 containing a set image 50a from the projection device 10.
[0134] Next, the control device 4 remains on standby until the origin setting operation is sensed (step S197). For example, the control device 4 detects a third touch of the projected object 6 based on the top of the indicator 52 during the origin setting operation (e.g., referring to...). Figure 6 The system remains in standby mode until the origin setting operation is detected. When the control device 4 senses the origin setting operation, it begins to accumulate the detection results based on the movement of the indicated position of the indicator 52 (step S198).
[0135] Next, the control device 4 starts detecting the indication position based on the indicator body 52 according to the detection results accumulated from step S198 and the first information generated through step S195 (step S199), and ends a series of processes when starting to detect the indication position.
[0136] Alternatively, if, for example, the first information is pre-stored in the storage medium 4a of the control device 4 based on the measured size of the projection area 11, the control device 4 can omit the processing for generating the first information (steps S191 to S195) and start processing from step S196. In this case, in step S199, the control device 4 starts detecting the indicated position based on the first information stored in the storage medium 4a.
[0137] <Processing based on the change in distance between the projection device 10 and the projected object 6>
[0138] For example, if at least one of the projection device 10 and the projected object 6 moves, and the distance between the projection device 10 and the projected object 6 (projected image) changes, the relationship between the size of the projected image in the projected object 6 and the size of the image 50 changes. Therefore, when the control device 4 senses a change in the distance between the projection device 10 and the projected object 6, it can execute... Figure 19 The process is shown. Thus, even if the distance between the projection device 10 and the projected object 6 changes, the indicated position based on the indicator 52 can continue to be detected.
[0139] For example, the control device 4 can sense changes in the distance between the projection device 10 and the projected object 6 based on the distance sensor provided by the projection device 10. Alternatively, the control device 4 can sense changes in the distance between the projection device 10 and the projected object 6 based on changes in the state (focal position) of the focusing lens included in the projection optics system 23 of the projection device 10. Changes in the state of the focusing lens can be based on changes in the focal position of manual focusing or changes in the focal position of automatic focusing.
[0140] <Processing based on changes in the focal distance in the projection lens of the projection device 10>
[0141] For example, if the focal distance of the projection lens included in the projection optics system 23 of the projection device 10 changes, the distance between the projection device 10 and the projected object 6 changes, and the relationship between the size of the projected image in the projected object 6 and the size of the image 50 is likely to change. Therefore, if the control device 4 senses a change in the focal distance of the projection lens included in the projection optics system 23 of the projection device 10, it can execute... Figure 19 The process is shown. Thus, even if the distance between the projection device 10 and the projected object 6 changes, the indicated position based on the indicator 52 can continue to be detected.
[0142] For example, if the projection lens in the projection optical system 23 includes a zoom lens, and the focal distance of the zoom lens changes, the control device 4 can sense the change in the focal distance of the zoom lens based on the signal from the control circuit 24 of the projection unit 1. Furthermore, if the projection lens of the projection optical system 23 is replaceable, and the projection lens of the projection optical system 23 is replaced with a lens with a different focal distance, the control device 4 can sense the change in focal distance based on the lens replacement based on the signal from the control circuit 24 of the projection unit 1.
[0143] <Processing at specified intervals>
[0144] As described above, the control device 4 can detect the indicated position based on the indicator 52 by detecting the movement of the indicated position based on the indicator 52 after the origin setting operation is performed. However, the longer the time elapsed since the origin setting operation, the more the error in the detection result accumulates, resulting in a decrease in the detection accuracy of the indicated position based on the indicator 52.
[0145] Therefore, control device 4 can, for example, perform Figure 19 After the series of processes shown, execution is performed at specified intervals. Figure 19 The steps S196 to S199 are shown. By resetting the origin at predetermined intervals, errors in the detection results accumulate, thereby suppressing a decrease in detection accuracy.
[0146] <An example of controlling the position of a set image based on the detection results of the indicated position>
[0147] Figure 20 This diagram illustrates an example of controlling the position of a setting image based on the detection result of the indicator position. The control device 4 can control the image 50, which contains a setting image for setting the origin of the indicator position based on the indicator 52, to be projected from the projection device 10 after detecting the indicator position based on the indicator 52, and change the position of the setting image in the image 50 according to the detection result of the indicator position.
[0148] For example, as described above, control device 4 performs [operations] at predetermined intervals. Figure 19 The steps S196 to S199 are shown. Furthermore, in step S196, the control device 4, as... Figure 5 The image 50 shown is projected from the projection device 10 and includes the set image 50a. Here, the two regions that divide the image 50 into left and right parts will be described.
[0149] In step S196, the control device 4 determines whether the detected indication position based on the indicator 52 is included in the left region or the right region of the image 50.
[0150] If the detected indication location is determined to be within the right region of image 50, then the indicator 52 is highly likely to be located near the right region of image 50 projected onto the object 6. In this case, such as Figure 5 As shown, the control device 4 projects the image 50 containing the set image 50a from the projection device 10 onto the right area.
[0151] On the other hand, if the detected indication position is determined to be within the left region of image 50, the indication 52 is highly likely to be located near the left region of image 50 projected onto the object 6. In this case, such as Figure 20 As shown, the control device 4 projects the image 50 containing the set image 50a from the projection device 10 onto the left area.
[0152] Therefore, in step S196, the image 50a is projected onto a position where the operator 51 can easily perform the origin setting operation, thus reducing the operator's workload.
[0153] The two regions that divide the image 50 into two parts have been described, but the setting image 50a can be further subdivided so that the control device 4 can more precisely control the position of the setting image 50a in the image 50.
[0154] <An example of controlling the position of a set image based on the setting state of the projection device 10>
[0155] Figure 21 This diagram illustrates an example of controlling the position of a set image based on the setting state of the projection device 10. The control device 4 can control the position of the set image in the image 50 according to the setting state of the projection device 10.
[0156] For example, in Figure 5 In the example shown, the projection device 10 is positioned on the floor or similar surface. If the projection area 11 on the object 6 is large in the vertical direction, such as... Figure 5As shown, by projecting the image 50a onto the lower portion of the image 50, the operator 51 can easily perform the origin setting operation (touch of the projected setting image 50a).
[0157] On the other hand, such as Figure 21 As shown, the projection device 10 is installed in a suspended state from the ceiling or the like, relative to... Figure 5 For example, if the projection device 10 is inverted, the image 50 is also inverted. Therefore, in this state, it is difficult for the operator 51 to perform the origin setting operation when setting the image 50a to be projected onto the upper part of the image 50.
[0158] In contrast, when the projection device 10 is in an inverted state, the control device 4 changes the position of the setting image 50a in the image 50 by projecting the setting image 50a onto the lower portion of the image 50. Therefore, regardless of the setting state of the projection device 10, the operator 51 can easily perform the origin setting operation.
[0159] For example, the control device 4 can detect the setting status of the projection device 10 based on the detection results of a level sensor or the like installed on the projection device 10. Alternatively, the user (e.g., operator 51) can set the setting status of the projection device 10 to the control device 4, and the control device 4 can detect the setting status of the projection device 10 based on the user's settings.
[0160] Furthermore, if the setting image 50a is asymmetrical in the vertical direction, the control device 4 can project an image 50 containing the setting image 50a that is flipped in the vertical direction from the projection device 10, so that the projected setting image 50a will not be upside down.
[0161] As explained above, according to the projection device 10, an image 50 containing a setting image 50a for setting the origin of the indication position based on the indicator 52 is projected from the projection device 10. When the position represented by the setting image 50a in the projected image is indicated by the indicator 52, the input result of the setting operation of the operator 51 is obtained. The indication position based on the indicator 52 in the image 50 can be detected according to the position of the setting image 50a in the image 50 and the amount of movement of the indication position after obtaining the input result of the setting operation.
[0162] Therefore, for example, without capturing the projected image 50 and the indicator 52 using a camera device, it is possible to detect the indication position based on the indicator 52 in the image used in the projection. Thus, it is possible to achieve the detection of the indication position based on the indicator 52 while suppressing the manufacturing cost of the projection device 10 or the projection system including the projection device 10.
[0163] <Variation Example 1>
[0164] As an example of setting the origin point for inputting to the input section provided on the indicator body 52, the operation of touching the projected object 6 by the top of the indicator body 52 has been described. However, setting the origin point for inputting to the input section provided on the indicator body 52 can also be, for example, pressing a button provided on the indicator body 52.
[0165] Furthermore, the origin setting operation is not limited to inputting data to the input section provided on the indicator 52; it can also be an input operation to the input section provided on the object 6 (projected surface) on which the projected image is projected. For example, if a touch sensor is provided on the object 6, the origin setting operation can be an operation in which the object 6 is touched by the top of the indicator 52 to input data to the input section (touch sensor) provided on the object 6 (projected surface).
[0166] The origin setting operation has been explained, but the same variations can be performed on the first or second setting operation.
[0167] <Variation Example 2>
[0168] The application of the indication position detection device of the embodiment to the projection device 10 has been described, but the device is not limited to this structure. For example, the indication position detection device of the embodiment may be other devices capable of communicating directly or indirectly with the projection device 10. For example, the indication position detection device of the embodiment may be a personal computer or the like capable of communicating with the projection device 10. In this case, the indication position detection device of the embodiment performs the above-described indication position detection process by communicating with the projection device 10.
[0169] This instruction manual contains at least the following information. (1)
[0171] A position detection device includes a processor that performs the following control: acquiring the movement amount of an indicator capable of detecting the movement amount of the indicated position.
[0172] An image is projected from the projection device, including a setting image for setting the origin based on the indicated position of the aforementioned indicator.
[0173] While the position indicated by the aforementioned indicator in the projected image is that of the preset image, the input result of the operator's preset operation is obtained.
[0174] Based on the position of the setting image in the above image and the amount of movement after obtaining the input result of the setting operation, the indication position based on the indicator in the above image is detected. (2)
[0176] According to the position detection device described in (1), wherein,
[0177] The above setting operation includes the operation of inputting data to the input section provided on the above indicator body. (3)
[0179] According to the position detection device described in (1) or (2), wherein,
[0180] The above setting operation includes inputting data to the input section provided on the projection surface on which the above-projected image is projected. (4)
[0182] The indicating position detection device according to any one of (1) to (3), wherein,
[0183] The processor described above performs the following control:
[0184] According to the first piece of information indicating the relationship between the size of the projected image and the size of the image,
[0185] The position of the aforementioned set image in the above image, and
[0186] The indicated position in the image based on the indicator is detected by detecting the amount of movement after the above setting operation. (5)
[0188] According to the position detection device described in (4), wherein,
[0189] The processor described above performs the following control:
[0190] An image is projected from the projection device, including a set image representing the first position and the second position within the aforementioned image.
[0191] After urging the operator to perform the first setting operation while the indicator points to the first position in the projected image, the operator then performs the second setting operation while the indicator points to the second position in the projected image.
[0192] The first information is obtained based on the detection results of the indicator from the detection of the first setting operation to the detection of the second setting operation. (6)
[0194] According to the position detection device described in (4), wherein,
[0195] The processor described above performs the following control:
[0196] After projecting an image including a set image displaying the first position within the aforementioned image from the aforementioned projection device, an image including a set image displaying the second position within the aforementioned image is then projected from the aforementioned projection device.
[0197] After urging the operator to perform the first setting operation while the indicator points to the first position in the projected image, the operator then performs the second setting operation while the indicator points to the second position in the projected image.
[0198] The first information is obtained based on the amount of movement from the detection of the first setting operation to the detection of the second setting operation. (7)
[0200] The indicating position detection device according to any one of (1) to (6), wherein,
[0201] The processor performs the following control: it projects the image from the projection device according to the change in distance between the projection device and the projected image. (8)
[0203] The indicating position detection device according to any one of (1) to (7), wherein,
[0204] The processor performs the following control: it projects the image from the projection device according to the change in the focal distance in the projection lens of the projection device. (9)
[0206] The indicating position detection device according to any one of (1) to (8), wherein,
[0207] The processor performs the following control: at predetermined intervals, it projects the image from the projection device. (10)
[0209] The indicating position detection device according to any one of (1) to (9), wherein,
[0210] The processor performs the following control: changes the position of the set image in the image according to the detected indicated position. (11)
[0212] The indicating position detection device according to any one of (1) to (10), wherein,
[0213] The processor performs the following control: changes the position of the set image in the image according to the setting state of the projection device. (12)
[0215] A method for indicating a position detection, wherein the processor of the indicating position detection device performs the following control:
[0216] The aforementioned movement amount of the indicator body, which can detect the movement amount of the indicated position, is obtained.
[0217] An image is projected from the projection device, including a setting image for setting the origin based on the indicated position of the aforementioned indicator.
[0218] While the position indicated by the aforementioned indicator in the projected image is that of the preset image, the input result of the operator's preset operation is obtained.
[0219] Based on the position of the setting image in the above image and the amount of movement after obtaining the input result of the setting operation, the indication position based on the indicator in the above image is detected. (13)
[0221] According to the indication position detection method described in (12), wherein,
[0222] The above setting operation includes the operation of inputting data to the input section provided on the above indicator body. (14)
[0224] According to the indication position detection method described in (12) or (13), wherein,
[0225] The above setting operation includes inputting data to the input section provided on the projection surface on which the above-projected image is projected. (15)
[0227] According to any one of (12) to (14) the indication position detection method, wherein,
[0228] The processor described above performs the following control:
[0229] According to the first piece of information indicating the relationship between the size of the projected image and the size of the image,
[0230] The position of the aforementioned set image in the above image, and
[0231] The indicated position in the image based on the indicator is detected by detecting the amount of movement after the above setting operation. (16)
[0233] According to the indication position detection method described in (15), wherein,
[0234] The processor described above performs the following control:
[0235] An image is projected from the projection device, including a set image representing the first position and the second position within the aforementioned image.
[0236] After urging the operator to perform the first setting operation while the indicator points to the first position in the projected image, the operator then performs the second setting operation while the indicator points to the second position in the projected image.
[0237] The first information is obtained based on the detection results of the indicator from the detection of the first setting operation to the detection of the second setting operation. (17)
[0239] According to the indication position detection method described in (15), wherein,
[0240] The processor described above performs the following control:
[0241] After projecting an image including a set image displaying the first position within the aforementioned image from the aforementioned projection device, an image including a set image displaying the second position within the aforementioned image is then projected from the aforementioned projection device.
[0242] After urging the operator to perform the first setting operation while the indicator points to the first position in the projected image, the operator then performs the second setting operation while the indicator points to the second position in the projected image.
[0243] The first information is obtained based on the amount of movement from the detection of the first setting operation to the detection of the second setting operation. (18)
[0245] According to any one of (12) to (17) the indication position detection method, wherein,
[0246] The processor performs the following control: it projects the image from the projection device according to the change in distance between the projection device and the projected image. (19)
[0248] According to any one of (12) to (18) the indication position detection method, wherein,
[0249] The processor performs the following control: it projects the image from the projection device according to the change in the focal distance in the projection lens of the projection device. (20)
[0251] According to any one of (12) to (19) the indication position detection method, wherein,
[0252] The processor performs the following control: at predetermined intervals, it projects the image from the projection device. (twenty one)
[0254] According to any one of (12) to (20) the indication position detection method, wherein,
[0255] The processor performs the following control: changes the position of the set image in the image according to the detected indicated position. (twenty two)
[0257] According to any one of (12) to (21) the indication position detection method, wherein,
[0258] The processor performs the following control: changes the position of the set image in the image according to the setting state of the projection device. (twenty three)
[0260] A position detection indication program is provided to cause the processor of the position detection indication device to perform the following control processes:
[0261] The aforementioned movement amount of the indicator body, which can detect the movement amount of the indicated position, is obtained.
[0262] An image is projected from the projection device, including a setting image for setting the origin based on the indicated position of the aforementioned indicator.
[0263] While the position indicated by the aforementioned indicator in the projected image is that of the preset image, the input result of the operator's preset operation is obtained.
[0264] Based on the position of the setting image in the above image and the amount of movement after obtaining the input result of the setting operation, the indication position based on the indicator in the above image is detected. (twenty four)
[0266] A projection system comprising:
[0267] Projection device; and
[0268] The indicator position detection device controls the acquisition of the movement of an indicator capable of detecting the movement of the indicator position, and projects an image from the projection device including a setting image for setting the origin of the indicator position based on the indicator. In a state where the indicator indicates the position represented by the setting image in the projected image, the device acquires the input result of the operator's setting operation, and detects the indicator position based on the indicator in the image based on the position of the setting image in the image and the movement after acquiring the input result of the setting operation.
[0269] Various embodiments have been described above with reference to the accompanying drawings, but the present invention is not limited to these examples. It is obvious to those skilled in the art that various modifications or alterations will be conceived within the scope described in the technical solutions, and these modifications or alterations should naturally fall within the technical scope of the present invention. Furthermore, the constituent elements of the above embodiments can be combined arbitrarily without departing from the spirit of the invention.
[0270] Furthermore, this application is based on Japanese patent application filed on August 28, 2020 (Japanese Patent Application No. 2020-144981), the contents of which are incorporated herein by reference.
[0271] Symbol Explanation
[0272] 1-Projection unit, 1, 2-Direction X, 1, 2-Direction Z, 1, 2-Direction Y, 2-Operation receiving unit, 2A, 3A-Hollow part, 2a, 2b, 3a, 3c, 15a-Opening, 4-Control device, 4a-Storage medium, 6-Projected object, 10-Projection device, 11-Projection area, 12-Light modulation unit, 15-Frame, 21-Light source, 22-Light modulation unit, 23-Projection optical system, 24-Control circuit, 31 - Second optical system, 32, 122 - Reflecting components, 33 - Third optical system, 34 - Lens, 50 - Image, 50a, 50b, 50c, 50d, 50e - Setting image, 51 - Operator, 52 - Indicator, 101 - Main body, 102 - First component, 103 - Second component, 104 - Projection direction changing mechanism, 105 - Displacement mechanism, 106 - Optical unit, 121 - First optical system, G1 - Image.
Claims
1. An indication position detection apparatus including a processor that performs the following control: acquiring a movement amount of an indication body capable of detecting a movement amount of an indication position, projecting, from a projection apparatus, an image including a setting image for setting an origin based on an indication position of the indication body, urging an operator to indicate a first position and a second position in a projected projection image by the indication body, and acquiring first information indicating a relationship between a size of the projection image and a size of the image based on a detection result of the movement amount from when the first position is indicated until the second position is indicated, acquiring an input result of a setting operation of the operator in a state where a position indicated by the setting image in the projection image is indicated by the indication body, detecting an indication position in the image based on the indication body based on a position of the setting image in the image, the movement amount after the input result of the setting operation is acquired, and the first information.
2. The indication position detection apparatus according to claim 1, wherein the setting operation includes an operation of inputting to an input portion provided to the indication body.
3. The indication position detection apparatus according to claim 1 or 2, wherein the setting operation includes an operation of inputting to an input portion provided to a projection surface on which the projection image is projected.
4. The indication position detection apparatus according to claim 1 or 2, wherein the processor performs the following control: projecting, from the projection apparatus, an image including a setting image indicating a first position and a second position in the image, urging an operator to perform a first setting operation in a state where the first position in the projection image is indicated by the indication body, and then perform a second setting operation in a state where the second position in the projection image is indicated by the indication body, acquiring the first information based on a detection result of the indication body from when the first setting operation is detected until the second setting operation is detected.
5. The indication position detection apparatus according to claim 1 or 2, wherein the processor performs the following control: projecting, from the projection apparatus, an image including a setting image indicating a first position in the image, and then projecting, from the projection apparatus, an image including a setting image indicating a second position in the image, urging an operator to perform a first setting operation in a state where the first position in the projection image is indicated by the indication body, and then perform a second setting operation in a state where the second position in the projection image is indicated by the indication body, acquiring the first information based on the movement amount from when the first setting operation is detected until the second setting operation is detected.
6. The indication position detection apparatus according to claim 1 or 2, wherein the processor performs the following control: projecting the image from the projection apparatus based on a change in a distance between the projection apparatus and the projection image.
7. The indication position detection apparatus according to claim 1 or 2, wherein The processor controls the projection of the image from the projection device in accordance with a change in a focal distance in a projection lens of the projection device.
8. The pointing position detection device according to claim 1 or 2, wherein The processor controls the projection of the image from the projection device at a prescribed time interval.
9. A pointing position detection device comprising a processor that controls: acquiring a movement amount of a pointing body that is capable of detecting a movement amount of a pointing position, projecting, from a projection device, an image including a setting image for setting an origin based on a pointing position of the pointing body, acquiring an input result of a setting operation of an operator in a state in which a position indicated by the setting image in a projected projection image is indicated by the pointing body, detecting a pointing position in the image based on the pointing body in accordance with a position of the setting image in the image and the movement amount after the input result of the setting operation is acquired, and changing the position of the setting image in the image in accordance with the detected pointing position.
10. A pointing position detection device comprising a processor that controls: acquiring a movement amount of a pointing body that is capable of detecting a movement amount of a pointing position, projecting, from a projection device, an image including a setting image for setting an origin based on a pointing position of the pointing body, acquiring an input result of a setting operation of an operator in a state in which a position indicated by the setting image in a projected projection image is indicated by the pointing body, detecting a pointing position in the image based on the pointing position of the pointing body in accordance with a position of the setting image in the image and the movement amount after the input result of the setting operation is acquired, and changing the position of the setting image in the image in accordance with a setting state of the projection device.
11. A method of indicating position detection, wherein, A processor of a pointing position detection device controls: acquiring a movement amount of a pointing body that is capable of detecting a movement amount of a pointing position, projecting, from a projection device, an image including a setting image for setting an origin based on a pointing position of the pointing body, urging an operator to indicate a first position and a second position in a projected projection image by the pointing body, acquiring first information indicating a relationship between a size of the projection image and a size of the image in accordance with a detection result of the movement amount from when the first position is indicated until the second position is indicated, acquiring an input result of a setting operation of the operator in a state in which a position indicated by the setting image in the projection image is indicated by the pointing body, detecting a pointing position in the image based on the pointing body in accordance with the position of the setting image in the image, the movement amount after the input result of the setting operation is acquired, and the first position.
12. The pointing position detection method according to claim 11, wherein The setting operation includes an operation of inputting to an input portion provided to the pointing body.
13. The pointing position detection method according to claim 11 or 12, wherein The setting operation includes an operation of inputting to an input section provided to a projected surface on which the projected image is projected.
14. The indication position detection method according to claim 11 or 12, wherein the processor controls as follows: the image including the setting image indicating the first position and the second position in the image is projected from the projection device, the operator is urged to perform the first setting operation in a state where the first position in the projected image is indicated by the indication body, and to perform the second setting operation in a state where the second position in the projected image is indicated by the indication body, the first information is acquired based on the detection result of the indication body from when the first setting operation is detected until the second setting operation is detected.
15. The indication position detection method according to claim 11 or 12, wherein the processor controls as follows: the image including the setting image indicating the first position in the image is projected from the projection device, and then the image including the setting image indicating the second position in the image is projected from the projection device, the operator is urged to perform the first setting operation in a state where the first position in the projected image is indicated by the indication body, and to perform the second setting operation in a state where the second position in the projected image is indicated by the indication body, the first information is acquired based on the movement amount from when the first setting operation is detected until the second setting operation is detected.
16. The indication position detection method according to claim 11 or 12, wherein the processor controls as follows: the image is projected from the projection device according to a change in distance between the projection device and the projected image.
17. The indication position detection method according to claim 11 or 12, wherein the processor controls as follows: the image is projected from the projection device according to a change in focal distance in a projection lens of the projection device.
18. The indication position detection method according to claim 11 or 12, wherein the processor controls as follows: the image is projected from the projection device at a predetermined time interval.
19. An indication position detection method, wherein a processor of an indication position detection device controls as follows: the movement amount of an indication body capable of detecting a movement amount of an indication position is acquired, an image including a setting image for setting an origin of an indication position based on the indication body is projected from a projection device, an input result of a setting operation of an operator is acquired in a state where a position indicated by the setting image in a projected projected image is indicated by the indication body, an indication position based on the indication body in the image is detected based on a position of the setting image in the image and the movement amount after the input result of the setting operation is acquired, and a position of the setting image in the image is changed based on the detected indication position.
20. An indication position detection method, wherein a processor of an indication position detection device controls as follows: the movement amount of an indication body capable of detecting a movement amount of an indication position is acquired, projecting, from a projection device, an image including a setting image for setting an origin based on an indication position of the indication body, acquiring an input result of a setting operation of an operator in a state where a position indicated by the setting image in a projected projection image is indicated by the indication body, detecting an indication position in the image based on the indication body, from a position of the setting image in the image and the movement amount after the input result of the setting operation is acquired, and changing the position of the setting image in the image according to a setting state of the projection device.
21. A storage medium storing an indication position detection program for causing a processor of an indication position detection device to execute processing that controls: acquiring a movement amount of an indication body that can detect a movement amount of an indication position, projecting, from a projection device, an image including a setting image for setting an origin based on an indication position of the indication body, urging an operator to indicate a first position and a second position in a projected projection image by the indication body, acquiring first information indicating a relationship between a size of the projection image and a size of the image, from a detection result of the movement amount from when the first position is indicated until the second position is indicated, acquiring an input result of a setting operation of the operator in a state where a position indicated by the setting image in the projection image is indicated by the indication body, detecting an indication position in the image based on the indication body, from a position of the setting image in the image, the movement amount after the input result of the setting operation is acquired, and the first information.
22. A storage medium storing an indication position detection program for causing a processor of an indication position detection device to execute processing that controls: acquiring a movement amount of an indication body that can detect a movement amount of an indication position, projecting, from a projection device, an image including a setting image for setting an origin based on an indication position of the indication body, acquiring an input result of a setting operation of an operator in a state where a position indicated by the setting image in a projected projection image is indicated by the indication body, detecting an indication position in the image based on the indication body, from a position of the setting image in the image and the movement amount after the input result of the setting operation is acquired, and changing the position of the setting image in the image according to the detected indication position.
23. A storage medium storing an indication position detection program for causing a processor of an indication position detection device to execute processing that controls: acquiring a movement amount of an indication body that can detect a movement amount of an indication position, projecting, from a projection device, an image including a setting image for setting an origin based on an indication position of the indication body, acquiring an input result of a setting operation of an operator in a state where a position indicated by the setting image in a projected projection image is indicated by the indication body, detecting an indication position in the image based on the indication body, from a position of the setting image in the image and the movement amount after the input result of the setting operation is acquired, and changing the position of the setting image in the image according to the detected indication position. The position of the setting image in the image is detected based on the position of the setting image in the image and the movement amount after the input result of the setting operation is obtained, and the position of the setting image in the image is changed based on the setting state of the projection device.
24. A projection system comprising: a projection device; and a position-of-indication detection device that obtains the movement amount of an indication body capable of detecting the movement amount of a position of indication, and projects, from the projection device, a control including an image of a setting image for setting an origin of a position of indication based on the indication body, prompts an operator to indicate a first position and a second position in a projected projection image by the indication body, obtains first information indicating a relationship between a size of the projection image and a size of the image based on a detection result of the movement amount from when the first position is indicated until the second position is indicated, obtains an input result of a setting operation of the operator in a state where a position indicated by the setting image in the projection image is indicated by the indication body, and detects a position of indication based on the indication body in the image based on the position of the setting image in the image, the movement amount after the input result of the setting operation is obtained, and the first information.
25. A projection system comprising: a projection device; and a position-of-indication detection device that obtains the movement amount of an indication body capable of detecting the movement amount of a position of indication, and projects, from the projection device, a control including an image of a setting image for setting an origin of a position of indication based on the indication body, obtains an input result of a setting operation of an operator in a state where a position indicated by the setting image in a projected projection image is indicated by the indication body, detects a position of indication based on the indication body in the image based on the position of the setting image in the image and the movement amount after the input result of the setting operation is obtained, and changes the position of the setting image in the image based on the detected position of indication.
26. A projection system comprising: a projection device; and a position-of-indication detection device that obtains the movement amount of an indication body capable of detecting the movement amount of a position of indication, and projects, from the projection device, a control including an image of a setting image for setting an origin of a position of indication based on the indication body, obtains an input result of a setting operation of an operator in a state where a position indicated by the setting image in a projected projection image is indicated by the indication body, detects a position of indication based on the indication body in the image based on the position of the setting image in the image and the movement amount after the input result of the setting operation is obtained, and changes the position of the setting image in the image based on a setting state of the projection device.
Citation Information
Patent Citations
GUI application for 3D remote controllers
JP2010538400A
Projection system, projection device, projection method and program
JP2012216928A
Cable destination display label producing device, cable destination display label producing method and cable destination display label producing program
JP2020144981A
Hybrid tracking system for hand-mobilized device
WO2018020497A1
Projection system, projection device, projection control method and program
JP2008250562A