Location information acquisition device and input / display system

Abstract

The present invention provides a location information acquisition device capable of detecting user operations without physical contact. [Solution] The position information acquisition device includes a substrate 2, first to third sensing elements each including a light-emitting element 6 arranged in a triangle on the substrate 2 that emits a transmission signal and a light-receiving element 7 that detects a received signal reflected by an object, and a control unit 10 that controls the first to third sensing elements and calculates the distance to the object based on the transmission signal and the received signal. The control unit 10 calculates a first distance between the first sensing element and the object, a second distance between the second sensing element and the object, and a third distance between the third sensing element and the object, calculates a first hemisphere with the first sensing element as the center and the first distance as the radius, a second hemisphere with the second sensing element as the center and the second distance as the radius, and a third hemisphere with the third sensing element as the center and the third distance as the radius, calculates the intersection point of the first to third hemispheres, and determines the intersection point to be the position of the object.

Description

Technical Field

[0001] The present invention relates to a position information acquisition device and an input display system.

Background Art

[0002] There is known a 2D TOF sensor that can input information without the user directly touching it. Since the 2D TOF sensor is optical, unlike a capacitive type, it has the feature that it can detect an input operation without being affected when the user wears gloves.

[0003] However, the 2D TOF sensor is for acquiring position information in a 2D space and cannot acquire position information in a 3D space. Therefore, it is difficult to apply the 2D TOF sensor to devices that perform various inputs including depth by spatial gestures and the like.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Non-Patent Documents

[0005]

Non-Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0006] The present invention provides a position information acquisition device and an input display system capable of detecting a user's operation without contact. [Means for solving the problem]

[0007] According to a first aspect of the present invention, a position information acquisition device is provided which includes a substrate, first to third sensing elements each including a light-emitting element that emits a transmission signal and a light-receiving element that detects a received signal reflected by an object, arranged in a triangular shape on the substrate, and controls the first to third sensing elements and calculates the distance to the object based on the transmission signal and the received signal, wherein the control calculates a first distance between the first sensing element and the object, a second distance between the second sensing element and the object, and a third distance between the third sensing element and the object, calculates a first hemisphere centered on the first sensing element with a radius of the first distance, a second hemisphere centered on the second sensing element with a radius of the second distance, and a third hemisphere centered on the third sensing element with a radius of the third distance, calculates the intersection point of the first to third hemispheres, and determines the intersection point to be the position of the object.

[0008] According to a second aspect of the present invention, a position information acquisition device according to the first aspect is provided, wherein the light-emitting element is configured to emit light radially into the surroundings.

[0009] According to a third aspect of the present invention, a position information acquisition device is provided which includes a substrate, first to fourth sensing elements each including a light-emitting element that emits a transmission signal and a light-receiving element that detects a received signal reflected by an object, arranged in a rectangular shape on the substrate, and a control unit that controls the first to fourth sensing elements and calculates the distance to the object based on the transmission signal and the received signal, wherein each of the first to third sensing elements emits light such that its vertical and horizontal radiation angles are limited, the fourth sensing element emits light radially outward, the control unit uses the received signals of three of the first to fourth sensing elements to calculate first to third distances between each of the three sensing elements and the object, calculates first to third hemispheres each with the three sensing elements as centers and the first to third distances as radii, calculates the intersection point of the first to third hemispheres, and determines the intersection point as the position of the object.

[0010] According to a fourth aspect of the present invention, a position information acquisition device according to the third aspect is provided, wherein the vertical radiation angle is set in an angular range of 0 degrees to 90 degrees, with the horizontal plane being 0 degrees, and the horizontal radiation angle is set in an angular range of 90 degrees to 180 degrees, with the direction from the light-emitting element toward the center of the substrate as the center.

[0011] According to a fifth aspect of the present invention, a position information acquisition device according to the third aspect is provided, wherein each of the first to third sensing elements includes a light-emitting part that emits light and a light-shielding member configured to partially surround the light-emitting part and to shield a portion of the light emitted by the light-emitting part.

[0012] According to a sixth aspect of the present invention, a position information acquisition device according to the first or third aspect is provided, wherein the light-emitting element is configured to emit infrared light.

[0013] According to a seventh aspect of the present invention, a position information acquisition device according to the first or third aspect is provided, wherein the control unit calculates a first intersection circle where the first hemisphere and the second hemisphere intersect, a second intersection circle where the second hemisphere and the third hemisphere intersect, and a third intersection circle where the third hemisphere and the first hemisphere intersect, calculates the intersection point of the first to third intersection circles, and determines that the intersection point is the position of the object.

[0014] According to an eighth aspect of the present invention, an input display system is provided which comprises a display device for displaying an image and a location information acquisition device disposed on the display device according to the first or third aspect.

[0015] According to a ninth aspect of the present invention, an input display system according to the eighth aspect is provided, wherein the location information acquisition device detects user operations non-contactually, and the control unit controls the operation of the display device based on the user operations.

[0016] According to a tenth aspect of the present invention, an input display system according to the eighth aspect is provided, wherein the display device is configured to display an aerial image in the space above the position information acquisition device. [Effects of the Invention]

[0017] According to the present invention, it is possible to provide a location information acquisition device and an input display system that can detect user operations without physical contact. [Brief explanation of the drawing]

[0018] [Figure 1] Figure 1 is a perspective view of a location information acquisition device according to the first embodiment of the present invention. [Figure 2] Figure 2 illustrates the detection operation of the first sensing element. [Figure 3] Figure 3 illustrates an example of the transmitted and received signals of the first sensing element. [Figure 4] Figure 4 is a block diagram of the location information acquisition device. [Figure 5]Figure 5 is a flowchart illustrating the operation of the location information acquisition device. [Figure 6] Figure 6 is a timing diagram illustrating an example of the operation of the first to third sensing elements. [Figure 7] Figure 7 is a schematic diagram illustrating the detection region of the first sensing element. [Figure 8] Figure 8 illustrates the detection regions of the first to third sensing elements. [Figure 9] Figure 9 shows the three detected regions extracted. [Figure 10] Figure 10 is a perspective view illustrating the principle of the position determination operation of the position determination unit. [Figure 11] Figure 11 is a plan view illustrating the principle of the position determination operation of the position determination unit. [Figure 12] Figure 12 is a perspective view illustrating the principle of the position determination operation of the position determination unit. [Figure 13] Figure 13 is a perspective view of the input display system according to a second embodiment of the present invention. [Figure 14] Figure 14 is a block diagram of the input and display system. [Figure 15] Figure 15 is a flowchart illustrating the operation of the input and display system. [Figure 16] Figure 16 is a perspective view of the input display system according to the third embodiment of the present invention. [Figure 17] Figure 17 is a perspective view of a location information acquisition device according to a fourth embodiment of the present invention. [Figure 18] Figure 18 is a perspective view illustrating an example of a light-emitting element configuration. [Figure 19] Figure 19 is a perspective view illustrating the operation of the third sensing element. [Figure 20] Figure 20 is a perspective view illustrating the operation of the first to fourth sensing elements. [Figure 21] Figure 21 is a timing diagram illustrating an example of the operation of the first to fourth sensing elements. [Figure 22]Figure 22 is a flowchart illustrating the operation of the location information acquisition device. [Modes for carrying out the invention]

[0019] The embodiments will be described below with reference to the drawings. However, the drawings are schematic or conceptual, and the dimensions and proportions in each drawing are not necessarily the same as those in reality. Furthermore, even when the same part is represented between drawings, the relationship between dimensions and proportions may be represented differently. In particular, the embodiments shown below are illustrative examples of devices and methods for realizing the technical concept of the present invention, and the technical concept of the present invention is not determined by the shape, structure, arrangement, etc. of the components. In the following description, elements having the same function and configuration are denoted by the same reference numerals, and redundant descriptions are omitted.

[0020] [1] First Embodiment [1-1] Configuration of the location information acquisition device 1 Figure 1 is a perspective view of a position information acquisition device 1 according to a first embodiment of the present invention. In Figure 1, the X direction is the direction along one side of the position information acquisition device 1, the Y direction is the direction perpendicular to the X direction in the horizontal plane, and the Z direction is the direction perpendicular to the XY plane (also called the normal direction). The position information acquisition device 1 comprises a substrate 2 and first to third sensing elements 3 to 5.

[0021] Substrate 2 is made of, for example, a transparent insulating material. Substrate 2 is made of, for example, glass or a transparent resin (including acrylic resin). Substrate 2 has, for example, a rectangular shape.

[0022] The first to third sensing elements 3 to 5 are provided on the substrate 2. The first to third sensing elements 3 to 5 are arranged apart from each other in a triangular shape. For example, the first to third sensing elements 3 to 5 are arranged at the three corners of the substrate 2. The configuration of the first sensing element 3 will be described in detail below, using it as an example, but the second and third sensing elements 4 and 5 have the same configuration as the first sensing element 3.

[0023] The first sensing element 3 has the function of detecting an object using light. The first sensing element 3 is composed of a TOF (time of flight) sensor. A TOF sensor is a sensor that measures the distance to an object based on the time of flight of light. The first sensing element 3 includes a light-emitting element 6 and a light-receiving element 7. In Figure 1, the light-emitting element 6 is not hatched, while the light-receiving element 7 is hatched to distinguish them from each other.

[0024] The light-emitting element 6 has the function of emitting light. The light emitted by the light-emitting element 6 is, for example, infrared light (infrared light) that does not stimulate the user's vision and is not affected by visible light. The light-emitting element 6 emits light radially. The light-emitting element 6 is composed of, for example, an LED (light-emitting diode).

[0025] The light-receiving element 7 has the function of detecting light (infrared light in this embodiment). The light-receiving element 7 is composed of a photodiode or an image sensor, etc.

[0026] Figure 2 illustrates the detection operation of the first sensing element 3. The first sensing element 3 is assumed to detect an object 8. Let L be the distance (straight-line distance) between the first sensing element 3 and the object 8. The light-emitting element 6 transmits a transmission signal 6A. The transmission signal 6A is light and is a pulse signal. The transmission signal 6A is reflected by the object 8. The light-receiving element 7 detects the reflected light (referred to as the received signal 7A) reflected by the object 8.

[0027] Figure 3 illustrates an example of the transmission signal 6A and reception signal 7A of the first sensing element 3. In Figure 3, the horizontal axis represents time, and the vertical axis represents signal intensity. The signal intensity is in arbitrary units (au). The light-emitting element 6 emits or transmits a pulsed transmission signal 6A at predetermined time intervals. The light-receiving element 7 detects the pulsed reception signal 7A after a time t has elapsed since the transmission signal 6A was emitted. If the speed of light is c, the distance L is calculated by the following equation (1).

[0028] L = (1 / 2) * c * t ... (1) [1-2] Block composition Next, the block configuration of the location information acquisition device 1 will be described. Figure 4 is a block diagram of the location information acquisition device 1. The location information acquisition device 1 comprises a control unit 10, an input / output interface (input / output IF) 20, a sensor unit 21, and a power supply circuit 24.

[0029] The input / output interface 20 is connected to the control unit 10 via a bus and also to the sensor unit 21 via a bus. The input / output interface 20 performs interface processing between the control unit 10 and the sensor unit 21 according to a predetermined standard.

[0030] The sensor unit 21 comprises a sensor controller 22 and a sensing element group 23. The sensing element group 23 comprises the first to third sensing elements 3 to 5 described above. The sensor controller 22 performs interface processing between the input / output interface 20 and the sensing element group 23. The sensor controller 22 also supplies control signals to the sensing element group 23 and controls the operation of the sensing element group 23.

[0031] The control unit 10 includes one or more processors such as a CPU (Central Processing Unit) and an MPU (Micro Processing Unit). The control unit 10 implements various functions by executing programs stored in the storage unit 11. The control unit 10 comprises a storage unit 11, a signal processing unit 12, a position determination unit 13, and a designated operation processing unit 14.

[0032] The storage unit 11 includes non-volatile storage devices such as ROM (Read Only Memory), HDD (Hard Disk Drive), and SSD (Solid State Drive), and volatile storage devices such as RAM (Random Access Memory) and registers. The storage unit 11 stores programs executed by the processor of the control unit 10. The storage unit 11 also stores various data necessary for controlling the control unit 10.

[0033] The signal processing unit 12 controls the first to third sensing elements 3 to 5 to emit a transmission signal at predetermined sampling periods SP. The sampling period SP is the period during which each of the first to third sensing elements 3 to 5 emits one transmission pulse. Multiple sampling periods SP are set consecutively, and at each sampling period SP, the first to third sensing elements 3 to 5 emit a transmission signal. The signal processing unit 12 receives signals from the first to third sensing elements 3 to 5 and determines which of the multiple received signals corresponds to each of the first to third sensing elements 3 to 5.

[0034] The position determination unit 13 calculates the distance from each of the first to third sensing elements 3 to 5 to the object based on the emission timing of the transmission signals emitted by each of the first to third sensing elements 3 to 5 and the light reception timing of the reception signals detected by each of the first to third sensing elements 3 to 5. The position determination unit 13 also calculates the position of the object (specifically, the position of the object in the spatial region above the substrate 2) based on the multiple distances calculated. The position of the object also includes position information in the depth direction (Z direction) of the substrate 2.

[0035] The designated action processing unit 14 determines whether the position of the object determined by the position determination unit 13 is within the designated area. The designated area is a predetermined area in the space above the substrate 2. For example, when a user operates the designated area with their finger, the user's finger corresponds to the object. If the position of the object is within the designated area, the designated action processing unit 14 executes a pre-set designated action.

[0036] The power supply circuit 24 receives power from an external source. The power supply circuit 24 generates multiple types of voltages. The power supply circuit 24 supplies the optimal voltage to each circuit of the position information acquisition device 1.

[0037] [1-3] Operation Next, we will explain the operation of the location information acquisition device 1. Figure 5 is a flowchart illustrating the operation of the location information acquisition device 1.

[0038] The signal processing unit 12 causes the first to third sensing elements 3 to 5 to emit a transmission signal for each sampling period SP. The first to third sensing elements 3 to 5 each emit a transmission signal (step S100). The transmission signal is pulsed light (for example, infrared light).

[0039] The first to third sensing elements 3 to 5 each monitor whether or not they have detected a received signal (step S101). The first to third sensing elements 3 to 5 then detect the received signal reflected from the object (step S101 = Yes).

[0040] Figure 6 is a timing diagram illustrating an example of the operation of the first to third sensing elements 3 to 5. The first to third sensing elements 3 to 5 are referred to as channels CH1 to CH3.

[0041] Each of the first to third sensing elements 3 to 5 emits a transmission signal at each sampling period SP. Furthermore, each of the first to third sensing elements 3 to 5 emits a transmission signal so that the timing of the three transmission signals (transmission pulses) is staggered. Because the emission times of the three transmission signals are different, the transmission signals of each of the first to third sensing elements 3 to 5 can be identified, and the received signal corresponding to a specific transmission signal can be determined.

[0042] In the example shown in Figure 6, the first sensing element 3 of channel CH1 detects the received signal after time t1 has elapsed since emitting the transmit signal. The second sensing element 4 of channel CH2 detects the received signal after time t2 has elapsed since emitting the transmit signal. The third sensing element 5 of channel CH3 detects the received signal after time t3 has elapsed since emitting the transmit signal.

[0043] Next, the position determination unit 13 determines the position of the object using the received signals detected by the first to third sensing elements 3 to 5 (step S102). The position determination operation of the position determination unit 13 will be described in detail below.

[0044] Figure 7 is a schematic diagram illustrating the detection area of ​​the first sensing element 3. The operation of the second and third sensing elements 4 and 5 is the same as in Figure 7. The position of the first sensing element 3 is centered at "o".

[0045] The light-emitting element 6 emits light in all directions. A portion of the light emitted from the light-emitting element 6 is reflected by the object 8, and the reflected light from the object 8 is detected by the light-receiving element 7. The position determination unit 13 calculates the distance L from the first sensing element 3 to the object 8 using the above equation (1). Since the light-emitting element 6 emits light in all directions, the direction of the object 8 is not specified, and the distance L to the object 8 is determined. That is, it is determined that the object 8 is located on a hemisphere of radius r (=L). The hemisphere (also called a hemispherical surface) in Figure 7 is the detection area 3A of the first sensing element 3.

[0046] Figure 8 illustrates the detection regions of the first to third sensing elements 3 to 5. Each of the first to third sensing elements 3 to 5 detects the object 8. The position determination unit 13 determines the hemispherical detection region 3A based on the received signal from the first sensing element 3. The radius of the detection region 3A is the distance from the first sensing element 3 to the object 8. The position determination unit 13 determines the hemispherical detection region 4A based on the received signal from the second sensing element 4. The radius of the detection region 4A is the distance from the second sensing element 4 to the object 8. The position determination unit 13 determines the hemispherical detection region 5A based on the received signal from the third sensing element 5. The radius of the detection region 5A is the distance from the third sensing element 5 to the object 8. Figure 9 shows the three detection regions 3A to 5A extracted. The position of the object 8 is calculated from the intersection of the three hemispheres (detection regions 3A to 5A).

[0047] Figure 10 is a perspective view illustrating the principle of the position determination operation of the position determination unit 13. Figure 11 is a plan view illustrating the principle of the position determination operation of the position determination unit 13.

[0048] The intersection circle where detection area 3A and detection area 4A intersect is denoted as IC1, the intersection circle where detection area 4A and detection area 5A intersect is denoted as IC2, and the intersection circle where detection area 5A and detection area 3A intersect is denoted as IC3. The intersection circle is a semi - circle formed by the curve where two hemispheres intersect.

[0049] The intersection points of the intersection circles IC1 - IC3 are denoted as IP. The intersection point IP is the position of the object 8. Therefore, by calculating the equations of the intersection circles IC1 - IC3, the intersection point IP, that is, the position of the object 8 can be calculated.

[0050] Figure 12 is a perspective view explaining the principle of the position determination operation of the position determination unit 13. The upper surface of the substrate 2 is used as the reference plane of the coordinates. The coordinates in this embodiment are used to determine the position of an object in space and have the same meaning as the position of the object. The coordinates are represented by (x, y, z), where the x - coordinate corresponds to the X - direction, the y - coordinate corresponds to the Y - direction, and the z - coordinate corresponds to the Z - direction. For example, the center of the substrate 2 is at the coordinates (0, 0, 0).

[0051] Let the position of the first sensing element 3 be P1(x1, y1, z1), the position of the second sensing element 4 be P2(x2, y2, z2), and the position of the third sensing element 5 be P3(x3, y3, z3). Let the radii of the detection areas 3A - 5A be r1 - r3. Let the intersection point of the detection areas 3A - 5A be P(x, y, z). Channel CH1 corresponds to i = 1, channel CH2 corresponds to i = 2, and channel CH3 corresponds to i = 3.

[0052] P i (x i ,y i ,z i )[i = 1, 2, 3] as the center and the hemisphere with radius r i [i = 1, 2, 3] is represented by equations (2.1) - (2.3). (x1 - x) 2 +(y1 - y) 2 +(z1 - z) 2 =r1 2 ···(2.1) (x2 - x) 2 +(y2 - y) 2 +(z2 - z) 2 =r22 ...(2.2) (x3-x) 2 +(y3-y) 2 +(z3-z) 2 =r3 2 ...(2.3) Here, r i =(1 / 2)*c*ti[i=1, 2, 3]

[0053] The intersection point P(x,y,z) of the three hemispheres is calculated from the system of three equations (2.1) to (2.3). Subtracting equation (2.1) from equations (2.2) and (2.3) and rearranging gives equations (3.1) and (3.2). (x2-x1)x+(y2-y1)y+(z2-z1)z=-(A2-A1) / 2 ···(3.1) (x3-x1)x+(y3-y1)y+(z3-z1)z=-(A3-A1) / 2 ···(3.2) Here, A i =r i 2 -x i 2 -y i 2 -z i 2 [i=1, 2, 3]

[0054] By rearranging equations (3.1) and (3.2), equations (4.1) and (4.2) are derived. x 21 x+y 21 y+z 21 z=A 21 ...(4.1) x 31 x+y 31 y+z 31 z=A 31 ...(4.2) Here x i1 =x i -x1, y i1 =y i -y1, z i1 =z i -z1[i=1, 2, 3] A i1 =-(A i-A1) / 2[i=2,3]

[0055] From equations (4.1) and (4.2), equations (5.1) and (5.2) are derived. x=[(A 21 y 31 -A 31 y 21 )+(y 21 z 31 -y 31 z 21 )z] / D ···(5.1) y=[(A 31 x 21 -A 21 x 31 )+(x 31 z 21 -x 21 z 31 )z] / D ···(5.2)

[0056] By rearranging equations (5.1) and (5.2), equations (6.1) and (6.2) are derived. x = B0 + B1z ... (6.1) y = C0 + C1z ... (6.2) Here, D=x 21 y 31 -y 21 x 31 (Assume ≠ 0) B0=(A 21 y 31 -A 31 y 21 ) / D B1=(y 21 z 31 -y 31 z 21 ) / D C0=(A 31 x 21 -A 21 x 31 ) / D C1=(x 31 z 21 -x 21 z 31 ) / D

[0057] Substituting equations (6.1) and (6.2) into equation (2.1) and simplifying, equation (7) is calculated. Ez 2 +2Fz + G = 0 ···(7) Here, E = B1 2 + C1 2 + 1 F = B1(B0 - x1)+ C1(C0 - y1)- z1 G = (B0 - x1) 2 +(C0 - y1) 2 + z1 2 - r1 2

[0058] Solving the quadratic equation of equation (7) ((F 2 - EG) 1 / 2 ≥ 0), equation (8) is calculated. z = [- F ± √(F 2 - EG) 1 / 2 / E ···(8) Here, the detection regions 3A to 5A are 0 ≤ z

[0059] Substituting equation (8) into equations (6.1) and (6.2), x and y are expressed by equations (9.1) and (9.2). x = B0 + B1[- F ± √(F 2 - EG) 1 / 2 / E ···(9.1) y = C0 + C1[- F ± √(F 2 - EG) 1 / 2 / E ···(9.2) Note that when the discriminant of equation (8): (F 2 - EG) is negative, there is no intersection point.

[0060] The position determination unit 13 calculates the position P(x, y, z) of the object 8 by the above calculation.

[0061] Subsequently, the specified operation processing unit 14 determines whether the position of the detected object 8 is within the specified region (step S103). Information regarding the position of the specified region is stored in the storage unit 11.

[0062] If the detected object 8 is located within the specified area (step S103 = Yes), the specified operation processing unit 14 executes a pre-set specified operation (step S104). The specified operation is set according to the system in which the location information acquisition device 1 is incorporated.

[0063] Next, the control unit 10 monitors whether or not it has received a termination operation from the user (step S105). If it receives a termination operation, the control unit 10 terminates the operation position input process.

[0064] [1-4] Effects of the first embodiment According to the first embodiment, the control unit 10 calculates first to third distances from the first to third sensing elements 3 to 5 to the object based on the transmitted and received signals of the first to third sensing elements 3 to 5. The control unit 10 can then calculate the position of the object (e.g., the user's finger) in the spatial domain based on the first to third distances. A position information acquisition device capable of acquiring position information of an object located above the substrate 2 can be realized. Furthermore, a position information acquisition device capable of detecting user operations without contact can be realized.

[0065] Furthermore, the first to third sensing elements 3 to 5 are configured to emit light (e.g., infrared light) without specifying the direction of emission. In other words, there is no need to control the angle of the light emitted by the first to third sensing elements 3 to 5. This simplifies the configuration of the first to third sensing elements 3 to 5.

[0066] [2] Second embodiment The second embodiment is an example of the configuration of an input and display system equipped with a location information acquisition device 1. The input and display system is a system that combines the function of inputting information and the function of displaying information.

[0067] Figure 13 is a perspective view of an input display system 30 according to a second embodiment of the present invention. The input display system 30 comprises a display device 31 and a location information acquisition device 1.

[0068] The display device 31 is a device that displays images (including videos and images) on its own screen. The display device 31 is also called a flat-panel display device. There are no particular restrictions on the type of display device 31. The display device 31 may be composed of a liquid crystal display device, an organic EL (electroluminescence) display device, or a micro-LED (light-emitting diode) display device.

[0069] The display device 31 has a display area DA on its upper surface. The display area DA corresponds to the screen of the display device 31. The display device 31 displays an image in the display area DA.

[0070] The location information acquisition device 1 is mounted on the display device 31. The location information acquisition device 1 is positioned, for example, so as to be in contact with the screen of the display device 31. The location information acquisition device 1 may also be positioned at a distance from the display device 31. The display device 31 and the location information acquisition device 1 are fixed in a desired position using fixing members (not shown).

[0071] The configuration of the position information acquisition device 1 is the same as in the first embodiment. The substrate 2 is made of a transparent insulating material that does not obstruct the image of the display device 31. The substrate 2 is made of, for example, glass or a transparent resin (including acrylic resin). The first to third sensing elements 3 to 5 are arranged outside the display device 31 in a plan view.

[0072] Furthermore, the substrate 2 may be configured by removing the area that overlaps with the display area DA. In this modified example, the substrate 2 functions as a component on which the first to third sensing elements 3 to 5 are mounted. In addition, the user directly views the screen of the display device 31.

[0073] Figure 14 is a block diagram of the input / display system 30. The input / display system 30 comprises a control unit 10, an input / output interface (input / output IF) 20, a sensor unit 21, a display device 31, and a power supply circuit 24.

[0074] The input / output interface 20 is connected to the display device 31 via a bus. The input / output interface 20 performs interface processing between the control unit 10 and the display device 31 according to a predetermined standard.

[0075] The control unit 10 includes a storage unit 11, a signal processing unit 12, a position determination unit 13, a designated operation processing unit 14, and a display processing unit 15.

[0076] The display processing unit 15 controls the operation of the display device 31. The display processing unit 15 transmits image data to the display device 31 and causes the display device 31 to display the image.

[0077] Next, the operation of the input and display system 30 configured as described above will be explained. Figure 15 is a flowchart illustrating the operation of the input and display system 30.

[0078] The display processing unit 15 causes the display device 31 to display an image. The display device 31 displays the image in its display area DA (step S200).

[0079] The user views the image displayed in the display area DA through the circuit board 2. The user manipulates the image, for example, with their finger. Alternatively, the user can perform input operations on the input display system 30 (specifically, the location information acquisition device 1) without contact. Or, the user can perform input operations by touching the location information acquisition device 1.

[0080] Next, the control unit 10 executes the position information acquisition process (steps S201 to S203). The processes in steps S201 to S203 are the same as steps S100 to S102 in the first embodiment.

[0081] Next, the designated operation processing unit 14 determines whether the position of the detected object 8 is within the designated area (step S204). If the position of the detected object 8 is within the designated area (step S204 = Yes), the designated operation processing unit 14 executes a pre-set designated operation (step S104). The designated operation includes, for example, updating the image displayed by the display device 31 to an image corresponding to the user's input operation.

[0082] Next, the control unit 10 monitors whether or not it has received a termination command from the user (step S206). If it receives a termination command, the control unit 10 terminates its operation.

[0083] According to the second embodiment, an input display system 30 capable of receiving user input operations without physical contact can be realized. Furthermore, an input display system 30 capable of displaying images tailored to the user can be realized. In addition, input operations performed by the user to manipulate images can be detected.

[0084] [3] Third embodiment The third embodiment is an example configuration of an input display system 30 equipped with a function for displaying an aerial image.

[0085] Figure 16 is a perspective view of an input display system 30 according to a third embodiment of the present invention. The input display system 30 comprises an aerial display device 31 and a position information acquisition device 1.

[0086] The aerial display device 31 displays an aerial image 32 in the air above it. The configuration of the aerial display device 31 can be based on "Japanese Patent Publication No. 7184220". The configuration of the aerial display device 31 is not limited to the above-mentioned document, and other configurations may be used.

[0087] The user perceives the aerial image 32 in the air above the input display system 30. The user manipulates the aerial image 32, for example, with their finger. The user also performs input operations without touching the input display system 30 (specifically, the location information acquisition device 1). Other operations of the input display system 30 are the same as in the second embodiment.

[0088] According to the third embodiment, an input display system 30 capable of displaying an aerial image 32 in mid-air can be realized. Furthermore, an input display system 30 capable of receiving user input operations without physical contact can be realized. In addition, input operations performed by the user on the aerial image 32 can be detected.

[0089] [4] Fourth Embodiment The fourth embodiment is another configuration example of the location information acquisition device 1.

[0090] [4-1] Configuration of the location information acquisition device 1 Figure 17 is a perspective view of a location information acquisition device 1 according to a fourth embodiment of the present invention. The location information acquisition device 1 comprises a substrate 2 and first to fourth sensing elements 41 to 44.

[0091] The first to fourth sensing elements 41 to 44 are provided on the substrate 2. The first to fourth sensing elements 41 to 44 are arranged apart from each other and in a rectangular shape. The first to fourth sensing elements 41 to 44 are arranged, for example, at the four corners of the substrate 2.

[0092] The configurations of the first to third sensing elements 41 to 43 are the same. The configuration of the fourth sensing element 44 is different from that of the first to third sensing elements 41 to 43. The configuration of the first sensing element 41 will be described in detail below, using it as an example, but the second and third sensing elements 42 and 43 have the same configuration as the first sensing element 41.

[0093] The first sensing element 41 has the function of detecting an object using light. The first sensing element 41 is composed of a TOF sensor. The first sensing element 41 includes a light-emitting element 45 and a light-receiving element 46. In Figure 17, the light-emitting element 45 is not hatched, while the light-receiving element 46 is hatched to distinguish them from each other.

[0094] The light-emitting element 45 has the function of emitting light. The light emitted by the light-emitting element 45 is, for example, infrared light (infrared light) that does not stimulate the user's vision and is not affected by visible light. The light-emitting element 45 is configured to emit light toward the center of the substrate 2 and to limit the range of light emission. The direction in which the light-emitting element 45 emits light includes the center of the substrate 2.

[0095] Figure 18 is a perspective view illustrating an example of the configuration of the light-emitting element 45. The light-emitting element 45 comprises a light-emitting section 45A and a light-shielding member 45B.

[0096] The light-emitting section 45A emits light radially. The light-emitting section 45A is composed of, for example, an LED.

[0097] The light-shielding member 45B has the function of blocking light (infrared light). The light-shielding member 45B is provided on the substrate 2. The light-shielding member 45B is configured to block light components of the light emitted by the light-emitting unit 45A other than the light component directed towards the center of the substrate 2. The light-shielding member 45B has a configuration in which one side of a rectangular box is removed. The light-shielding member 45B is positioned to cover the light-emitting unit 45A. The light-shielding member 45B is made of, for example, a resin mixed with a black pigment or dye.

[0098] The light-emitting element 45, configured as described above, emits light such that the vertical radiation angle θ1 is within a predetermined angular range and the horizontal radiation angle θ2 is within a predetermined angular range. Here, the vertical and horizontal directions are based on the plane of the substrate 2. The vertical radiation angle θ1 is the angle upward from the horizontal plane. The vertical radiation angle θ1 is also called the elevation angle. The horizontal radiation angle θ2 is the angle centered on the direction from the light-emitting element 45 toward the center of the substrate 2.

[0099] The vertical radiation angle θ1 of the light-emitting element 45 is set to be between 0 degrees and 90 degrees. Preferably, the radiation angle θ1 is set to be between 0 degrees and 60 degrees. Even more preferably, the radiation angle θ1 is set to be between 0 degrees and 45 degrees. A radiation angle θ1 = 0 degrees corresponds to the horizontal direction.

[0100] The horizontal radiation angle θ2 of the light-emitting element 45 is set to an angle that allows light to be emitted across the entire substrate 2. The horizontal radiation angle θ2 of the light-emitting element 45 is set to be between 90 degrees and 180 degrees, with respect to the direction from the light-emitting element 45 toward the center of the substrate 2. Preferably, the radiation angle θ2 is set to be between 90 degrees and 120 degrees, with respect to the direction from the light-emitting element 45 toward the center of the substrate 2.

[0101] The light-receiving element 46 has the function of detecting light (infrared light in this embodiment). The light-receiving element 46 is composed of a photodiode or an image sensor, etc.

[0102] The fourth sensing element 44 has the function of detecting an object using light. The fourth sensing element 44 is composed of a TOF sensor. The fourth sensing element 44 includes a light-emitting element 47 and a light-receiving element 48.

[0103] The light-emitting element 47 has the function of emitting light. The light emitted by the light-emitting element 47 is, for example, infrared light. The light-emitting element 47 emits light radially. That is, the fourth sensing element 44 is not configured to limit the radiation angle. The light-emitting element 47 is composed of, for example, an LED.

[0104] The light-receiving element 48 has the function of detecting light (infrared light in this embodiment). The light-receiving element 48 is composed of a photodiode or an image sensor, etc.

[0105] The block diagram of the location information acquisition device 1 is the same as that of the first embodiment.

[0106] [4-2] Operation Next, we will explain the operation of the location information acquisition device 1.

[0107] First, the operation of one of the first to third sensing elements 41 to 43 will be described. Figure 19 is a perspective view illustrating the operation of the third sensing element 43. The operation of the first and second sensing elements 41 and 42 is the same as that of the third sensing element 43.

[0108] The third sensing element 43 emits light such that its vertical radiation angle θ1 is within a predetermined angular range and its horizontal radiation angle θ2 is within a predetermined angular range. The third sensing element 43 forms a detection region 43A made of light. The detection region 43A is formed over the entire surface of the substrate 2. The third sensing element 43 detects light (received signal) reflected from an object within the detection region 43A.

[0109] The third sensing element 43 does not emit light into the spatial region above the vertical radiation angle θ1. The third sensing element 43 can operate in a way that does not detect reflected light from objects in regions other than the detection region 43A. Therefore, it is possible to prevent false detection of objects that are not the target of detection.

[0110] Next, the operation of the first to fourth sensing elements 41 to 44 will be described. Figure 20 is a perspective view illustrating the operation of the first to fourth sensing elements 41 to 44.

[0111] Each of the first to third sensing elements 41 to 43 emits light such that its vertical radiation angle θ1 is within a predetermined angular range and its horizontal radiation angle θ2 is within a predetermined angular range. Each of the first to third sensing elements 41 to 43 forms first to third detection regions 41A to 43A made of light. Each of the first to third sensing elements 41 to 43 detects light (received signal) reflected from an object within the first to third detection regions 41A to 43A.

[0112] The fourth sensing element 44 emits light radially around itself. The fourth sensing element 44 detects objects in its vicinity. The operation of the fourth sensing element 44 is the same as the operation of any of the sensing elements in the first embodiment.

[0113] In Figure 20, the first object OB1 is located near the center of the substrate 2 in a plan view, and the second object OB2 is located from the center of the substrate 2 towards the third sensing element 43 in a plan view. The first object OB1 is detected by the first to fourth sensing elements 41 to 44. The second object OB2 is detected by the first sensing element 41, the second sensing element 42, and the fourth sensing element 44, but not by the third sensing element 43.

[0114] Figure 21 is a timing diagram illustrating an example of the operation of the first to fourth sensing elements 41 to 44. The first to fourth sensing elements 41 to 44 are called channels CH1 to CH4.

[0115] The first to fourth sensing elements 41 to 44 each emit a transmission signal during each sampling period SP. In Figure 21, sampling period SP_OB1 shows the detection operation of the first object OB1, and sampling period SP_OB2 shows the detection operation of the second object OB2.

[0116] During the sampling period SP_OB1, the first sensing element 41 of channel CH1 detects the received signal 1 time after time t1 has elapsed since emitting the transmit signal. The second sensing element 42 of channel CH2 detects the received signal 2 time after time t2 has elapsed since emitting the transmit signal. The third sensing element 43 of channel CH3 detects the received signal 3 time after emitting the transmit signal. The fourth sensing element 44 of channel CH4 detects the received signal 4 time after time t4 has elapsed since emitting the transmit signal. During the sampling period SP_OB1, the first to fourth sensing elements 41 to 44 all detect the received signal. During the sampling period SP_OB1, the position of the first object OB1 can be calculated using the received signals of any three sensing elements from the first to fourth sensing elements 41 to 44.

[0117] During the sampling period SP_OB2, channels CH1, CH2, and CH4 detect the received signal, but channel CH3 does not. During the sampling period SP_OB2, the position of the second object OB2 can be calculated using the received signals from the first sensing element 41, the second sensing element 42, and the fourth sensing element 44.

[0118] Figure 22 is a flowchart illustrating the operation of the position information acquisition device 1. The signal processing unit 12 causes the first to fourth sensing elements 41 to 44 to emit a transmission signal for each sampling period SP. The first to fourth sensing elements 41 to 44 each emit a transmission signal (step S300).

[0119] The first to fourth sensing elements 41 to 44 each monitor whether or not a received signal has been detected. The first to fourth sensing elements 41 to 44 then detect the received signal that has been reflected by the object.

[0120] Next, the position determination unit 13 determines whether or not three or more of the first to fourth sensing elements 41 to 44 have detected a received signal (step S301).

[0121] If three or more sensing elements detect a received signal (step S301), the position determination unit 13 selects three sensing elements that detected the received signal (step S302). Specifically, if all of the first to fourth sensing elements 41 to 44 detect a received signal, the position determination unit 13 selects any three sensing elements from the first to fourth sensing elements 41 to 44. Also, if three of the first to fourth sensing elements 41 to 44 detect a received signal, the unit selects those three sensing elements.

[0122] Next, the position determination unit 13 determines the position of the object using the received signals detected by the three sensing elements selected in step S302 (step S303). The position determination operation of the position determination unit 13 is the same as in the first embodiment.

[0123] Subsequently, the control unit 10 executes the processes in steps S304 to S306. The processes in steps S304 to S306 are the same as steps S103 to S105 in Figure 5.

[0124] [4-3] Effects of the fourth embodiment According to the fourth embodiment, the detection area of ​​the position information acquisition device 1 can be restricted to a specific spatial area. Furthermore, it is possible to prevent the position determination operation from being performed using reflected light from objects existing outside the predetermined spatial area. This prevents false detection of objects that are not the target of detection. In addition, it is possible to improve the accuracy of detecting the target object.

[0125] The fourth embodiment can also be applied to the second and third embodiments.

[0126] The present invention is not limited to the embodiments described above, and can be modified in various ways during implementation without departing from its essence. Furthermore, each embodiment may be combined as appropriate, and in that case, the combined effects can be obtained. Moreover, the above embodiments include various inventions, and various inventions can be extracted by selecting combinations from the multiple constituent elements disclosed. For example, if the problem can be solved and effects obtained even if some constituent elements are deleted from all the constituent elements shown in the embodiment, then the configuration with these deleted constituent elements can be extracted as an invention. [Explanation of Symbols]

[0127] 1...Location information acquisition device, 2...Substrate, 3-5...First to third sensing elements, 3A-5A...Detection area, 6...Light-emitting element, 6A...Transmitting signal, 7...Light-receiving element, 7A...Received signal, 8...Object, 10...Control unit, 11...Storage unit, 12...Signal processing unit, 13...Location determination unit, 14...Specified operation processing unit, 15...Display processing unit, 20...Input / output interface, 21...Sensor unit, 22...Sensor controller, 23...Sensing element group, 24...Power supply circuit, 30...Input display system, 31...Display device, 32...Air image, 41-44...First to fourth sensing elements, 41A-43A...Detection area, 45...Light-emitting element, 45A...Light-emitting unit, 45B...Light-shielding member, 46...Light-receiving element, 47...Light-emitting element, 48...Light-receiving element.

Claims

1. circuit board and The first to third sensing elements are arranged in a triangular shape on the substrate and each includes a light-emitting element that emits a transmission signal and a light-receiving element that detects a received signal reflected by an object. A control unit that controls the first to third sensing elements and calculates the distance to the object based on the transmitted signal and the received signal, It is equipped with, The control unit, The first distance between the first sensing element and the object, the second distance between the second sensing element and the object, and the third distance between the third sensing element and the object are calculated. The first hemisphere is centered on the first sensing element and has a radius of the first distance, the second hemisphere is centered on the second sensing element and has a radius of the second distance, and the third hemisphere is centered on the third sensing element and has a radius of the third distance. The intersection points of the first to third hemispheres are calculated, and these intersection points are determined to be the positions of the object. Location information acquisition device.

2. The light-emitting element is configured to emit light radially outwards. A location information acquisition device according to claim 1.

3. circuit board and The first to fourth sensing elements are arranged in a rectangular shape on the substrate and each includes a light-emitting element that emits a transmission signal and a light-receiving element that detects a received signal reflected by an object. A control unit that controls the first to fourth sensing elements and calculates the distance to the object based on the transmitted signal and the received signal, It is equipped with, Each of the first to third sensing elements emits light such that its vertical and horizontal radiation angles are limited. The fourth sensing element emits light radially into the surroundings, The control unit, Using the received signals from three of the first to fourth sensing elements, the first to third distances between each of the three sensing elements and the object are calculated. The first to third hemispheres are calculated, each with the three sensing elements as the center and the first to third distances as the radii. The intersection points of the first to third hemispheres are calculated, and these intersection points are determined to be the positions of the object. Location information acquisition device.

4. The aforementioned vertical radiation angle is set to an angle range of 0 degrees to 90 degrees, with the horizontal plane being 0 degrees. The horizontal radiation angle is set to an angle range of 90 degrees to 180 degrees, with the direction from the light-emitting element toward the center of the substrate as the center. A location information acquisition device according to claim 3.

5. The light-emitting element included in each of the first to third sensing elements is A light-emitting part that emits light, It includes a light-shielding member configured to partially surround the light-emitting portion and to block a portion of the light emitted by the light-emitting portion. A location information acquisition device according to claim 3.

6. The light-emitting element is configured to emit infrared light. A location information acquisition device according to claim 1 or 3.

7. The control unit, The first intersection circle where the first hemisphere and the second hemisphere intersect, the second intersection circle where the second hemisphere and the third hemisphere intersect, and the third intersection circle where the third hemisphere and the first hemisphere intersect are calculated. The intersection points of the first to third intersecting circles are calculated, and these intersection points are determined to be the positions of the object. A location information acquisition device according to claim 1 or 3.

8. A display device for displaying images, A location information acquisition device according to claim 1 or 3, which is arranged on the display device, An input and display system equipped with the following features.

9. The aforementioned location information acquisition device detects user operations without physical contact, The control unit controls the operation of the display device based on the user's operation. The input display system according to claim 8.

10. The display device is configured to display an aerial image in the space above the position information acquisition device. The input display system according to claim 8.

Images