Proximity detection device, display unit, and information processing system
The proximity position detection device uses infrared light sources and photodetectors outside the display to calculate both horizontal and vertical positions, addressing the limitations of existing systems by detecting both dimensions without additional display space.
Patent Information
- Application Number
- JP2022164920
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2022-10-13
- Publication Date
- 2026-08-25
- Estimated Expiration
- 2042-10-13
AI Technical Summary
Existing proximity detection systems for display surfaces can only detect the horizontal position of an object, such as a user's hand or finger, but not the vertical position, and require space on the left or right side of the display for installation, which is not feasible in displays with vertical switches.
A proximity position detection device using infrared light sources and photodetectors arranged outside the display surface on both sides, with a calculation unit to determine both horizontal and vertical positions based on the intensity ratio and distribution of reflected infrared light.
Enables detection of both horizontal and vertical positions of an object without requiring space on the left or right sides of the display, using a simple configuration that integrates with displays to perform accurate position detection.
Smart Images

Figure 0007910939000001 
Figure 0007910939000002 
Figure 0007910939000003
Abstract
Description
Technical Field
[0001] The present invention relates to a technique for detecting the position of a detected object close to the display surface, with the user's hand, finger, etc. as the detected object.
Background Art
[0002] As a technique for detecting the position of a detected object close to the display surface, with the user's hand, finger, etc. as the detected object, a plurality of LEDs arranged along the lower side of the display and irradiating infrared light toward the upper front of the display are sequentially lit, and a plurality of photodiodes arranged along the lower side of the display detect the reflected light of the infrared light by the user's hand, and the horizontal direction (left - right direction) of the detected object close to the display surface is detected from the intensity distribution of the reflected light detected when each LED is lit. A detection system is known (for example, Patent Document 1).
Prior Art Documents
Patent Documents
[0003]
Patent Document 1
Summary of the Invention
Problems to be Solved by the Invention
[0004] For example, when displaying a plurality of icons arranged in the vertical and horizontal directions on a display and detecting the icon close to which a finger is approaching, in order to detect the position of the detected object close to it, in addition to the horizontal position of the detected object close to it, it is necessary to detect the vertical position (up - down direction).
[0005] However, according to the above - described detection system, since only LEDs and photodiodes are arranged along the lower side of the display, the horizontal position of the detected object close to it can be detected, but the vertical position (up - down direction) cannot be detected. While it's possible to detect vertical positions in the same way as horizontal positions by placing LEDs or photodiodes along the right or left edges of a display, there are cases where space isn't available to place LEDs or photodiodes on the right or left side of the display. For example, in displays used in car navigation systems, multiple switches are often arranged vertically on both the left and right sides of the display. In such displays, it is not possible to place LEDs or photodiodes on the right or left side of the display.
[0006] Therefore, the present invention aims to provide a proximity position detection device that detects the position of a detected object, such as a user's hand or fingers, that is close to the display surface of a display, and that does not require space on the left or right side of the display for the proximity position detection device to be installed, and can detect both the horizontal and vertical positions of a nearby detected object with a relatively simple configuration. [Means for solving the problem]
[0007] To achieve the above objectives, the present invention provides a proximity position detection device for detecting the position of an object close to the display surface of a display, comprising: a plurality of first infrared light sources, which are a plurality of infrared light sources that emit infrared light passing in front of the display surface, arranged outside the first side of the display surface, with one of the two horizontal sides of the display surface designated as the first side and the other side as the second side; a plurality of first photodetectors, which are a plurality of photodetectors that are a plurality of photodetectors arranged outside the first side of the display surface, arranged along the first side; a plurality of second infrared light sources, which are one or more infrared light sources that emit infrared light passing in front of the display surface, arranged outside the second side of the display surface; and a proximity position calculation unit.
[0008] The proximity position calculation unit performs a detection operation in which, for each of the first infrared light sources, the intensity of the reflected infrared light emitted by the first infrared light source is detected by the first photodetector which is pre-associated with the first infrared light source, and for each of the second infrared light sources, the intensity of the reflected infrared light emitted by the second infrared light source is detected by the first photodetector which is pre-associated with the second infrared light source. The system includes a vertical position calculation means for calculating the vertical position of an object close to the display surface of a display based on the ratio of the attributes of an intensity group consisting of intensity levels to the attributes of an intensity group consisting of intensity levels of reflected infrared light emitted by each of the second infrared light sources detected by each of the first photodetectors in the detection operation, and a horizontal position calculation means for calculating the horizontal position of an object close to the display surface of a display based on the distribution of intensity levels of reflected infrared light emitted by each of the first infrared light sources detected by each of the first photodetectors in the detection operation.
[0009] Furthermore, the attribute of the intensity group is the sum of the intensities included in the intensity group, or the maximum value of the intensities included in the intensity group. The vertical position calculation means calculates the position closer to the first side as the vertical position of the object as the ratio of the attribute of the intensity group, which consists of the intensities of the reflected infrared light emitted by each of the first infrared light sources, to the attribute of the intensity group, which consists of the intensities of the reflected infrared light emitted by each of the second infrared light sources, becomes larger, and the position closer to the second side as the vertical position of the object as the ratio becomes smaller.
[0010] Here, in the proximity position detection device, the horizontal position calculation means takes the centroid of the intensity distribution of the reflected infrared light emitted by each of the first infrared light sources detected by each of the first photodetectors in the detection operation as the horizontal position of the object. To calculate. Furthermore, in order to achieve the above objectives, the present invention provides a proximity position detection device for detecting the position of an object close to the display surface of a display, comprising: a plurality of first infrared light sources, which are a plurality of infrared light sources that emit infrared light passing in front of the display surface, arranged outside the first side of the display surface, with one of the two horizontal sides of the display surface being the first side and the other side being the second side; a plurality of first photodetectors, which are a plurality of photodetectors that are arranged outside the first side of the display surface, arranged along the first side; a plurality of second infrared light sources, which are a plurality of infrared light sources that emit infrared light passing in front of the display surface, arranged outside the second side of the display surface, arranged along the second side; and a proximity position calculation unit.
[0011] The proximity position calculation unit includes a detection operation execution unit that, for each of the first infrared light sources, causes the intensity of the reflected infrared light emitted by the first infrared light source to be detected by the first photodetector pre-associated with the first infrared light source, and for each of the second infrared light sources, detects the intensity of the reflected infrared light emitted by the second infrared light source to be detected by the first photodetector pre-associated with the second infrared light source; a vertical position calculation means that calculates the vertical position of an object close to the display surface of the display based on the ratio of the attributes of the intensity group consisting of the intensity of the reflected infrared light emitted by each of the first infrared light sources detected by each of the first photodetectors in the detection operation, and the attributes of the intensity group consisting of the intensity of the reflected infrared light emitted by each of the second infrared light sources detected by each of the first photodetectors in the detection operation; and a horizontal position calculation means that calculates the horizontal position of an object close to the display surface of the display.
[0012] Furthermore, the attribute of the intensity group is the sum of the intensities included in the intensity group, or the maximum value of the intensities included in the intensity group. The vertical position calculation means calculates the position closer to the first side as the vertical position of the object as the ratio of the attribute of the intensity group, which consists of the intensities of the reflected infrared light emitted by each of the first infrared light sources, to the attribute of the intensity group, which consists of the intensities of the reflected infrared light emitted by each of the second infrared light sources, becomes larger, and the position closer to the second side as the vertical position of the object becomes smaller.
[0013] Furthermore, the horizontal position calculation means sets the horizontal position of the object to be determined from the distribution of the intensity of the reflected infrared light emitted by each of the first infrared light sources detected by each of the first photodetectors in the detection operation as the first estimated position, and the horizontal position of the object to be determined from the distribution of the intensity of the reflected infrared light emitted by each of the second infrared light sources detected by each of the first photodetectors in the detection operation as the second estimated position, and then sets either the first estimated position or the second estimated position, or the vertical position calculated by the vertical position calculation means. The weight of the first estimated position is defined as a weight that increases as the position is closer to the first side and decreases as the vertical position is closer to the second side, and the weight of the second estimated position is defined as a weight that increases as the vertical position calculated by the vertical position calculation means is closer to the second side and decreases as the vertical position is closer to the first side. The weighted average of the first estimated position and the second estimated position, such that the sum of the weights of the first estimated position and the second estimated position is 1, is calculated as the horizontal position of the object close to the display surface of the display.
[0014] Here, in the proximity position detection device, the horizontal position calculation means sets the centroid of the intensity distribution of the reflected infrared light emitted by each of the first infrared light sources detected by each of the first photodetectors during the detection operation as the first estimated position, and the centroid of the intensity distribution of the reflected infrared light emitted by each of the second infrared light sources detected by each of the first photodetectors during the detection operation as the second estimated position Let's assume that.
[0015] Furthermore, in order to achieve the above objectives, the present invention provides a proximity position detection device for detecting the position of an object close to the display surface of a display, comprising: a plurality of first infrared light sources, which are a plurality of infrared light sources that emit infrared light passing in front of the display surface, arranged outside the first side of the display surface, with one of the two horizontal sides of the display surface designated as the first side and the other side as the second side; a plurality of first photodetectors, which are a plurality of photodetectors that are a plurality of photodetectors that are arranged outside the first side of the display surface, arranged along the first side; a plurality of second infrared light sources, which are a plurality of infrared light sources that emit infrared light passing in front of the display surface, arranged outside the second side of the display surface, arranged along the second side; a plurality of second photodetectors, which are a plurality of photodetectors that are arranged outside the second side of the display surface, arranged along the second side; and a proximity position calculation unit.
[0016] The proximity position calculation unit includes a detection operation execution unit that, for each of the first infrared light sources, causes the intensity of the reflected infrared light emitted by the first infrared light source to be detected by the first photodetector which is pre-associated with the first infrared light source, and for each of the second infrared light sources, detects the intensity of the reflected infrared light emitted by the second infrared light source which is pre-associated with the second infrared light source. The unit also includes a vertical position calculation means that calculates the vertical position of an object close to the display surface of the display based on the ratio of the attributes of the intensity group consisting of the intensity of the reflected infrared light emitted by each of the first infrared light sources detected by each of the first photodetectors in the detection operation, and the attributes of the intensity group consisting of the intensity of the reflected infrared light emitted by each of the second infrared light sources detected by each of the second photodetectors in the detection operation, and a horizontal position calculation means that calculates the horizontal position of an object close to the display surface of the display.
[0017] The attribute of the intensity group is the sum of the intensities included in the intensity group, or the maximum value of the intensities included in the intensity group. The vertical position calculation means calculates the position closer to the first side as the vertical position of the object as the ratio of the attribute of the intensity group, which consists of the intensities of the reflected infrared light emitted by each of the first infrared light sources, to the attribute of the intensity group, which consists of the intensities of the reflected infrared light emitted by each of the second infrared light sources, becomes larger, and calculates the position closer to the second side as the vertical position of the object as the ratio becomes smaller.
[0018] Furthermore, the horizontal position calculation means calculates a weighted average of the first and second estimated positions, where the sum of the weights of the first and second estimated positions is 1, using the estimated horizontal position of the object, determined from the distribution of the intensity of the reflected infrared light emitted by each of the first infrared light sources detected by each of the first photodetectors in the detection operation, as the first estimated position. The weight of the first estimated position is determined by either the first estimated position or the second estimated position, where the weight of the first estimated position is such that the vertical position calculated by the vertical position calculation means increases as it approaches the first side and decreases as it approaches the second side, and the weight of the second estimated position is such that the weight of the second estimated position is such that it increases as it approaches the second side and decreases as it approaches the first side. The weight of the first estimated position and the second estimated position is determined by using a weighted average of the weights of the first and second estimated positions, where the sum of the weights of the first and second estimated positions is 1, as the horizontal position of the object close to the display surface of the display.
[0019] Here, the proximity position detection device may be configured such that the horizontal position calculation means sets the centroid of the intensity distribution of the reflected infrared light emitted by each of the first infrared light sources detected by each of the first photodetectors in the detection operation as the first estimated position, and the centroid of the intensity distribution of the reflected infrared light emitted by each of the second infrared light sources detected by each of the second photodetectors in the detection operation as the second estimated position.
[0020] Furthermore, the present invention also provides a display unit comprising the proximity position detection device described above and the display integrated with the proximity position detection device. The present invention also provides an information processing system including the above proximity position detection device, the display, and a data processing device that uses the display for display output. In this information processing system, the proximity position detection device notifies the data processing device of the vertical position calculated by the vertical position calculation means and the horizontal position calculated by the horizontal position calculation means as detection positions, and the data processing device performs processing according to the notified detection positions.
[0021] According to the above proximity position detection device, both the horizontal position and the vertical position of the detected object can be detected without requiring space for installing the proximity position detection device on the left and right sides of the display. In addition, since the first infrared light source and the first photodetector used for detecting the horizontal position are used in combination to detect the vertical position, both the horizontal position and the vertical position of the detected object can be detected with a relatively simple configuration.
Advantages of the Invention
[0022] As described above, according to the present invention, there is provided a proximity position detection device that detects the position of a detected object close to the display surface with the user's hand or finger as the detected object, and can detect the horizontal position and the vertical position of the proximity detected object with a relatively simple configuration without requiring space for installing the proximity position detection device on the left and right sides of the display.
Brief Description of the Drawings
[0023] [Figure 1] It is a block diagram showing the configuration of an information processing system according to an embodiment of the present invention. [Figure 2] It is a diagram showing the arrangement of a display according to an embodiment of the present invention. [Figure 3] It is a diagram showing the arrangement of a proximity detection sensor according to an embodiment of the present invention. [Figure 4] It is a diagram showing the operation sequence of a proximity detection sensor according to an embodiment of the present invention. [Figure 5] This figure shows an example of processing for proximity detection positions according to an embodiment of the present invention. [Figure 6] This figure shows another example of a proximity detection sensor according to an embodiment of the present invention and another example of an operation sequence. [Figure 7] This figure shows another example of a proximity detection sensor according to an embodiment of the present invention and another example of an operation sequence. [Modes for carrying out the invention]
[0024] Embodiments of the present invention will be described below. First, let me describe the first embodiment. Figure 1 shows the configuration of the information processing system according to this first embodiment. The information processing system is a system installed in an automobile and includes a data processing device 1 that runs car navigation applications and media player applications, a display 2 with a touch panel that the data processing device 1 uses for displaying images and inputting positions on the images, a proximity position detection device 3, and other peripheral devices 4 used by the data processing device 1.
[0025] The display 2, for example as shown in Figure 2, is in the form of a display unit 10 integrated with a proximity position detection device 3, and is positioned on the car's dashboard between the driver's and passenger's seats with its display surface facing backward. The proximity position detection device 3 then detects the horizontal and vertical positions of the detected object, such as the user's hand or fingers, as it approaches the display surface of the display 2, and notifies the data processing device 1 of the detected position. The data processing device 1 then performs processing according to the notified detected position.
[0026] Returning to Figure 1, the proximity position detection device 3 comprises a lower proximity detection sensor 31, an upper proximity detection sensor 32, and a proximity detection controller 33. The lower proximity detection sensor 31 is equipped with four infrared LEDs, LED1, LED2, LED3, and LED4, and two photodiodes, PD1 and PD2, which detect infrared light. Furthermore, the upper proximity detection sensor 32 is equipped with four infrared LEDs, LED5, LED6, LED7, and LED8, and two photodiodes, PD3 and PD4, which detect infrared light. Furthermore, the proximity detection controller 33 includes a drive unit 331 that drives LED1, LED2, LED3, LED4, LED5, LED6, LED7, and LED8 to emit light, a lower detection unit 332 that converts the current signals output by PD1 and PD2 of the lower proximity detection sensor 31 into intensity signals representing the intensity of infrared light incident on PD1 and PD2 and outputs them, and an upper detection unit 333 that converts the current signals output by PD3 and PD4 of the upper proximity detection sensor 32 into intensity signals representing the intensity of infrared light incident on PD3 and PD4 and outputs them.
[0027] Furthermore, the proximity detection controller 33 includes a detection control unit 334 that controls the operation of the drive unit 331, the lower detection unit 332, and the upper detection unit 333, and detects the horizontal and vertical coordinates of the object approaching the display surface of the display 2 from the intensity of the infrared light represented by the intensity signals output by the lower detection unit 332 and the upper detection unit 333, and notifies the data processing device 1 of the detection position.
[0028] Next, as shown in Figures 3a and 3b, the LEDs 1, 2, 3, and 4 of the lower proximity sensor are arranged in that order from left to right, slightly below the bottom edge of the display 2, at approximately equal intervals, defining the front, back, left, right, up, and down directions relative to the display 2. However, the forward direction is the display direction of the display 2.
[0029] Additionally, the lower proximity sensor PD1 is positioned midway between LED1 and LED2 and converts the reflected light of incident infrared light into an electric current signal, while PD2 is positioned midway between LED3 and LED4 and converts the reflected light of incident infrared light into an electric current signal. Furthermore, the LEDs 5, 6, 7, and 8 of the upper proximity sensor are arranged in that order from left to right, at approximately equal intervals slightly above the top edge of the display 2. Additionally, the upper proximity sensor PD3 is positioned midway between LED5 and LED6 and converts the reflected light of incident infrared light into an electric current signal, while PD4 is positioned midway between LED7 and LED8 and converts the reflected light of incident infrared light into an electric current signal. The arrows in Figures 3a and 3b represent the central axis of the beam angle of LED1, LED2, LED3, LED4, LED5, LED6, LED7, and LED8. LED1, LED2, LED3, and LED4 emit infrared light obliquely upwards and in front of the display 2, while LED5, LED6, LED7, and LED8 emit infrared light obliquely downwards and in front of the display 2.
[0030] Next, the detection control unit 334 of the proximity detection controller 33 controls the operation of the drive unit 331, the lower detection unit 332, and the upper detection unit 333 so that the cycle shown in Figure 4 is repeated. The cycle shown in Figure 4a consists of a period in which the drive unit 331 emits light only from LED1 and the lower detection unit 332 outputs an intensity signal L1 representing the intensity of infrared light incident on PD1; a period in which the drive unit 331 emits light only from LED2 and the lower detection unit 332 outputs an intensity signal L2 representing the intensity of infrared light incident on PD1; a period in which the drive unit 331 emits light only from LED3 and the lower detection unit 332 outputs an intensity signal L3 representing the intensity of infrared light incident on PD2; and a period in which the drive unit 331 emits light only from LED4 and the lower detection unit 332 outputs an intensity signal L4 representing the intensity of infrared light incident on PD2. The system includes a period in which the drive unit 331 emits light only from LED 5 and the upper detection unit 333 outputs an intensity signal L5 representing the intensity of infrared light incident on PD 3, a period in which the drive unit 331 emits light only from LED 6 and the upper detection unit 333 outputs an intensity signal L6 representing the intensity of infrared light incident on PD 3, a period in which the drive unit 331 emits light only from LED 7 and the upper detection unit 333 outputs an intensity signal L7 representing the intensity of infrared light incident on PD 4, and a period in which the drive unit 331 emits light only from LED 8 and the upper detection unit 333 outputs an intensity signal L8 representing the intensity of infrared light incident on PD 4.
[0031] Next, we will describe the detection of the horizontal X and vertical Y coordinates of the proximity position of the object to be detected to the display 2 by the detection control unit 334 of the proximity detection controller 33. The detection control unit 334 acquires intensity signals L1, L2, L3, L4, L5, L6, L7, and L8 from the lower detection unit 332 and the upper detection unit 333 in each cycle shown in Figure 4. Then, using x1 as the horizontal coordinates of LED1 and LED5, x2 as the horizontal coordinates of LED2 and LED6, x3 as the horizontal coordinates of LED3 and LED7, and x4 as the horizontal coordinates of LED4 and LED8, the horizontal coordinate GL, which is obtained as the centroid of the intensity distribution of intensity signals L1, L2, L3, and L4 detected by the lower detection unit 332, and the horizontal coordinate GH, which is obtained as the centroid of the intensity distribution of intensity signals L3, L4, L5, and L6 detected by the upper detection unit 333, are calculated using Equations 1 and 2.
[0032] Formula 1: GL=(X1×L1+X2×L2+X3×L3+X4×L4) / (L1+L2+L3+L4) Formula 2: GH=(X1×L5+X2×L6+X3×L7+X4×L8) / (L5+L6+L7+L8) Then, the vertical coordinate Y of the proximity position of the detected object is determined using Equation 3. Formula 3: Y=(L1+L2+L3+L4) / {(L1+L2+L3+L4)+(L5+L6+L7+L8)} Y takes values from 0 to 1. As the proximity of the detected object approaches the bottom edge of display 2, (L1+L2+L3+L4) becomes larger and (L5+L6+L7+L8) becomes smaller, so Y approaches 1. As the proximity of the detected object approaches the top edge of display 2, (L5+L6+L7+L8) becomes larger and (L1+L2+L3+L4) becomes smaller, so Y approaches 0.
[0033] Furthermore, when the proximity of the detected object is at the center of the vertical direction of display 2, (L1+L2+L3+L4) and (L5+L6+L7+L8) are approximately equal, so Y is approximately 0.5. Therefore, by setting the vertical coordinate of the lower edge of display 2 to 1 and the vertical coordinate of the upper edge of display 2 to 0, the vertical coordinate of the proximity position of the detected object can be represented by Y. Next, the horizontal coordinate X of the proximity position of the detected object is determined using Equation 4. Equation 4: X = GL × Y + GH × (1 - Y) Equation 4 indicates that the weight of the horizontal coordinate GL, obtained from the intensity signal detected by the lower detection unit 332, is increased as Y increases, and the weight of the horizontal coordinate GH, obtained from the intensity signal detected by the upper detection unit 333, is increased as Y decreases. The weight of GL and GH is then calculated as a weighted average where the sum of the weights of GL and GH equals 1.
[0034] The reason for setting the weights in this way is that a larger Y value indicates that the proximity of the detected object is lower, thus increasing the reliability of the horizontal coordinate GL obtained by the lower detection unit 332 from L1+L2+L3+L4, while a smaller Y value indicates that the proximity of the detected object is higher, thus increasing the reliability of the horizontal coordinate GH obtained by the upper detection unit 333 from L5+L6+L7+L8.
[0035] In the above, the vertical coordinate Y of the proximity position of the detected object was determined using Equation 3. However, the coordinate Y may also be determined using Equation 5, where MAX(A, B, C, D) is a function that gives the maximum value among A, B, C, and D. Formula 5: Y=MAX(L1, L2, L3, L4) / {MAX(L1, L2, L3, L4)+MAX(L5, L6, L7, L8)} Furthermore, while the horizontal coordinate X of the proximity position of the detected object was determined using Equation 4 above, the coordinate X can also be determined by setting X=GL when Y is 0.5 or greater, and X=GH when Y is less than 0.5. Returning to Figure 1, the data processing device 1, having received the coordinates (X, Y) as the detected position from the detection control unit 334 of the proximity position detection device 3, performs the following processing, for example. In other words, when the data processing device 1 displays eight icons on the display 2 in a 2-row vertical and 4-column horizontal configuration, as shown in Figure 5a, and the user brings their finger close to the display 2 to operate an icon, as shown in Figure 5b, the proximity position detection device 3 outputs the coordinates (X, Y) of the position where the finger approached as the detected position to the data processing device 1.
[0036] The data processing device 1 identifies the icon that the finger has approached from the coordinates (X, Y) received from the proximity position detection device 3, and, as shown in Figure 5c, highlights the icon that the user has approached by enlarging or bordering it, thereby facilitating the identification of the user of the icon that the finger has approached.
[0037] If the icon the user brings their finger close to is indeed the icon they want to operate, the user touches the touch panel on display 2, and the data processing device 1, having detected the touch, accepts the operation for that icon. If the icon the user brings their finger close to is not the icon they want to operate, the user moves their finger, highlighting other icons, and then touches the icon they truly want to operate.
[0038] In this example, icon operation is accepted by touching the touch panel. However, if the maximum value among L1-L8 exceeds a predetermined threshold, the proximity detection device 3 may notify the data processing device 1, and upon receiving this notification, the data processing device 1 may accept operation of the icon currently highlighted. The first embodiment of the present invention has been described above.
[0039] A second embodiment of the present invention will be described below. The following description will only cover the differences between the second embodiment and the first embodiment. The information processing system according to this second embodiment has a configuration in which, as shown in Figure 6a, the two photodiodes PD3 and PD4 of the upper proximity detection sensor 32 of the proximity position detection device 3 are omitted, and the upper detection unit 333, which is no longer needed, is also omitted.
[0040] Furthermore, in this second embodiment, the detection control unit 334 of the proximity detection controller 33 controls the operation of the drive unit 331 and the lower detection unit 332 so that the cycle shown in Figure 6b is repeated. The cycle shown in Figure 6b consists of a period in which the drive unit 331 emits light only from LED1 and the lower detection unit 332 outputs an intensity signal L1 representing the intensity of infrared light incident on PD1; a period in which the drive unit 331 emits light only from LED2 and the lower detection unit 332 outputs an intensity signal L2 representing the intensity of infrared light incident on PD1; a period in which the drive unit 331 emits light only from LED3 and the lower detection unit 332 outputs an intensity signal L3 representing the intensity of infrared light incident on PD2; and a period in which the drive unit 331 emits light only from LED4 and the lower detection unit 332 outputs an intensity signal L4 representing the intensity of infrared light incident on PD2. The system includes a period in which the drive unit 331 emits light only from LED 5 and the lower detection unit 332 outputs an intensity signal L5 representing the intensity of infrared light incident on PD1, a period in which the drive unit 331 emits light only from LED 6 and the lower detection unit 332 outputs an intensity signal L6 representing the intensity of infrared light incident on PD1, a period in which the drive unit 331 emits light only from LED 7 and the lower detection unit 332 outputs an intensity signal L7 representing the intensity of infrared light incident on PD2, and a period in which the drive unit 331 emits light only from LED 8 and the lower detection unit 332 outputs an intensity signal L8 representing the intensity of infrared light incident on PD2.
[0041] Furthermore, the detection control unit 334 of the proximity detection controller 33 detects the vertical coordinate Y of the proximity position of the object to be detected using the following equation 6. Formula 6: Y=(L1+L2+L3+L4) / {(L1+L2+L3+L4)+K×(L5+L6+L7+L8)} In Equation 6, K is a preset constant and is a coefficient for correcting the difference in intensity signal levels caused by the difference in positional relationship between the LED of the lower proximity detection sensor 31 and the PD of the lower proximity detection sensor 31 that outputs an intensity signal when the LED is lit, and the positional relationship between the LED of the upper proximity detection sensor 32 and the PD of the lower proximity detection sensor 31 that outputs an intensity signal when the LED is lit.
[0042] More specifically, K is set such that, for example, when the detected object is close to the center of the display surface of display 2 in the vertical, horizontal, or vertical direction, (L1+L2+L3+L4)=K×(L5+L6+L7+L8). With this configuration of the second embodiment, as well as the proximity position of the detected object approaches the bottom edge of the display 2, (L1+L2+L3+L4) becomes larger and (L5+L6+L7+L8) becomes smaller, and as the proximity position of the detected object approaches the top edge of the display 2, (L5+L6+L7+L8) becomes larger and (L1+L2+L3+L4) becomes smaller. Therefore, the vertical coordinate Y of the proximity position of the detected object can be detected in the same way as in the first embodiment.
[0043] Furthermore, by omitting the two photodiodes PD3 and PD4 of the upper proximity detection sensor 32, the upper detection unit 333 becomes unnecessary. Generally, since the output of a photodiode is minute, if photodiodes are provided for both the upper proximity detection sensor 32 and the lower proximity detection sensor 31, it is necessary to provide two separate detection units, such as a photodiode controller IC, near the upper proximity detection sensor 32 and the lower proximity detection sensor 31, respectively, as in the upper detection unit 333 and lower detection unit 332 of the first embodiment. However, in this second embodiment, it is sufficient to provide a detection unit only near the lower proximity detection sensor 31, so this second embodiment is more cost-effective than the first embodiment.
[0044] Next, the horizontal coordinate X of the proximity position of the detection control unit 334 in this second embodiment is calculated using equations 1, 2, and 4 of the first embodiment. However, in equation 4, the coordinate Y obtained in equation 6 is used. The second embodiment of the present invention has been described above. In the above, the vertical coordinate Y of the proximity position of the detected object was determined using Equation 5. However, the coordinate Y may also be determined using Equation 7, where MAX(A, B, C, D) is a function that gives the maximum value among A, B, C, and D. Equation 7: Y=MAX(L1, L2, L3, L4) / {MAX(L1, L2, L3, L4)+K×MAX(L5, L6, L7, L8)} Furthermore, while the horizontal coordinate X of the proximity position of the detected object was obtained using Equation 4, the coordinate X can also be obtained by setting X=GL when Y is 0.5 or greater, and X=GH when Y is less than 0.5. Alternatively, the coordinate X can be found by unconditionally setting X = GL. A third embodiment of the present invention will be described below. The following description will only cover the differences between the third embodiment and the first embodiment. The information processing system according to this third embodiment has the configuration of the information processing system of the first embodiment shown in Figure 1, but as shown in Figure 7a, the upper proximity detection sensor 32 of the proximity position detection device 3 is composed of only two LEDs 5 and LED 6, the two LEDs and two photodiodes PD3 and PD4 of the upper proximity detection sensor 32 are omitted, and the upper detection unit 333 which has become unnecessary as a result is also omitted.
[0045] In the third embodiment, the left-right position of LED 5 of the upper proximity detection sensor 32 is approximately midway between LED 1 and LED 2 in the left-right direction, as shown in the figure, and the left-right position of LED 6 of the upper proximity detection sensor 32 is approximately midway between LED 3 and LED 4 in the left-right direction. Furthermore, LEDs 5 and 6 are used that have a wider light distribution characteristic than the LEDs of the lower proximity detection sensor 31.
[0046] Furthermore, in this third embodiment, the detection control unit 334 of the proximity detection controller 33 controls the operation of the drive unit 331 and the lower detection unit 332 so that the cycle shown in Figure 7b is repeated. The cycle shown in Figure 7b consists of a period in which the drive unit 331 emits light only from LED1 and the lower detection unit 332 outputs an intensity signal L1 representing the intensity of infrared light incident on PD1, a period in which the drive unit 331 emits light only from LED2 and the lower detection unit 332 outputs an intensity signal L2 representing the intensity of infrared light incident on PD1, and a period in which the drive unit 331 emits light only from LED3 and the lower detection unit 332 outputs an intensity signal L3 representing the intensity of infrared light incident on PD2. The system includes an o-period, a period in which the drive unit 331 illuminates only LED4 and the lower detection unit 332 outputs an intensity signal L4 representing the intensity of infrared light incident on PD2, a period in which the drive unit 331 illuminates only LED5 and the lower detection unit 332 outputs an intensity signal L5 representing the intensity of infrared light incident on PD1, and a period in which the drive unit 331 illuminates only LED6 and the lower detection unit 332 outputs an intensity signal L6 representing the intensity of infrared light incident on PD2.
[0047] Furthermore, the detection control unit 334 of the proximity detection controller 33 detects the vertical coordinate Y of the proximity position of the object to be detected using the following equation 8. Formula 8: Y=(L1+L2+L3+L4) / {(L1+L2+L3+L4)+M×(L5+L6)} In Equation 8, M is a preset constant and is a coefficient that corrects for differences in the intensity signal levels caused by the positional relationship between the LED of the lower proximity detection sensor 31 and the PD of the lower proximity detection sensor 31 that outputs an intensity signal when the LED is lit, the positional relationship between the LED of the upper proximity detection sensor 32 and the PD of the lower proximity detection sensor 31 that outputs an intensity signal when the LED is lit, and the differences in the characteristics of the LED of the lower proximity detection sensor 31 and the LED of the upper proximity detection sensor 32.
[0048] More specifically, M is set such that, for example, when the detected object is close to the center of the display surface of display 2 in the vertical, horizontal, or vertical direction, (L1+L2+L3+L4)=M×(L5+L6). With this configuration of the second embodiment, as well as the proximity position of the detected object approaches the bottom edge of the display 2, (L1+L2+L3+L4) becomes larger and (L5+L6) becomes smaller, and as the proximity position of the detected object approaches the top edge of the display 2, (L5+L6) becomes larger and (L1+L2+L3+L4) becomes smaller. Therefore, the vertical coordinate Y of the proximity position of the detected object can be detected in the same way as in the first embodiment.
[0049] Furthermore, compared to the second embodiment, the configuration can be further simplified, and costs can be reduced. Next, the horizontal coordinate X of the proximity position of the detection control unit 334 in this third embodiment is calculated by Equation 9. Formula 9:X=(X1×L1+X2×L2+X3×L3+X4×L4) / (L1+L2+L3+L4) The third embodiment of the present invention has been described above. In the above, the vertical coordinate Y of the proximity position of the detected object was determined using Equation 8. However, the coordinate Y may also be determined using Equation 7, where MAX(A, B, C, D) is a function that gives the maximum value among A, B, C, and D. Equation 9: Y=MAX(L1, L2, L3, L4) / {MAX(L1, L2, L3, L4)+M×MAX(L5, L6)} Embodiments of the present invention have been described above. According to the proximity position detection device 3 described in each of the above embodiments, it is possible to detect both the horizontal and vertical positions of the object to be detected without requiring space on the left or right of the display 2 for the installation of the proximity position detection device 3. Furthermore, by using LEDs or photodiodes, which are used to detect horizontal position, in conjunction with vertical position detection, it is possible to detect both the horizontal and vertical positions of the object being detected with a relatively simple configuration. [Explanation of Symbols]
[0050] 1...Data processing device, 2...Display, 3...Proximity position detection device, 4...Peripheral device, 10...Display unit, 31...Lower proximity detection sensor, 32...Upper proximity detection sensor, 33...Proximity detection controller, 331...Drive unit, 332...Lower detection unit, 333...Upper detection unit, 334...Detection control unit.
Claims
1. A proximity position detection device for detecting the position of an object close to the display surface of a display, A plurality of first infrared light sources are arranged along the first side outside the first side of the display surface, with one of the two horizontal sides of the display surface designated as the first side and the other side as the second side, and the plurality of first infrared light sources emit infrared light passing in front of the display surface. A plurality of first photodetectors are arranged along the first edge outside the first edge of the display surface, A plurality of second infrared light sources, which are one or more infrared light sources that emit infrared light passing in front of the display surface and are arranged outside the second side of the display surface, It has a proximity position calculation unit, The aforementioned proximity position calculation unit is: A detection operation execution unit performs a detection operation in which, for each of the first infrared light sources, the intensity of the reflected infrared light emitted by the first infrared light source is detected by the first photodetector which is pre-associated with the first infrared light source, and for each of the second infrared light sources, the intensity of the reflected infrared light emitted by the second infrared light source is detected by the first photodetector which is pre-associated with the second infrared light source. A vertical position calculation means for calculating the vertical position of an object close to the display surface of a display based on the ratio of the attributes of an intensity group consisting of the intensity of the reflected infrared light emitted from each of the first infrared light sources detected by each of the first photodetectors in the detection operation, and the attributes of an intensity group consisting of the intensity of the reflected infrared light emitted from each of the second infrared light sources detected by each of the first photodetectors in the detection operation, The system includes a horizontal position calculation means that calculates the horizontal position of an object close to the display surface of the display based on the distribution of the intensity of the reflected infrared light emitted by each of the first infrared light sources detected by each of the first photodetectors in the detection operation, The attribute of the aforementioned intensity group is the sum of the intensities included in that intensity group, or the maximum value of the intensities included in that intensity group. The vertical position calculation means calculates the vertical position of the object as the position closer to the first side increases as the ratio of the attribute of the intensity group consisting of the intensity of the reflected infrared light emitted by each first infrared light source to the attribute of the intensity group consisting of the intensity of the reflected infrared light emitted by each second infrared light source increases, and calculates the vertical position of the object as the position closer to the second side increases as the ratio decreases. The proximity position detection device is characterized in that the horizontal position calculation means calculates the centroid of the intensity distribution of the reflected infrared light emitted by each of the first infrared light sources detected by each of the first photodetectors in the detection operation as the horizontal position of the object.
2. A proximity position detection device for detecting the position of an object close to the display surface of a display, A plurality of first infrared light sources are arranged along the first side outside the first side of the display surface, with one of the two horizontal sides of the display surface designated as the first side and the other side as the second side, and the plurality of first infrared light sources emit infrared light passing in front of the display surface. A plurality of first photodetectors are arranged along the first edge outside the first edge of the display surface, A plurality of second infrared light sources, which are a plurality of infrared light sources that emit infrared light passing in front of the display surface, are arranged along the second side outside the second side of the display surface, It has a proximity position calculation unit, The aforementioned proximity position calculation unit is: A detection operation execution unit performs a detection operation in which, for each of the first infrared light sources, the intensity of the reflected infrared light emitted by the first infrared light source is detected by the first photodetector which is pre-associated with the first infrared light source, and for each of the second infrared light sources, the intensity of the reflected infrared light emitted by the second infrared light source is detected by the first photodetector which is pre-associated with the second infrared light source. A vertical position calculation means for calculating the vertical position of an object close to the display surface of a display based on the ratio of the attributes of an intensity group consisting of the intensity of the reflected infrared light emitted from each of the first infrared light sources detected by each of the first photodetectors in the detection operation, and the attributes of an intensity group consisting of the intensity of the reflected infrared light emitted from each of the second infrared light sources detected by each of the first photodetectors in the detection operation, It includes a horizontal position calculation means for calculating the horizontal position of an object close to the display surface of the display, The attribute of the aforementioned intensity group is the sum of the intensities included in that intensity group, or the maximum value of the intensities included in that intensity group. The vertical position calculation means calculates the vertical position of the object as the position closer to the first side increases as the ratio of the attribute of the intensity group consisting of the intensity of the reflected infrared light emitted by each first infrared light source to the attribute of the intensity group consisting of the intensity of the reflected infrared light emitted by each second infrared light source increases, and calculates the vertical position of the object as the position closer to the second side increases as the ratio decreases. The aforementioned horizontal position calculation means is In the detection operation, the centroid of the intensity distribution of the reflected infrared light emitted by each of the first infrared light sources detected by each of the first photodetectors is set as the first estimated position, and the centroid of the intensity distribution of the reflected infrared light emitted by each of the second infrared light sources detected by each of the first photodetectors in the detection operation is set as the second estimated position. Either the first estimated position or the second estimated position, or, The weight of the first estimated position is such that the vertical position calculated by the vertical position calculation means increases as it approaches the first side and decreases as it approaches the second side, and the weight of the second estimated position is such that the vertical position calculated by the vertical position calculation means increases as it approaches the second side and decreases as it approaches the first side, and the weight of the first estimated position is such that the sum of the weights of the first estimated position and the second estimated position is 1, and the weighted average of the first estimated position and the second estimated position is, A proximity position detection device characterized by calculating the horizontal position of an object adjacent to the display surface of the aforementioned display.
3. A proximity position detection device for detecting the position of an object close to the display surface of a display, A plurality of first infrared light sources are arranged along the first side outside the first side of the display surface, with one of the two horizontal sides of the display surface designated as the first side and the other side as the second side, and the plurality of first infrared light sources emit infrared light passing in front of the display surface. A plurality of first photodetectors are arranged along the first edge outside the first edge of the display surface, A plurality of second infrared light sources, which are a plurality of infrared light sources that emit infrared light passing in front of the display surface, are arranged along the second side outside the second side of the display surface, A plurality of second photodetectors are arranged along the second side on the outside of the second side of the display surface, It has a proximity position calculation unit, The aforementioned proximity position calculation unit is: A detection operation execution unit performs a detection operation in which, for each of the first infrared light sources, the intensity of the reflected infrared light emitted by the first infrared light source is detected by the first photodetector which is pre-associated with the first infrared light source, and for each of the second infrared light sources, the intensity of the reflected infrared light emitted by the second infrared light source is detected by the second photodetector which is pre-associated with the second infrared light source. A vertical position calculation means that calculates the vertical position of an object close to the display surface of a display based on the ratio of the attributes of the intensity group consisting of the intensity of the reflected infrared light emitted from each of the first infrared light sources detected by each of the first photodetectors in the detection operation, and the attributes of the intensity group consisting of the intensity of the reflected infrared light emitted from each of the second infrared light sources detected by each of the second photodetectors in the detection operation, It includes a horizontal position calculation means for calculating the horizontal position of an object close to the display surface of the display, The attribute of the aforementioned intensity group is the sum of the intensities included in that intensity group, or the maximum value of the intensities included in that intensity group. The vertical position calculation means calculates the vertical position of the object as the position closer to the first side increases as the ratio of the attribute of the intensity group consisting of the intensity of the reflected infrared light emitted by each first infrared light source to the attribute of the intensity group consisting of the intensity of the reflected infrared light emitted by each second infrared light source increases, and calculates the vertical position of the object as the position closer to the second side increases as the ratio decreases. The aforementioned horizontal position calculation means is In the detection operation, the estimated horizontal position of the object obtained from the distribution of the intensity of the reflected infrared light emitted by each of the first infrared light sources detected by each of the first photodetectors is defined as the first estimated position, and the estimated horizontal position of the object obtained from the distribution of the intensity of the reflected infrared light emitted by each of the second infrared light sources detected by each of the second photodetectors in the detection operation is defined as the second estimated position. Either the first estimated position or the second estimated position, or, The weight of the first estimated position is such that the vertical position calculated by the vertical position calculation means increases as it approaches the first side and decreases as it approaches the second side, and the weight of the second estimated position is such that the vertical position calculated by the vertical position calculation means increases as it approaches the second side and decreases as it approaches the first side, and the weight of the first estimated position is such that the sum of the weights of the first estimated position and the second estimated position is 1, and the weighted average of the first estimated position and the second estimated position is, A proximity position detection device characterized by calculating the horizontal position of an object adjacent to the display surface of the aforementioned display.
4. A proximity position detection device according to claim 3, The proximity position detection device is characterized in that the horizontal position calculation means sets the centroid of the intensity distribution of the reflected infrared light emitted by each of the first infrared light sources detected by each of the first photodetectors in the detection operation as the first estimated position, and the centroid of the intensity distribution of the reflected infrared light emitted by each of the second infrared light sources detected by each of the second photodetectors in the detection operation as the second estimated position.
5. A display unit characterized by comprising a proximity position detection device according to claim 1, 2, 3, or 4, and the display integrated with the proximity position detection device.
6. A proximity position detection device according to claim 1, 2, 3, or 4, comprising a display and a data processing device that uses the display for display output, The proximity position detection device notifies the data processing device of the vertical position calculated by the vertical position calculation means and the horizontal position calculated by the horizontal position calculation means as the detected positions. The data processing device is an information processing system characterized by performing processing according to the notified detection location.
Citation Information
Patent Citations
Information processor, calibration metho, and program
JP2012252708A
Proximity detection device
JP2022014516A
Proximity position detecting device, display unit and information processing system
JP2022061242A
Display device
JP2022129445A
Method and device for receiving reflectance-based input
US20130207936A1