Proximity detection device, display unit, and information processing system

Abstract

The present invention provides a proximity detection device that prevents the operation of other devices from being mistakenly detected as the user's hand approaching a display surface. Four infrared LEDs and two photodiodes PD are arranged in the order of LED1, PD1, LED2, LED3, PD2, and LED4, and are configured slightly below the bottom edge of the display surface. The left-right reflection generation position is estimated based on A1, A2, A3, and A4, which are the detection signals A1 of PD1 when LED1 is illuminated, A2 of PD1 when LED2 is illuminated, A3 of PD2 when LED3 is illuminated, and A4 of PD2 when LED4 is illuminated. Based on the left-right reflection generation position, a threshold value Th is set so that the threshold value Th becomes larger when the reflection generation position is on the left side of the driver's seat. Furthermore, if the maximum value of A1, A2, A3, and A4 exceeds the threshold value Th, the approach of the user's hand is detected.

Description

Technical Field

[0001] The present invention relates to a technology for detecting the approach of a user's hand toward a display surface of a display. Background Art

[0002] As a technology for detecting the approach of a user's hand to the display surface of a display, the following detection system is known: infrared light is irradiated toward the upper front of the display from several infrared LEDs arranged in a left-right arrangement below the lower edge of the display surface of the display, and the reflected light of the infrared light caused by the user's hand is detected using a photodiode, thereby detecting the approach of the user's hand to the display surface of the display and accepting it as an operation on the display (for example, patent document 1).

[0003] Here, the detection system is arranged between the driver's seat and the front passenger seat on the dashboard of the car. In order to avoid accepting the driver's operation of other devices such as the wiper lever as operation of the display, a dedicated infrared LED is provided to emit infrared light from the display toward the driver's seat. When the photodiode detects the reflected light of the infrared light with a strong intensity emitted by the dedicated infrared LED, the detection of the user's hand approaching is suppressed.

[0004] Prior art literature

[0005] Patent Literature

[0006] Patent Document 1: Japanese Patent Application Publication No. 2019-74465 Summary of the Invention

[0007] According to the above-mentioned detection system, in order to prevent the driver's operation of other devices from being recognized as an operation on the display, a dedicated infrared LED is required to emit infrared light from the display toward the driver's seat.

[0008] In addition, when the user actually moves his hand close to the display surface of the display in order to operate the display, depending on how the hand is brought close, the photodiode detects the strong reflected light of the infrared light emitted by the dedicated infrared LED, and there is a case where the operation on the display is not accepted.

[0009] Therefore, the technical problem of the present invention is to suppress the erroneous detection of operations on other devices as the user's hand approaching the display surface of the display without using a dedicated infrared LED that emits infrared light from the display toward the driver's seat.

[0010] In order to solve the above technical problems, the present invention is a proximity detection device for detecting the approach of a user to the display surface of a display, the proximity detection device comprising: a plurality of infrared light sources arranged on the outside of the display surface of the display along a first side which is one side of the display surface, and emitting infrared light passing in front of the display surface; one or more light detectors arranged on the outside of the display surface; a proximity detection unit for detecting the approach of the user to the display surface with a set sensitivity using the intensity of the reflected light of the infrared light emitted by each infrared light source detected by the light detector; and a sensitivity setting unit for estimating a first direction position based on the intensity of the reflected light of the infrared light emitted by each infrared light source detected by the light detector, and setting the sensitivity of the proximity detection unit to a sensitivity determined based on the relationship between the pre-set first direction position and the sensitivity and the estimated first direction position, wherein the first direction position is a position where reflection occurs in the direction along the first side, i.e., the first direction.

[0011] Here, such a proximity detection device may be configured such that the sensitivity setting unit calculates the center of gravity of the intensity distribution of the reflected infrared light detected by the photodetector as the value indicating the position in the first direction.

[0012] Alternatively, the proximity detection device may be configured such that the display is positioned between the driver's seat and the passenger seat in the left-right direction of the vehicle, and the first direction coincides with the left-right direction of the vehicle. In this case, the relationship between the predetermined first direction position and the sensitivity may be such that the sensitivity decreases when the first direction position is within the driver's seat side region of the display surface compared to when the first direction position is within the passenger seat side region of the display surface.

[0013] In addition, the above proximity detection device can also be configured such that, in the proximity detection unit, when the maximum value of the intensity of the reflected light of the infrared light emitted by the infrared light source detected by the light detector for each of the multiple infrared light sources exceeds a set threshold value, the user's approach to the display surface is detected, the relationship between the first direction position and the sensitivity is defined as the relationship between the first direction position and the threshold value, and in the sensitivity setting unit, the threshold value of the proximity detection unit is set to a threshold value determined based on the relationship between the pre-set first direction position and the threshold value and the estimated first direction position.

[0014] According to the proximity detection device as described above, the sensitivity for detecting the approach of the user's hand can be arbitrarily set for each position along the direction of the first side of the display surface by using only a plurality of infrared light sources and light detectors arranged along the first side of the display surface for use in detecting the approach of the user's hand to the display surface.

[0015] Furthermore, by setting the sensitivity of the area on the driver's seat side of the display surface to be lower, it is possible to suppress the misdetection of operations on other devices as the user's hand approaching the display surface of the display without using a dedicated infrared LED that emits infrared light from the display toward the driver's seat.

[0016] Here, it may also be that the display is arranged at a position between the driver's seat and the front passenger seat in the left-right direction of the automobile, and the proximity detection device has a plurality of light detectors arranged along the first side as the light detectors. In the proximity detection unit, for each of the plurality of infrared light sources, the intensity of the reflected light of the infrared light emitted by the infrared light source, detected by the light detector located at a position relatively close to the infrared light source that emits the infrared light, is used as the first detected reflection intensity of the emitted light of the infrared light source. When the intensity of the reflected light of the infrared light represented by the first detected reflection intensity of the emitted light of each infrared light source exceeds a set threshold value, the user's approach to the display surface is detected, and the first direction position and the sensitivity The relationship between the first direction position and the threshold value is defined as the relationship between the first direction position and the threshold value, and in the sensitivity setting unit, the threshold value of the proximity detection unit is set to a threshold value determined based on the relationship between the predetermined first direction position and the threshold value and the estimated first direction position, and when the intensity of the reflected light of the infrared light emitted by the infrared light source located near the driver's seat detected by the light detector which is relatively far away from the infrared light source located near the driver's seat and the first detected reflection intensity of the infrared light source located near the driver's seat are both greater than specified levels, instead of the threshold value determined based on the relationship, the threshold value of the proximity detection unit is set to a threshold value that is adjusted so that the threshold value determined based on the relationship becomes a smaller threshold value.

[0017] Thus, since the sensitivity of the driver's seat side area of ​​the display surface is set lower, it is possible to prevent the user's hand from not being detected in the portion of the driver's seat side area far from the first side, that is, the portion far from the infrared light source.

[0018] In addition, in the above proximity detection device, four infrared LEDs are arranged along the lower side of the lower side of the display as the multiple infrared light sources, and there are two photodiodes: a photodiode arranged at a position between the infrared LED arranged at the far left and the infrared LED arranged second from the left, and a photodiode arranged at a position between the infrared LED arranged at the far right and the infrared LED arranged second from the right.

[0019] In addition, in order to solve the technical problem, the present invention is a proximity detection device for detecting a user approaching a display surface of a display, the proximity detection device being provided with: a plurality of infrared light sources arranged outside the display surface of the display along a first side serving as one side of the display surface, emitting infrared light passing in front of the display surface; a plurality of infrared light sources arranged outside the display surface along a second side of the display surface serving as an opposite side to the first side, emitting infrared light passing in front of the display surface; one or more light detectors arranged outside the display surface; a proximity detection unit detecting the user approaching the display surface with a set sensitivity using the intensity of reflected light of the infrared light emitted by each infrared light source detected by the light detector. approach; and a sensitivity setting unit, which estimates the position where the reflection in the first direction, i.e., the first direction position, occurs based on the intensity of the reflected light of the infrared light emitted by a plurality of infrared light sources at different positions in the direction along the first side, i.e., the first direction, detected by the light detector, and estimates the position where the reflection in the second direction, i.e., the second direction position, occurs based on the intensity of the reflected light of the infrared light emitted by a plurality of infrared light sources at different positions in the direction along the side perpendicular to the first side, i.e., the second direction, detected by the light detector, and sets the sensitivity of the proximity detection unit to a sensitivity determined based on the relationship between the pre-set first direction position, the second direction position, and the sensitivity and the estimated first direction position and the second direction position.

[0020] Here, such a proximity detection device can also be constructed as follows: in the sensitivity setting unit, the center of gravity of the intensity distribution is calculated as the value representing the first direction position, and the center of gravity of the intensity distribution is obtained by taking the coordinates of the intensity of the reflected light of the infrared light detected by the light detector as the order of the arrangement of the infrared light sources that emit the infrared light along the first direction; and the center of gravity of the intensity distribution is calculated as the value representing the second direction position, and the center of gravity of the intensity distribution is obtained by taking the coordinates of the intensity of the reflected light of the infrared light detected by the light detector as the order of the arrangement of the infrared light sources that emit the infrared light along the second direction.

[0021] In addition, in such a proximity detection device, there may be two infrared LEDs arranged in the vertical direction on the left side of the display surface of the display as a plurality of infrared light sources arranged along the first side, two infrared LEDs arranged in the vertical direction on the right side of the display surface of the display as a plurality of infrared light sources arranged along the second side, a photodiode arranged in a position between the two infrared LEDs arranged in the vertical direction on the left side of the display surface, and a photodiode arranged in a position between the two infrared LEDs arranged in the vertical direction on the right side of the display surface as the light detector.

[0022] According to such a proximity detection device, the sensitivity for detecting the approach of the user's hand can be arbitrarily set for each position in the left, right, up and down directions on the display surface by using only a plurality of infrared light sources arranged along the first side of the display surface and a plurality of infrared light sources and light detectors arranged along the second side of the display surface for detecting the approach of the user's hand to the display surface.

[0023] Therefore, by setting the sensitivity of the area on the driver's seat side of the display surface to be lower, it is possible to suppress the misdetection of operations on other devices as the user's hand approaching the display surface of the display without using a dedicated infrared LED that emits infrared light from the display toward the driver's seat.

[0024] In addition, the present invention also provides a display unit including the above-mentioned proximity detection device and the display integrated with the proximity detection device.

[0025] The present invention also provides an information processing system comprising the above-described proximity detection device, the display, and a data processing device that uses the display for display output. In this information processing system, when the proximity detection device detects a user approaching the display surface, it notifies the data processing device of the proximity.

[0026] Effects of the Invention

[0027] As described above, according to the present invention, it is possible to suppress erroneous detection of operations on other devices as the user's hand approaching the display surface of the display without using a dedicated infrared LED that emits infrared light from the display toward the driver's seat. BRIEF DESCRIPTION OF THE DRAWINGS

[0028] Figure 1 This is a block diagram showing the configuration of an information processing system according to the first embodiment of the present invention.

[0029] Figure 2 It is a diagram showing the arrangement of a display according to the first embodiment of the present invention.

[0030] Figure 3 It is a diagram showing the arrangement and detection area of ​​the proximity detection sensor according to the first embodiment of the present invention.

[0031] Figure 4 It is a diagram showing the operation sequence of the proximity sensor according to the first embodiment of the present invention.

[0032] Figure 5 This is a flowchart showing the proximity detection process according to the first embodiment of the present invention.

[0033] Figure 6This is a diagram showing threshold values ​​according to the first embodiment of the present invention.

[0034] Figure 7 It is a diagram showing the arrangement of proximity detection sensors according to the second embodiment of the present invention.

[0035] Figure 8 It is a diagram showing the operation sequence of the proximity sensor according to the second embodiment of the present invention.

[0036] Figure 9 It is a diagram showing the principle of area detection by the proximity detection sensor according to the second embodiment of the present invention.

[0037] Figure 10 This is a flowchart showing the proximity detection process according to the second embodiment of the present invention.

[0038] Figure 11 It is a diagram showing the arrangement of proximity sensors according to a third embodiment of the present invention.

[0039] Figure 12 This is a flowchart showing the proximity detection process according to the third embodiment of the present invention.

[0040] Figure 13 This is a diagram showing threshold values ​​according to the third embodiment of the present invention. DETAILED DESCRIPTION

[0041] Hereinafter, embodiments of the present invention will be described.

[0042] First, a first embodiment will be described.

[0043] Figure 1 The configuration of the information processing system according to the first embodiment is shown.

[0044] The information processing system is a system installed in a car and includes: a data processing device 1 that executes car navigation applications, media player applications, etc., a display 2 used by the data processing device 1 when displaying images, a proximity detection device 3, and other peripheral devices 4 used by the data processing device 1.

[0045] Here, if Figure 2 As shown, the display 2 and the proximity detection device 3 are in the form of an integrated display unit 10, with the display surface facing rearward and arranged between the driver's seat and the passenger seat on the dashboard of the car. In addition, the example shown in the figure is for a car with a left steering wheel.

[0046] Return to Figure 1 The proximity detection device 3 includes a proximity detection sensor 31 and a proximity detection controller 32 .

[0047] The proximity detection sensor 31 includes four infrared LEDs, LED1 , LED2 , LED3 , and LED4 , and two photodiodes PD1 and PD2 for detecting infrared light.

[0048] In addition, the proximity detection controller 32 includes: a driving unit 321, which drives LED1, LED2, LED3, and LED4 to make them emit light; a detection unit 322, which converts the current signal output by PD1 and PD2 into an intensity signal indicating the intensity of the infrared light incident on PD1 and PD2 and outputs it; and a detection control unit 323, which controls the operation of the driving unit 321 and the detection unit 322, and detects the approach of the user's hand to the display surface of the display 2 based on the intensity of the infrared light indicated by the intensity signal output by the detection unit 322, and notifies the data processing device 1.

[0049] Then, if Figure 3 a、 Figure 3 As shown in b, the left-right, up-down, and front-back directions are determined relative to the display 2, and LED1, LED2, LED3, and LED4 are arranged in this order from left to right at approximately equal intervals slightly below the lower edge of the display 2. The front direction is the display direction of the display 2.

[0050] In addition, PD1 is configured between LED1 and LED2, and converts the reflected light of the incident infrared light into a current signal. PD2 is configured between LED3 and LED4, and converts the reflected light of the incident infrared light into a current signal and outputs it.

[0051] Figure 3 a、 Figure 3 The arrows in b indicate the central axes of the directional angles of LED1 , LED2 , LED3 , and LED4 . LED1 , LED2 , LED3 , and LED4 emit infrared light obliquely toward the upper front of the display 2 .

[0052] Figure 3 In the first embodiment, c represents the area for detecting the user's hand, that is, the range of the detection area as viewed in the vertical direction. In addition, the hatched area in the figure is the range of the detection area as viewed in the vertical direction.

[0053] As shown in the figure, in the first range, which is approximately 1 / 3 of the range on the right side of the display surface in the left-right direction, the detection area is set so that the distance from the display surface to the front boundary of the detection area is constant. In the range to the left of the first range, the detection area is set so that the distance from the display surface to the front boundary of the detection area gradually decreases as it approaches the left side which is the driver's seat side.

[0054] Next, the detection control unit 323 of the proximity detection controller 32 repeatedly performs Figure 4 The operations of the driving unit 321 and the detecting unit 322 are controlled in the cyclic manner shown.

[0055] Here, each cycle includes: a period in which the driving unit 321 only makes LED1 emit light and the detection unit 322 outputs an intensity signal A1 indicating the intensity of the infrared light incident to PD1; a period in which the driving unit 321 only makes LED2 emit light and the detection unit 322 outputs an intensity signal A2 indicating the intensity of the infrared light incident to PD1; a period in which the driving unit 321 only makes LED3 emit light and the detection unit 322 outputs an intensity signal A3 indicating the intensity of the infrared light incident to PD2; and a period in which the driving unit 321 only makes LED4 emit light and the detection unit 322 outputs an intensity signal A4 indicating the intensity of the infrared light incident to PD2.

[0056] Next, the proximity detection process performed by the detection control unit 323 of the proximity detection controller 32 will be described.

[0057] Figure 5 The steps of the proximity detection process are shown.

[0058] As shown in the figure, if the detection control unit 323 Figure 4 In each of the cycles shown, intensity signals A1, A2, A3, and A4 are obtained from the detection unit 322 (step 502). Then, using a predetermined evaluation function f(), an evaluation index V for each of the intensity signals A1, A2, A3, and A4 is calculated using V = f(A1, A2, A3, and A4) (step 504). The evaluation function f() is a function that calculates the magnitude of reflection caused by an object near the display surface in front of the display surface based on the intensity signals A1, A2, A3, and A4. As an example, the evaluation function f() can be a function that calculates the maximum value of the intensity signals A1, A2, A3, and A4, or a linear combination function of A1, A2, A3, and A4 (a×A1+b×A2+c×A3+d×A4).

[0059] Furthermore, the maximum value of the intensity signals A1, A2, A3, and A4 is calculated as MA (step 506), and it is checked whether MA exceeds a predetermined threshold value Thmin (step 508). As the threshold value Thmin, for example, the minimum value that MA can take when reflection due to the user's hand occurs near the display surface in front of the display surface of the display 2 is used.

[0060] Then, if MA does not exceed the threshold value Thmin (step 508 ), the process directly returns to step 502 to wait for the acquisition of the intensity signals A1 , A2 , A3 , and A4 from the detection unit 322 in the next cycle.

[0061] On the other hand, if MA exceeds the threshold value Thmin, the center of gravity G is calculated using the following equation (step 510).

[0062] G=(1×A1+2×A2+3×A3+4×A4) / (A1+A2+A3+A4)

[0063] Here, the center of gravity G represents the coordinates of the center of gravity of the intensity distribution of the infrared light LED. The coordinate value of the center of gravity when only A1 is detected and other values ​​are zero is represented as 1, the coordinate value of the center of gravity when only A4 is detected and other values ​​are zero is represented as 4, and the middle position is represented as a coordinate value between 1 and 4.

[0064] In addition, the center of gravity G represents the estimated value of the left-right position where the reflection caused by the user's hand in front of the display surface occurs, using values ​​from 1 to 4. The estimated position takes a larger value as it is to the right and a smaller value as it is to the left.

[0065] Furthermore, next, a threshold value Th is set for the value corresponding to the center of gravity G (step 512 ).

[0066] Next, V calculated in step 504 is compared with the threshold Th (step 514). If the evaluation index V is not greater than the threshold Th, the process returns directly to step 502 and waits for the intensity signals A1, A2, A3, and A4 of the next cycle to be obtained from the detection unit 322.

[0067] On the other hand, when the evaluation index V is greater than the threshold value Th, the approach of the user's hand to the display surface of the display 2 is detected, and the approach of the user's hand is notified to the data processing device 1 (step 516).

[0068] Then, the process returns to step 502 to wait for the acquisition of the intensity signals A1, A2, A3, and A4 from the detection unit 322 in the next cycle.

[0069] Here, in step 512, the threshold value Th is set to a value corresponding to the value of the center of gravity G indicating the position in the left-right direction where the reflection caused by the user's hand occurs, so that the area where the user's hand approaches is detected in steps 514 and 516, that is, the range observed in the up-down direction of the detection area becomes Figure 3 The range shown in c.

[0070] That is, in step 512, for example, according to Figure 6 The threshold value Th is set by the relationship between the center of gravity G and the threshold value Th shown in FIG. Figure 6In the relationship shown, as the center of gravity G increases from 1 to approximately 3, Th gradually increases from minTh to maxTh. When the center of gravity G is within the range of approximately 3 to 4, Th becomes a constant value, maxTh. Furthermore, such a relationship between the center of gravity G and the threshold value Th can be set in the detection control unit 323 using a mathematical formula or as a table.

[0071] The proximity detection process performed by the detection control unit 323 has been described above.

[0072] As described above, according to this first embodiment, only four infrared LEDs and two photodiodes are used to detect the approach of the user's hand to the display surface, and the sensitivity of detecting the approach of the user's hand can be arbitrarily set for each position in the left and right directions on the display surface. The sensitivity is the distance from the display surface to the area where the approach of the user's hand is detected, that is, the front boundary of the detection area.

[0073] And, as the detection area, set Figure 3 In the detection area on the driver's seat side, i.e., the left side, where the distance from the display surface to the front boundary of the detection area is small, as shown in c, the sensitivity on the driver's seat side, i.e., the left side, is set low. Thus, without using a dedicated infrared LED that emits infrared light from the display toward the driver's seat, it is possible to suppress the situation where operations on other devices are mistakenly detected as the user's hand approaching the display surface of the display.

[0074] In addition, according to the first embodiment, it is possible to set Figure 3 Therefore, by setting different threshold values ​​Th for each intensity signal A1, A2, A3, and A4, a detection area is set as shown in c. Figure 3 As in the case of the detection area shown in d, it is possible to suppress repeated detection and non-detection of proximity in response to the user's hand movement shown by the arrow in the figure.

[0075] Hereinafter, a second embodiment of the present invention will be described.

[0076] In the first embodiment described above, since LED1, LED2, LED3, and LED4 are arranged below the display surface, the infrared light intensity is smaller in the area above the display surface where the distance from LED1, LED2, LED3, and LED4 increases compared to the area below the display surface. Therefore, when the threshold value Th is set to the area below the display surface based only on the center of gravity G as in the first embodiment, the detection area in front of the area becomes smaller than that of the area below the display surface. Figure 3When the detection area shown in c matches the area, the area on the left side of the display surface where the relatively large threshold Th is set and above the area where the infrared light illumination intensity is small is Figure 7 In the area A_E1 of a and b, the user's hand sometimes cannot be detected normally.

[0077] The second embodiment solves such a problem and differs from the first embodiment only in the loop performed by the drive unit 321 and the detection unit 322 by the detection control unit 323 of the proximity detection controller 32 and the proximity detection processing performed by the detection control unit 323 .

[0078] In the second embodiment, the detection control unit 323 of the proximity detection controller 32 controls the operation of the driving unit 321 and the detection unit 322 to repeatedly perform Figure 8 The loop shown in a.

[0079] Here, each cycle includes: a period in which the driving unit 321 only makes LED1 emit light and the detection unit 322 outputs an intensity signal A1 indicating the intensity of the infrared light incident to PD1 and an intensity signal E1 indicating the intensity of the infrared light incident to PD2; a period in which the driving unit 321 only makes LED2 emit light and the detection unit 322 outputs an intensity signal A2 indicating the intensity of the infrared light incident to PD1; a period in which the driving unit 321 only makes LED3 emit light and the detection unit 322 outputs an intensity signal A3 indicating the intensity of the infrared light incident to PD2; and a period in which the driving unit 321 only makes LED4 emit light and the detection unit 322 outputs an intensity signal A4 indicating the intensity of the infrared light incident to PD2.

[0080] However, the detection control unit 323 of the proximity detection controller 32 may also be repeatedly Figure 8 The loop shown in b is replaced by Figure 8 The operation of the driving unit 321 and the detecting unit 322 is controlled in a cyclic manner as shown in FIG.

[0081] Figure 8The cycle shown in b includes: a period in which the driving unit 321 only makes LED1 emit light and the detection unit 322 outputs an intensity signal A1 indicating the intensity of the infrared light incident to PD1; a period in which the driving unit 321 only makes LED2 emit light and the detection unit 322 outputs an intensity signal A2 indicating the intensity of the infrared light incident to PD1; a period in which the driving unit 321 only makes LED3 emit light and the detection unit 322 outputs an intensity signal A3 indicating the intensity of the infrared light incident to PD2; a period in which the driving unit 321 only makes LED4 emit light and the detection unit 322 outputs an intensity signal A4 indicating the intensity of the infrared light incident to PD2; and a period in which the driving unit 321 only makes LED1 emit light and the detection unit 322 outputs an intensity signal E1 indicating the intensity of the infrared light incident to PD2.

[0082] exist Figure 8 In the cycle of a and b, the intensity signal E1 represents the intensity of the infrared light incident on PD2 when only LED1 is illuminated. Figure 7 When reflection by the user's hand occurs in the area A_E1 on the upper left side of the display 2 shown in a and b, a larger value is shown compared to when reflection occurs in other areas.

[0083] This is because the area A_E1 on the upper left side of the display 2 is illuminated by the infrared light emitted by the LED 1, and the positional relationship between the LED 1, the PD 2 and the area A_E1 is as follows: Figure 9 As shown in a, the positional relationship of the reflected light of the infrared light emitted by LED1 due to the reflection generated in area A_E1 reaches PD2. In contrast, other areas are almost not irradiated by the infrared light emitted by LED1, or the positional relationship between LED1 and PD2 is as shown in Figure 9 As shown in b, this is an area with a positional relationship in which the reflected infrared light emitted by the LED 1 hardly reaches the PD 2 due to reflection occurring in this area.

[0084] then, Figure 10 The following shows the steps of a proximity detection process performed by the detection control unit 323 of the proximity detection controller 32 in the second embodiment.

[0085] As shown in the figure, in the second embodiment, if the detection control unit 323 Figure 4In each of the cycles shown, intensity signals A1, A2, A3, A4, and E1 are obtained from the detection unit 322 (step 1002). Then, using a predetermined evaluation function f(), an evaluation index V for each of the intensity signals A1, A2, A3, and A4 is calculated using V = f(A1, A2, A3, A4) (step 1004). The evaluation function f() is a function that calculates the magnitude of reflection caused by an object near the display surface in front of the display surface based on the intensity signals A1, A2, A3, and A4. As an example, the evaluation function f() can be a function that calculates the maximum value of the intensity signals A1, A2, A3, and A4, a linear combination function of A1, A2, A3, and A4 (a×A1+b×A2+c×A3+d×A4), or the like.

[0086] In addition, the maximum value of the intensity signals A1, A2, A3, and A4 is calculated as MA (step 1006), and it is checked whether MA exceeds the specified threshold value Thmin (step 1008). If not, it returns directly to step 1002 and waits for the next cycle of intensity signals A1, A2, A3, A4, and E1 to be obtained from the detection unit 322.

[0087] On the other hand, if MA exceeds the threshold value Thmin, the center of gravity G is calculated using the following equation in the same manner as in the first embodiment (step 1010 ).

[0088] G=(1×A1+2×A2+3×A3+4×A4) / (A1+A2+A3+A4)

[0089] Furthermore, similarly to the first embodiment, the threshold value Th is set to a value corresponding to the center of gravity G (step 1012 ).

[0090] Next, Ez is calculated by Ez=A1×E1 (step 1014 ), and the threshold Th is adjusted according to the value of Ez (step 1016 ).

[0091] In step 1016, the threshold value Th is adjusted so that when Ez is large, the threshold value Th becomes smaller than when Ez is small. More specifically, n is set to a predetermined positive integer. When Ez is greater than a predetermined value, the threshold value Th is reduced by n%. When Ez is not greater than the predetermined value, the threshold value Th is not changed. Alternatively, the threshold value Th is adjusted by increasing or decreasing the threshold value so that it decreases as Ez increases.

[0092] Furthermore, V calculated in step 1004 is compared with the adjusted threshold Th (step 1018). If the evaluation index V is not greater than the threshold Th, the process returns directly to step 1002 and waits for the intensity signals A1, A2, A3, A4, and E1 of the next cycle to be obtained from the detection unit 322.

[0093] On the other hand, when the evaluation index V is greater than the threshold value Th, the approach of the user's hand to the display surface of the display 2 is detected, and the approach of the user's hand is notified to the data processing device 1 (step 1020).

[0094] Then, the process returns to step 1002 to wait for the acquisition of the intensity signals A1, A2, A3, A4, and E1 from the detection unit 322 in the next cycle.

[0095] Furthermore, here, A1 takes a relatively large value when reflection by the user's hand occurs in the area to the left of the display 2. Furthermore, as described above, E1 takes a relatively large value when reflection by the user's hand occurs in the area approximately above and to the left of the display 2, and takes a relatively small value when reflection by the user's hand does not occur in the area above and to the left of the display 2.

[0096] Therefore, when both A1 and E1 are larger than a predetermined level and the product of A1 and E1 becomes larger, that is, when Ez calculated in step 104 is large, it can be determined that reflection caused by the user's hand occurred at a position in the upper left area of ​​the display 2.

[0097] Furthermore, by adjusting the threshold value Th in step 1016 so that the threshold value Th becomes smaller when Ez is large, it is possible to detect the region in steps 1018 and 1029 using a threshold value Th smaller than that in the lower left region. Figure 7 The user's hand is within the upper left area A_E1 shown in a and b.

[0098] Therefore, in the first embodiment, the threshold value Th is set to the detection area in front of the area below the display surface based only on the center of gravity G. Figure 3 When the detection area shown in c matches, according to the second embodiment, the user's hand can also be detected normally in the area A_E1 located on the left side of the display surface where a relatively large threshold Th is set and above the left where the illumination intensity of infrared light is smaller.

[0099] The second embodiment of the present invention has been described above.

[0100] In the proximity detection processing of the second embodiment shown above, A1×E1 is used as Ez, but other values ​​may be used as long as it is a signal that can roughly determine the area where the detection weakening of the upper part of the driver's seat side needs to be compensated in the first embodiment.

[0101] Hereinafter, a third embodiment of the present invention will be described.

[0102] The third embodiment differs from the first embodiment only in the arrangement of LED1 , LED2 , LED3 , LED4 , PD1 , and PD2 and the proximity detection process performed by the detection control unit 323 .

[0103] That is, in the third embodiment, if Figure 11 As shown, LED1, PD1, and LED2 are arranged slightly to the left of the left side of the display surface of the display 2, from top to bottom in the order of the record; and LED3, PD2, and LED4 are arranged slightly to the right of the right side of the display surface of the display 2, from top to bottom in the order of the record.

[0104] In addition, the detection control unit 323 performs Figure 12 The proximity detection process is shown.

[0105] As shown in the figure, in the proximity detection process, if Figure 4 In each cycle shown, intensity signals A1, A2, A3, and A4 are obtained from the detection unit 322 (step 1202), and the evaluation index V of the intensity signals A1, A2, A3, and A4 is calculated using the prescribed evaluation function f() through V=f(A1, A2, A3, A4) (step 1204).

[0106] The evaluation function f() is a function that calculates the magnitude of reflection caused by an object near the display surface in front of the display surface based on the intensity signals A1, A2, A3, and A4. As an example, the evaluation function f() may also be a function that calculates the maximum value of the intensity signals A1, A2, A3, and A4, or a linear combination function of A1, A2, A3, and A4 (a×A1+b×A2+c×A3+d×A4).

[0107] Calculate the maximum value of the intensity signals A1, A2, A3, and A4 as MA (step 1206)

[0108] Then, it is checked whether MA exceeds the threshold value Thmin (step 1208). If not, the process returns directly to step 1202 to wait for the acquisition of the intensity signals A1, A2, A3, and A4 from the detection unit 322 in the next cycle.

[0109] On the other hand, if MA exceeds the threshold value Thmin, the centers of gravity Gx and Gy are calculated using the following equations (step 1210).

[0110] Gx={1×(A1+A2)+2×(A3+A4)} / (A1+A2+A3+A4),

[0111] Gy={1×(A1+A3)+2×(A2+A4)} / (A1+A2+A3+A4)

[0112] Here, in the intensity signals A1, A2, A3, and A4, the x-coordinates of the intensity signals are pre-assigned according to the order of arrangement of the infrared LEDs in the left-right direction, and the infrared LEDs emit reflected light with an intensity represented by the intensity signal, and the y-coordinates of the intensity signals are pre-assigned according to the order of arrangement of the infrared LEDs in the left-right direction, and the infrared LEDs emit reflected light with an intensity represented by the intensity signal.

[0113] Here, the intensity signals A1 and A2 of the reflected infrared light of the first LED1 and LED2 from the left are assigned x-coordinate 1, the intensity signals A3 and A4 of the reflected infrared light of the second LED3 and LED4 from the left are assigned x-coordinate 2, the intensity signals A1 and A3 of the reflected infrared light of the first LED1 and LED3 from the top are assigned y-coordinate 1, and the intensity signals A2 and A4 of the reflected infrared light of the second LED2 and LED4 from the top are assigned y-coordinate 2.

[0114] Furthermore, the center of gravity Gx represents the x-coordinate of the center of gravity of the intensity distribution, and the center of gravity Gy represents the y-coordinate of the center of gravity of the intensity distribution.

[0115] The center of gravity Gx represents an estimated value of the left-right position where the reflection caused by the user's hand in front of the display surface occurs, using a value ranging from 1 to 2, with the estimated value increasing as the position moves to the right and decreasing as the position moves to the left. Furthermore, the center of gravity Gy represents an estimated value of the up-down position where the reflection caused by the user's hand in front of the display surface occurs, using a value ranging from 1 to 2, with the estimated value increasing as the position moves to the bottom and decreasing as the position moves to the top.

[0116] Furthermore, next, the threshold value Th is set to a value corresponding to the left-right center of gravity Gx and the up-down center of gravity Gy (step 1212).

[0117] Then, V calculated in step 1204 is compared with the threshold Th (step 1214). If the evaluation index V is not greater than the threshold Th, it returns directly to step 1202 and waits for the next cycle of intensity signals A1, A2, A3, and A4 to be obtained from the detection unit 322.

[0118] On the other hand, when the evaluation index V is greater than the threshold value Th, the approach of the user's hand to the display surface of the display 2 is detected, and the approach of the user's hand is notified to the data processing device 1 (step 1216).

[0119] Then, the process returns to step 1202 to wait for the acquisition of the intensity signals A1, A2, A3, and A4 of the next cycle from the detection unit 322.

[0120] Here, in step 1212, the threshold Th is set based on the left-right center of gravity Gx indicating the left-right position where the reflection caused by the user's hand occurs, and the up-down center of gravity Gy indicating the up-down position where the reflection caused by the user's hand occurs, so that the area in front of the display surface where the approach of the user's hand is detected by steps 1214 and 1216, that is, the front boundary of the detection area, becomes a desired shape, that is, so that the distance from each position on the display surface to the front boundary of the detection area becomes a distance that matches the desired shape of the front boundary of the detection area.

[0121] For example, in step 1212, if Figure 13 By setting the threshold value Th based on the relationship between the horizontal center of gravity Gx and the vertical center of gravity Gy shown in FIG. 1 , a detection area can be formed in which the distance from the display surface to the front boundary increases from the lower left to the upper right.

[0122] As described above, according to this third embodiment, the distance from the display surface to the area for detecting the approach of the user's hand, that is, the front boundary of the detection area, that is, the sensitivity for detecting the approach of the user's hand, can be arbitrarily set for each position in the left, right, up, and down directions on the display surface using only four infrared LEDs and two photodiodes used in detecting the approach of the user's hand to the display surface.

[0123] The third embodiment of the present invention has been described above.

[0124] In addition, in the proximity detection processing of the above-mentioned first embodiment, second embodiment, and third embodiment, the maximum value of the intensity signals A1, A2, A3, and A4 is used as the evaluation index MA, but as the evaluation index V, other values ​​can also be used as long as it is an indicator of the degree of size of the reflected light detected in PD1 and PD2.

[0125] In addition, in the above first, second and third embodiments, four infrared LEDs LED1, LED2, LED3 and LED4 and two photodiodes PD1 and PD2 are used, but the number of infrared LEDs can be other than 4 and the number of photodiodes can be other than 2.

[0126] Description of Reference Numerals

[0127] 1 ...data processing device, 2 ...display, 3 ...proximity detection device, 4 ...peripheral device, 10 ...display unit, 31 ...proximity detection sensor, 32 ...proximity detection controller, 321 ...driving unit, 322 ...detection unit, 323 ...detection control unit.

Claims

1. A proximity detection device for detecting a user approaching a display surface of a display, characterized in that: have: A plurality of infrared light sources are arranged outside a display surface of the display and along a first side of the display surface, emitting infrared light that passes in front of the display surface; One or more light detectors, disposed outside the display surface; a proximity detection unit that detects a user approaching the display surface with a set sensitivity using the intensity of reflected light of the infrared light emitted by each of the infrared light sources detected by the light detector; as well as The sensitivity setting unit estimates the first direction position based on the intensity of the reflected light of the infrared light emitted by each infrared light source detected by the light detector, and sets the sensitivity of the proximity detection unit to a sensitivity determined based on the relationship between the pre-set first direction position and the sensitivity and the estimated first direction position, wherein the first direction position is the position where reflection occurs in the direction along the first edge, i.e., the first direction.

2. The proximity detection device according to claim 1, wherein: The sensitivity setting unit calculates a centroid of intensity distribution of reflected infrared light detected by the photodetector as a value indicating the first directional position.

3. The proximity detection device according to claim 2, characterized in that: The display is arranged between the driver's seat and the passenger seat in the left-right direction of the car. The first direction is consistent with the left-right direction of the car, The relationship between the preset first direction position and sensitivity is such that when the first direction position is within the driver's seat side area of ​​the display surface, the sensitivity is lower than when the first direction position is within the passenger seat side area of ​​the display surface.

4. The proximity detection device according to claim 3, characterized in that: The proximity detection unit detects the user's approach to the display surface when the maximum value of the intensity of the reflected light of the infrared light emitted by each of the plurality of infrared light sources detected by the light detector exceeds a set threshold value. The relationship between the first direction position and the sensitivity is defined as the relationship between the first direction position and the threshold, The sensitivity setting unit sets the threshold of the proximity detection unit to a threshold determined based on a preset relationship between the first direction position and the threshold and the estimated first direction position.

5. The proximity detection device according to claim 3, characterized in that: The photodetectors include a plurality of photodetectors arranged along the first side. The proximity detection unit detects, for each of the plurality of infrared light sources, the intensity of the reflected light of the infrared light emitted by the infrared light source detected by the light detector located relatively close to the infrared light source emitting the infrared light, as a first detected reflection intensity of the light emitted by the infrared light source, and detects the user's approach to the display surface when the intensity of the reflected light of the infrared light represented by the first detected reflection intensity of the light emitted by each infrared light source exceeds a set threshold value. The relationship between the first direction position and the sensitivity is defined as the relationship between the first direction position and the threshold, The sensitivity setting unit sets the threshold value of the proximity detection unit to a threshold value determined based on the relationship between a predetermined first direction position and the threshold value and the estimated first direction position, and when the intensity of the reflected light of the infrared light emitted by the infrared light source located near the driver's seat detected by a light detector that is relatively far away from the infrared light source located near the driver's seat and the first detected reflection intensity of the infrared light source located near the driver's seat are both greater than specified levels, the threshold value of the proximity detection unit is set to a threshold value that is adjusted so that the threshold value determined based on the relationship becomes a smaller threshold value, instead of the threshold value determined based on the relationship.

6. The proximity detection device according to claim 2, characterized in that: The proximity detection unit detects the user approaching the display surface when the maximum value of the intensity of the reflected light of the infrared light emitted by each of the plurality of infrared light sources detected by the light detector exceeds a set threshold value. The relationship between the first direction position and the sensitivity is defined as the relationship between the first direction position and the threshold, The sensitivity setting unit sets the threshold of the proximity detection unit to a threshold determined based on a preset relationship between the first direction position and the threshold and the estimated first direction position.

7. The proximity detection device according to claim 1, characterized in that: The display is arranged between the driver's seat and the passenger seat in the left-right direction of the car. The first direction is consistent with the left-right direction of the car, The relationship between the preset first direction position and sensitivity is such that when the first direction position is within the driver's seat side area of ​​the display surface, the sensitivity is lower than when the first direction position is within the passenger seat side area of ​​the display surface.

8. The proximity detection device according to claim 7, characterized in that: The proximity detection unit detects the user approaching the display surface when the maximum value of the intensity of the reflected light of the infrared light emitted by each of the plurality of infrared light sources detected by the light detector exceeds a set threshold value. The relationship between the first direction position and the sensitivity is defined as the relationship between the first direction position and the threshold, The sensitivity setting unit sets the threshold of the proximity detection unit to a threshold determined based on a preset relationship between the first direction position and the threshold and the estimated first direction position.

9. A proximity detection device for detecting a user approaching a display surface of a display, characterized in that: have: A plurality of infrared light sources are arranged outside a display surface of the display and along a first side of the display surface, emitting infrared light that passes in front of the display surface; a plurality of infrared light sources arranged outside the display surface and along a second side of the display surface opposite to the first side, emitting infrared light passing in front of the display surface; One or more light detectors, disposed outside the display surface; a proximity detection unit that detects a user approaching the display surface with a set sensitivity using the intensity of reflected light of the infrared light emitted by each infrared light source detected by the light detector; as well as The sensitivity setting unit estimates the position where the reflection in the first direction occurs, i.e., the first direction position, based on the intensity of the reflected light of the infrared light emitted by a plurality of infrared light sources at different positions in the direction along the first side, i.e., the first direction position, detected by the light detector; estimates the position where the reflection in the second direction occurs, i.e., the second direction position, based on the intensity of the reflected light of the infrared light emitted by a plurality of infrared light sources at different positions in the direction along the side perpendicular to the first side, i.e., the second direction position, detected by the light detector; and sets the sensitivity of the proximity detection unit to a sensitivity determined based on the relationship between the pre-set first direction position, the second direction position, and the sensitivity, and the estimated first direction position and the second direction position.

10. The proximity detection device according to claim 9, characterized in that: The sensitivity setting unit calculates the center of gravity of the intensity distribution as a value representing the position in the first direction, and the center of gravity of the intensity distribution is obtained by taking the coordinates of the intensity of the reflected light of the infrared light detected by the light detector as the order of the arrangement of the infrared light sources that emit the infrared light along the first direction, and calculates the center of gravity of the following intensity distribution as a value representing the position in the second direction, and the center of gravity of the intensity distribution is obtained by taking the coordinates of the intensity of the reflected light of the infrared light detected by the light detector as the order of the arrangement of the infrared light sources that emit the infrared light along the second direction.

Images