Touch operator recognition system and information processing system

Abstract

The present invention addresses the problem of providing a "touch operator recognition system and an information processing system" that recognize a user who touches a touch panel regardless of the manner of touching the touch panel. [Solution] On the basis of the intensity distribution of reflected light of infrared light emitted obliquely upward forward from a plurality of infrared LEDs arranged in the left-right direction below the display surface of a display (2), the position in the left-right direction of a subject approaching the display surface is estimated as an approaching position (Gx). When the positive direction of the coordinates in the horizontal direction is set as a direction from left to right, the coordinates Tx in the horizontal direction and the proximity position Gx of the touch position of the touch panel are used, and when the proximity position Gx is located at a position separated by Th1 or more to the right side than the coordinates Tx, a user of the driver's seat on the right side of the display (2) is set as a touch operator, and when the proximity position Gx is located at a position separated by Th1 or more to the right side than the coordinates Tx, the display (2) is set as a touch operator. When the proximity position Gx is located at a position at a distance of Th1 or more to the left side from the coordinate Tx, a user of the passenger seat on the left side of the display (2) is set as a touch operator.

Description

Technical Field

[0001] The present invention relates to a technology for identifying an operator of a touch panel from among users located on the left and right of the touch panel. Background Art

[0002] As a technology for identifying the operator of the touch panel from among the users on the left and right of the touch panel, the following technology is known: Fig.12 As shown in the exploded view of FIG. 1 , a frame-shaped optical position detection device 1203 having an opening 12031 is provided to overlap a touch panel 1202 arranged on a display surface of a display monitor 1201 (eg, Patent Document 1).

[0003] like Fig.12 As shown in FIG. 1 b, the optical position detection device 1203 has a column of light-emitting diodes 12032 and a column of photodiodes 12033 arranged opposite to each other in the vertical direction and the horizontal direction. In addition, when the touch panel is not operated, infrared light emitted from the light-emitting diodes 12032 at each position passes through the opening 12031 and is detected by the photodiodes 12033 at the opposite position. On the other hand, when the touch panel 1202 is touched, the infrared light emitted from the light-emitting diodes 12032 at the position corresponding to the position of the touched finger is blocked by the finger, and the infrared light is no longer detected by the photodiodes 12033 at the opposite position. The optical position detection device 1203 detects the position of the finger based on the position of the photodiodes 12033 that no longer detect infrared light.

[0004] In addition, if Fig.12 As shown in c1, generally speaking, when a user on the right side of the touch panel touches the touch panel, since the finger tip is tilted to the left, the horizontal coordinate X1 of the touch position detected by the touch panel is closer to the right than the horizontal coordinate X2 of the finger position detected by the optical position detection device 1203, as shown in FIG. Fig.12 As shown in c2, when the user on the left side of the touch panel touches the touch panel, since the fingertip is tilted to the right, the horizontal coordinate X1 of the touch position detected by the touch panel is closer to the left than the horizontal coordinate X2 of the finger position detected by the optical position detection device 1203. Taking advantage of this, in this technology, based on the size relationship between the horizontal coordinate X1 of the touch position detected by the touch panel 1202 and the horizontal coordinate X2 of the finger position detected by the optical position detection device 1203, it is identified which of the users on the left or right of the touch panel 1202 has touched the touch panel 1202.

[0005] In addition, as a technology related to the present application, a detection system is known, which uses a user's hand or finger as a detection object, and sequentially lights up a plurality of LEDs arranged along the lower side of the display and irradiating infrared light in an upward and diagonal direction in front of the display, and detects reflected light of the infrared light caused by the detection object by a plurality of photodiodes arranged along the lower side of the display, and detects the horizontal (left-right) position of the detection object close to the display surface of the display based on the distribution of the intensity of the reflected light detected when each LED is lit (for example, patent document 2).

[0006] Prior art literature:

[0007] Patent Literature:

[0008] Patent Document 1: Japanese Patent Application Publication No. 2007-331692

[0009] Patent Document 2: Japanese Patent Application Publication No. 2021-117189 Summary of the invention

[0010] Problems to be solved by the invention:

[0011] In order to prevent a user's finger or hand from blocking the display content of the display monitor, the user may orient the finger touching the touch panel substantially perpendicularly to the touch surface of the touch panel.

[0012] In this case, according to the above-mentioned technique of using the optical position detection device 1203, as Fig.12 As shown in d, the horizontal coordinate X1 of the touch position detected by the touch panel 1202 is substantially equal to the horizontal coordinate X2 of the finger position detected by the optical position detection device 1203, and it is impossible to identify which user touches the touch panel.

[0013] Therefore, an object of the present invention is to widely identify which of the users on the left and right sides of the touch panel is the user who has touched the touch panel, regardless of the way of touching.

[0014] Means used to solve the problem:

[0015] In order to achieve the above-mentioned problem, the present invention is a touch operator identification system for determining a user who has operated a touch panel, wherein the touch panel is arranged to overlap with the display surface of a display, and the touched position is detected as a touch position, and the touch operator identification system comprises: a proximity detection device for detecting an object close to the display surface of the display; and a user determination mechanism for determining a user who has touched the touch panel. The proximity detection device comprises: a plurality of light sources arranged outside the display surface of the display along the left-right direction of the display surface, and emitting invisible light in front of the display surface; a photodetector for detecting reflected light of the invisible light emitted by the light source arranged outside the display surface of the display; and a reference position estimation mechanism for estimating the coordinates of the approaching object in the left-right direction of the display surface as a left-right direction reference position based on the distribution of the intensity of the reflected light of the invisible light emitted by each of the light sources detected by the photodetector. In addition, when the touch panel is touched, the user judgment mechanism judges whether the user who operates the touch panel is a user on the left side or the right side of the display based on the coordinates of the touch position detected by the touch panel in the left-right direction of the display surface, that is, the left-right touch position and the left-right reference position calculated by the reference position estimation mechanism, the positional relationship in the left-right direction of the display surface, and the distance in the left-right direction of the display surface.

[0016] Here, such a touch operator identification system can also be constructed as follows: in the reference position estimating mechanism of the proximity detection device, instead of estimating the coordinates of the approaching detection object in the left-right direction of the display surface as the left-right direction reference position, the coordinates of the center of gravity of the reflected light of the invisible light emitted by each of the light sources detected by the light detector are calculated in the left-right direction of the display surface as the left-right direction reference position after the distribution of the intensity is corrected in a manner that maintains the magnitude relationship of the intensity and decreases in a greater proportion as the intensity increases.

[0017] In addition, the above touch operator identification system can also be constructed as follows: in the user judgment mechanism, when the left-right direction reference position is located on the left side of the left-right direction touch position and is more than a prescribed distance away from the left-right direction touch position, it is judged that the user who operates the touch panel is a user located on the left side of the display; and when the left-right direction reference position is located on the right side of the left-right direction touch position and is more than the prescribed distance away from the left-right direction touch position, it is judged that the user who operates the touch panel is a user located on the right side of the display.

[0018] Alternatively, the above touch operator identification system may also be configured such that, in the user judgment mechanism, when the left-right direction touch position is located in the central area in the left-right direction of the display, if the left-right direction reference position exists on the left side of the left-right direction touch position and is at a position more than a first distance away from the left-right direction touch position, it is judged that the user who has operated the touch panel is a user located on the left side of the display; and if the left-right direction reference position exists on the right side of the left-right direction touch position and is at a position more than the first distance away from the left-right direction touch position, it is judged that the user who has operated the touch panel is a user located on the right side of the display; and when the left-right direction touch position is located in the area to the left of the central area of ​​the display, if the left-right direction reference position exists on the right side of the left-right direction touch position and is at a position more than a second distance away from the left-right direction touch position, it is judged that the user who has operated the touch panel is a user located on the right side of the left-right direction touch position. The user who operated the touch panel is a user located on the left side of the display, and when the left-right direction reference position exists at a position that is to the right of the left-right direction touch position and is at least a third distance greater than the second distance away from the left-right direction touch position, it is determined that the user who operated the touch panel is a user located on the right side of the display; when the left-right direction touch position is located in an area to the right of the central area of ​​the display, when the left-right direction reference position exists at a position that is to the left of the left-right direction touch position and is at least a third distance away from the left-right direction touch position, it is determined that the user who operated the touch panel is a user located on the right side of the display, and when the left-right direction reference position exists at a position that is to the left of the left-right direction touch position and is at least a third distance away from the left-right direction touch position, it is determined that the user who operated the touch panel is a user located on the left side of the display.

[0019] Alternatively, the above touch operator identification system may also be configured such that, in the user judgment mechanism, a first reference position and a second reference position are set corresponding to the left-right direction touch position, and when the left-right direction reference position is on the left side of the first reference position, it is judged that the user who has operated the touch panel is a user located on the left side of the display, and when the left-right direction reference position is on the right side of the second reference position, it is judged that the user who has operated the touch panel is a user located on the right side of the display. Here, the user determination mechanism sets the following first reference position, so that when the left-right touch position is at a position near the left end, the relative position of the first reference position with respect to the left-right touch position becomes a first relative position at a first distance on the right side of the left-right touch position, and when the left-right touch position is at a position near the right end, the relative position of the first reference position with respect to the left-right touch position becomes a second relative position at a second distance on the left side of the left-right touch position, and the second distance is a distance greater than the first distance. When the left-right touch position is between a position near the left end and a position near the right end, the relative position of the first reference position with respect to the left-right touch position becomes closer to the first relative position as it is closer to the left end, and the relative position of the first reference position with respect to the left-right touch position becomes closer to the second relative position as it is closer to the right end. In addition, the second reference position is set as follows, so that when the left-right touch position is near the right end, the relative position of the second reference position with respect to the left-right touch position becomes the third relative position that is away from the left side of the left-right touch position by the first distance, and when the left-right touch position is near the left end, the relative position of the second reference position with respect to the left-right touch position becomes the fourth relative position that is away from the right side of the left-right touch position by the second distance, and when the left-right touch position is between the position near the left end and the position near the right end, the closer to the right end, the closer the relative position of the second reference position with respect to the left-right touch position is, and the closer to the left end, the closer the relative position of the second reference position with respect to the left-right touch position is, the closer the relative position of the second reference position with respect to the left-right touch position is.

[0020] In addition, in the above touch operator identification system, the display may be arranged between the driver's seat and the front passenger seat in the left-right direction of the car, and the user on the left side of the display may be regarded as one of the users sitting on the driver's seat and the user sitting on the front passenger seat, while the user on the right side of the display may be regarded as the other user.

[0021] In addition, the present invention also provides an information processing system, comprising the above touch operator recognition system, the display, the touch panel, and a data processing device that uses the display for display output and the touch panel for position input. In the information processing system, the touch operator recognition system notifies the data processing device of the user who has been determined to have operated the touch panel, and the data processing device performs processing corresponding to the touch position detected by the touch panel, and for at least a part of the processing performed corresponding to the touch position, the content of the processing to be performed is switched according to the user who has operated the touch panel notified from the touch operator recognition system.

[0022] In addition, the present invention also provides an information processing system, comprising the above-mentioned touch operator recognition system for calculating the coordinates of the approaching object in the left-right direction of the display surface as the left-right reference position, the display, the touch panel, and a data processing device that uses the display for display output and the touch panel for position input. In the information processing system, the touch operator recognition system notifies the data processing device of the calculated left-right reference position and the user who has been determined to have operated the touch panel. In addition, the data processing device comprises: a gesture response processing mechanism that recognizes the user's gesture performed in front of the display surface of the display based on the calculated left-right reference position and performs processing corresponding to the recognized gesture; and a touch response processing mechanism that performs processing corresponding to the touch position detected by the touch panel. In addition, the touch response processing mechanism switches the content of the processing to be performed in accordance with the user who has operated the touch panel notified from the touch operator recognition system for at least a part of the processing performed in accordance with the touch position.

[0023] According to the above touch operator identification system, by comparing the left and right reference positions estimated by the proximity detection device with the left and right touch positions detected by the touch panel, it is determined whether the user operating the touch panel is on the left or right side of the display.

[0024] Here, the proximity detection device uses the reflected light of invisible light emitted in front of the display surface of the display to detect approaching objects, so the left and right reference position estimated based on the intensity distribution of the reflected light includes: the deviation of the left and right touch position toward the direction of the user performing the touching operation due to the influence of reflection on the arm extended in front of the display surface from the side where the user performing the touching operation is located.

[0025] Therefore, regardless of the touch pattern such as the direction of the finger touching the touch panel, it is possible to accurately determine the user who has performed the touch operation.

[0026] Effect of the invention:

[0027] As described above, according to the present invention, regardless of the method of touching, it is possible to widely identify which of the users on the left and right sides of the touch panel is the user who has touched the touch panel. BRIEF DESCRIPTION OF THE DRAWINGS

[0028] Figure 1 This is a block diagram showing the configuration of an information processing system according to the first embodiment of the present invention.

[0029] Figure 2 It is a diagram showing the arrangement of a display according to the first embodiment of the present invention.

[0030] Figure 3 It is a diagram showing the arrangement of proximity detection sensors according to the first embodiment of the present invention.

[0031] Figure 4 It is a diagram showing an operation sequence of the proximity detection sensor according to the first embodiment of the present invention.

[0032] Figure 5 This is a flowchart showing the touch response process according to the first embodiment of the present invention.

[0033] Figure 6 It is a diagram showing the mechanism of operator judgment according to the first embodiment of the present invention.

[0034] Figure 7 It is a diagram showing a processing example of the touch response process according to the first embodiment of the present invention.

[0035] Figure 8 It is a diagram showing the mechanism of operator judgment according to the second embodiment of the present invention.

[0036] Fig. 9 This is a flowchart showing a touch response process according to the third embodiment of the present invention.

[0037] Fig.10 It is a diagram showing the mechanism of operator judgment according to the third embodiment of the present invention.

[0038] Fig.11 It is a diagram showing a processing example of the touch response process according to the third embodiment of the present invention.

[0039] Fig.12 It is a diagram showing the technology involved in the prior art document.

[0040] Description of reference numerals:

[0041] 1 ... data processing device, 2 ... display, 3 ... proximity detection device, 4 ... peripheral device, 10 ... display unit, 31 ... proximity detection sensor, 32 ... proximity detection controller, 321 ... driving unit, 322 ... detection unit, 323 ... detection control unit. DETAILED DESCRIPTION

[0042] Hereinafter, the embodiment of the present invention will be described by taking the application to a right-hand drive vehicle with the driver's seat on the right and the passenger seat on the left as an example. However, in the case of a left-hand drive vehicle with the driver's seat on the left and the passenger seat on the right, the embodiment can also be applied by exchanging the left and right in the following description.

[0043] First, the first embodiment will be described.

[0044] Figure 1 The configuration of the information processing system according to the first embodiment is shown.

[0045] The information processing system is a system installed in a car, and includes a data processing device 1 for executing car navigation applications or media player applications, a display 2 with a touch panel for use by the data processing device 1 in image display and coordinate input, a proximity detection device 3, and other peripheral devices 4 for use by the data processing device 1.

[0046] Here, if Figure 2 As shown, the display 2 is arranged in the form of a display unit 10 integrated with the proximity detection device 3 at a position between the driver's seat and the front passenger seat on the dashboard of the automobile with the display surface facing rearward.

[0047] return Figure 1 The proximity detection device 3 takes the user's hand or finger as the detected object, detects the horizontal coordinates of the detected object approaching the display surface of the display 2, and provides it to the data processing device 1 as the proximity position. The data processing device 1 performs processing corresponding to the provided proximity position.

[0048] The proximity detection device 3 includes a proximity detection sensor 31 and a proximity detection controller 32 .

[0049] The proximity detection sensor 31 includes four infrared LEDs, LED1 , LED2 , LED3 , and LED4 , and two photodiodes, PD1 and PD2 , for detecting infrared light.

[0050] In addition, the proximity detection controller 32 includes: a driving unit 321, which drives LED1, LED2, LED3, and LED4 to make them emit light; a detection unit 322, which converts the current signal output by PD1 and PD2 into an intensity signal representing the intensity of the infrared light incident on PD1 and PD2 and outputs it; and a detection control unit 323, which controls the operation of the driving unit 321 and the detection unit 322, and calculates the horizontal coordinates of the detected object close to the display surface of the display 2 based on the intensity of the infrared light represented by the intensity signal converted by the detection unit 322, and notifies the data processing device 1 as the proximity position.

[0051] Next, if Figure 3 As shown in a, b, and c, LED1, LED2, LED3, and LED4 are arranged in this order from left to right at approximately equal intervals slightly below the bottom side of the display 2.

[0052] In addition, PD1 is configured between LED1 and LED2, and converts the reflected light of the incident infrared light into a current signal. PD2 is configured between LED3 and LED4, and converts the reflected light of the incident infrared light into a current signal and outputs it.

[0053] Figure 3 The arrows in a and b represent the central axes of the directional angles of LED1 , LED2 , LED3 , and LED4 . LED1 , LED2 , LED3 , and LED4 irradiate infrared light obliquely toward the upper front of the display 2 .

[0054] Next, the detection control unit 323 of the proximity detection controller 32 repeatedly performs Figure 4 The operation of the driving unit 321 and the detecting unit 322 is controlled in the cyclic manner shown.

[0055] Here, each cycle includes the following stages: a stage in which the driving unit 321 only makes LED1 emit light and the detection unit 322 outputs an intensity signal L1 representing the intensity of the infrared light incident to PD1; a stage in which the driving unit 321 only makes LED2 emit light and the detection unit 322 outputs an intensity signal L2 representing the intensity of the infrared light incident to PD1; a stage in which the driving unit 321 only makes LED3 emit light and the detection unit 322 outputs an intensity signal L3 representing the intensity of the infrared light incident to PD2; and a stage in which the driving unit 321 only makes LED4 emit light and the detection unit 322 outputs an intensity signal L4 representing the intensity of the infrared light incident to PD2.

[0056] In addition, when the maximum value of the intensity signals L1 , L2 , L3 , and L4 exceeds a predetermined threshold value, the detection control unit 323 detects the approach of the subject and notifies the data processing device 1 of the approach.

[0057] In addition, when x1 is set as the horizontal coordinate of LED1, x2 is set as the horizontal coordinate of LED2, x3 is set as the horizontal coordinate of LED3, and x4 is set as the horizontal coordinate of LED4, the detection control unit 323 calculates the horizontal coordinate obtained as the center of gravity of the intensity distribution of the intensity signals L1, L2, L3, and L4 detected by the detection unit 322 through Formula 1 as the proximity position Gx.

[0058] Formula 1: Gx=(X1×L1+X2×L2+X3×L3+X4×L4) / (L1+L2+L3+L4)

[0059] In addition, if the data processing device 1 is notified by the proximity detection controller 32 that the detected body is approaching, it obtains the proximity position Gx calculated by the proximity detection controller 32 and performs prescribed processing corresponding to the proximity position Gx, such as enlarging the display of an icon displayed at a position on the display corresponding to the proximity position Gx, or identifying the gesture of the hand in space based on the time change of the proximity position Gx and switching the display screen or application according to the identified gesture.

[0060] return Figure 1 If a touch occurs on the touch surface, the touch panel of the display 2 detects the touch position (Tx, Ty) as the coordinates of the touched position, and notifies the data processing device 1 that the touch has occurred. Here, Tx of the touch position (Tx, Ty) is the coordinate in the horizontal direction, and Ty is the coordinate in the vertical direction.

[0061] Then, the data processing device 1 , which has been notified of the touch, performs a touch response process in order to execute a process corresponding to the touch on the touch panel.

[0062] Figure 5 Indicates the process of touch response processing.

[0063] Here, it is assumed that the horizontal coordinate system of the touch panel detecting the touch position coordinate Tx and the horizontal coordinate system of the proximity detection controller 32 calculating the proximity position Gx are the same coordinate system, and the positive direction of the coordinate system is from left to right.

[0064] As shown in the figure, in the touch response process, the touch position (Tx, Ty) is first obtained from the touch panel (step 502).

[0065] In addition, the proximity position Gx calculated by the proximity detection controller 32 is acquired (step 504 ).

[0066] Then, it is determined whether Gx>Tx+Th1 is satisfied (step 506). Th1 is a predetermined reference value, and Th1>0.

[0067] Then, if Gx>Tx+Th1 is satisfied (step 506), the user in the driver's seat is set as the touch operator (step 514).

[0068] On the other hand, if Gx>Tx+Th1 is not satisfied (step 506), it is determined whether Gx<Tx-Th1 is satisfied (step 508).

[0069] Then, if Gx<Tx-Th1 is satisfied (step 508), the user in the front passenger seat is set as the touch operator (step 512).

[0070] On the other hand, if Gx<Tx-Th1 is not satisfied either (step 508), an unknown user is set as the operator of the touch (step 510).

[0071] Then, a process corresponding to the touch position (Tx, Ty) and the operator of the touch set in any one of steps 510, 512, and 514 is executed (step 516). Then, the process returns to the process starting from step 502.

[0072] Here, in step 516, for example, the following processing is performed: when the touch position (Tx, Ty) is an icon displayed on the display 2 for accepting an execution instruction of a specified action and prohibiting the user in the driver's seat from operating while the car is moving, if the current car is not moving, the action is performed; if the current car is moving, the action is performed only when the set operator is a user in the front passenger seat, and if the set operator is an unknown user or a user in the driver's seat, the action is not performed.

[0073] Here, if Figure 6 As shown in a, when the user in the driver's seat located on the right side of the display 2 touches the touch panel, the arm of the user in the driver's seat extends from the right side in the direction toward the touch position. Therefore, due to the influence of the reflected light of the arm, the proximity position Gx calculated by the proximity detection controller 32 becomes a position on the right side that is larger than the horizontal coordinate Tx of the touch position detected by the touch panel.

[0074] In addition, if Figure 6 As shown in b, when the user on the passenger seat located on the left side of the display 2 touches the touch panel, the arm of the user on the passenger seat extends from the left side in the direction toward the touch position. Therefore, due to the influence of the reflected light of the arm, the proximity position Gx calculated by the proximity detection controller 32 becomes a position on the left side that is smaller than the horizontal coordinate Tx of the touch position detected by the touch panel.

[0075] Here, Figure 7a, b, and c show: in the above touch response processing, the range of the proximity position Gx when the user of the driver's seat is set as the touch operator and the range of the proximity position Gx when the user of the front passenger seat is set as the touch operator relative to the horizontal coordinate Tx of the touch position. In addition, Xmin in the figure represents the minimum value of the horizontal coordinate Tx of the touch position, and Xmax represents the maximum value of the horizontal coordinate Tx of the touch position. Here, in this embodiment, it is set to Xmin=0.

[0076] As shown in the figure, when the proximity position Gx exists at a position more than Th1 to the right of the horizontal coordinate Tx of the touch position, the user in the driver's seat is set as the touch operator, and when the proximity position Gx exists at a position more than Th1 to the left of the horizontal coordinate Tx of the touch position, the user in the passenger seat is set as the touch operator.

[0077] Thus, through the touch response processing described above, the true operator who has touched the touch position can be accurately set.

[0078] The first embodiment of the present invention has been described above.

[0079] As described above, in the first embodiment, by comparing the proximity position Gx estimated by the proximity detection device 3 with the coordinates Tx of the touch position detected by the touch panel, it is determined whether the user operating the touch panel is located on the left side or the right side of the display 2.

[0080] In addition, in the proximity detection device 4, the proximity position Gx estimated based on the intensity distribution of reflected light of invisible light emitted toward the front of the display surface of the display 2 includes a deviation of the coordinates Tx of the touch position toward the direction of the user performing the touch operation due to the influence of reflection on the arm extended toward the front of the display surface from the side where the user performing the touch operation is located.

[0081] As described above, according to the first embodiment, regardless of the touch pattern such as the direction of the finger of the user touching the touch panel, it is possible to appropriately determine the user who has performed the touch operation.

[0082] Next, a second embodiment of the present invention will be described.

[0083] The second embodiment differs from the first embodiment only in the operation related to the setting by the touch operator.

[0084] like Figure 8As shown in a of FIG. 1 , when the user extends his arm from a direction close to the direction perpendicular to the display surface of the display 2 and touches the touch panel, the intensity of the reflected light reaching the proximity detection sensor 31 from the arm becomes smaller than the intensity of the reflected light reaching the proximity detection sensor 31 from the hand or finger located near the display surface of the display 2. Therefore, as shown in FIG. Figure 8 Compared with the case where the user extends his arm obliquely with respect to the display surface of the display 2 and touches the touch panel as shown in b, a position close to the horizontal coordinate Tx of the touched position is calculated as the close position Gx.

[0085] Therefore, when the user extends his arm in a direction close to the direction perpendicular to the display surface of the display 2 and touches the touch panel, in the touch response processing shown in the first embodiment, it may not be possible to set the user in the driver's seat or the user in the passenger seat as the touch operator, but to set them as an unknown user.

[0086] Therefore, in the second embodiment, the following evaluation value is used to set the touch operator, and the evaluation value is calculated in a manner that makes the influence of reflected light from a hand or finger located close to the display surface of the display 2 smaller than the influence of reflected light from the arm. That is, even if the user extends his arm in a direction close to the direction perpendicular to the display surface of the display 2 and touches the touch panel, an evaluation value that is significantly different from the horizontal coordinate Tx of the touch position will be produced.

[0087] Here, the reflected light of a hand or finger located near the display surface of the display 2 is detected by the proximity detection sensor 31 as reflected light with greater intensity. Therefore, as such an evaluation value, the evaluation value can be calculated in a manner that makes the influence of reflected light with greater intensity smaller while maintaining the range of the magnitude relationship of the intensities.

[0088] More specifically, as such an evaluation value, the center of gravity G2x of the intensity signals L1', L2', L3', L4' obtained by Formula 2 can be used, wherein the intensity signals L1', L2', L3', L4' are intensity signals obtained by reducing the larger values ​​of the intensity signals L1, L2, L3, L4 detected by the proximity detection sensor 31 at a larger proportion while maintaining the size relationship.

[0089] Formula 2: G2x=(X1×L1'+X2×L2'+X3×L3'+X4×L4') / (L1'+L2'+L3'+L4')

[0090] In addition, as intensity signals L1', L2', L3', L4', for example, the following can be used:

[0091] L1'=L11 / 2 , L2'=L2 1 / 2 , L3'=L3 1 / 2 , L4'=L4 1 / 2

[0092] or

[0093] L1'=log(L1), L2'=log(L2), L3'=log(L3), L4'=log(L4).

[0094] The intensity signals L1', L2', L3', and L4' only need to satisfy Li'>Lj' and Li' / Li<Lj' / Lj when Li>Lj, and may be obtained by other calculation methods.

[0095] In the second embodiment, the detection control unit 323 calculates the evaluation value G2x and provides it to the data processing device 1.

[0096] In addition, the data processing device 1 Figure 5 In step 504 of the touch response process shown, the evaluation value G2x is obtained from the proximity detection controller 32 instead of the proximity position Gx.

[0097] In step 506, it is determined whether G2x>Tx+Th1 is satisfied. If G2x>Tx+Th1 is satisfied, the user in the driver's seat is set as the touch operator in step 514. In step 508, it is determined whether G2x<Tx-Th1 is satisfied. If G2x<Tx-Th1 is satisfied, the user in the passenger seat is set as the touch operator in step 512. In addition, if neither G2x>Tx+Th1 nor G2x<Tx-Th1 is satisfied, an unknown user is set as the touch operator in step 510.

[0098] In this way, including the case where the user extends his arm in a direction close to the direction perpendicular to the display surface of the display 2 and touches the touch panel, the correct user can be set as the operator of the touch.

[0099] The second embodiment of the present invention has been described above.

[0100] Next, a third embodiment of the present invention will be described.

[0101] The third embodiment differs from the first embodiment only in the content of the touch response process.

[0102] Fig. 9 The following is a diagram showing a procedure of touch response processing performed in the third embodiment.

[0103] As shown in the figure, in the touch response process, first, the touch position (Tx, Ty) is obtained from the touch panel (step 902).

[0104] In addition, the proximity position Gx calculated by the proximity detection controller 32 is acquired (step 904 ).

[0105] Then, ThD and ThP are set according to the horizontal coordinate Tx of the touch position (step 906 ).

[0106] The details of setting ThD and ThP will be described later.

[0107] Then, it is determined whether Gx>Tx+ThD is satisfied (step 908).

[0108] Then, if Gx>Tx+ThD is satisfied (step 908), the user in the driver's seat is set as the touch operator (step 916).

[0109] On the other hand, if Gx>Tx+ThD is not satisfied (step 908), it is determined whether Gx<Tx+ThP is satisfied (step 910).

[0110] Then, if Gx<Tx+ThP is satisfied (step 910 ), the user in the front passenger seat is set as the touch operator (step 914 ).

[0111] On the other hand, if Gx<Tx+ThP is also not satisfied (step 910 ), an unknown user is set as the operator of the touch (step 912 ).

[0112] Then, a process corresponding to the touch position (Tx, Ty) and the operator who touched the touch set in any one of steps 912, 914, and 916 is executed (step 918). Then, the process returns to the process starting from step 902.

[0113] Here, ThD and ThP set in accordance with the horizontal coordinate Tx of the touch position in step 906 will be described.

[0114] In setting ThD and ThP, XLB and XRB which are predetermined so as to satisfy the following relationship between the minimum value Xmin=0 and the maximum value Xmax of the coordinate Tx in the horizontal direction of the touch position are used.

[0115] Xmin<XLB<Xmid<XRB<Xmax

[0116] Here, Xmid is set to be the middle point between Xmin and Xmax (the coordinate of the center in the left-right direction of the touch panel) expressed by Xmid=(Xmax+Xmin) / 2=Xmax / 2.

[0117] In addition, according to the coordinate Tx of the touch position in the horizontal direction, ThD and ThP are determined as follows, assuming that Th1>0, Th2>0, Th3>0, Th2<Th1, Th2<Th3, and Th3>Th1.

[0118] When Xmin≤Tx≤XLB, ThD=Th3,ThP=Th2

[0119] When XLB<Tx<XRB, ThD=Th1, ThP=-Th1

[0120] When XRB≤Tx≤Xmax, ThD=-Th2, ThP=-Th3

[0121] Here, the reason why ThD and ThP are determined in accordance with the coordinate Tx is as follows.

[0122] like Fig.10 As shown in a, when the user in the passenger seat touches the position of the touch panel near the left end of the display 2, the reflected light reflected by the arm of the user in the passenger seat reaching the proximity detection sensor 31 becomes less. Since the detection of reflected light reflected by the hand or finger dominates the reflected light reaching the proximity detection sensor 31, the position around the horizontal coordinate Tx of the touch position is calculated as the proximity position Gx.

[0123] On the other hand, Fig.10 As shown in b, when the user in the driver's seat touches the position of the touch panel close to the left end of the display 2, reflected light reflected by the arm of the user in the driver's seat is generated in a large range, and the reflected light reflected by the arm reaching the proximity detection sensor 31 increases, so the position that is greatly deviated to the right than the horizontal coordinate Tx of the touch position is calculated as the proximity position Gx.

[0124] The same is true when a touch occurs at a position near the right end of the display 2 on the touch panel. When the touch is made by the user in the driver's seat, the amount of reflected light reflected by the arm of the user in the driver's seat that reaches the proximity detection sensor 31 decreases, and detection of reflected light reflected by the hand or finger dominates the reflected light that reaches the proximity detection sensor 31. Therefore, a position around the horizontal coordinate Tx of the touch position is calculated as the proximity position Gx. When the touch is made by the user in the front passenger seat, reflected light reflected by the arm of the user in the front passenger seat is generated in a wide range, and the amount of reflected light reflected by the arm that reaches the proximity detection sensor 31 increases. Therefore, a position that is greatly deviated to the left of the horizontal coordinate Tx of the touch position is calculated as the proximity position Gx.

[0125] Therefore, in the touch response process shown in the first embodiment, when a position close to the left end of the display 2 or a position close to the right end of the display 2 is touched, the real user may not be set as the operator of the touch.

[0126] On the other hand, in the third embodiment, ThD and ThP are determined according to the coordinate Tx as described above, and when Gx>Tx+ThD is satisfied, the user in the driver's seat is set as the touch operator, and when Gx<Tx+ThP is satisfied, the user in the passenger seat is set as the touch operator, so that Fig.11 As illustrated by a, b, and c, relative to the horizontal coordinate Tx of the touch position, the range of the proximity position Gx when the user in the driver's seat is set as the touching operator and the range of the proximity position Gx when the user in the passenger seat is set as the touching operator are set.

[0127] like Fig.11 As shown in b, when the horizontal coordinate Tx of the touch position is close to the left end of the display 2 (the position is within the coordinate range below XLB), when the position around the coordinate Tx and the position within the range to its left are calculated as the proximity position Gx, the user in the passenger seat is set as the touch operator, and when the position farther to the right from the coordinate Tx is calculated as the proximity position Gx, the user in the driver's seat is set as the touch operator.

[0128] In addition, if Fig.11 As shown in c, when the horizontal coordinate Tx of the touch position is close to the right end of the display 2 (the position is within the coordinate range above XRB), when the position around the coordinate Tx and the position to its right are calculated as the proximity position Gx, the user in the driver's seat is set as the touch operator, and when the position farther to the left from the coordinate Tx is calculated as the proximity position Gx, the user in the passenger seat is set as the touch operator.

[0129] In addition, when the horizontal coordinate Tx of the touch position is neither near the left end of the display 2 nor near the right end of the display 2, as shown in FIG. Fig.11 As shown in a, the touching operator is set in the same manner as in the first embodiment.

[0130] Thus, according to the third embodiment, even when the touch occurs at a position close to the left end or the right end of the touch panel on the display 2, a correct user can be set as the operator of the touch.

[0131] The third embodiment of the present invention has been described above.

[0132] Next, a fourth embodiment of the present invention will be described.

[0133] The fourth embodiment differs from the third embodiment only in the method of setting ThD and ThP.

[0134] In the fourth embodiment, ThD and ThP are set so that ThD gradually changes to Th3, Th1, and -Th2, and ThP gradually changes to Th2, -Th1, and -Th3 as the horizontal coordinate Tx of the touch position changes from Xmin=0 to Xmax.

[0135] Such a setting can be realized, for example, in the following manner.

[0136] When the coordinate Tx is between Xmin and Xmid, it is set to:

[0137] ThD=Th3+(Th1-Th3)Tx / Xmid,

[0138] ThP=Th2+(-Th1-Th2)Tx / Xmid,

[0139] When the coordinate Tx is between Xmid and Xmax, it is set to:

[0140] ThD=Th1+(-Th2-Th1)(Tx-Xmid) / Xmid,

[0141] ThP=-Th1+(-Th3+Th1)(Tx-Xmid) / Xmid.

[0142] Alternatively, ThD and ThP are set so that ThD gradually changes from Th3 to -Th2 and ThP gradually changes from Th2 to -Th3 as the horizontal coordinate Tx of the touch position changes from Xmin=0 to Xmax.

[0143] Such a setting can be achieved, for example, by the following methods:

[0144] ThD=Th3+(-Th2-Th3)Tx / Xmax,

[0145] ThP=Th2+(-Th3-Th2)Tx / Xmax.

[0146] By setting ThD and ThP in this way, as in the third embodiment, even when the touch is made at a position close to the left end or the right end of the display 2 on the touch panel, a correct user can be set as the operator of the touch.

[0147] The embodiments of the present invention have been described above.

[0148] In the third and fourth embodiments described above, the evaluation value G2x described in the second embodiment may be used in the touch response process instead of the proximity position Gx.

Claims

1. A touch operator identification system for determining a user who has operated a touch panel, the touch panel being superimposed on a display surface of a display and detecting a touched position as a touch position, the touch operator identification system being characterized in that: a proximity detection device for detecting an object approaching a display surface of the display; as well as A user judging means judges a user who has touched the touch panel, The proximity detection device comprises: A plurality of light sources are arranged outside a display surface of the display and along the left-right direction of the display surface, and emit invisible light in front of the display surface; a light detector for detecting reflected light of invisible light emitted by the light source arranged outside the display surface of the display; as well as The reference position estimation mechanism estimates the coordinates of the approaching object to be detected in the left-right direction of the display surface as a left-right direction reference position based on the distribution of the intensity of the reflected light of the invisible light emitted by each of the light sources detected by the light detector. When the touch panel is touched, the user judgment mechanism judges whether the user who operates the touch panel is a user on the left side of the display or a user on the right side of the display based on the coordinates of the touch position detected by the touch panel in the left-right direction of the display surface, i.e., the left-right direction touch position and the left-right direction reference position calculated by the reference position calculation mechanism, the positional relationship in the left-right direction of the display surface, and the distance in the left-right direction of the display surface.

2. A touch operator identification system for determining a user who has operated a touch panel, wherein the touch panel is overlapped on a display surface of a display and detects a touched position as a touch position, wherein the touch operator identification system is characterized in that: a proximity detection device for detecting an object approaching a display surface of the display; as well as A user judging means judges a user who has touched the touch panel, The proximity detection device comprises: A plurality of light sources are arranged outside a display surface of the display and along the left-right direction of the display surface, and emit invisible light in front of the display surface; a light detector for detecting reflected light of invisible light emitted by the light source arranged outside the display surface of the display; as well as A reference position estimation mechanism estimates the coordinates of the center of gravity of the reflected light in the left-right direction of the display surface after the distribution of the intensity of the reflected light is corrected in such a way that the intensity relationship is maintained and the intensity decreases at a greater ratio as the intensity increases, as a reference position in the left-right direction, wherein the reflected light is the reflected light of the invisible light emitted by each of the light sources detected by the light detector, When the touch panel is touched, the user judgment mechanism judges whether the user who operates the touch panel is a user on the left side of the display or a user on the right side of the display based on the coordinates of the touch position detected by the touch panel in the left-right direction of the display surface, i.e., the left-right direction touch position and the left-right direction reference position calculated by the reference position calculation mechanism, the positional relationship in the left-right direction of the display surface, and the distance in the left-right direction of the display surface.

3. The touch operator identification system according to claim 1 or 2, characterized in that: The user judgment mechanism judges that the user who operates the touch panel is a user located on the left side of the display when the left-right direction reference position exists on the left side of the left-right direction touch position and is more than a prescribed distance away from the left-right direction touch position; and judges that the user who operates the touch panel is a user located on the right side of the display when the left-right direction reference position exists on the right side of the left-right direction touch position and is more than the prescribed distance away from the left-right direction touch position.

4. The touch operator identification system according to claim 1 or 2, The user judgment mechanism, When the left-right direction touch position is located in the center area in the left-right direction of the display, when the left-right direction reference position is located on the left side of the left-right direction touch position and is separated from the left-right direction touch position by a first distance or more, it is determined that the user who has operated the touch panel is a user located on the left side of the display, and when the left-right direction reference position is located on the right side of the left-right direction touch position and is separated from the left-right direction touch position by the first distance or more, it is determined that the user who has operated the touch panel is a user located on the right side of the display, When the left-right direction touch position is located in an area to the left of the center area of ​​the display, when the left-right direction reference position exists to the left of a position that is a second distance away from the left-right direction touch position and to the right of the left-right direction touch position, it is determined that the user who has operated the touch panel is a user located on the left side of the display; and when the left-right direction reference position exists to the right of the left-right direction touch position and is a third distance greater than the second distance away from the left-right direction touch position, it is determined that the user who has operated the touch panel is a user located on the right side of the display. When the left-right touch position is located in the area to the right of the central area of ​​the display, and when the left-right reference position exists on the left side of the left-right touch position and on the right side of a position away from the left-right touch position by the second distance, it is judged that the user who operates the touch panel is a user located on the right side of the display, and when the left-right reference position exists on the left side of the left-right touch position and at a position away from the left-right touch position by more than the third distance, it is judged that the user who operates the touch panel is a user located on the left side of the display.

5. The touch operator identification system according to claim 1 or 2, characterized in that: The user judgment mechanism, A first reference position and a second reference position are set according to the left-right direction touch position, When the left-right direction reference position is on the left side of the first reference position, it is determined that the user who has operated the touch panel is a user located on the left side of the display, and when the left-right direction reference position is on the right side of the second reference position, it is determined that the user who has operated the touch panel is a user located on the right side of the display. The user determines the organization, The first reference position is set as follows, so that when the left-right touch position is near the left end, the relative position of the first reference position with respect to the left-right touch position becomes a first relative position away from the left-right touch position by a first distance, and when the left-right touch position is near the right end, the relative position of the first reference position with respect to the left-right touch position becomes a second relative position away from the left-right touch position by a second distance, the second distance being a distance greater than the first distance, and when the left-right touch position is between a position near the left end and a position near the right end, the relative position of the first reference position with respect to the left-right touch position becomes closer to the first relative position as it is closer to the left end, and the relative position of the first reference position with respect to the left-right touch position becomes closer to the second relative position as it is closer to the right end, The second reference position is set as follows, so that when the left-right touch position is near the right end, the relative position of the second reference position with respect to the left-right touch position becomes the third relative position that is away from the left side of the left-right touch position by the first distance, and when the left-right touch position is near the left end, the relative position of the second reference position with respect to the left-right touch position becomes the fourth relative position that is away from the right side of the left-right touch position by the second distance, and when the left-right touch position is between the position near the left end and the position near the right end, the closer to the right end, the closer the relative position of the second reference position with respect to the left-right touch position is, and the closer to the left end, the closer the relative position of the second reference position with respect to the left-right touch position is, the closer the relative position of the second reference position with respect to the left-right touch position is.

6. The touch operator identification system according to claim 1 or 2, characterized in that: The display is arranged between the driver's seat and the passenger seat in the left-right direction of the vehicle. The user located on the left side of the display is one of the user sitting in the driver's seat and the user sitting in the passenger seat, and the user located on the right side of the display is the other user.

7. An information processing system, characterized in that: A data processing device comprising the touch operator recognition system according to claim 1 or 2, the display, the touch panel, and a data processing device using the display for display output and the touch panel for position input, The touch operator identification system notifies the data processing device of the user who has been determined to have operated the touch panel. The data processing device performs processing according to a touch position detected by the touch panel, and switches the content of processing to be performed according to a user who has operated the touch panel and is notified from a touch operator identification system for at least a portion of the processing performed according to the touch position.

8. An information processing system, characterized in that: A touch operator recognition system according to claim 1, the display, the touch panel, and a data processing device using the display for display output and the touch panel for position input, The touch operator identification system notifies the data processing device of the estimated left-right reference position and the user who has been identified as having operated the touch panel. The data processing device comprises: a gesture response processing mechanism, which recognizes a user's gesture performed in front of the display surface of the display according to the estimated left-right direction reference position, and performs processing corresponding to the recognized gesture; as well as A touch response processing mechanism performs processing corresponding to the touch position detected by the touch panel, The touch response processing means switches the content of the processing to be performed in accordance with the user who has operated the touch panel and has been notified from the touch operator recognition system, with respect to at least a part of the processing to be performed in accordance with the touch position.

Images