Touch operator identifying system and information processing system

Abstract

To provide a touch operator identifying system and an information processing system that identify a user who made a touch regardless of the way of the touch to a touch panel.SOLUTION: The position of an object to be detected that approaches a display surface in the horizontal direction is calculated as an approaching position Gx from the intensity distribution of reflected lights of infrared lights emitted in an obliquely upward and front direction from a plurality of infrared LEDs arranged side by side along the horizontal direction under the display surface of a display 2. With the positive direction of a coordinate in the horizontal direction being taken as a direction directed from the left side to the right side, using a coordinate Tx of the touch position of a touch panel in the horizontal direction and the approaching position Gx, when the approaching position Gx is located at a position apart from the coordinate Tx to the right side by greater than or equal to a threshold Th1, a user on a driver's seat at the right side of the display 2 is set as the touch operator, and when the approaching position Gx is located at a position apart from the coordinate Tx to the left side by greater than or equal to the threshold Th1, a user on a front passenger's seat at the left side of the display 2 is set as the touch operator.SELECTED DRAWING: Figure 7

Description

[Technical field]

[0001] The present invention relates to a technique for identifying an operator of a touch panel from among users positioned to the left and right of the touch panel. [Background technology]

[0002] As a technology for identifying the operator of a touch panel from among users positioned to the left and right of the touch panel, a technology is known in which a frame-shaped optical position detection device 1203 having an opening 12031 is placed over a touch panel 1202 arranged on the display surface of a display monitor 1201, as shown in the exploded view of Figure 12a (for example, Patent Document 1).

[0003] As shown in Fig. 12b, the optical position detection device 1203 has a row of light-emitting diodes 12032 and a row of photodiodes 12033 arranged opposite each other in the vertical and horizontal directions. When no operation is performed on the touch panel, infrared light emitted from the light-emitting diodes 12032 at each position passes through the opening 12031 and is detected by the photodiode 12033 at the opposite position. On the other hand, when the touch panel 1202 is touched, the infrared light emitted from the light-emitting diode 12032 at a position corresponding to the position of the touching finger is blocked by the finger, and the infrared light is no longer detected by the photodiode 12033 at the opposite position. The optical position detection device 1203 detects the position of the finger from the position of the photodiode 12033 where the infrared light is no longer detected.

[0004] Furthermore, as shown in FIG. 12c1, generally, when a user on the right side of the touch panel touches the touch panel, the fingertip is tilted to the left, so that the horizontal coordinate X1 of the touch position detected by the touch panel is to the right of the horizontal coordinate X2 of the finger position detected by the optical position detection device 1203. As shown in FIG. 12c2, when a user on the left side of the touch panel touches the touch panel, the fingertip is tilted to the right, so that the horizontal coordinate X1 of the touch position detected by the touch panel is to the left of the horizontal coordinate X2 of the finger position detected by the optical position detection device 1203. Taking advantage of this, this technology identifies whether the user who touched the touch panel 1202 is a user located to the left or right of the touch panel 1202, based on the magnitude relationship between the horizontal coordinate X1 of the touch position detected by the touch panel 1202 and the horizontal coordinate X2 of the finger position detected by the optical position detection device 1203.

[0005] Also, as a technology related to the present application, a detection system is known in which a user's hand, finger, etc. is used as a detectable object, and multiple LEDs are arranged along the lower edge of the display to emit infrared light diagonally upwards in front of the display. The multiple photodiodes arranged along the lower edge of the display detect the reflected infrared light by the detectable object, and the horizontal (left-right) position of the detectable object approaching the display surface of the display is detected from the distribution of the intensity of the reflected light detected when each LED is lit (for example, Patent Document 2). [Prior art documents] [Patent documents]

[0006] [Patent Document 1] JP 2007-331692 A [Patent Document 2] JP 2021-117189 A Summary of the Invention [Problem to be solved by the invention]

[0007] In order to prevent the display content of the display monitor from being obscured by a user's finger or hand, the user may orient the finger touching the touch panel approximately perpendicular to the touch surface of the touch panel. In this case, according to the technology using the optical position detection device 1203 described above, as shown in FIG. 12d, the horizontal coordinate X1 of the touch position detected by the touch panel 1202 and the horizontal coordinate X2 of the finger position detected by the optical position detection device 1203 will be roughly equal, making it impossible to identify whether the user touching the touch panel is on the left or right side of the touch panel.

[0008] Therefore, an object of the present invention is to make it possible to broadly identify which of the users on the left and right sides of a touch panel has touched the touch panel, regardless of the manner of touch. [Means for solving the problem]

[0009] In order to achieve the above object, the present invention provides a touch operator identification system for identifying a user who has operated a touch panel that is provided over the display surface of a display and detects a touched position as a touch position, the touch operator identification system comprising an approach detection device for detecting an object approaching the display surface of the display, and a user identification means for identifying a user who has touched the touch panel. The approach detection device comprises a plurality of light sources that are arranged in a row along the left-right direction of the display surface on the outside of the display surface of the display and emit invisible light toward the front of the display surface, a photodetector that detects reflected light of the invisible light emitted by the light sources arranged outside the display surface of the display, and a reference position calculation means that calculates the left-right coordinates of the approaching detected object on the display surface as a left-right reference position from the distribution of the intensity of the reflected light of the invisible light emitted by each light source detected by the photodetector. Then, when a touch occurs on the touch panel, the user discrimination means determines whether the user operating the touch panel is a user located on the left or right side of the display based on the left-right positional relationship on the display surface between the left-right touch position, which is the left-right coordinate of the touch position detected by the touch panel, and the left-right reference position calculated by the reference position calculation means, and the left-right distance on the display surface.

[0010] Here, such a touch operator identification system may be configured such that, instead of calculating the left-right coordinates of the display surface of the approaching detectable object as the left-right reference position, the reference position calculation means of the approach detection device calculates, as the left-right reference position, the coordinates of the left-right center of gravity of the display surface of a distribution in which the intensity of the reflected light of the invisible light emitted by each of the light sources detected by the photodetector is modified so that the intensity decreases at a greater rate as the intensity increases, while maintaining the magnitude relationship of the intensities.

[0011] Furthermore, the above touch operator identification system may be configured so that the user discrimination means determines that the user operating the touch panel is a user located on the left side of the display when the left / right reference position is located a predetermined distance or more away from the left / right touch position on the left side of the left / right touch position, and determines that the user operating the touch panel is a user located on the right side of the display when the left / right reference position is located a predetermined distance or more away from the left / right touch position on the right side of the left / right touch position.

[0012] Alternatively, in the above touch operator identification system, the user discrimination means determines that the user who operated the touch panel is a user located on the left side of the display when the left / right touch position is in a central area of ​​the display in the left-right direction and a left / right reference position is located a first distance or more away from the left / right touch position on the left side of the left / right touch position, determines that the user who operated the touch panel is a user located on the left side of the display when the left / right reference position is located the first distance or more away from the right / left touch position on the right side of the left / right touch position, and determines that the user who operated the touch panel is a user located on the right side of the display when the left / right touch position is in an area to the left of the central area of ​​the display and a left / right reference position is located a second distance or more away from the right / left touch position on the right side of the left / right touch position. The touch panel may be configured to determine that the user is located on the left side of the display, and if the left-right reference position is located at a third distance or more greater than the second distance from the left-right touch position to the right of the left-right touch position, the touch panel may be determined to be a user located on the right side of the display, and if the left-right touch position is in an area to the right of the central area of ​​the display and the left-right reference position is located to the right of a position that is the second distance from the left-right touch position to the left of the left-right touch position, the touch panel may be determined to be a user located on the right side of the display, and if the left-right reference position is located at a third distance or more from the left-right touch position to the left of the left-right touch position, the touch panel may be determined to be a user located on the left side of the display.

[0013] Alternatively, the above touch operator identification system may be configured so that the user discrimination means sets a first reference position and a second reference position according to the left-right touch position, and determines that the user who operated the touch panel is a user located on the left side of the display when the left-right reference position is to the left of the first reference position, and determines that the user who operated the touch panel is a user located on the right side of the display when the left-right reference position is to the right of the second reference position. Here, the user discrimination means sets a first reference position such that, when the left / right touch position is a position near the left end, the relative position with respect to the left / right touch position is a first relative position that is a first distance to the right of the left / right touch position, when the left / right touch position is a position near the right end, the relative position with respect to the left / right touch position is a second relative position that is a second distance to the left of the left / right touch position that is a distance greater than the first distance, and when the left / right touch position is between a position near the left end and a position near the right end, the relative position with respect to the left / right touch position is closer to the first relative position as it approaches the left end and closer to the second relative position as it approaches the right end. The second reference position is set so that when the left / right touch position is a position near the right end, the relative position with respect to the left / right touch position becomes a third relative position that is a first distance away to the left of the left / right touch position, when the left / right touch position is a position near the left end, the relative position with respect to the left / right touch position becomes a fourth relative position that is a second distance away to the right of the left / right touch position, and when the left / right touch position is between a position near the left end and a position near the right end, the second reference position becomes closer to the third relative position as it approaches the right end and closer to the fourth relative position as it approaches the left end.

[0014] Furthermore, in the above touch operator identification system, the display may be positioned between the driver's seat and the passenger seat in the left-right direction of the vehicle, and the user positioned to the left of the display may be one of the users seated in the driver's seat and the passenger seat, and the user positioned to the right of the display may be the other user.

[0015] The present invention also provides an information processing system including the above-mentioned touch operator identification system, the display, the touch panel, and a data processing device that uses the display for display output and the touch panel for position input. In this information processing system, the touch operator identification system notifies the data processing device of the user who operated the identified touch panel, and the data processing device performs processing according to the touch position detected by the touch panel and switches the content of at least a part of the processing performed according to the touch position according to the user who operated the touch panel notified by the touch operator identification system.

[0016] The present invention also provides an information processing system including a touch operator identification system that calculates the left-right coordinates of the approaching detection object on the display surface as the left-right reference position, the display, the touch panel, and a data processing device that uses the display for display output and the touch panel for position input. In this information processing system, the touch operator identification system notifies the data processing device of the calculated left-right reference position and the determined user who operated the touch panel. The data processing device also includes a gesture response processing means that identifies a gesture made by the user in front of the display surface of the display from the calculated left-right reference position and performs processing according to the identified gesture, and a touch response processing means that performs processing according to the touch position detected by the touch panel. The touch response processing means switches the content of the processing to be performed for at least a part of the processing to be performed according to the touch position, depending on the user who operated the touch panel notified by the touch operator identification system.

[0017] According to the above-described touch operator identification system, a comparison is made between the left / right reference position calculated using the approach detection device and the left / right touch position detected by the touch panel to determine whether the user operating the touch panel is located on the left or right side of the display. Here, the approach detection device detects an approaching object by reflected light of invisible light emitted forward on the display surface of the display, so the left-right reference position calculated from the intensity distribution of the reflected light includes a deviation from the left-right touch position in the direction of the user performing the touch operation due to the influence of reflection from the arm that is stretched out in front of the display surface from the side where the user performing the touch operation is located. Therefore, the user who performed the touch operation can be accurately identified regardless of the manner of touch, such as the orientation of the user's finger touching the touch panel. Effect of the Invention

[0018] As described above, according to the present invention, it is possible to broadly identify which of the users on the left and right sides of the touch panel has touched the touch panel, regardless of the manner of touch. [Brief description of the drawings]

[0019] [Figure 1] 1 is a block diagram showing a configuration of an information processing system according to a first embodiment of the present invention. [Diagram 2] FIG. 2 is a diagram showing the arrangement of displays according to the first embodiment of the present invention. [Diagram 3] 1 is a diagram showing an arrangement of approach detection sensors according to a first embodiment of the present invention; [Figure 4] 5 is a diagram showing an operation sequence of the approach detection sensor according to the first embodiment of the present invention. FIG. [Diagram 5] 5 is a flowchart showing a touch response process according to the first embodiment of the present invention. [Figure 6] 3A to 3C are diagrams illustrating a mechanism for identifying an operator according to the first embodiment of the present invention. [Figure 7]5A to 5C are diagrams illustrating a processing example of touch response processing according to the first embodiment of the present invention. [Figure 8] 13 is a diagram showing a mechanism for identifying an operator according to a second embodiment of the present invention. FIG. [Figure 9] 13 is a flowchart showing a touch response process according to the third embodiment of the present invention. [Figure 10] 13 is a diagram showing a mechanism for identifying an operator according to a third embodiment of the present invention. FIG. [Figure 11] FIG. 13 is a diagram illustrating a processing example of a touch response process according to the third embodiment of the present invention. [Figure 12] FIG. 1 illustrates a technique according to a prior art document. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0020] Hereinafter, the embodiment of the present invention will be described with reference to an example of application to a right-hand drive vehicle in which the driver's seat is on the right side and the passenger seat is on the left side. However, the present embodiment can also be applied to a left-hand drive vehicle in which the driver's seat is on the left side and the passenger seat is on the right side by interchanging the left and right in the following description.

[0021] First, the first embodiment will be described. FIG. 1 shows the configuration of an information processing system according to the first embodiment. The information processing system is a system installed in an automobile, and includes a data processing device 1 that executes a car navigation application, a media player application, etc., a display 2 with a touch panel that the data processing device 1 uses for displaying images and inputting coordinates, an approach detection device 3, and other peripheral devices 4 that the data processing device 1 uses.

[0022] As shown in FIG. 2, the display 2 is in the form of a display unit 10 integrated with the approach detection device 3, and is disposed on the dashboard of the automobile between the driver's seat and the passenger seat with the display surface facing rearward. Returning to Figure 1, the approach detection device 3 detects the horizontal coordinates of a detectable object, such as a user's hand or finger, approaching the display surface of the display 2, and provides this as the approach position to the data processing device 1, and the data processing device 1 performs processing according to the provided approach position.

[0023] The approach detection device 3 includes an approach detection sensor 31 and an approach detection controller 32 . The approach detection sensor 31 includes four infrared LEDs, LED1, LED2, LED3, and LED4, and two photodiodes, PD1 and PD2, that detect infrared light. The approach detection controller 32 also includes a drive unit 321 that drives LED1, LED2, LED3, and LED4 to emit light, a detection unit 322 that converts the current signals output by PD1 and PD2 into intensity signals representing the intensity of infrared light incident on PD1 and PD2 and outputs the signals, and a detection control unit 323 that controls the operation of the drive unit 321 and the detection unit 322, and calculates the horizontal coordinates of a detectable object approaching the display surface of the display 2 from the intensity of infrared light represented by the intensity signal converted by the detection unit 322, and notifies the data processing device 1 of the approach position.

[0024] Next, as shown in FIGS. 3a, 3b, and 3c, LED1, LED2, LED3, and LED4 are arranged in that order from left to right at a position slightly below the bottom edge of the display 2 at approximately equal intervals. In addition, PD1 is positioned halfway between LED1 and LED2 and converts the reflected infrared light that is incident on it into a current signal, and PD2 is positioned halfway between LED3 and LED4 and converts the reflected infrared light that is incident on it into a current signal and outputs it. The arrows in Figures 3a and 3b indicate the central axes of the directivity angles of LED1, LED2, LED3, and LED4, and LED1, LED2, LED3, and LED4 irradiate infrared light obliquely toward the upper front of display 2. Next, the detection control section 323 of the approach detection controller 32 controls the operations of the drive section 321 and the detection section 322 so that the cycle shown in FIG. 4 is repeated. Here, each cycle includes a period during which the driver 321 causes only LED1 to emit light and the detector 322 outputs an intensity signal L1 representing the intensity of infrared light incident on PD1, a period during which the driver 321 causes only LED2 to emit light and the detector 322 outputs an intensity signal L2 representing the intensity of infrared light incident on PD1, a period during which the driver 321 causes only LED3 to emit light and the detector 322 outputs an intensity signal L3 representing the intensity of infrared light incident on PD2, and a period during which the driver 321 causes only LED4 to emit light and the detector 322 outputs an intensity signal L4 representing the intensity of infrared light incident on PD2.

[0025] Then, when the maximum value of the intensity signals L1, L2, L3, and L4 exceeds a predetermined threshold value, the detection control unit 323 detects the approach of an object to be detected and notifies the data processing device 1. In addition, the detection control unit 323 calculates the horizontal coordinate obtained as the center of gravity of the intensity distribution of the intensity signals L1, L2, L3, and L4 detected by the detection unit 322 as the approach position Gx using Equation 1, where x1 is the horizontal coordinate of LED1, x2 is the horizontal coordinate of LED2, x3 is the horizontal coordinate of LED3, and x4 is the horizontal coordinate of LED4.

[0026] Formula 1: Gx=(X1×L1+X2×L2+X3×L3+X4×L4) / (L1+L2+L3+L4) Then, when the data processing device 1 is notified by the approach detection controller 32 that a detectable object is approaching, it acquires the approach position Gx calculated by the approach detection controller 32 and performs a predetermined process according to the approach position Gx, such as enlarging the display of an icon displayed at a position on the display corresponding to the approach position Gx, recognizing a gesture of the hand in space from the change over time in the approach position Gx, and switching the display screen or application according to the recognized gesture.

[0027] Returning to FIG. 1, when a touch occurs on the touch panel of the display 2, the touch panel detects the touch position (Tx, Ty), which is the coordinates of the touched position, and notifies the data processing device 1 of the occurrence of the touch. Here, Tx of the touch position (Tx, Ty) is the horizontal coordinate, and Ty is the vertical coordinate.

[0028] Then, the data processing device 1 notified of the occurrence of the touch performs a touch response process to execute a process corresponding to the touch on the touch panel. FIG. 5 shows the procedure of this touch response process. Here, hereinafter, the horizontal coordinate system in which the touch panel detects the coordinate Tx of the touch position and the horizontal coordinate system in which the proximity detection controller 32 calculates the proximity position Gx are the same coordinate system, and the positive direction of the coordinate system is assumed to be the direction from left to right. As shown in the figure, in the touch response process, first, the touch position (Tx, Ty) is acquired from the touch panel (step 502). Also, the proximity position Gx calculated by the proximity detection controller 32 is acquired (step 504). Then, it is determined whether Gx>Tx + Th1 is satisfied (step 506). However, Th1 is a predetermined reference value, and Th1>0. If Gx>Tx + Th1 is satisfied (step 506), the user in the driver's seat is set as the touch operator (step 514). On the other hand, if Gx>Tx + Th1 is not satisfied (step 506), it is determined whether Gx<Tx - Th1 is satisfied (step 508). If Gx<Tx - Th1 is satisfied (step 508), the user in the passenger seat is set as the touch operator (step 512). On the other hand, if Gx<Tx - Th1 is also not satisfied (step 508), an unknown user is set as the touch operator (step 510). Then, a process is executed according to the touch position (Tx, Ty) and the operator of the touch set in any one of steps 510, 512, and 514 (step 516). Here, in step 516, for example, if the touch position (Tx, Ty) is an icon displayed on display 2 for receiving an instruction to execute a specified action, which is prohibited for the user in the driver's seat while the car is moving, then if the car is not currently moving, then that action is executed, and if the car is currently moving, then that action is executed only if the set operator is the user in the passenger seat, and if the set operator is an unknown user or the user in the driver's seat, then processing is performed such that the action is not executed.

[0029] Here, as shown in FIG. 6a, when a user in the driver's seat located to the right of the display 2 touches the touch panel, the user's arm extends from the right side toward the touch position, and due to the influence of the reflected light from this arm, the approach position Gx calculated by the approach detection controller 32 becomes a position to the right that is greater than the horizontal coordinate Tx of the touch position detected by the touch panel.

[0030] Furthermore, as shown in FIG. 6b, when a user in the passenger seat on the left side of display 2 touches the touch panel, the user's arm extends from the left side toward the touch position, and due to the influence of the light reflected by this arm, the approach position Gx calculated by the approach detection controller 32 becomes a position to the left that is smaller than the horizontal coordinate Tx of the touch position detected by the touch panel.

[0031] 7a, 7b, and 7c show the range of approach positions Gx where the user in the driver's seat is set as the touch operator and the range of approach positions Gx where the user in the passenger seat is set as the touch operator with respect to the horizontal coordinate Tx of the touch position in the above touch response process. Note that Xmin in the figures indicates the minimum value of the horizontal coordinate Tx of the touch position, and Xmax indicates the maximum value of the horizontal coordinate Tx of the touch position. Here, in this embodiment, Xmin=0.

[0032] As shown in the figure, when the approach position Gx is located at a position Th1 or more to the right of the horizontal coordinate Tx of the touch position, the user in the driver's seat is set as the operator of the touch, and when the approach position Gx is located at a position Th1 or more to the left of the horizontal coordinate Tx of the touch position, the user in the passenger seat is set as the operator of the touch.

[0033] Therefore, by the above-described touch response process, the true operator who touched the touch position can be correctly set. The first embodiment of the present invention has been described above. In this way, in this first embodiment, by comparing the approach position Gx calculated using the approach detection device 3 with the coordinates Tx of the touch position detected by the touch panel, it is determined whether the user who operated the touch panel is located on the left or right side of the display 2. In addition, in the approach detection device 4, the approach position Gx calculated from the intensity distribution of the reflected light of invisible light emitted toward the front of the display surface of the display 2 includes a deviation in the direction of the user performing the touch operation from the coordinates Tx of the touch position due to the influence of reflection from the arm stretched out in front of the display surface from the side where the user performing the touch operation is located. Therefore, according to the first embodiment, it is possible to properly identify the user who performed the touch operation, regardless of the manner of touch, such as the orientation of the user's finger touching the touch panel.

[0034] Next, a second embodiment of the present invention will be described. The second embodiment differs from the first embodiment only in the operation related to the touch operator's settings. As shown in Figure 8a, when a user extends their arm in a direction close to perpendicular to the display surface of display 2 to touch the touch panel, the ratio of the intensity of reflected light reaching the approach detection sensor 31 from the arm to the intensity of reflected light reaching the approach detection sensor 31 from the hand or fingers located close to the display surface of display 2 is small, so that the approach position Gx is calculated to be closer to the horizontal coordinate Tx of the touch position than when the user extends their arm diagonally to the display surface of display 2 to touch the touch panel as shown in Figure 8b.

[0035] Therefore, if a user touches the touch panel by extending their arm in a direction close to perpendicular to the display surface of the display 2, the touch response processing shown in the first embodiment may not be able to set the user in the driver's seat or the user in the passenger seat as the operator of the touch, and may instead set the user as an unknown user.

[0036] Therefore, in the second embodiment, the operator of the touch is set using an evaluation value that is calculated so that the influence of reflected light from the hand or fingers close to the display surface of the display 2 is smaller than the influence of reflected light from the arm, that is, an evaluation value that has a relatively large difference from the horizontal coordinate Tx of the touch position even when the user touches the touch panel by extending their arm from a direction close to perpendicular to the display surface of the display 2.

[0037] Here, the reflected light from a hand or a finger located close to the display surface of the display 2 is detected by the approach detection sensor 31 as reflected light of greater intensity, so the evaluation value should be calculated so that the influence of the reflected light of greater intensity is minimized within a range in which the relationship between the intensities is maintained.

[0038] More specifically, as such an evaluation value, the center of gravity G2x obtained by using Equation 2 of the intensity signals L1', L2', L3', and L4' obtained by reducing the intensity signals L1, L2, L3, and L4 detected by the approach detection sensor 31 at a greater rate within a range in which the magnitude relationship is maintained, can be used. Formula 2: G2x = (X1 × L1' + X2 × L2' + X3 × L3' + X4 × L4') / (L1' + L2' + L3' + L4') In addition, as the intensity signals L1', L2', L3', and L4', for example, L1' = L1 1 / 2 , L2' = L2 1 / 2 , L3' = L3 1 / 2 , L4' = L4 1 / 2 or L1' = log(L1), L2' = log(L2), L3' = log(L3), L4' = log(L4), can be used.

[0039] However, as long as the intensity signals L1', L2', L3', and L4' satisfy Li' > Lj' and Li' / Li < Lj' / Lj when Li > Lj, they may be obtained by other calculation methods. Now, in this second embodiment, the detection control unit 323 calculates the evaluation value G2x and provides it to the data processing device 1. In addition, the data processing device 1 acquires the evaluation value G2x from the proximity detection controller 32 instead of the proximity position Gx in step 504 of the touch response process shown in FIG. 5. In step 506, it is determined whether G2x > Tx + Th1 is satisfied. If G2x > Tx + Th1 is satisfied, the user in the driver's seat is set as the touch operator in step 514. In step 508, it is determined whether G2x < Tx - Th1 is satisfied. If G2x < Tx - Th1 is satisfied, the user in the passenger seat is set as the touch operator in step 512. If neither G2x > Tx + Th1 nor G2x < Tx - Th1 is satisfied, an unknown user is set as the touch operator in step 510.

[0040] By doing so, it is possible to set the correct user as the touch operator, including the case where the user touches the touch panel by stretching the arm from a direction close to the direction perpendicular to the display surface of the display 2. The second embodiment of the present invention has been described above. Next, a third embodiment of the present invention will be described. The third embodiment differs from the first embodiment only in the content of the touch response process. FIG. 9 shows the procedure of the touch response process performed in this third embodiment. As shown in the figure, in this touch response process, first, a touch position (Tx, Ty) is acquired from the touch panel (step 902). Also, the approach position Gx calculated by the proximity detection controller 32 is acquired (step 904). Then, ThD and ThP are set according to the horizontal coordinate Tx of the touch position (step 906). Details of the setting of ThD and ThP will be described later. Then, it is determined whether Gx>Tx + ThD is satisfied (step 908). If Gx>Tx + ThD is satisfied (step 908), the user in the driver's seat is set as the touch operator (step 916). On the other hand, if Gx>Tx + ThD is not satisfied (step 908), it is determined whether Gx<Tx + ThP is satisfied (step 910). If Gx<Tx + ThP is satisfied (step 910), the user in the passenger seat is set as the touch operator (step 914). On the other hand, if Gx<Tx + ThP is not satisfied either (step 910), an unknown user is set as the touch operator (step 912). Then, processing corresponding to the touch position (Tx, Ty) and the touch operator set in any of steps 912, 914, and 916 is executed (step 918). Then, the process returns to the process from step 902. Here, in step 906, ThD and ThP set according to the horizontal coordinate Tx of the touch position will be described. For the setting of ThD and ThP, XLB and XRB predetermined so as to satisfy the following relationship are used between the minimum value Xmin = 0 and the maximum value Xmax of the horizontal coordinate Tx of the touch position. Xmin<XLB<Xmid<XRB<Xmax Here, Xmid is the midpoint between Xmin and Xmax (the coordinates of the center in the left-right direction of the touch panel) expressed as Xmid=(Xmax+Xmin) / 2=Xmax / 2. Then, depending on the horizontal coordinate Tx of the touch position, Th1>0, Th2>0, Th3>0, Th2 <Th1、Th2<Th3、Th3> For Th1, ThD and ThP are defined as follows: When Xmin≦Tx≦XLB, ThD=Th3, ThP=Th2 XLB <Tx<XRBのとき、ThD=Th1、ThP=-Th1 When XRB≦Tx≦Xmax, ThD=-Th2, ThP=-Th3 The reason why ThD and ThP are determined in accordance with the coordinate Tx is as follows.

[0041] As shown in Figure 10a, when a user in the passenger seat touches a position near the left edge of the touch panel display 2, the reflected light from the user's arm in the passenger seat that reaches the approach detection sensor 31 becomes less, and the reflected light that reaches the approach detection sensor 31 is dominated by the detection of reflected light from the hand and fingers, so that a position around the horizontal coordinate Tx of the touch position is calculated as the approach position Gx.

[0042] On the other hand, as shown in Figure 10b, when the user in the driver's seat touches a position close to the left edge of the touch panel display 2, the reflected light from the user's arm occurs over a wide area, and more light is reflected from the arm and reaches the approach detection sensor 31, so that the approach position Gx is calculated to be a position that is significantly shifted to the right of the horizontal coordinate Tx of the touch position.

[0043] The same applies when a touch occurs near the right end of the display 2 of the touch panel. When it is a touch by the user in the driver's seat, the reflected light from the user's arm in the driver's seat arriving at the proximity detection sensor 31 decreases, and the detection of the reflected light by the hand or finger becomes dominant for the reflected light arriving at the proximity detection sensor 31. Therefore, the position around the horizontal coordinate Tx of the touch position is calculated as the approach position Gx. When it is a touch by the user in the passenger seat, the reflected light from the user's arm in the passenger seat is generated in a wide range, and the reflected light from the arm arriving at the proximity detection sensor 31 increases. Therefore, as the approach position Gx, a position shifted significantly to the left and larger than the horizontal coordinate Tx of the touch position is calculated.

[0044] For this reason, in the touch response process shown in the first embodiment, when a position near the left end or the right end of the display 2 is touched, there is a risk that the true user cannot be set as the touch operator. On the other hand, in the present third embodiment, as described above, ThD and ThP are determined according to the coordinate Tx. When Gx>Tx + ThD is satisfied, the user in the driver's seat is set as the touch operator, and when Gx<Tx + ThP is satisfied, the user in the passenger seat is set as the touch operator. Thus, as illustrated in FIGS. 11a, b, c, for the horizontal coordinate Tx of the touch position, the range of the approach position Gx where the user in the driver's seat is set as the touch operator and the range of the approach position Gx where the user in the passenger seat is set as the touch operator are set.

[0045] As shown in FIG. 11b, when the horizontal coordinate Tx of the touch position is near the left end of the display 2 (a position within the coordinate range of XLB or less), when the position around the coordinate Tx and the position within the range to its left are calculated as the approach position Gx, the user in the passenger seat is set as the touch operator, and when a position relatively far to the right from the coordinate Tx is calculated as the approach position Gx, the user in the driver's seat is set as the touch operator.

[0046] Furthermore, as shown in FIG. 11c, when the horizontal coordinate Tx of the touch position is close to the right end of the display 2 (when it is within a coordinate range equal to or greater than XRB), when a position around the coordinate Tx and a position within the range to the right of it are calculated as the approach position Gx, the user in the driver's seat is set as the operator of the touch, and when a position relatively far to the left of the coordinate Tx is calculated as the approach position Gx, the user in the passenger seat is set as the operator of the touch.

[0047] Furthermore, when the horizontal coordinate Tx of the touch position is neither close to the left edge nor close to the right edge of the display 2, the operator of the touch is set in the same manner as in the first embodiment, as shown in FIG. 11a. Therefore, according to the third embodiment, it is possible to set the correct user as the operator of the touch, even when a touch occurs at a position close to the left edge or close to the right edge of display 2 of the touch panel. The third embodiment of the present invention has been described above. Next, a fourth embodiment of the present invention will be described. The fourth embodiment differs from the third embodiment only in the method of setting ThD and ThP. In the fourth embodiment, ThD and ThP are set so that ThD gradually changes from Th3 to Th1 to -Th2 and ThP gradually changes from Th2 to -Th1 to -Th3 as the horizontal coordinate Tx of the touch position changes from Xmin=0 to Xmax. Such a setting would be, for example, when the coordinate Tx is between Xmin and Xmid: ThD=Th3+(Th1-Th3)Tx / Xmid, ThP = Th2 + (-Th1 - Th2) Tx / Xmid When the coordinate Tx is between Xmid and Xmax, ThD=Th1+(-Th2-Th1)(Tx-Xmid) / Xmid, This can be achieved by setting ThP=-Th1+(-Th3+Th1)(Tx-Xmid) / Xmid, etc.

[0048] Alternatively, ThD and ThP are set so that ThD gradually changes from Th3 to -Th2 and ThP gradually changes from Th2 to -Th3 as the horizontal coordinate Tx of the touch position changes from Xmin=0 to Xmax. Such a setting would be, for example, ThD=Th3+(-Th2-Th3)Tx / Xmax, ThP=Th2+(-Th3-Th2)Tx / Xmax This can be achieved by:

[0049] Even if ThD and ThP are set in this way, as in the third embodiment, the correct user can be set as the operator of the touch, including when a touch occurs near the left edge or near the right edge of the touch panel display 2. The embodiment of the present invention has been described above. In the third and fourth embodiments described above, the evaluation value G2x shown in the second embodiment may be used in place of the approach position Gx in the touch response process. [Explanation of symbols]

[0050] 1...data processing device, 2...display, 3...approach detection device, 4...peripheral device, 10...display unit, 31...approach detection sensor, 32...approach detection controller, 321...drive section, 322...detection section, 323...detection control section.

Claims

1. A touch operator identification system for identifying a user who has operated a touch panel that is provided over a display surface of a display and detects a touched position as a touch position, comprising: an approach detection device that detects an object approaching a display surface of the display; a user identification means for identifying a user who touches the touch panel; The approach detection device includes: a plurality of light sources arranged on the outer side of a display surface of the display along a left-right direction of the display surface, the light sources emitting invisible light toward a front of the display surface; a light detector disposed outside a display surface of the display and configured to detect reflected light of invisible light emitted by the light source; a reference position calculation means for calculating a left-right coordinate of the display surface of an approaching detection object as a left-right reference position from a distribution of the intensity of reflected light of the invisible light emitted by each of the light sources detected by the light detector, The user discrimination means, when a touch occurs on the touch panel, discriminates whether the user operating the touch panel is a user located on the left side or the right side of the display based on the left-right positional relationship on the display surface between the left-right touch position, which is the left-right coordinate of the touch position detected by the touch panel, and the left-right reference position calculated by the reference position calculation means, and the left-right distance on the display surface.

2. A touch operator identification system for identifying a user who has operated a touch panel that is provided over a display surface of a display and detects a touched position as a touch position, comprising: an approach detection device that detects an object approaching a display surface of the display; a user identification means for identifying a user who touches the touch panel; The approach detection device includes: a plurality of light sources arranged on the outer side of a display surface of the display along a left-right direction of the display surface, the light sources emitting invisible light toward a front of the display surface; a light detector disposed outside a display surface of the display and configured to detect reflected light of invisible light emitted by the light source; a reference position calculation means for calculating, as a left-right reference position, coordinates of a center of gravity in the left-right direction of the display surface of a distribution in which a distribution of intensities of reflected light of invisible light emitted by each of the light sources detected by the light detector is corrected so that the intensity decreases at a greater rate as the intensity increases while maintaining a magnitude relationship between the intensities; The user discrimination means, when a touch occurs on the touch panel, discriminates whether the user operating the touch panel is a user located on the left side or the right side of the display based on the left-right positional relationship on the display surface between the left-right touch position, which is the left-right coordinate of the touch position detected by the touch panel, and the left-right reference position calculated by the reference position calculation means, and the left-right distance on the display surface.

3. The touch operator identification system according to claim 1 or 2, the user determination means determines that the user who operated the touch panel is a user located on the left side of the display when the left / right reference position is located a predetermined distance or more away from the left / right touch position to the left of the left / right touch position, and determines that the user who operated the touch panel is a user located on the right side of the display when the left / right reference position is located a predetermined distance or more away from the right / left touch position to the right of the left / right touch position.

4. The touch operator identification system according to claim 1 or 2, The user identification means when the left / right touch position is in a central area in the left / right direction of the display and a left / right reference position is located at a position that is a first distance or more away from the left / right touch position on the left side of the left / right touch position, it is determined that the user who operated the touch panel is a user located on the left side of the display, and when the left / right reference position is located at a position that is the first distance or more away from the right / left touch position on the right side of the left / right touch position, it is determined that the user who operated the touch panel is a user located on the right side of the display; when the left-right touch position is in an area to the left of the central area of ​​the display, and a left-right reference position is located to the left of a position that is a second distance away from the left-right touch position on the right side of the left-right touch position, it is determined that the user who operated the touch panel is a user located on the left side of the display; and when the left-right reference position is located at a third distance or more that is greater than the second distance away from the left-right touch position on the right side of the left-right touch position, it is determined that the user who operated the touch panel is a user located on the right side of the display; a left-right touch position on the left side of the left-right touch position and a right-left reference position on the right side of the left-right touch position, the left-right touch position being the second distance away; and a right-left touch position on the left side of the left-right touch position and a left-right reference position on the right side of the left-right touch position, the left-right touch position being the second distance away;

5. The touch operator identification system according to claim 1 or 2, The user identification means setting a first reference position and a second reference position according to the left / right touch position; When the left-right direction reference position is to the left of the first reference position, it is determined that the user who operated the touch panel is a user located on the left side of the display, and when the left-right direction reference position is to the right of the second reference position, it is determined that the user who operated the touch panel is a user located on the right side of the display, The user discrimination means is the first reference position is set so that, when the left / right touch position is at a position near the left end, the relative position with respect to the left / right touch position becomes a first relative position that is a first distance away to the right of the left / right touch position, when the left / right touch position is at a position near the right end, the relative position with respect to the left / right touch position becomes a second relative position that is a second distance away to the left of the left / right touch position that is a distance greater than the first distance, and when the left / right touch position is between a position near the left end and a position near the right end, the relative position with respect to the left / right touch position becomes closer to the first relative position as it approaches the left end and closer to the second relative position as it approaches the right end; the second reference position is set so that, when the left / right touch position is a position near the right end, the relative position with respect to the left / right touch position is a third relative position that is a first distance away to the left of the left / right touch position, when the left / right touch position is a position near the left end, the relative position with respect to the left / right touch position is a fourth relative position that is a second distance away to the right of the left / right touch position, and when the left / right touch position is between a position near the left end and a position near the right end, the relative position with respect to the left / right touch position is closer to the third relative position as it approaches the right end and closer to the fourth relative position as it approaches the left end.

6. The touch operator identification system according to claim 1 or 2, the display is disposed between a driver's seat and a passenger seat in the left-right direction of the vehicle; A touch operator identification system, characterized in that a user located on the left side of the display is one of a user seated in a driver's seat and a user seated in a passenger seat, and a user located on the right side of the display is the other user.

7. 3. A touch operator identification system according to claim 1, the display, the touch panel, and a data processing device that uses the display for display output and the touch panel for position input, the touch operator identification system notifies the data processing device of the identified user who operated the touch panel; The information processing system is characterized in that the data processing device performs processing according to the touch position detected by the touch panel, and switches the content of at least some of the processing performed according to the touch position depending on the user who operated the touch panel notified by a touch operator identification system.

8. a data processing device that uses the display for display output and the touch panel for position input, the data processing device comprising: the touch operator identification system according to claim 1; the display; the touch panel; and a data processing device that uses the display for display output and the touch panel for position input, the touch operator identification system notifies the data processing device of the calculated left-right reference position and the identified user who operated the touch panel; The data processing device includes: a gesture response processing means for identifying a gesture made by a user in front of a display surface of the display from the calculated left-right reference position and performing processing according to the identified gesture; a touch response processing means for performing processing in response to a touch position detected by the touch panel; The information processing system is characterized in that the touch response processing means switches the content of the processing to be performed, for at least a portion of the processing performed in response to the touch position, depending on the user who operated the touch panel notified by the touch operator identification system.

Images