Proximity detection device and information processing system

Abstract

Provided is a "proximity detection device and information processing system" that suppresses omission of acceptance of operations due to reflection of the user's wrist or arm. When a rightward movement gesture operation is performed in which a hand approaching a display (2) is moved from the left to the right of the display, a position shift of the hand returning to the left side is sometimes detected due to reflection of the wrist, etc. A detection control unit (323) that detects the approach of the hand to the display and notifies the position of the hand to a data processing device (1) notifies the data processing device of the non-detection of the approach of the hand at the time Pd when the movement amount dx of the hand position to the right begins to decrease after exceeding a threshold value Th. The data processing device calculates the rightward movement amount Δx from the position xS when the approach of the hand is detected to the position xPd-1 immediately before the time when the non-detection is notified Pd, and accepts the rightward movement gesture operation and performs prescribed processing when the movement amount Δx exceeds the threshold value Th.

Description

Technical Field

[0001] The present invention relates to a technology for detecting the approach of a user's hand toward a display surface of a display. Background Art

[0002] As a technology for detecting the approach of a user's hand to the display surface of a display, the following technology is known: infrared light is irradiated from a plurality of infrared LEDs arranged left and right below the lower edge of the display surface of the display toward the front of the display surface of the display, and the reflected light of the infrared light reflected by the user's hand is detected by a photodiode, thereby detecting the approach of the user's hand to the display surface of the display and accepting it as an operation on the display (for example, patent document 1).

[0003] Here, in this technology, a display is arranged between the driver's seat and the passenger seat on the dashboard of a car, and mainly receives operations on the display from a user who is the driver.

[0004] Prior art literature

[0005] Patent Literature

[0006] Patent Document 1: Japanese Patent Application Publication No. 2019-74465 Summary of the Invention

[0007] Problems to be solved by the invention

[0008] When a display that is not placed in front of the user, such as the display placed between the driver's seat and the passenger seat, is used as a display, operations on the display may not be correctly received due to reflection of infrared light by the user's wrist or arm.

[0009] That is, for example, when accepting an action of moving a hand close to the display from left to right to a greater extent than a predetermined threshold as an operation on the display, if the user performing the operation is a user sitting on the left side of the display, Figure 7 As shown in a, if the user moves their hand from left to right, the inclination of their hand and arm increases as they move rightward. However, even though the user's hand may be moving to the right of the display, light reflected from the user's wrist or arm may cause a position to the left of the right end of the display to be mistakenly detected as the location where the user's hand is approaching.

[0010] Figure 7 The b takes the right direction of the display as the positive x direction, the x coordinate of the left end of the display as 0, and the x coordinate of the right end as L, which is for Figure 7 The position change of a is detected by the movement of the hand from left to right. Figure 7The movement of a starts from the position S at the left end of the display where the hand approaches, and is detected as a position shift to the position P near the right end of the display. Next, until the position E of the hand is finally detected, the position shift is mistakenly detected as the hand returning to the left.

[0011] Next, if the Figure 7 The position shift detected as b is calculated as the movement amount of the hand from the position S where the hand approach is detected to the position E where the hand is detected. Figure 7 The movement amount Δx is shown in c.

[0012] Then, when the movement amount Δx is compared with the predetermined amount Th and the movement amount Δx is larger than the threshold value, the user's hand movement is accepted as an operation on the display, but Figure 7 The movement amount Δx shown in c is due to Figure 7 The false detection of the position shift from P to E returning to the left shown in b is smaller than the actual movement of the user's hand. Due to this reduction, the movement amount Δx does not exceed the threshold and the hand movement performed by the user is not accepted as an operation on the display.

[0013] Therefore, the subject of the present invention is to suppress the omission of acceptance of the operation caused by the misdetection of the position due to the reflection of the user's wrist or arm after the hand is moved outside the display when the action of moving the hand close to the display in one direction for more than a specified distance is accepted as an operation for the display.

[0014] Means for solving problems

[0015] To achieve the aforementioned object, the present invention provides a proximity detection device, utilized as an input device of a data processing device, that detects the proximity of a user's hand to a display surface of a display of the data processing device. The device comprises: a proximity detection mechanism that detects the presence or absence of a user's hand approaching the display surface and the left-right position of the hand approaching the display surface using an infrared light source disposed outside the display surface of the display and emitting infrared light that passes in front of the display surface, and a photodetector disposed outside the display surface and detecting reflected light of the infrared light; and a notification mechanism that outputs a "not detected" signal to the data processing device when the proximity detection mechanism does not detect the approach of the user's hand, and outputs the left-right position detected by the proximity detection mechanism to the data processing device when the proximity detection mechanism is detecting the approach of the user's hand. Here, one of the left and right directions is defined as a first direction, and the notification mechanism outputs a "not detected" signal to the data processing device when the amount of movement of the position detected by the proximity detection mechanism in the first direction exceeds a predetermined threshold and then decreases while the proximity detection mechanism is detecting the approach of the user's hand.

[0016] Here, such a proximity detection device can also be configured to have the proximity detection mechanism: a plurality of the infrared light sources, arranged in the left-right direction below the display surface of the display; and a plurality of the light detectors, arranged in the left-right direction below the display surface of the display; the proximity detection mechanism sequentially lights up the plurality of infrared light sources, and detects whether the user's hand is approaching the display surface and the left-right position of the hand based on the reflected light detected by each light detector when each infrared light source is lit.

[0017] According to such a proximity detection device, when the movement amount of the hand in the first direction exceeds a threshold and then decreases, by outputting non-detection to the data processing device when the decrease begins, the data processing device can identify the position immediately before the movement amount begins to decrease as the end position of the movement.

[0018] Therefore, even if the position of the hand returns to the first direction in the opposite direction due to erroneous detection of the position due to reflection of the user's wrist or arm after the hand is moved in the first direction in a manner exceeding the threshold and moving outside the display, the data processing device can accept the user operation corresponding to the movement above the threshold in the first direction, and the omission of acceptance of the user operation can be suppressed.

[0019] In addition, the present invention also provides an information processing system having the above-mentioned proximity detection device and the data processing device, wherein the data processing device has: a user operation acceptance mechanism, which uses the left-right direction position output from the proximity detection device when the proximity detection device starts to detect the approach of the user's hand as the starting position, and uses the left-right direction position output from the proximity detection device immediately before the proximity detection device outputs the undetected position as the ending position, and accepts the specified user operation when the movement amount in the first direction from the starting position to the ending position exceeds the threshold.

[0020] Furthermore, to achieve the aforementioned object, the present invention provides a proximity detection device, utilized as an input device of a data processing device, that detects the proximity of a user's hand to a display surface of a display of the data processing device. The device comprises: a proximity detection mechanism that detects the presence or absence of the user's hand approaching the display surface and the vertical position of the hand approaching the display surface using an infrared light source disposed outside the display surface of the display and emitting infrared light that passes in front of the display surface, and a photodetector disposed outside the display surface and detecting reflected light of the infrared light; and a notification mechanism that outputs "not detected" to the data processing device when the proximity detection mechanism does not detect the approach of the user's hand, and outputs the vertical position detected by the proximity detection mechanism to the data processing device when the proximity detection mechanism is detecting the approach of the user's hand. Here, the upward direction is defined as a first direction, and the notification mechanism outputs "not detected" to the data processing device when the amount of movement of the position detected by the proximity detection mechanism in the first direction exceeds a predetermined threshold and then decreases while the proximity detection mechanism is detecting the approach of the user's hand.

[0021] According to this proximity detection device, similar to the above-mentioned proximity detection device that uses the left or right direction as the first direction, it is possible to suppress omission of acceptance of a user operation corresponding to movement greater than or equal to a threshold in the first direction, which is the upward direction.

[0022] The present invention also provides an information processing system including such a proximity detection device and the data processing device. The data processing device includes a user operation accepting mechanism that uses the vertical position output by the proximity detection device when the proximity detection device begins detecting the approach of the user's hand as a starting position, and the vertical position output by the proximity detection device immediately before the proximity detection device outputs no detection as an ending position, and accepts a predetermined user operation when the amount of movement in the first direction from the starting position to the ending position exceeds a threshold.

[0023] Furthermore, the above-mentioned information processing system may be installed in a car, and the display of the data processing device may be arranged between the driver's seat and the passenger seat of the car.

[0024] Effects of the Invention

[0025] As described above, according to the present invention, when the action of moving a hand close to a display in one direction for more than a specified distance is accepted as an operation for the display, it is possible to suppress the omission of the acceptance of the operation caused by the erroneous detection of the position caused by the reflection of the user's wrist or arm after moving the hand outside the display. BRIEF DESCRIPTION OF THE DRAWINGS

[0026] Figure 1 It is a block diagram showing the configuration of an information processing system according to an embodiment of the present invention.

[0027] Figure 2 It is a diagram showing the arrangement of a display according to an embodiment of the present invention.

[0028] Figure 3 It is a diagram showing the arrangement of proximity detection sensors according to an embodiment of the present invention.

[0029] Figure 4 This is a flowchart showing the notification process according to the embodiment of the present invention.

[0030] Figure 5 It is a diagram showing a processing example of notification processing according to the embodiment of the present invention.

[0031] Figure 6 It is a diagram showing another arrangement of the proximity detection sensor according to the embodiment of the present invention.

[0032] Figure 7 It is a figure which shows the subject of this invention.

[0033] Description of reference numerals:

[0034] 1 ...data processing device, 2 ...display, 3 ...proximity detection device, 4 ...peripheral device, 10 ...display unit, 31 ...proximity detection sensor, 32 ...proximity detection controller, 321 ...driving unit, 322 ...detection unit, 323 ...detection control unit. DETAILED DESCRIPTION

[0035] Hereinafter, embodiments of the present invention will be described.

[0036] exist Figure 1 Detailed description of the structure of the information processing system according to the present embodiment is shown in FIG.

[0037] The information processing system is a system installed in a car, and includes a data processing device 1 for executing various applications such as car navigation applications and media player applications, a display 2 for the data processing device 1 to use in image display, a proximity detection device 3, and other peripheral devices 4 used by the data processing device 1.

[0038] Display 2 Figure 2 As shown, the display unit 10 including the touch panel display 2 and the proximity detection device 3 is integrated and arranged between the driver's seat and the passenger seat on the dashboard of the vehicle with the display surface facing rearward.

[0039] Here, the display 2 may be a display 2 with a touch panel including a touch panel used by the data processing device 1 for coordinate input on a display surface.

[0040] In the example shown in the figure, the car is a left-hand steering car, and the driver, who is the main user of the information processing system, operates the display 2 from the left side of the display 2.

[0041] return Figure 1 The proximity detection device 3 includes a proximity detection sensor 31 and a proximity detection controller 32 .

[0042] The proximity detection sensor 31 includes five infrared LEDs, namely, LED1 , LED2 , LED3 , LED4 , and LED5 , and two photodiodes, namely, PD1 and PD2 , for detecting infrared light.

[0043] In addition, the proximity detection controller 32 includes: a driving unit 321 that drives LED1, LED2, LED3, LED4, and LED5 to make them emit light, a detection unit 322 that converts the current signal output by PD1 and PD2 into an intensity signal representing the intensity of the infrared light incident on PD1 and PD2 and outputs it, and a detection control unit 323.

[0044] Next, if Figure 3 As shown in a and b, the left-right, up-down, and front-back directions are determined relative to the display 2, and LED1, LED2, LED3, LED4, and LED5 are arranged in this order from left to right, slightly below the lower edge of the display 2. Among them, the front direction is the display direction of the display 2.

[0045] In addition, PD1 is configured between LED2 and LED3, and converts the reflected light of the incident infrared light into a current signal. PD2 is configured between LED3 and LED4, and converts the reflected light of the incident infrared light into a current signal and outputs it.

[0046] Figure 3The arrows in a and b represent the central axes of the directional angles of LED1 , LED2 , LED3 , LED4 , and LED5 , and LED1 , LED2 , LED3 , LED4 , and LED5 irradiate infrared light obliquely toward the upper front of the display 2 .

[0047] Next, the detection control unit 323 of the proximity detection controller 32 repeatedly controls the actions of the driving unit 321 and the detection unit 322 and performs detection processing to detect whether the user's hand is approaching the display surface of the display 2 and the position of the approach based on the intensity of the infrared light represented by the intensity signal output by the detection unit 322.

[0048] In this detection process, the detection control unit 323 turns on LED1, LED2, LED3, LED4, and LED5 one by one in sequence, and detects the intensity of the reflected light of the infrared light incident on the position of PD1 and PD2 based on the output of PD1 and PD2. Based on the intensity of the reflected light at the detected positions of PD1 and PD2, it detects whether the user's hand is approaching the display surface of the display 2, and calculates the left and right position of the user's hand close to the display surface of the display 2 based on the relationship between the positions of LED1, LED2, LED3, LED4, and LED5 and the intensity of the reflected light at the detected positions of PD1 and PD2.

[0049] Next, a description will be given of a notification process performed by the detection control unit 323 of the proximity detection controller 32 to notify the data processing device 1 of the content detected in the detection process.

[0050] exist Figure 4 The order in which the notifications are processed is indicated in .

[0051] As shown in the figure, the detection control unit 323 first investigates whether the user's hand is detected approaching the display surface of the display 2 during the detection process (step 402). If not detected, it notifies the data processing device 1 that no detection is made (step 424) and returns to the processing of step 402.

[0052] On the other hand, when proximity is detected in the detection process (step 402), the left-right position of the user's hand close to the display surface of the display 2 calculated in the detection process is obtained as the current position (step 404), and the obtained current position is stored as the starting position (step 406), and then the current position is notified to the data processing device 1 (step 408).

[0053] Next, the detection control unit 323 again checks whether the user's hand is detected approaching the display surface of the display 2 during the detection process (step 410). If not, it notifies the data processing device 1 of the non-detection (step 424) and returns to the process of step 402.

[0054] On the other hand, when proximity is detected during the detection process (step 410), the left-right position of the user's hand close to the display surface of the display 2 calculated during the detection process is obtained as the current position (step 412), and the distance from the stored starting position to the obtained current position is calculated as the movement amount (step 414).

[0055] Then, it is checked whether the movement amount exceeds a predetermined threshold value Th (step 416 ). Here, the threshold value Th is set to 0.7L, which is 70% of the horizontal width L of the display 2 , for example.

[0056] Then, if the movement amount does not exceed the threshold value Th (step 416), the current position obtained in step 412 is stored as the previous position (step 418), the current position obtained in step 412 is notified to the data processing device 1 (step 420), and the processing from step 410 is returned.

[0057] On the other hand, when it is determined in step 416 that the movement amount exceeds the threshold value Th, it is checked whether the position return has occurred (step 422).

[0058] Here, in step 422, if the previous position is stored and the current position obtained in step 412 is closer to the starting position than the previous position, it is determined that the position has returned. In other cases, it is determined that the position has not returned. Furthermore, if the previous position is not stored, it is also determined that the position has not returned.

[0059] Then, if the position return does not occur (step 422), the current position obtained in step 412 is stored as the previous position (step 418), the current position obtained in step 412 is notified to the data processing device 1 (step 420), and the processing from step 410 is returned.

[0060] On the other hand, when position return has occurred, the data processing device 1 is notified of non-detection (step 424 ), and the process returns to step 402 .

[0061] The notification process performed by the detection control unit 323 has been described above.

[0062] Furthermore, the data processing device 1 accepts the user's operation based on the notification from the detection control unit 323 through such notification processing.

[0063] That is, when the amount of movement in the right direction from the current position when the approach of the hand is detected to the current position notified immediately before the notification that the approach of the hand is not detected exceeds the above-mentioned threshold Th, the data processing device 1 accepts the user's right-moving gesture operation and performs the prescribed processing that has been pre-established to correspond to the right-moving gesture operation.

[0064] Here, the current position when detection of the approach of the hand starts refers to the current position first notified after being notified by the detection control unit 323 that the approach is not detected, or the current position when the non-detection notification is no longer received.

[0065] In addition, when the current position when the detection of the approach of the hand is started is set to the current position first notified after the detection control unit 323 notifies that no approach is detected, at the time of startup, the current position first notified is set to the current position when the detection of the approach of the hand is started.

[0066] Furthermore, the data processing device 1 performs, for example, switching of an active application or switching of a screen displayed on the display 2 as a predetermined process associated with the right-move gesture operation.

[0067] exist Figure 5 2 shows an example of the notification process of the detection control unit 323.

[0068] Assume that the user who is currently the driver sitting on the left side of the display 2 is Figure 5 As shown in a, the intention is to perform a right move gesture operation, and the hand close to the display 2 is moved from the left end of the display 2 to the right side of the display 2.

[0069] Then, after the user's hand moves to the right side of the display 2, due to reflected light reflected from the user's wrist or arm, a position further to the left of the right end of the display 2 is erroneously detected as the position where the user's hand is approaching.

[0070] In this case, the detection control unit 323 performs the detection processing, and sets the right direction of the display 2 as the positive x direction, the x coordinate of the left end of the display 2 as 0, and the x coordinate of the right end as L. Figure 5 The hand of a moves from left to right, such as Figure 5 As shown in b, it is detected that the hand moves from the position of the left end of the display 2 to the position near the right end of the display 2, and then moves back to the left side.

[0071] In addition, for Figure 5 The position shift shown in b is calculated in step 414 of the notification process of the detection control unit 323. Figure 5 As shown in c, the rightward movement amount dx gradually increases and then decreases.

[0072] Here, if the threshold value Th used in step 416 of the notification process is set to 0.7L, which is 70% of the horizontal width L of the display 2, then the user intends to perform a right-move gesture operation. Figure 5 As shown in a, the hand moves greatly from left to right with a threshold value Th, which is 0.7L or more. Figure 5 As shown in c, the maximum value of the rightward movement amount dx, that is, the movement amount dx immediately before the decrease, exceeds the threshold value Th, that is, 0.7L. Figure 5 At time Pd when the movement amount dx of b exceeds the threshold value Th, ie, 0.7 L, and starts to decrease, the occurrence of position return is detected in step 422 of the notification process.

[0073] In this case, from the moment the approach starting point S is detected until the moment Pd at which the position return occurs is detected, the left-right position of the user's hand detected in the detection process, that is, the current position, is notified to the data processing device 1 from the detection control unit 323, and at the moment Pd at which the position return occurs is detected, the data processing device 1 is notified from the detection control unit 323 that it is not detected.

[0074] As a result, in the data processing apparatus 1, as Figure 5 As shown in d, the amount of movement in the right direction from the current position xS when the approach of the hand starts to be detected to the current position xPd-1 that was notified immediately before the moment Pd at which the approach of the hand was not detected is calculated as the amount of movement Δx. The amount of movement Δx becomes the amount of movement dx immediately before the amount of movement dx starts to decrease, and therefore exceeds the threshold value Th, i.e., 0.7L. In the data processing device 1, the user's right-moving gesture operation can be accepted.

[0075] Therefore, according to this embodiment, when accepting the action of moving the hand close to the display 2 in the right direction by the threshold value Th as the user's right move gesture operation, it is possible to suppress the omission of acceptance of the user's right move gesture operation due to the erroneous detection of the position caused by the reflection of the user's wrist or arm after moving the hand outside the display 2.

[0076] Furthermore, in the notification process of the detection control unit 323, after notifying the data processing device 1 that no detection has been made at the time Pd when the position return occurs, the current position detected in the detection process is restarted and notified to the data processing device 1. Then, in the data processing device 1, the current position detected in the detection process is restarted. Figure 5The user operation is accepted based on the amount of movement from the current position xPd+1 that was initially notified after being notified of non-detection at the time Pd to the current position xE immediately before the next notification of non-detection, as shown in d. However, since the change in the position that is erroneously detected due to the reflected light reflected on the user's wrist or arm after the user's hand moves to the right side of the display 2 is small, the user operation to be accepted is not set for smaller movements of the hand, thereby suppressing the situation in which the user operation is accepted for the movement of the erroneously detected position.

[0077] The embodiments of the present invention have been described above.

[0078] In addition, the above embodiment describes the case where the action of moving the hand close to the display 2 in the right direction in a manner exceeding the threshold value Th is accepted as the user's right-moving gesture operation, but this embodiment can also be applied in the data processing device 1 by replacing left and right in the above description when accepting the action of moving the hand close to the display 2 in the left direction in a manner exceeding the threshold value Th as the user's left-moving gesture operation.

[0079] In addition, this embodiment can also be applied by replacing the left with the bottom and the right with the top in the above description. That is, in this case, Figure 6 As shown in a and b of FIG, an infrared LED and a photodiode are arranged vertically on the left outer edge of display 2. Detection control unit 323 detects the vertical position of an approaching hand. Data processing device 1 accepts an upward movement of the hand approaching display 2 exceeding a threshold value Th as a user's upward gesture operation and performs prescribed processing. Alternatively, the infrared LED and photodiode may be arranged vertically on the right outer edge of display 2.

[0080] Here, when the user performs an upward gesture operation of moving the hand close to the display 2 upward, as shown in FIG. Figure 6 As shown in c, sometimes, although the user's hand moves to the upper side of the display 2, due to the reflected light reflected on the user's wrist or arm, the position below the upper end of the display 2 is mistakenly detected as the position close to the user's hand. Similar to the above-mentioned right-move gesture operation, the position of the detected hand moves from the lower side of the display 2 to the position near the upper end of the display 2 and then returns to the position on the lower side.

[0081] Then, by applying this embodiment, when such a position return occurs, notification processing is performed to notify the data processing device that the hand position has not been detected at the moment when the upward movement amount exceeds the threshold and begins to decrease, thereby suppressing the omission of acceptance of the upward gesture operation.

[0082] Furthermore, the above description takes as an example an information processing system in which the display 2 is provided between the driver's seat and the passenger seat on the dashboard of a car, but the present embodiment is similarly applicable to any information processing system.

Claims

1. A proximity detection device used as an input device of a data processing device and detecting the approach of a user's hand to a display surface of a display of the data processing device, characterized in that: have: a proximity detection mechanism that detects the presence or absence of a user's hand approaching the display surface and the left-right position of the hand approaching the display surface using an infrared light source disposed outside the display surface of the display and emitting infrared light that passes in front of the display surface, and a light detector disposed outside the display surface and detecting reflected light of the infrared light; as well as The notification mechanism outputs to the data processing device that the user's hand is not approaching when the proximity detection mechanism does not detect the user's hand approaching, and outputs to the data processing device the left-right position detected by the proximity detection mechanism when the proximity detection mechanism is detecting the user's hand approaching. Taking one direction between the left direction and the right direction as the first direction, the notification mechanism outputs a non-detection to the data processing device when the movement amount of the position detected by the proximity detection mechanism toward the first direction exceeds a prescribed threshold and then decreases during the period when the proximity detection mechanism detects the approach of the user's hand.

2. The proximity detection device according to claim 1, wherein The proximity detection mechanism includes a plurality of infrared light sources arranged in the left-right direction below the display surface of the display, and a plurality of light detectors arranged in the left-right direction below the display surface of the display, so that the plurality of infrared light sources are lit in sequence, and based on the reflected light detected by each light detector when each infrared light source is lit, whether the user's hand is approaching the display surface and the left-right position of the hand are detected.

3. An information processing system, characterized in that: The information processing system comprises the proximity detection device according to claim 1 or 2, and the data processing device. The data processing device includes: a user operation acceptance mechanism, which uses the left-right direction position output from the proximity detection device when the proximity detection device starts to detect the approach of the user's hand as the starting position, and uses the left-right direction position last output from the proximity detection device before the output from the proximity detection device is not detected as the ending position, and accepts the specified user operation when the movement amount in the first direction from the starting position to the ending position exceeds the threshold.

4. A proximity detection device used as an input device of a data processing device and detecting the approach of a user's hand to a display surface of a display of the data processing device, characterized in that: have: a proximity detection mechanism that detects the presence of a user's hand approaching the display surface and the vertical position of the hand approaching the display surface using an infrared light source disposed outside the display surface of the display and emitting infrared light that passes in front of the display surface, and a light detector disposed outside the display surface and detecting reflected light of the infrared light; as well as The notification mechanism outputs to the data processing device that the user's hand is not approaching when the proximity detection mechanism does not detect the user's hand approaching, and outputs to the data processing device the vertical position detected by the proximity detection mechanism when the proximity detection mechanism is detecting the user's hand approaching. Taking the upward direction as the first direction, the notification mechanism outputs non-detection to the data processing device when the movement amount of the position detected by the proximity detection mechanism in the first direction exceeds a specified threshold and then decreases during the period when the proximity detection mechanism detects the approach of the user's hand.

5. An information processing system, characterized in that: The information processing system comprises the proximity detection device according to claim 4 and the data processing device. The data processing device includes: a user operation acceptance mechanism, which uses the up-down direction position output from the proximity detection device when the proximity detection device starts to detect the approach of the user's hand as the starting position, and uses the up-down direction position last output from the proximity detection device before the output from the proximity detection device is not detected as the ending position, and accepts the specified user operation when the movement amount in the first direction from the starting position to the ending position exceeds the threshold.

6. The information processing system according to claim 3 or 5, wherein: This information processing system is installed in the car. The display of the data processing device is arranged between the driver's seat and the passenger seat of the automobile.

Images