Sensor device, sensor system, and method for controlling sensor device

The non-contact sensor device addresses the limitations of IR-type detection by using a gesture sensor for low-cost, low-load operation with area-based signal generation, enhancing user convenience and preventing unintended signals.

JP7586429B2Active Publication Date: 2024-11-19ASCO SA +1
View PDF 6 Cites 0 Cited by

Patent Information

Application Number
JP2021095526
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2021-06-08
Publication Date
2024-11-19
Estimated Expiration
2041-06-08

AI Technical Summary

Technical Problem

Existing IR-type detection devices require close contact with the display device, are costly, and impose a high CPU load due to image processing, making them inconvenient for users, especially when the display is difficult to reach, and image processing devices are expensive and resource-intensive.

Method used

A non-contact sensor device with a gesture sensor unit that detects gestures and identifies them, generating output signals based on the detected gestures and the area occupied by the object, allowing for a simple configuration and reduced CPU load, and includes features to prevent unintended signal generation and chattering.

Benefits of technology

The sensor device achieves a non-contact, low-cost solution with reduced processing load, enabling user-friendly operation and preventing unintended signal generation through advanced gesture detection and area-based signal generation.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007586429000001
    Figure 0007586429000001
  • Figure 0007586429000002
    Figure 0007586429000002
  • Figure 0007586429000003
    Figure 0007586429000003
Patent Text Reader

Abstract

To provide: a non-contact sensor device with an easy configuration and a light processing load; a sensor system; and a control method of the sensor device.SOLUTION: In a sensor system 10, a sensor device 1 comprises: a gesture sensor unit 11; an acquisition unit 122 which acquires a gesture signal representing a gesture and an area occupied by an object within a detection range; and a generation unit 123 which generates a corresponding output signal on the basis of the gesture represented by the gesture signal and a size of the area.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to a sensor device, a sensor system, and a method for controlling a sensor device. [Background technology]

[0002] Conventionally, there are known sensor devices capable of detecting non-contact operations. Examples of such sensor devices include infrared (IR) type detection devices that detect the presence or absence of an object based on the difference in the amount of reflected infrared light, and image processing devices that detect the gesture of an object by image recognition.

[0003] Patent document 1 also discloses a mobile computing device having a sensor system including an IR light emitting diode (LED) and an IR proximity sensor, and configured to acquire data related to a user's movements in three dimensions. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Special Publication No. 2013-534009 Summary of the Invention [Problem to be solved by the invention]

[0005] However, the above-mentioned IR detection device requires the detection unit to be in close contact with the display device, which is a structural constraint. In other words, when the display device is a digital signage or the like that is difficult for the user to reach, it is not user-friendly. In addition, the above-mentioned image processing device has problems such as high development costs and software costs, and a large load on the CPU.

[0006] One aspect of the present invention has been made in view of the above problems, and an object of the present invention is to realize a non-contact sensor device with a simple configuration and a light processing load. [Means for solving the problem]

[0007] In order to solve the above problems, a sensor device according to one embodiment of the present invention includes a gesture sensor unit that detects a gesture of an object within a detection range, an identification unit that identifies the gesture detected by the gesture sensor unit, an acquisition unit that acquires a gesture signal indicating the gesture identified by the identification unit and an area occupied by the object in the detection range, a generation unit that generates a corresponding output signal based on the gesture indicated by the gesture signal and the size of the area, and an output unit that outputs the output signal.

[0008] According to the above configuration, the sensor unit, which is a gesture sensor, can be configured to be separated from the display device, thereby reducing the constraints on the configuration. In addition, since the gesture sensor unit that detects gestures is used, high-load processing such as image processing is not required, and a non-contact sensor device can be realized at low cost with a low CPU load.

[0009] The sensor device can also switch output signals based on the area occupied by the object in the detection range. For example, if the palm of the hand is "confirm" and the fingertip is "cancel," the user can place the palm of the hand in the detection range to transmit an output signal indicating "confirm" to the external device based on the area occupied by the palm. The user can place the finger of the user in the detection range to transmit an output signal indicating "cancel" to the external device based on the area occupied by the fingertip. In this way, the sensor device can generate output signals by a method different from conventional methods.

[0010] In addition, when the detection range is divided into a first range that is close to the gesture sensor unit and a second range that is farther away than the first range, the generation unit may generate different output signals when the target object is in the first range and when the target object is in the second range, even for the same gesture.

[0011] According to the above configuration, the generation unit can generate different output signals when the object is in the first range and when it is in the second range, so that when the object is in the second range, an output signal based on a gesture is generated, and when the object is in the first range, even if it is the same gesture, an output signal based on the area occupied by the object rather than the gesture is generated.

[0012] The generation unit may not generate an output signal corresponding to a gesture signal acquired from the gesture sensor unit until a first predetermined time after the acquisition unit acquires the gesture signal.

[0013] According to the above configuration, it is possible to prevent generation of an output signal corresponding to a gesture unintended by the user, such as an action between one gesture and the next.

[0014] In addition, when the gesture is an action of approaching and moving away from the gesture sensor, the identification unit may identify the gesture using different thresholds, a start threshold for recognizing that the object is approaching the gesture sensor and an end threshold for recognizing that the object has moved away from the gesture sensor.

[0015] According to the above configuration, it is possible to prevent a chattering phenomenon in which the operation of identifying the area occupied by the object is repeatedly started and stopped.

[0016] Furthermore, the generation unit may not generate an output signal corresponding to a gesture signal acquired from the gesture sensor unit until a second predetermined time after the target object exceeds the end threshold and moves away from the gesture sensor.

[0017] According to the above configuration, it is possible to prevent an unintended action of the user after a gesture from being identified as a gesture and an output signal corresponding to the gesture from being generated.

[0018] In order to solve the above problems, a sensor system according to one embodiment of the present invention is a sensor system including the sensor device and an alarm device, wherein the sensor device has a transmitting unit that transmits an operation signal indicating a gesture movement detected by the gesture sensor unit to the alarm device, and the alarm device issues an alarm corresponding to the operation signal.

[0019] The notification device may include a plurality of LEDs, and may switch display modes of the plurality of LEDs in response to the operation signal.

[0020] According to the above configuration, the notification device can notify the user of the gesture identified by the identification unit.

[0021] Further, the sensor device is a sensor device having an interlock function, and is provided with a sub-sensor unit different from the gesture sensor unit, the sub-sensor unit being a gesture sensor or a touch sensor, and when the sub-sensor unit detects a predetermined gesture or touch operation by the object, the generation unit generates a corresponding output signal based on the gesture detected by the gesture sensor unit and the size of the area, and when the sub-sensor unit does not detect a predetermined touch operation or gesture by the object, the generation unit may not generate the output signal even if the gesture sensor unit detects a gesture.

[0022] According to the above configuration, the sensor device can have an interlock function using the two sensor units. That is, unintended detection of the gesture sensor unit can be prevented, and the safety of the user can be improved.

[0023] In order to solve the above problems, a sensor system according to one embodiment of the present invention is a sensor system including a sensor device and an external device that receives the output signal from the sensor device, wherein the sensor device has a plurality of the gesture sensor units, the external device generates a display image including a plurality of objects corresponding to each of the plurality of gesture sensor units, and the generation unit generates an output signal regarding the object corresponding to the gesture sensor unit that detected the target object among the plurality of gesture sensor units.

[0024] According to the above configuration, the sensor device can generate an output signal to an external device by using a plurality of gesture sensor units.

[0025] In order to solve the above problems, a control method of a sensor device according to one embodiment of the present invention includes a detection step of detecting a gesture of an object in a detection range, an identification step of identifying the gesture detected in the detection step, an acquisition step of acquiring a gesture signal indicating the gesture identified in the identification step and an area occupied by the object in the detection range, a generation step of generating a corresponding output signal based on the gesture indicated by the gesture signal and the size of the area, and an output step of outputting the output signal. Effect of the Invention

[0026] According to one aspect of the present invention, a non-contact sensor device with a simple configuration and a light processing load can be realized. [Brief description of the drawings]

[0027] [Figure 1] 1 is a block diagram showing a schematic configuration of a sensor system including a sensor device according to an embodiment of the present invention. [Diagram 2] FIG. 2 is a schematic diagram showing an example of an alarm device connected to the sensor device. [Diagram 3] 4 is a schematic diagram showing a detection range of a gesture sensor unit of the sensor device. FIG. [Figure 4] 1 is a schematic diagram showing a state in which a user's fingers and palm are in a first range. FIG. [Diagram 5] 5 is a flowchart showing a process performed by a control unit of the sensor device. [Figure 6] 4 is a schematic diagram showing a first predetermined time during which an output signal corresponding to a gesture signal is not generated. FIG. [Figure 7] 13 is a schematic diagram showing a second predetermined time during which an output signal corresponding to a gesture signal is not generated. FIG. [Figure 8] FIG. 13 is a block diagram showing a schematic configuration of a sensor system including a sensor device according to another embodiment of the present invention. [Figure 9] 10A to 10C are diagrams illustrating how the gesture sensor unit and the sub-sensor unit of the sensor device detect the right hand and the left hand of a user, respectively. [Figure 10] 10 is a diagram showing a correspondence relationship between a plurality of gesture sensor units of the sensor device and a plurality of objects displayed on a display unit of an external device. FIG. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0028] [Embodiment 1] (Configuration example of sensor device 1) Fig. 1 is a block diagram showing a schematic configuration of a sensor system 10 including a sensor device 1 according to an embodiment of the present invention. As shown in Fig. 1, the sensor device 1 includes a gesture sensor unit 11, a control unit 12, a storage unit 13, a transmission unit 14, and an output unit 15. The sensor device 1 transmits output signals to an external device 2 and an alarm device 3 connected to the outside via the output unit 15 and the transmission unit 14, respectively.

[0029] The gesture sensor unit 11 detects a gesture of the object 20 (e.g., a user's hand) in the detection range R (see FIG. 3). The gesture sensor unit 11 has an IR light source that irradiates IR light and an IR sensor that detects the IR light reflected by the object 20. The gesture sensor unit 11 can detect the coordinates of the object 20 relative to the gesture sensor unit 11, the area occupied by the object 20 (hereinafter referred to as the occupied area), and the gesture of the object 20 by using a known configuration of the IR light source and the IR sensor. The coordinates of the object 20 are coordinates (X, Y, and Z coordinates) on two axes (XY axes) on the sensor surface 11a (see FIG. 3) and an axis (Z axis) perpendicular to the sensor surface 11a, with the gesture sensor unit 11 as the origin. The occupied area of ​​the object 20 is a portion surrounded by the outer periphery of the object 20 in the detection range R in a planar view of the sensor surface 11a. The gesture of the target object 20 is a gesture that the gesture sensor unit 11 detects in response to a specific movement of the target object 20 within the detection range R. For example, when a user moves his / her hand from left to right within the detection range R, the gesture sensor unit 11 detects such a movement as a "right operation." Here, the gesture sensor unit 11 can automatically detect the start and end of the specific movement corresponding to the gesture.

[0030] The control unit 12 is a CPU (Central Processing Unit) of the sensor device 1, and controls each unit constituting the sensor device 1 in an integrated manner. The control unit 12 includes an identifying unit 121, an acquiring unit 122, and a generating unit 123.

[0031] The identification unit 121 acquires the coordinates and the occupied area of ​​the target object 20 from the gesture sensor unit 11 over time. Furthermore, when the gesture sensor unit 11 detects the end of an action indicating a gesture, the identification unit 121 acquires the gesture. The identification unit 121 identifies the occupied area and the gesture. The acquisition unit 122 acquires a gesture signal indicating the gesture identified by the identification unit 121 and the occupied area. The generation unit 123 generates a corresponding output signal based on the gesture indicated by the gesture signal and the size of the occupied area.

[0032] The storage unit 13 stores a correspondence table in which gestures of the target object 20 are associated with output signals to the external device 2. For example, the storage unit 13 stores a “right operation” gesture of moving the hand from left to right and a signal indicating right scrolling (input of the right arrow key) in association with each other.

[0033] The output unit 15 and the transmission unit 14 communicate with the transmission units included in the external device 2 and the notification device 3. The output unit 15 and the transmission unit 14 may communicate with the external device 2 and the notification device 3, respectively, via a wired communication path such as USB (Universal Serial Bus) or a wireless communication path such as Bluetooth (registered trademark).

[0034] The external device 2 is a PC (Personal Computer), an FA (Factory Automation) device, or the like. The external device 2 receives an output signal from the sensor device 1 and operates based on the output signal. The external device 2 may include a display unit (not shown), and the display unit may display a display image corresponding to a gesture identified by the control unit 12.

[0035] The notification device 3 is an LED display device having a plurality of LEDs 31 (see FIG. 2). The notification device 3 receives an operation signal indicating the gesture movement detected by the gesture sensor unit 11 from the sensor device 1, and performs a notification operation corresponding to the operation signal. With such a configuration, the notification device 3 can notify the user of the gesture identified by the identification unit 121. A specific configuration of the notification device 3 will be described later with reference to FIG. 2. Note that the notification device 3 is not limited to an LED display device, and may have a configuration capable of switching the notification operation in response to the operation signal. For example, the notification device 3 may be a speaker that outputs a sound corresponding to the operation signal. For example, when the notification device 3 receives an operation signal indicating "right operation" from the control unit 12, the notification device 3 outputs a beep sound corresponding to the operation signal, or outputs a voice saying "right". Alternatively, the notification device 3 may be a liquid crystal display that displays an animation corresponding to the operation signal. The notification device 3 may be configured integrally with the sensor device 1.

[0036] 2 is a schematic diagram showing an example of an alarm device 3 (LED display device) connected to the sensor device 1. As shown in FIG. 2, the alarm device 3 has a plurality of LEDs 31 on its display surface. The plurality of LEDs 31 includes a plurality of LEDs 31a arranged in a circle and a plurality of LEDs 31b arranged in a cross shape. The alarm device 3 switches the display mode of the plurality of LEDs 31 in response to an operation signal received from the sensor device 1.

[0037] For example, the notification device 3 lights up the LED 31b near the center (for example, blue) while not receiving an operation signal from the sensor device 1. When the notification device 3 receives an operation signal indicating a "right operation" from the sensor device 1, it sequentially lights up the multiple cross-shaped LEDs 31b (for example, blue) from the LED 31b near the center to the LED 31b at the right. When the notification device 3 receives an operation signal indicating a "right rotation operation" from the sensor device 1, it sequentially lights up the multiple circular LEDs 31a (for example, blue) from the LED 31a at the top to the LED 31a at the right. When the notification device 3 receives an operation signal indicating a "palm approach" from the sensor device 1, it switches the light emission color of the LED 31b near the center from blue to red, or switches the lighting state to a blinking state. With this configuration, the user can visually check whether the identification unit 121 has correctly identified the gesture by checking the display state of the multiple LEDs 31 corresponding to the gesture input by the user. Note that such a display state may be implemented on the display unit of the external device 2. Further, the configuration of the notification device 3 (the arrangement of the plurality of LEDs 31) is not limited to the above-mentioned configuration, and may be any configuration that can switch the display mode of the plurality of LEDs 31 in response to an operation signal.

[0038] FIG. 3 is a schematic diagram showing a detection range R of the gesture sensor unit 11 of the sensor device 1. As shown in FIG. 3, the detection range R of the gesture sensor unit 11 includes a first range R1 that is close to the gesture sensor unit 11 and a second range R2 that is farther away than the first range. In the example shown in FIG. 3, the first range R1 is a range surrounded by boundary surfaces B1 and B2 that are respectively distanced by distances L1 and L2 (L2>L1) from a plane including the sensor surface 11a in the detection range R. The second range R2 is a range surrounded by boundary surfaces B2 and B3 that are respectively distanced by distances L2 and L3 (L3>L2) from a plane including the sensor surface 11a in the detection range R. For example, the distances L2 and L3 are about 2 cm and about 10 cm, respectively.

[0039] The generating unit 123 generates different output signals when the target object 20 is in the first range R1 and when it is in the second range R2, even for the same gesture. Note that "the target object 20 is in the first range R1" refers to a state in which at least a part of the target object 20 is in the first range R1. Also, "the target object 20 is in the second range R2" refers to a state in which at least a part of the target object 20 is in the second range R2, and no target object 20 is in the first range R1.

[0040] Specifically, the identification unit 121 identifies the occupied area when the target 20 is in the first range R1. Also, the identification unit 121 identifies the gesture when the target 20 is in the second range R2. In detail, the identification unit 121 identifies the occupied area when the target 20 remains in the first range R1 for a predetermined time (for example, about 0.8 seconds) after the target 20 enters the first range R1. In the example shown in FIG. 3, the identification unit 121 identifies the target 20 as being in the first range R1 when the distance from the gesture sensor unit 11 to the target 20 (Z coordinate of the target 20) falls within the range from L1 to L2. As a result, the generation unit 123 can generate an output signal based on the gesture when the target 20 is in the second range R2, and generate an output signal based on the occupied area of ​​the target 20 instead of the gesture when the target 20 is in the first range R1, even if the gesture is the same.

[0041] The identification unit 121 does not identify a gesture when the target object 20 is in the first range R1. With this configuration, it is possible to prevent the generation unit 123 from generating an output signal based on an occupied area and an output signal based on a gesture in a redundant manner when the target object 20 is in the first range R1.

[0042] In addition, when the gesture is an action of approaching and leaving the gesture sensor unit 11, the identification unit 121 may identify the gesture using different thresholds for the start threshold and the end threshold. Here, the start threshold is a threshold at which the identification unit 121 recognizes that the target object 20 has entered the first range R1 and is approaching the gesture sensor unit 11. The end threshold is a threshold at which the identification unit 121 recognizes that the target object 20 has left the gesture sensor unit 11. With this configuration, it is possible to prevent a chattering phenomenon in which the identification unit 121 repeatedly starts and ends the action of identifying the occupied area. In the example shown in FIG. 3, the start threshold is the boundary surface B2, and the end threshold is the boundary surface B3.

[0043] FIG. 4 is a schematic diagram showing a state in which the user's fingers and palm are in the first range R1. Reference numerals 4A and 4B in FIG. 4 respectively indicate states in which the user's fingers and palm are in the first range R1. When the size of the occupied area of ​​the object 20 is larger than a predetermined threshold, the generating unit 123 generates an output signal corresponding to "approaching the palm". When the size of the occupied area of ​​the object 20 is smaller than a predetermined threshold, the generating unit 123 generates an output signal corresponding to "approaching the finger". With this configuration, the generating unit 123 can switch the output signal to the external device 2 based on the size of the occupied area of ​​the object 20 in the first range R1.

[0044] In addition, FIG. 4 shows a method of generating two types of output signals corresponding to "approach of a finger" and "approach of a palm" using one threshold, but the present invention is not limited to this. For example, the generation unit 123 may generate three or more types of output signals using two or more thresholds. In addition, the predetermined threshold for the size of the occupied area of ​​the target object 20 may be set by the user. In this way, the generation unit 123 can switch the output signal using a predetermined threshold according to the size of the finger and palm of each user.

[0045] Here, in the range R0 within the detection range R, which is less than the distance L1 from the gesture sensor unit 11 (the range closer to the gesture sensor unit 11 than the first range R1), the difference between the size of the occupied area corresponding to the palm and the size of the occupied area corresponding to the fingertip is small. Therefore, the generation unit 123 may generate an output signal unintended by the user. For example, even if the user brings the palm closer, the generation unit 123 may determine that the size of the occupied area is smaller than a predetermined threshold and generate an output signal corresponding to "approach of the finger". Therefore, when the object 20 is in the range R0, the identification unit 121 does not identify the occupied area. This can suppress the possibility that the generation unit 123 generates an erroneous output signal unintended by the user. In addition, when the object 20 enters the range R0 without passing through the first range R1 (for example, when entering the range R0 from the side), the generation unit 123 does not generate an output signal corresponding to the occupied area or gesture of the object 20 in the range R0.

[0046] (Operation example of sensor device 1) Fig. 5 is a flowchart showing the processing of the control unit 12 of the sensor device 1. The processing of the control unit 12 identifying a gesture and an occupied area and generating an output signal corresponding to the gesture and the occupied area will be described below with reference to Fig. 5.

[0047] As shown in Fig. 5, first, the identification unit 121 determines whether or not the object 20 has entered the first range R1 based on the coordinates of the object 20 acquired from the gesture sensor unit 11 (S1). When it is determined that the object 20 has entered the first range R1 (YES in S1), the identification unit 121 identifies the occupied area (identification step, S2). When it is not determined that the object 20 has entered the first range R1 (NO in S1), the process proceeds to S6, which will be described later. Note that the identification unit 121 may determine that the object 20 has entered the first range R1 when the object 20 has entered the first range R1 and remained in the first range R1 for a predetermined time (for example, about 0.8 seconds).

[0048] Next, the acquisition unit 122 acquires the occupied area from the identification unit 121 (acquisition step). Furthermore, the acquisition unit 122 acquires from the storage unit 13 a correspondence table in which the size of the occupied area corresponds to an output signal to the external device 2. The generation unit 123 generates an output signal corresponding to the size of the occupied area based on the correspondence table (generation step, S3). The output unit 15 outputs the output signal to the external device 2. Note that the generation unit 123 may generate an operation signal corresponding to the size of the occupied area. The transmission unit 14 may transmit the operation signal to the alarm device 3.

[0049] Next, the identification unit 121 determines whether or not the target 20 has exceeded the end threshold based on the coordinates of the target 20 acquired from the gesture sensor unit 11 (S4). If it is determined that the target 20 has exceeded the end threshold (YES in S4), the control unit 12 proceeds to S5, which will be described later. If it is not determined that the target 20 has exceeded the end threshold (NO in S4), the control unit 12 waits without identifying the gesture and the occupied area.

[0050] The generation unit 123 does not generate an output signal corresponding to the gesture signal acquired from the gesture sensor unit 11 until a second predetermined time t2 after the target object 20 exceeds the end threshold and moves away from the gesture sensor unit 11 (S5). The second predetermined time t2 will be described later with reference to FIG.

[0051] In S1, if it is not determined that the target object 20 has entered the first range R1 (NO in S1), the process proceeds to S6. If a gesture signal is acquired from the gesture sensor unit 11 (YES in S6), the identification unit 121 identifies the gesture (identification step, S7). If a gesture signal is not acquired from the gesture sensor unit 11 (NO in S6), the control unit 12 ends the process.

[0052] Next, the acquisition unit 122 acquires the gesture from the identification unit 121 (acquisition step). Furthermore, the acquisition unit 122 acquires a correspondence table in which the gesture is associated with an output signal to the external device 2 from the storage unit 13. The generation unit 123 generates an output signal corresponding to the gesture based on the correspondence table (generation step, S8). The output unit 15 outputs the output signal to the external device 2. The generation unit 123 may generate an operation signal corresponding to the gesture. The transmission unit 14 may transmit the operation signal to the notification device 3.

[0053] The generation unit 123 does not generate an output signal corresponding to the gesture signal acquired from the gesture sensor unit 11 until a first predetermined time t1 has elapsed since the acquisition unit 122 acquired the gesture signal (S9). The first predetermined time t1 will be described later with reference to FIG. 6.

[0054] As described above, the sensor device 1 can switch the output signal to the external device based on the area occupied by the object 20 in the first range R. For example, if the palm of the hand is "confirm" and the fingertip is "cancel," the user can transmit an output signal indicating "confirm" to the external device 2 based on the area occupied by the palm by placing the palm in the first range R. Also, the user can transmit an output signal indicating "cancel" to the external device 2 based on the area occupied by the fingertip by placing a finger in the first range R. In this way, the sensor device 1 can generate an output signal to the external device 2 by a method different from the conventional method.

[0055] FIG. 6 is a schematic diagram showing a first predetermined time t1 during which an output signal corresponding to a gesture signal is not generated. As shown in FIG. 6, when a user performs a motion indicating a "right operation" in succession, in the second range R2, the hand that has moved from left to right is once moved to the left, and then moved from left to right again. At this time, even though the user intends to perform a motion indicating a "right operation" twice in succession, the gesture sensor unit 11 may detect the gestures in the order of "right operation," "left operation," and "right operation." If the generation unit 123 generates output signals corresponding to these gesture signals, it will generate an output signal corresponding to a "left operation" that is not intended by the user.

[0056] Therefore, the generation unit 123 does not generate an output signal corresponding to a gesture signal acquired from the gesture sensor unit 11 within a first predetermined time t1 after the acquisition unit 122 acquires a gesture signal. In the example shown in Fig. 6, the generation unit 123 does not generate an output signal corresponding to a gesture signal indicating a "left operation" acquired from the gesture sensor unit 11 within a first predetermined time t1 after the acquisition unit 122 acquires a first gesture indicating a "right operation". This allows the sensor device 1 to prevent the generation of an output signal corresponding to a gesture unintended by the user, such as an operation between a certain gesture and the next gesture.

[0057] The notification device 3 may perform a notification action corresponding to the operation signal from the sensor device 1 until the end of the first predetermined time t1 after receiving the operation signal from the sensor device 1. This allows the user to be notified of the first predetermined time t1 during which no gesture signal is acquired. In the example shown in Fig. 6, the user may move his / her hand, which has been moved from left to right, to the left once during the notification action of the notification device 3.

[0058] FIG. 7 is a schematic diagram showing a second predetermined time t2 during which an output signal corresponding to a gesture signal is not generated. As shown in FIG. 7, when a user performs an action indicating "approaching of the palm", the user may move the hand from left to right so as to move from the left of the first range R1 through the first range R1 to the right of the first range R1. At this time, the gesture sensor unit 11 detects a gesture indicating a "right operation" of the target 20 in the first range R1. Here, the sensor device 1 requires a processing time from when the gesture sensor unit 11 detects the end of the action of the target 20 until the acquisition unit 122 acquires a gesture signal. Therefore, the acquisition unit 122 acquires a gesture signal indicating a "right operation" after recognizing that the target 20 has exceeded the end threshold and moved away from the gesture sensor unit 11. If the generation unit 123 generates an output signal corresponding to a gesture signal indicating a "right operation", the generation unit 123 will generate an output signal that is not intended by the user.

[0059] Therefore, the acquisition unit 122 does not generate an output signal corresponding to a gesture signal acquired from the gesture sensor unit 11 until the second predetermined time t2 after the target object 20 exceeds the end threshold and moves away from the gesture sensor unit 11. In the example shown in Fig. 7, the generation unit 123 does not acquire a gesture indicating a "right operation" acquired from the gesture sensor unit 11 until the second predetermined time t2 after the target object 20 exceeds the end threshold and moves away from the gesture sensor unit 11. This makes it possible to prevent the sensor device 1 from identifying an unintended action of the user after the gesture as a gesture and generating an output signal corresponding to the gesture.

[0060] [Embodiment 2] Other embodiments of the present invention will be described below. For ease of explanation, the same reference numerals are given to members having the same functions as those described in the above embodiment, and the description thereof will not be repeated.

[0061] 8 is a block diagram showing a schematic configuration of a sensor system 110 including a sensor device 100 according to another embodiment of the present invention. The sensor device 100 differs from the sensor device 1 in that a sub-sensor unit 101 is provided.

[0062] The sub-sensor unit 101 is a gesture sensor that detects a gesture of the target object 20, or a touch sensor that detects a touch operation of the target object 20. The sub-sensor unit 101 may be controlled in synchronization with the gesture sensor unit 11 by a known technique in order to avoid mutual interference with the gesture sensor unit 11.

[0063] When the sub-sensor unit 101 detects a predetermined gesture or touch operation by the target 20, the generation unit 123 generates a corresponding output signal based on the gesture detected by the gesture sensor unit 11 and the size of the occupied area. On the other hand, when the sub-sensor unit 101 does not detect a predetermined gesture or touch operation by the target 20, the generation unit 123 does not generate an output signal even if the gesture sensor unit 11 detects a gesture. With this configuration, the sensor device 100 can have an interlock function using two sensor units. That is, unintended detection by the gesture sensor unit 11 can be prevented.

[0064] FIG. 9 is a diagram showing how the gesture sensor unit 11 and the sub-sensor unit 101 of the sensor device 100 detect the right hand and the left hand of the user, respectively. In the example shown in FIG. 9, the sub-sensor unit 101 is a gesture sensor. As shown in FIG. 9, the user moves the right hand within the detection range of the gesture sensor unit 11 while placing the left hand within the detection range of the sub-sensor unit 101, so that the generation unit 123 can generate an output signal to the external device 2. In addition, if the user does not place the left hand within the detection range of the sub-sensor unit 101, even if the user moves the right hand within the detection range of the gesture sensor unit 11, the generation unit 123 does not generate an output signal to the external device 2. That is, the generation unit 123 generates a corresponding output signal based on the gesture detected by the gesture sensor unit 11 and the size of the occupied area only when the user places the left hand within the detection range of the sub-sensor unit 101. According to such a configuration, unless the user intentionally places his / her left hand within the detection range of the sub sensor unit 101 (unless the user uses both hands), an output signal based on the movement of the user's right hand is not generated to the external device 2. Therefore, the sensor device 100 can provide an interlock function using two sensor units.

[0065] [Embodiment 3] Other embodiments of the present invention will be described below. For ease of explanation, the same reference numerals are given to members having the same functions as those described in the above embodiment, and the description thereof will not be repeated.

[0066] FIG. 10 is a diagram showing a correspondence relationship between a plurality of gesture sensor units 11A to 11E and a plurality of objects (buttons) 211A to 211E displayed by the display unit 21 of the external device 2. FIG. 10 shows an example of a display image 22 generated by the display unit 21. As shown in FIG. 10, the sensor device 1 may include a plurality of gesture sensor units 11A to 11E. The external device 2 may generate a display image 22 including a plurality of objects 211A to 211E corresponding to the plurality of gesture sensor units 11A to 11E, respectively. Here, the generation unit 123 generates an output signal related to the object 211C corresponding to the gesture sensor unit 11C that detected the target object 20 among the plurality of gesture sensor units 11A to 11E. When the external device 2 receives the output signal, the external device 2 may perform a process corresponding to the output signal and may also generate a new display image 22. With this configuration, the sensor device 1 can generate an output signal to the external device 2 using the multiple gesture sensor units 11A to 11E.

[0067] For example, when the gesture sensor unit 11C detects a gesture of the target 20 in the second range R2, the generation unit 123 generates an output signal for selecting the object 211C. When the external device 2 receives the output signal, the generation unit 123 generates a display image 22 for emphasizing the object 211C. When the gesture sensor unit 11C detects a gesture of the target 20 in the first range R1, the generation unit 123 generates an output signal for determining the pressing of the object 211C. When the external device 2 receives the output signal, the generation unit 123 performs a process corresponding to the determination of the object 211C, and generates a display image 22 indicating that the object 211C has been determined. With this configuration, the user can determine the pressing of the object 211C after confirming that the object 211C has been selected.

[0068] [Software implementation example] The functions of the sensor device 1 (hereinafter referred to as the "device") can be realized by a program for causing a computer to function as the device, and a program for causing a computer to function as each control block of the device (particularly each part included in the control unit 12 and the external device 2).

[0069] In this case, the device includes a computer having at least one control device (e.g., a processor) and at least one storage device (e.g., a memory) as hardware for executing the program. The control device and storage device execute the program to realize each function described in each of the above embodiments.

[0070] The program may be non-transitory and may be recorded in one or more computer-readable recording media. The recording media may or may not be included in the device. In the latter case, the program may be provided to the device via any wired or wireless transmission medium.

[0071] In addition, some or all of the functions of each of the control blocks can be realized by a logic circuit. For example, an integrated circuit in which a logic circuit that functions as each of the control blocks is formed is also included in the scope of the present invention. In addition, the functions of each of the control blocks can be realized by, for example, a quantum computer.

[0072] Furthermore, each process described in each of the above embodiments may be executed by AI (Artificial Intelligence). In this case, the AI ​​may be executed by the control device or another device (for example, an edge computer or a cloud server).

[0073] The present invention is not limited to the above-described embodiments, and various modifications are possible within the scope of the claims. Embodiments obtained by appropriately combining the technical means disclosed in different embodiments are also included in the technical scope of the present invention. [Explanation of symbols]

[0074] 1, 100 Sensor device 2 External device 3. Notification device 10, 110 Sensor System 11 Gesture sensor unit 11A~11E Gesture sensor section 12 Control section 121 Specific section 122 Acquisition Department 123 Generation part 14 Transmitter 15 Output section 20 Object 31 LED 101 Sub-sensor part 211A~211E Objects R Detection range R1 1st range R2 Second range t1 First specified time t2 Second specified time

Claims

1. A gesture sensor unit that detects a gesture of an object in a detection range including a first range and a second range; an identification unit that identifies the gesture detected by the gesture sensor unit as a specific gesture; an acquisition unit that acquires a gesture signal indicating the specific gesture identified by the identification unit and an area occupied by the target object in the first range; a generator that generates an output signal corresponding to a size of the area when the object is in the first range, and generates an output signal corresponding to the specific gesture indicated by the gesture signal when the object is in the second range; and an output section that outputs the output signal.

2. A sensor device as described in claim 1, wherein the first range is a range close to the gesture sensor unit, and the second range is a range farther from the gesture sensor unit than the first range.

3. A sensor device as described in claim 1 or 2, wherein when the target object is within the second range, the generation unit does not generate an output signal corresponding to the gesture signal acquired from the gesture sensor unit within a first predetermined time after the acquisition unit acquires the gesture signal.

4. When the gesture is an action of approaching and moving away from the gesture sensor unit, The sensor device according to any one of claims 1 to 3, wherein the identification unit identifies the gesture using different thresholds: a start threshold for recognizing that the object is approaching the gesture sensor unit, and an end threshold for recognizing that the object has moved away from the gesture sensor unit.

5. The sensor device according to claim 4 , wherein the generation unit does not generate an output signal corresponding to the gesture signal acquired from the gesture sensor unit until a second predetermined time after the object has moved away from the gesture sensor unit beyond the end threshold.

6. A sensor system including the sensor device according to any one of claims 1 to 5 and an alarm device, the sensor device includes a transmission unit configured to transmit to the notification device an operation signal indicating a gesture movement detected by the gesture sensor unit; The notification device issues a notification corresponding to the operation signal.

7. The notification device includes a plurality of LEDs, The sensor system according to claim 6 , wherein a display mode of the plurality of LEDs is switched in response to the operation signal.

8. A sensor device having an interlock function, A sub-sensor unit different from the gesture sensor unit is provided, the sub-sensor unit is a gesture sensor or a touch sensor, The generation unit is When the sub-sensor unit detects a predetermined gesture or touch operation by the object, a corresponding output signal is generated based on the gesture detected by the gesture sensor unit and the size of the area; The sensor device according to any one of claims 1 to 5, wherein when the sub-sensor unit does not detect a predetermined touch operation or gesture by the object, the output signal is not generated even if the gesture sensor unit detects a gesture.

9. A sensor system including the sensor device according to any one of claims 1 to 5 and an external device that receives the output signal from the sensor device, The sensor device includes a plurality of the gesture sensor units, the external device generates a display image including a plurality of objects corresponding to the plurality of gesture sensor units, The generation unit generates an output signal related to the object corresponding to the gesture sensor unit that detects the target object among the plurality of gesture sensor units.

10. A detection step of detecting a gesture of an object in a detection range including a first range and a second range; a step of identifying the gesture detected in the step of detecting as a specific gesture; an acquiring step of acquiring a gesture signal indicating the specific gesture identified in the identifying step and an area occupied by the target object in the first range; generating an output signal corresponding to the size of the area when the object is in the first range, and generating an output signal corresponding to the specific gesture indicated by the gesture signal when the object is in the second range; and an output step of outputting the output signal.

Citation Information

Patent Citations

  • Command input device

    JP2005047327A

  • Non-contact information input device

    JP2005050177A

  • Program, information storage medium, and image generation system

    JP2011215921A

  • Display unit controlled by motion and motion control method for the same

    JP2012146303A

  • Method and apparatus for contactless gesture recognition and power reduction

    JP2013534009A