A photoelectric sensor for gesture recognition
Through cross-arrangement of the receiver tube array and timing signal control, the problem of large volume and low recognition rate of the photoelectric sensor is solved, and higher recognition accuracy and efficiency are achieved.
Patent Information
- Application Number
- CN202210139242.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-02-15
- Publication Date
- 2024-11-22
- Estimated Expiration
- 2042-02-15
AI Technical Summary
In gesture recognition, the existing photoelectric sensors have large scale in the receiving tube array, resulting in large area of the sensing area and inability to reduce the volume, and the identification algorithm is complex and the recognition rate is not high.
The receiving tube array is adopted with a cross-arranged receiving tube array, and the receiving tube array is controlled to select the receiving tubes in a specific direction in sequence to generate output signals, which simplifies the gesture recognition algorithm and improves the recognition accuracy.
A smaller sensing area and volume is achieved, the recognition algorithm is simplified, and the accuracy and efficiency of gesture recognition are improved.
Smart Images

Figure CN114596628B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of photoelectric sensors, and in particular to a photoelectric sensor for gesture recognition. Background Art
[0002] Photoelectric sensor is a device that converts light signals into electrical signals based on the photoelectric effect. Based on its physical properties, photoelectric sensors are widely used in various position measurement applications in automation equipment, the Internet of Things, and smart homes. Gesture recognition refers to the technology of collecting signals through corresponding sensor devices and processing the signals through relevant algorithms to identify the user's gestures. Depending on the type of sensor selected, gesture recognition solutions can be divided into gesture recognition technology that relies on image sensors, gesture recognition technology based on infrared images, gesture recognition technology based on infrared signals, etc.
[0003] In the prior art, there are already technical solutions for gesture recognition based on photoelectric sensors. For example, in the products of a certain automobile manufacturer, gesture recognition is achieved by projecting infrared light and collecting the reflected light of the hand. Since the photoelectric sensor itself does not directly collect the user's optical image, it can better protect the user's privacy and is therefore widely used.
[0004] However, in the actual implementation process, the inventors found that the photoelectric sensors in the prior art often need to rely on a receiving tube array composed of a large number of receiving tubes to collect reflected light, which results in a large sensing area of the sensor as a whole, making it impossible to reduce the volume of the photoelectric sensor and failing to meet the needs of users. At the same time, due to the large scale of the receiving tube array in the prior art, it is necessary to process the signals output by a large number of receiving tubes to obtain the actual situation of the reflected light, which results in the overall complexity of the recognition algorithm in the prior art and a low recognition rate. Summary of the invention
[0005] In view of the above problems existing in the prior art, a photoelectric sensor for gesture recognition is now provided.
[0006] The specific technical solutions are as follows:
[0007] A photoelectric sensor for gesture recognition, comprising:
[0008] A receiving tube array, wherein a plurality of receiving tubes are arranged in a cross shape;
[0009] A sensor circuit, the sensor circuit is connected to the receiving tube array;
[0010] The sensor circuit includes a timing unit, and the timing unit sends a timing signal to the receiving tube array;
[0011] The receiving tube array selects the receiving tubes in turn along the horizontal direction and the vertical direction under the control of the timing signal, and inputs the photoelectric signal corresponding to the receiving tube into the sensor circuit, and the sensor circuit generates an output signal according to the photoelectric signal;
[0012] A processing module is connected to the sensor circuit, and the processing module recognizes gestures according to the output signal.
[0013] Preferably, the sensor circuit includes a timing unit, and the timing unit is connected to the receiving tube array;
[0014] The timing unit sends a timing signal to the receiving tube array, and the receiving tube array enables the photoelectric signal of a specific receiving tube to be input into the sensor circuit according to the timing signal.
[0015] Preferably, the sensor circuit comprises:
[0016] A switched capacitor amplifier, the input end of which is connected to the output end of the receiving tube array;
[0017] A sampling and integrating unit, wherein the input end of the sampling and integrating unit is connected to the output end of the switched capacitor amplifier;
[0018] A signal processing unit, wherein the input end of the signal processing unit is connected to the output end of the sampling integration unit.
[0019] Preferably, the sensor circuit is also connected to at least one transmitting tube;
[0020] The transmitting tube and the receiving tube array are arranged on the same side and point to the same direction.
[0021] Preferably, the receiving tube array comprises:
[0022] A plurality of first receiving tubes, wherein the first receiving tubes are arranged in sequence along a horizontal direction;
[0023] A plurality of second receiving tubes, wherein the second receiving tubes are arranged in sequence along a vertical direction;
[0024] a third receiving tube, the third receiving tube being located at the center of the cross, the first receiving tube, the second receiving tube and the third receiving tube forming the cross;
[0025] The third receiving tube includes four sub-receiving tubes arranged in a rectangular shape;
[0026] The sub-receiving tubes, under the control of the timing signal, form two first receiving tubes arranged along the horizontal direction;
[0027] Alternatively, the sub-receiving tube forms two second receiving tubes arranged along the vertical direction under the control of the timing signal.
[0028] Preferably, under the control of the timing signal, the receiving tube array enables the photoelectric signals generated by the first receiving tubes to be sequentially input into the sensor circuit along a first direction;
[0029] And, the photoelectric signal generated by the second receiving tube is sequentially input into the sensor circuit along the second direction.
[0030] Preferably, the receiving tube array inputs the photoelectric signal of the first receiving tube to the sensor circuit through a first port, and the receiving tube array inputs the photoelectric signal of the second receiving tube to the sensor circuit through a second port;
[0031] The timing unit sends a first timing signal and a second timing signal to the receiving tube array, so that the receiving tube array simultaneously inputs the photoelectric signal of the first receiving tube and the photoelectric signal of the second receiving tube to the sensor circuit;
[0032] There is a preset phase difference between the first timing signal and the second timing signal, so that the third receiving tube forms the first receiving tube and the second receiving tube in sequence under the control of the first timing signal and the second timing signal.
[0033] Preferably, the processing module obtains the light intensity of each receiving tube in the receiving tube array according to the processing signal;
[0034] The processing module recognizes the gesture according to the change trend of the light intensity.
[0035] Preferably, when the light intensity of the first receiving tube increases in sequence along the horizontal direction, and the light intensity of a plurality of the second receiving tubes reaches a first peak value at the same time, it indicates that the gesture is a horizontal movement;
[0036] Furthermore, when the light intensity of the second receiving tube increases sequentially along the vertical direction, and the light intensity of a plurality of the first receiving tubes reaches a second peak value at the same time, it indicates that the gesture is a vertical movement.
[0037] Preferably, when the light intensity of the first receiving tube and the light intensity of the second receiving tube increase at the same time, it indicates that the gesture is close to the photoelectric sensor;
[0038] Furthermore, when the light intensity of the first receiving tube and the light intensity of the second receiving tube decrease simultaneously, it indicates that the gesture is away from the photoelectric sensor.
[0039] The above technical solution has the following advantages or beneficial effects: by setting up a receiving tube array arranged in a cross shape, the receiving area of the receiving tube array is reduced while realizing effective recognition of gestures, and the volume of the sensor is reduced; at the same time, the receiving tube array is controlled by a timing signal to sequentially select receiving tubes in a specific direction on the cross to generate output signals, so that the overall output signal sequence is associated with the actual light spot projection situation, the gesture recognition algorithm is simplified, and higher accuracy is achieved. BRIEF DESCRIPTION OF THE DRAWINGS
[0040] The embodiments of the present invention will be described more fully with reference to the attached drawings, which are provided for illustration and description only and are not intended to limit the scope of the present invention.
[0041] Figure 1 It is an overall schematic diagram of an embodiment of the present invention;
[0042] Figure 2 A schematic diagram of a sensor circuit in an embodiment of the present invention;
[0043] Figure 3 This is a schematic diagram of a transmitting tube in an embodiment of the present invention;
[0044] Figure 4 A schematic diagram of a photoelectric sensor in one embodiment of the present invention;
[0045] Figure 5 Schematic diagram of a receiving tube array in an embodiment of the present invention;
[0046] Figure 6 This is a schematic diagram of a third receiving tube in an embodiment of the present invention;
[0047] Figure 7 A schematic diagram of the change of the output signal amplitude in an embodiment of the present invention;
[0048] Figure 8 A schematic diagram of the change of the output signal amplitude in another embodiment of the present invention;
[0049] Fig. 9 Schematic diagram of output signal amplitude corresponding to each quadrant in an embodiment of the present invention;
[0050] Fig.10 A schematic diagram of the change of the output signal amplitude in an embodiment of the present invention; DETAILED DESCRIPTION
[0051] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.
[0052] It should be noted that, in the absence of conflict, the embodiments of the present invention and the features in the embodiments may be combined with each other.
[0053] The present invention will be further described below in conjunction with the accompanying drawings and specific embodiments, but they are not intended to limit the present invention.
[0054] The present invention comprises:
[0055] A photoelectric sensor for gesture recognition, such as Figure 1 As shown, including:
[0056] A receiving tube array 1, wherein a plurality of receiving tubes 2 are arranged in a cross shape;
[0057] The sensor circuit 3 is connected to the receiving tube array 1;
[0058] The sensor circuit 3 includes a timing unit 31, which sends a timing signal to the receiving tube array 1;
[0059] The receiving tube array 1 selects the receiving tube 2 in turn along the horizontal direction and the vertical direction under the control of the timing signal, and inputs the photoelectric signal corresponding to the receiving tube 2 into the sensor circuit 3, and the sensor circuit 3 generates an output signal according to the photoelectric signal;
[0060] The processing module 4 is connected to the sensor circuit 3, and the processing module 4 recognizes the gesture according to the output signal.
[0061] Specifically, in order to address the problem in the prior art that the photoelectric sensor has a large sensing area and a large number of receiving tubes, which results in a large overall volume of the photoelectric sensor, in this embodiment, a cross-shaped receiving tube array 1 is provided to effectively recognize gestures while reducing the number of receiving tubes 2, thereby achieving a smaller sensing area, thereby reducing the overall size and circuit scale of the photoelectric sensor, and achieving a smaller photoelectric sensor.
[0062] Furthermore, in view of the problem that the receiving tube array of the photoelectric sensor in the prior art is large and the number of receiving tubes is large, which leads to the recognition algorithm needing to process a large number of signals, making the recognition algorithm relatively complex and requiring a high-performance processing device, in this embodiment, a cross-shaped receiving tube array 1 is set to obtain the central part of the reflected light spot, and the receiving tube array 1 is controlled by a timing unit, and the receiving tubes 2 are selected in sequence along a specific direction to input the photoelectric signal into the sensor circuit 3, so that the processing module 4 can finally obtain the light intensity distribution in the X-axis direction and the Y-axis direction in a single cycle, that is, the distribution of the light spot on the X-axis and the Y-axis, and then realize the effective recognition of the gesture through a relatively simplified algorithm. While realizing the effective recognition of the gesture, the number of signals and processing steps that need to be processed are reduced, so that the recognition algorithm is simplified, thereby improving the processing efficiency, and the performance and power consumption requirements of the processing module 4 are relatively low, so that the overall volume of the photoelectric sensor is further reduced.
[0063] During the implementation process, the receiving tube array 1 includes a switch matrix, which includes a plurality of controllable switches, each of which is connected to a receiving tube, and is turned on and off in sequence under the drive of the control signal, and then the photoelectric signal is input into the sensor circuit 3 in sequence. The control signal can be generated by a register unit 6, in which the corresponding control parameters are solidified, and a control signal is generated according to the control parameters to control the opening and closing of the controllable switch. Alternatively, the control signal is a timing signal, and the switch matrix controls each controllable switch to be turned on or off in sequence according to the timing signal. The sensor circuit 3 mainly includes a signal processing circuit, which is used to amplify, phase-lock, demodulate and calculate the received light intensity, and then generate an output signal for characterizing the received light intensity. The sensor circuit 3 is connected to the processing module 4 through the corresponding communication port. The processing module 4 can be understood as one or more application-specific integrated circuits (ASICs), DSPs, programmable logic devices (PLDs), complex programmable logic devices (CPLDs), field programmable gate arrays (FPGAs), general-purpose processors, controllers, microcontrollers (MCUs), microprocessors, or other electronic components, and is provided with a corresponding computer program for identifying the user's operation gestures according to the output signal. In one embodiment, the processing module 4 also has a communication port connected to an external controlled device to output corresponding operation instructions, thereby achieving control of the controlled device. In another embodiment, the processing module 4 can also be connected to the switch tube through a corresponding control circuit to perform switch quantity control according to the recognition result.
[0064] In a preferred embodiment, Figure 2 As shown, the sensor circuit 3 includes a timing unit 31, and the timing unit 31 is connected to the receiving tube array 1;
[0065] The timing unit 31 sends a timing signal to the receiving tube array 1 , and the receiving tube array enables the photoelectric signal of a specific receiving tube to be input into the sensor circuit 3 according to the timing signal.
[0066] Specifically, in view of the problem that the photoelectric sensor used for gesture recognition in the prior art is relatively large in size, in this embodiment, a timing signal is sent to the receiving tube array 1 through the timing unit 31, so that the receiving tube array 1 selects specific receiving tubes 2 to be connected to the sensor circuit 3 in turn according to the timing signal, and then the photoelectric signal of each receiving tube 2 is input into the sensor circuit 3 in turn, thereby achieving the reception of the photoelectric signal of each receiving tube 2 while reducing the scale of the circuit used to connect the receiving tube 1, so that the size of the sensor can be reduced.
[0067] During the implementation, each receiving tube 2 is provided with a corresponding serial number. For example, in one embodiment, the receiving tube 2 is divided into an X-axis receiving tube and a Y-axis receiving tube according to its position in the cross; wherein the X-axis receiving tubes are sequentially arranged as DX1 to DXN along the positive direction of the X-axis; and the Y-axis receiving tubes are sequentially arranged as DY1 to DYN receiving tubes along the negative direction of the Y-axis. The timing unit 31 outputs a corresponding timing signal so that the controllable switches in the receiving tube array 11 are sequentially turned on in a specific order, such as the horizontal axis direction or the vertical axis direction of the receiving tube array 1, so that the sensor circuit 3 processes the photoelectric signal output by each receiving tube 2 in sequence, thereby realizing the measurement of the light intensity of each receiving tube 2 one by one. For example, in one embodiment, the receiving tubes 2 are first connected one by one along the positive direction of the X-axis, and then the receiving tubes 2 are connected one by one along the negative direction of the Y-axis, so as to realize the measurement of the light intensity of each receiving tube 2. When the last receiving tube 2 of the Y-axis is reached, it returns to the first receiving tube 2 of the X-axis to realize the process of cyclic detection.
[0068] In a preferred embodiment, Figure 2 As shown, the sensor circuit 3 also includes:
[0069] A switched capacitor amplifier 32, the input end of the switched capacitor amplifier 32 is connected to the output end of the receiving tube array 1;
[0070] A sampling and integrating unit 33, wherein an input end of the sampling and integrating unit 33 is connected to an output end of the switched capacitor amplifier 32;
[0071] The signal processing unit 34 has an input end connected to the output end of the sampling integration unit 33 .
[0072] Specifically, in order to achieve a better processing effect on the light intensity signals output by multiple receiving tubes 2, in this embodiment, by sequentially setting the switched capacitor amplifier 211, the sampling integration unit 222, and the signal processing unit 223, a phase-locking and demodulation process is implemented according to the timing signal, thereby accurately processing the light intensity signal output by each receiving tube 2.
[0073] In the implementation process, the switched capacitor amplifier 211 refers to a phase-locked amplifier implemented based on switched capacitor technology, which completes the phase-locked process based on the timing signal generated by the timing circuit 22, thereby achieving lower power consumption and better noise suppression effect. In one embodiment, the sampling integration unit 33 and the signal processing unit 34 are connected to a register unit, and the current-voltage conversion gain, sampling times and integration time are adjusted by the control parameters recorded in the register unit. The register unit 6 can be connected to an external control device through a bus protocol in the prior art to receive control parameters. According to actual needs, the register unit 6 can rely on a check bit or a check algorithm to verify the received control parameters to achieve better anti-interference. The signal processing unit 21 is an arithmetic logic circuit, which performs addition, subtraction, multiplication, division and other operations on the received signal under the adjustment of the control parameters, thereby generating an output signal for characterizing the light intensity.
[0074] In a preferred embodiment, Figure 3 As shown, the sensor circuit is also connected to at least one transmitting tube 5;
[0075] The transmitting tube 5 and the receiving tube array 1 are arranged on the same side and point in the same direction.
[0076] Specifically, to achieve a better gesture recognition effect, the transmitting tube 5 and the receiving tube array 1 are arranged on the same side, and the transmitting tube 5 emits irradiation light upward. When the user does not perform any operation, the receiving tube array 1 does not receive the light. When the user performs a gesture operation, the hand forms a reflection surface A above the transmitting tube 5, which then reflects the light to the receiving tube array 1, and the sensor circuit 1 determines the user's current gesture based on the receiving tube 1 that receives the reflected light.
[0077] During implementation, according to actual needs, such as the sensor's FOV (Field of View), sensing distance, operating area, etc., the number, size, and power of the transmitting tube 5 and the receiving tube 2 can be adaptively adjusted as needed. For example, in one embodiment, the user is required to perform a large-scale operation, so the number of receiving tubes 2 is increased to form a larger receiving tube array 1, thereby realizing the recognition of large-scale movements such as swinging arms and waving hands. In another embodiment, by adjusting the power of the transmitting tube 5 and adding a lens group in front of the receiving tube array 1, the recognition of operation gestures at a longer distance is realized.
[0078] In a preferred embodiment, the sensor circuit 3 also includes a transmitting tube driving circuit 51, which is connected to the timing unit 31 and the transmitting tube 5. The transmitting tube driving circuit drives the transmitting tube 5 to generate irradiation light under the control of the timing signal, thereby achieving phase locking between the signal processing circuit 21 and the transmitting tube driving circuit through the same timing signal.
[0079] As an optional implementation, the sensor circuit 3 can be implemented by a programmable sensor circuit. For example, CN202210103335.0 discloses a programmable photoelectric sensor, the circuit part of which can be used for the sensor circuit 3. This type of programmable sensor circuit usually includes a register unit 6, which is connected to an external host computer through a communication protocol in the prior art, such as I2C, SPI or a single-line communication interface, to receive control parameters output by the external host computer, and then adjust the parameters of the switch capacitor amplifier 32, the sampling integration unit 33, the signal processing unit 34, the timing unit 21 and the transmitting tube drive circuit 51, so that the sensor is more in line with actual needs. Depending on the actual setting environment, it is also possible to add a verification algorithm during the communication process, set a check bit in the register unit, and set a separate alarm circuit to avoid register flip failures caused by external electromagnetic interference. The host computer and the processing device can be the same device, which sends control parameters and receives signals output by the sensor circuit 3 through independent ports, or sends control parameters and receives output signals through the same port. The above modules can adjust their settings according to actual needs. For example, Figure 4 As shown, in one embodiment, the photoelectric sensor integrates a receiving tube array 1, a sensor circuit 2, a transmitting tube 5, a transmitting tube driving circuit 51 and a register 6, and is connected to an external processing module 4 through a bus to realize the gesture recognition function. The processing module 4 is used to send control parameters to the register unit 6 in the photoelectric sensor, and receive the output signal output by the sensor circuit 3, thereby realizing the gesture recognition process.
[0080] In a preferred embodiment, Figure 5 As shown, the receiving tube array 1 includes:
[0081] A plurality of first receiving tubes 2A, the first receiving tubes 2A are arranged in sequence along the horizontal direction;
[0082] A plurality of second receiving tubes 2B, the second receiving tubes 2B are arranged in sequence along the vertical direction;
[0083] The third receiving tube 2C is located in the center of the cross, and the first receiving tube 2A, the second receiving tube 2B and the third receiving tube 2C form a cross;
[0084] like Figure 6As shown, the third receiving tube 2C includes four sub-receiving tubes 2C1, 2C2, 2C3, and 2C4 arranged in a rectangular shape;
[0085] The sub-receiving tubes 2C1, 2C2, 2C3, and 2C4 form two first receiving tubes 2A arranged in the horizontal direction under the control of the timing signal, wherein the sub-receiving tube 2C1 and the sub-receiving tube 2C3 are connected in parallel to form a first receiving tube 2A, and the sub-receiving tube 2C2 and the sub-receiving tube 2C4 are connected in parallel to form another first receiving tube 2A;
[0086] Or, the sub-receiving tubes 2C1, 2C2, 2C3, and 2C4, under the control of the timing signal, form two second receiving tubes 2B arranged in the vertical direction, wherein the sub-receiving tube 2C1 and the sub-receiving tube 2C3 are connected in parallel to form a second receiving tube 2B, and the sub-receiving tube 2C2 and the sub-receiving tube 2C4 are connected in parallel to form another first receiving tube 2B.
[0087] Specifically, in this embodiment, by arranging the receiving tube array 1 into a cross shape, the number of receiving tubes 2 is reduced, so that the actual processing algorithm is simplified, thereby realizing effective recognition of gestures while achieving a smaller sensor volume. At the same time, by arranging a plurality of first receiving tubes 2A and second receiving tubes 2B arranged in sequence, the receiving tube array 1 is able to input the photoelectric signals generated by the receiving tubes 2 into the sensor circuit 3 in a specific order, thereby reducing the input circuit scale of the sensor circuit 3.
[0088] Furthermore, in order to achieve a better recognition effect of the operation gesture, in this embodiment, the output signals are obtained from the X-axis and Y-axis respectively, so as to realize the complete recording of the change trend of the light intensity in the X-axis and Y-axis directions respectively, and then comprehensively obtain the overall situation of the operation gesture. Therefore, by setting a third receiving tube 2C composed of four sub-receiving tubes 2C1, 2C2, 2C3, and 2C4, and controlling the area of each sub-receiving tube 2C1, 2C2, 2C3, and 2C4 to be half of the area of the first receiving tube 2A or the second receiving tube 2B, it can be realized in the receiving tube array 1 that the sub-receiving tube 2C1 and the sub-receiving tube 2C3, and the sub-receiving tube 2C2 and the sub-receiving tube 2C4 respectively form two first receiving tubes 2A in the X-axis direction, or the sub-receiving tube 2C1 and the sub-receiving tube 2C2, and the sub-receiving tube 2C3 and the sub-receiving tube 2C4 respectively form two second receiving tubes 2B in the Y-axis direction, so as to realize the complete recording of the light intensity of the X-axis or Y-axis.
[0089] During implementation, when it is necessary to obtain the photoelectric signal of the X-axis, the third receiving tube 2C connects the sub-receiving tube 2C1 and the sub-receiving tube 2C3 in parallel, and the sub-receiving tube 2C2 and the sub-receiving tube 2C4 in parallel under the action of the timing signal, thereby forming two receiving tubes with an area equal to that of the first receiving tube 2A in the X-axis direction, thereby realizing continuous recording of the light intensity of the X-axis. When it is necessary to obtain the photoelectric signal of the Y-axis, the third receiving tube 2C connects the sub-receiving tube 2C1 and the sub-receiving tube 2C2 in parallel, and the sub-receiving tube 2C3 and the sub-receiving tube 2C4 in parallel under the action of the timing signal, thereby forming two receiving tubes with an area equal to that of the second receiving tube 2B in the Y-axis direction, thereby realizing continuous recording of the light intensity of the Y-axis.
[0090] In a preferred embodiment, the receiving tube array 1 is controlled by the timing signal so that the photoelectric signal generated by the first receiving tube 2A is sequentially input into the sensor circuit along the first direction;
[0091] And, the photoelectric signals generated by the second receiving tube 2B are sequentially input into the sensor circuit along the second direction.
[0092] Specifically, in order to realize complete recognition of gesture operation on the cross-shaped sensor array 1, in this embodiment, the photoelectric signals generated by the first receiving tube 2A and the second receiving tube 2B are sequentially input into the sensor circuit 2 by setting a specific direction, and then a serial number-amplitude rectangular coordinate system can be established based on the serial number of the receiving tube 2 on the X-axis or Y-axis and the signal strength of the receiving tube, and the signal strength of each receiving tube 2 is fitted on the coordinate system to obtain the peak value of the light intensity on the X-axis or Y-axis and the distribution of the light intensity of the receiving tube array 1. Subsequently, by comparing the peak value of the light intensity and the distribution of the light intensity on the coordinate system along the time sequence, it can be effectively determined that the continuous change of the signal strength on the receiving tube array 1 on the X-axis and / or Y-axis due to the user's hand movement can be caused, and then the gesture can be recognized.
[0093] In a preferred embodiment, the receiving tube array 1 inputs the photoelectric signal of the first receiving tube 2A to the sensor circuit 3 through the first port, and the receiving tube array 1 inputs the photoelectric signal of the second receiving tube 2B to the sensor circuit 3 through the second port;
[0094] The timing unit 31 sends a first timing signal and a second timing signal to the receiving tube array 1, so that the receiving tube array 1 simultaneously inputs the photoelectric signal of the first receiving tube 2A and the photoelectric signal of the second receiving tube 2B to the sensor circuit 3;
[0095] There is a preset phase difference between the first timing signal and the second timing signal, so that the third receiving tube 2C forms the first receiving tube 2A and the second receiving tube 2B in sequence under the control of the first timing signal and the second timing signal.
[0096] Specifically, in order to address the problem of low recognition efficiency of photoelectric sensors in the prior art, in this embodiment, a first port and a second port are set to receive photoelectric signals output in the horizontal direction and the vertical direction respectively, thereby achieving rapid processing of the output signal of the sensor array 1, reducing the duration of a single cycle, and helping to improve the detection frequency of the photoelectric sensor, thereby achieving better recognition efficiency.
[0097] In the implementation process, the first timing signal and the second timing signal can be the same type of timing signal, which is used to control the receiving tube array 1 to sequentially input the photoelectric signals of the first receiving tube 2A and the second receiving tube 2B into the sensor circuit 3, and control the third receiving tube 2C to connect the sub-receiving tubes 2C1, 2C2, 2C3, and 2C4 in parallel to form the first receiving tube 2A or the second receiving tube 2B. By setting the phase difference, the third receiving tube 2C can be switched in the phase difference to complete the input process of the photoelectric signal in a specific direction. Since the signals in the X direction and the Y direction are measured and processed at the same time, the speed of gesture recognition is accelerated.
[0098] As an optional implementation, in the above embodiment, the transmitting tube driving circuit 51 can be connected to two transmitting tubes 5 respectively, and the transmitting tube driving circuit 51 drives each transmitting tube 5 to form irradiation light under the control of the first timing signal and the second timing signal, so as to generate the same or different irradiation light to the first receiving tube 2A and the second receiving tube 2B respectively, so that the sensor circuit 3 completes the phase locking of the first receiving tube 2A and the second receiving tube 2B according to the first timing signal and the second timing signal, thereby improving the processing accuracy of the sensor circuit 3. In the above control process, the emission time of the two transmitting tubes 5 does not overlap, so as to form irradiation light with a smaller fluctuation range on the receiving tube array 1. Or, in another embodiment, the transmitting tube driving circuit 51 drives one or more transmitting tubes 5, and drives each transmitting tube 5 to emit light simultaneously under the control of the first timing signal and the second timing signal. It should be understood that according to different control methods, the light intensity on the receiving tube array 1 changes accordingly, so that the output signal changes within a certain range, such as the maximum and minimum values, kurtosis, monotonic interval, etc. of the overall output signal, but it does not affect the recognition of gestures according to the change law of the output signal.
[0099] In a preferred embodiment, the processing module 4 obtains the light intensity of each receiving tube 2 in the receiving tube array 1 according to the processed signal;
[0100] The processing module 4 recognizes the gesture according to the change trend of the light intensity.
[0101] Specifically, in order to realize complete recognition of gesture operation on the cross-shaped sensor array 1, the present embodiment obtains the light intensity of each receiving tube 2 and accurately recognizes the operation gesture according to the change trend of the light intensity on the X-axis or Y-axis.
[0102] During the implementation, since the transmitting tube 5 is arranged on the same side as the receiving tube array 1, it will form a relatively uniform light spot on the receiving tube array 1 through the reflecting surface A, and the brightness of the center point of the light spot is significantly higher than the brightness of the edge of the light spot. Therefore, by recording the serial number of the receiving tube 2 corresponding to the peak value of the light intensity along the time series, the movement of the light spot on the receiving tube array 1 can be reflected, and then the movement of the reflecting surface A, that is, the user's hand in the X-axis and Y-axis directions can be characterized, and then the corresponding gesture can be identified. At the same time, since the distance of the reflecting surface A relative to the receiving tube array 1 will affect the light intensity and distribution of the light spot reflected back to the receiving tube array, the size of the light spot on the receiving tube array 1 and the change in size can be further determined by judging the distribution of the light intensity, and then the movement of the reflecting surface A, that is, the user's hand on the Z axis (relative to the distance of the photoelectric sensor) can be characterized.
[0103] In a preferred embodiment, when the light intensity of the first receiving tube 2A increases in sequence along the horizontal direction, and the light intensity of the plurality of second receiving tubes 2B reaches a first peak value at the same time, it indicates that the gesture is a horizontal movement;
[0104] Specifically, to achieve a better gesture recognition effect, in this embodiment, by comparing the light intensity change trend of the first receiving tube 2A in the X-axis direction with the light intensity change trend of the second receiving tube 2B in the Y-axis direction, it is comprehensively determined in which direction the gesture is moving.
[0105] In the implementation process, in one embodiment, the first receiving tube 2A of the receiving tube array 1 specifically includes 8 receiving tubes DX1 to DX8, wherein DX1 is the leftmost receiving tube in the horizontal direction, and DX8 is the rightmost receiving tube in the horizontal direction. The second receiving tube 2B includes 8 receiving tubes DY1 to DY8, wherein DY1 is the uppermost receiving tube in the vertical direction, and DY8 is the lowermost receiving tube in the vertical direction. Figure 7As shown, when the user's hand moves from left to right in the horizontal direction, the output signals of the multiple receiving tubes DX1 to DX8 in the first receiving tube 2A are obtained and sorted to obtain: when the user's hand is located at the far left, the receiving tube with the largest light intensity is the receiving tube DX1, and the receiving tube with the weakest light intensity is the receiving tube DX8; when the user's hand is located at the center, the receiving tube with the largest light intensity is the receiving tube DX4 or the receiving tube DX5; when the user's hand is located at the far left, the receiving tube with the largest light intensity is the receiving tube DX8, and the weakest light intensity is DX1. By comparing the above change trends, it can be judged that the user's hand moves from left to right in the horizontal direction. At the same time, by comparing the light intensity of the receiving tubes DY1 to DY8, it can be seen that when the user's hand is located on the left or right, the light intensity of the multiple second receiving tubes 2B is basically the same. Only when the user's hand is located at the center, that is, when the light intensity of the receiving tube DX4 or the receiving tube DX5 is the largest, the light intensity of the second receiving tube 2B reaches a peak value, and the light intensity of the receiving tube DY4 or the receiving tube DY5 closest to the center is the largest. Based on the above comparison, it can be seen that the user's hand does not move in the vertical direction.
[0106] Furthermore, when the light intensity of the second receiving tube increases in sequence along the vertical direction, and the light intensity of the plurality of first receiving tubes reaches a second peak value at the same time, it indicates that the gesture is moving in the vertical direction.
[0107] During the implementation process, Figure 8 As shown, when the user's hand moves from bottom to top in the vertical direction, the output signals of multiple receiving tubes DY1 to DY8 in the second receiving tube 2B are obtained and sorted to obtain: when the user's hand is at the bottom, the receiving tube with the largest light intensity is the receiving tube DY8, and the receiving tube with the weakest light intensity is the receiving tube DY1; when the user's hand is at the center, the receiving tube with the largest light intensity is the receiving tube DY4 or the receiving tube DY5; when the user's hand is at the top, the receiving tube with the largest light intensity is the receiving tube DY1, and the receiving tube with the weakest light intensity is the receiving tube DY8. By comparing the above change trends, it can be determined that the user's hand moves from bottom to top in the vertical direction. At the same time, by comparing the light intensity of the receiving tubes DX1 to DX8, it can be seen that when the user's hand is located at the upper side or the lower side, the light intensity of the plurality of first receiving tubes 2A is substantially the same. Only when the user's hand is located at the center, that is, when the light intensity of the receiving tube DY4 or the receiving tube DY5 is the largest, the light intensity of the first receiving tube 2A reaches a peak value, and the light intensity of the receiving tube DX4 or the receiving tube DX5 closest to the center is the largest. Based on the above comparison, it can be seen that the user's hand does not move in the horizontal direction.
[0108] Furthermore, based on the above process, the continuous movement of the user's hand in the entire plane can be obtained by comprehensively comparing the change trend of the amplitude of the received signal of the first receiving tube 2A in the horizontal direction and the change trend of the amplitude of the received signal of the second receiving tube 2B in the vertical direction.
[0109] In one embodiment, if Fig. 9 As shown, a plane rectangular coordinate system is established with the center point of the receiving tube array 1 as the origin, the center line of the first receiving tube 2A as the X axis, and the center line of the second receiving tube 2B as the Y axis. Each quadrant corresponds to a received signal strength sample.
[0110] For example, when the user's hand is in the first quadrant, the first receiving tube 2A receives the largest signal amplitude from DX8, the smallest signal amplitude from DX1, the second receiving tube 2B receives the largest signal amplitude from DY1, the smallest signal amplitude from DY8;
[0111] When the user's hand is in the second quadrant, the first receiving tube 2A receives the largest signal amplitude from DX1, and the smallest signal amplitude from DX8; the second receiving tube 2B receives the largest signal amplitude from DY1, and the smallest signal amplitude from DY8;
[0112] When the user's hand is in the third quadrant, the first receiving tube 2A receives the largest signal amplitude from DX1, the smallest signal amplitude from DX8, the second receiving tube 2B receives the largest signal amplitude from DY8, the smallest signal amplitude from DY1;
[0113] When the user's hand is in the fourth quadrant, the first receiving tube 2A receives the largest signal amplitude from DX8, the smallest signal amplitude from DX1, the second receiving tube 2B receives the largest signal amplitude from DY8, the smallest signal amplitude from DY1.
[0114] The quadrant in which the user's hand is located in the rectangular coordinate system can be determined based on the four received signal strength samples.
[0115] At this time, if the user wants to make a continuous action, such as counterclockwise rotation, the motion trajectory should be from the first quadrant to the second quadrant, and after reaching the third quadrant, turn to the fourth quadrant and then return to the first quadrant, so that the output signal of the photoelectric sensor changes in sequence according to the above-mentioned received signal strength samples, so that the processing module 4 can recognize that the continuous action is a counterclockwise rotation. Similarly, when the user needs to make an oblique movement, the motion trajectory is from the first quadrant to the third quadrant through the origin. At this time, in the output signal of the photoelectric sensor, the output amplitude of each receiving tube 2 reaches the maximum value, and then weakens to the corresponding received signal strength sample. Based on this process, the oblique movement of the continuous action through the origin can be identified. The above actions can be simply combined according to actual needs to make operations such as clockwise rotation, L-shaped gestures, and J-shaped gestures.
[0116] In a preferred embodiment, when the light intensity of the first receiving tube 2A and the light intensity of the second receiving tube 2B increase simultaneously, it indicates that the gesture is close to the photoelectric sensor;
[0117] Furthermore, when the light intensity of the first receiving tube 2A and the light intensity of the second receiving tube 2B decrease at the same time, it indicates that the gesture is away from the photoelectric sensor.
[0118] During the implementation process, Fig.10 As shown, taking the user's hand approaching the photoelectric sensor as an example, by comparing the output signal amplitude change trends of the multiple receiving tubes DX1 to DX8 in the first receiving tube 2A and the output signal amplitude change trends of the multiple receiving tubes DY1 to DY8 in the second receiving tube 2B, it can be seen that when the user's hand approaches the photoelectric sensor, the reflected light causes the multiple receiving tubes DX1 to DX8 in the first receiving tube 2A and the multiple receiving tubes DY1 to DY8 in the second receiving tube 2B to increase in light intensity at the same time, which is then reflected as an increase in the output signal. Based on this change trend, it can be concluded that the user's hand is approaching the photoelectric sensor. Similarly, when the output signal amplitudes of the first receiving tube 2A and the second receiving tube 2B decrease at the same time, it indicates that the user's hand is moving away from the photoelectric sensor; when the output signal amplitudes of the first receiving tube 2A and the second receiving tube 2B remain unchanged, it indicates that the distance between the user's hand and the photoelectric sensor remains unchanged.
[0119] As an optional implementation, a corresponding artificial intelligence model is preset in the processing module 4, which uses the above-mentioned output signal as a training set for training, so that the artificial intelligence model can classify the actually collected output signals in the application to accurately identify the user's gestures.
[0120] The beneficial effect of the present invention is that: by adjusting the arrangement of the receiving tube array 1, the algorithm is simplified, the accuracy of user gesture recognition is improved, and the overall area of the receiving tube array 1 is reduced, thereby making the overall volume of the photoelectric sensor smaller and convenient for integration in various devices. By sequentially receiving the photoelectric signals output by the first receiving tube 2A in the horizontal direction or the second receiving tube 2B in the vertical direction, a group of continuous output signal amplitude arrays for characterizing the current light intensity in the horizontal direction or the vertical direction is formed in the processing module 4, thereby effectively recording the position of the light spot formed on the receiving tube array 1 due to the reflection of the user's hand, and facilitating the movement of the light spot by comparing the changes in the array to identify the user's gesture movement. By selecting a programmable switch capacitor amplifier 32, a sampling integration unit 33, a signal processing unit 34, a timing unit 21 and a transmitting tube driving circuit, the amplitude, phase, frequency and other parameters of the output signal are effectively adjusted to ensure that the sensor does not enter a saturated state or a small output signal state, so that the sensitivity, detection distance, detection range and other parameters of the sensor can be changed according to the needs of the user in actual use, thereby making the sensor more in line with the needs of the user.
[0121] The above are only preferred embodiments of the present invention, and are not intended to limit the implementation methods and protection scope of the present invention. Those skilled in the art should be aware that all solutions obtained by equivalent substitutions and obvious changes made using the description and illustrations of the present invention should be included in the protection scope of the present invention.
Claims
1. A photoelectric sensor for gesture recognition, characterized in that: include: A receiving tube array, wherein a plurality of receiving tubes are arranged in a cross shape; A sensor circuit, the sensor circuit is connected to the receiving tube array; The sensor circuit includes a timing unit, and the timing unit sends a timing signal to the receiving tube array; The receiving tube array selects the receiving tubes in turn along the horizontal direction and the vertical direction under the control of the timing signal, and inputs the photoelectric signal corresponding to the receiving tube into the sensor circuit, and the sensor circuit generates an output signal according to the photoelectric signal; a processing module, the processing module being connected to the sensor circuit and identifying a gesture according to the output signal; The receiving tube array comprises: A plurality of first receiving tubes, wherein the first receiving tubes are arranged in sequence along a horizontal direction; A plurality of second receiving tubes, wherein the second receiving tubes are arranged in sequence along a vertical direction; a third receiving tube, the third receiving tube being located at the center of the cross, the first receiving tube, the second receiving tube and the third receiving tube forming the cross; The third receiving tube includes four sub-receiving tubes arranged in a rectangular shape; The sub-receiving tubes, under the control of the timing signal, form two first receiving tubes arranged along the horizontal direction; Or, the sub-receiving tube forms two second receiving tubes arranged along the vertical direction under the control of the timing signal; The receiving tube array inputs the photoelectric signal of the first receiving tube to the sensor circuit through the first port, and the receiving tube array inputs the photoelectric signal of the second receiving tube to the sensor circuit through the second port; The timing unit sends a first timing signal and a second timing signal to the receiving tube array, so that the receiving tube array simultaneously inputs the photoelectric signal of the first receiving tube and the photoelectric signal of the second receiving tube to the sensor circuit; There is a preset phase difference between the first timing signal and the second timing signal, so that the third receiving tube forms the first receiving tube and the second receiving tube in sequence under the control of the first timing signal and the second timing signal.
2. The photoelectric sensor according to claim 1, characterized in that: The sensor circuit comprises: A switched capacitor amplifier, the input end of which is connected to the output end of the receiving tube array; A sampling and integrating unit, wherein the input end of the sampling and integrating unit is connected to the output end of the switched capacitor amplifier; A signal processing unit, wherein the input end of the signal processing unit is connected to the output end of the sampling integration unit.
3. The photoelectric sensor according to claim 1, characterized in that: The sensor circuit is also connected to at least one transmitting tube; The transmitting tube and the receiving tube array are arranged on the same side and point to the same direction.
4. The photoelectric sensor according to claim 1, characterized in that: The receiving tube array, under the control of the timing signal, allows the photoelectric signals generated by the first receiving tubes to be sequentially input into the sensor circuit along a first direction; And, the photoelectric signal generated by the second receiving tube is sequentially input into the sensor circuit along the second direction.
5. The photoelectric sensor according to claim 1, characterized in that: The processing module obtains the light intensity of each receiving tube in the receiving tube array according to the processing signal; The processing module recognizes the gesture according to the change trend of the light intensity.
6. The photoelectric sensor according to claim 5, characterized in that: When the light intensity of the first receiving tube increases in sequence along the horizontal direction, and the light intensity of a plurality of the second receiving tubes reaches a first peak value at the same time, it indicates that the gesture is a horizontal movement; Furthermore, when the light intensity of the second receiving tube increases sequentially along the vertical direction, and the light intensity of a plurality of the first receiving tubes reaches a second peak value at the same time, it indicates that the gesture is a vertical movement.
7. The photoelectric sensor according to claim 5, characterized in that: When the light intensity of the first receiving tube and the light intensity of the second receiving tube increase at the same time, it indicates that the gesture is approaching the photoelectric sensor; Furthermore, when the light intensity of the first receiving tube and the light intensity of the second receiving tube decrease simultaneously, it indicates that the gesture is away from the photoelectric sensor.
