IDENTIFICATION SYSTEM FOR IDENTIFYING A PLUG CONNECTION WHICH A PLUG CONNECTOR was not correctly installed, AND DATA ACQUISITION SYSTEM FOR COLLECTING
By using a mating attempt identification device, measurement unit, and verification device in the mating connector, combined with an accelerometer and microphone, and utilizing artificial intelligence to analyze the mating process data, the problem of difficulty in identifying the correct installation of the mating connector in the prior art is solved, thereby improving the accuracy of the mating connection and reducing rework costs.
Patent Information
- Application Number
- CN202480041597.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2023-06-22
- Filing Date
- 2024-06-05
- Publication Date
- 2026-01-20
AI Technical Summary
Existing technologies struggle to accurately identify the correct installation status of connectors, potentially leading to incorrect connections that require complex and costly rework.
An identification system is employed, comprising a plug-in attempt identification device, a measurement unit, and a verification device. The system collects plug-in process data through an accelerometer and a microphone, and uses an artificial intelligence neural network to analyze the data and identify the correctness of the plug-in connection.
It improves the accuracy of identifying plug-in connections, reduces the occurrence of incorrect plug-in connections, and lowers the frequency and cost of rework.
Smart Images

Figure CN121368751A_ABST
Abstract
Description
TECHNICAL FIELD
[0001] The present application relates to an identification system for identifying incorrectly installed plug connections of plug connectors and a data acquisition system for collecting measurement data for such an identification system. BACKGROUND
[0002] Identification systems for identifying incorrectly installed plug connections of plug connectors and data acquisition systems for collecting measurement data related to the plugging of plug connectors are known in the prior art. During plugging, the plug part and the coupling part or parts of a plug connector are locked to each other, during which locking a sound signal or acoustic signal in the form of a click is emitted. The installation of such plug connectors is usually carried out manually. It is usually not easy to identify whether the plugging has been completed completely and correctly, i.e. whether a complete, secure and correct locking has taken place. Therefore, it is not possible to identify immediately and accurately during the assembly of a plug connector whether the assembly has been carried out completely and correctly, thus ensuring the safety of the plug connection. The assembly force is largely influenced by the person performing it, depending on the operating hand, the hand posture, the movement process and possible jamming of the parts to be assembled. Incorrect plug connections are usually only detected at the end of the production line. However, if the plugging of such plug connectors is not carried out correctly, complex and expensive rework is required to solve the problem of the incorrectly plugged plug connector.
[0003] For example, a control system and a method for controlling the assembly of a coupling device comprising at least one plug connector are known from WO 2013 / 131632 Al, in which it is proposed to arrange a mobile sensor device in the immediate vicinity of a signal source of the plug connector. The signal is an electronic signal and / or an acoustic signal. The signal emitted during the plugging process is captured and evaluated. When an acoustic signal, i.e. a characteristic sound of the plugging process, for example a characteristic sound of the click of a plug connector holding element, is emitted as a signal, the signal is captured during the plugging process and evaluated in an evaluation unit. The captured signal or sound can be separated from interfering signals, in particular interfering noise, and on the basis of which it is checked whether a normal click has been achieved, i.e. whether a secure plug connection can be established. The mobile sensor device is configured for capturing solid and / or air acoustic signals. For capturing solid acoustic signals, the mobile sensor device is brought into vibrational contact with the coupling device and / or at least one locking cam thereon. The mobile sensor device is arranged on a carrier material or integrated in a carrier material, wherein as a carrier material, for example, an assembly glove and / or a piece of clothing and / or a device that can be worn on the body by a person, for example a belt, a watch or a bracelet, is disclosed, in which the mobile sensor device can be integrated or has already been integrated. The data captured by the mobile sensor device is evaluated in a decentralized evaluation unit arranged in the vicinity and / or in a centralized evaluation unit. The transmission of the captured data is effected by WLAN, Bluetooth, cable, one or more USB interfaces or by radio.
[0004] From WO 2016 / 070984 A1 a device and a method for monitoring the assembly of two components by means of a clamping fastener for connecting the components are known, wherein a sensor for detecting an assembly force and an acoustic receiver are provided. During the assembly of the two components, the force exerted on at least one of the two components and the sound generated during the assembly of the two components are measured by means of the device for connecting the two components. The course of the measured force over time and / or the course of the measured sound over time is recorded. The course of the force over time and / or the course of the sound over time is evaluated, and a signal indicating the quality of the clamping assembly is generated when the course of the force over time and / or the course of the sound over time meets predetermined criteria. Furthermore, during the assembly of the two components, the acceleration of the fingers and / or the hand of the operator performing the assembly is measured. The assembly force as a basis for the signal is only limitedly suitable, since it depends on the personnel performing the assembly, wherein, for example, misalignment of the two components during the insertion has a great influence on the assembly force. Furthermore, the assembly force is difficult to detect and requires complex measurement sensor technology. The method is therefore prone to errors. The resolution between a normal and an abnormal plug-in connection is also difficult to determine by means of a force sensor. Acoustic sensors are susceptible to interference by distant background noise, for example the noise level in the assembly workshop. While the use of acoustic sensors in combination with motion sensors simultaneously improves the reliability and resolution of the distinction between a normal and an abnormal plug-in connection, rapid processing of the acquired data is required, which leads to relatively high costs in terms of high performance requirements and structural size of the electronics.
[0005] From WO 2015 / 053936 A1 a system for ensuring engagement of a connector is known, wherein a microphone is provided in the vicinity of an electrical connector assembly area, which is configured to capture audible sounds when the electrical connector is assembled. Furthermore, an output unit is also provided, which is connected to the microphone and receives audio signals from the microphone. The output unit processes the audio signals to ensure assembly of the connection. The output unit enhances the audio signals by filtering background noise. Due to the use of acoustic sensors, the system is suitable for applications with low to medium resolution requirements and / or for environments in which the influence of interfering noise on the measurement results is less. There is a limitation in the resolution between a normal plug-in connection and an abnormal plug-in connection during the evaluation.
[0006] WO 2017 / 062124 A1 likewise discloses a system for ensuring a mating connection of a connector. The system comprises a sensor unit worn by the user, which is worn in the vicinity of the operator's hand or on the hand, wherein the sensor unit comprises an acoustic sensor, which is arranged in the vicinity of the mating area of the electrical connector. As soon as the electrical connector is mated, the acoustic sensor is able to detect acoustic noise. Furthermore, the system comprises a controller worn by the user, which is connected to the acoustic sensor, wherein the controller receives an audio signal from the acoustic sensor and processes the audio signal in order to determine the mating status of the connector. The controller provides feedback information to the operator about the mating status of the connector. Due to the use of the acoustic sensor, the system is likewise suitable for applications with low to medium resolution capabilities and / or in environments where only little disturbing noise influences the measurement results. In this case, there is also a limitation in the resolution between a correct plug-in connection and an incorrect plug-in connection in the evaluation process.
[0007] A further system for ensuring a mating connection of a connector is known from WO 2017 / 062122 A1. The system comprises an acoustic sensor, which is arranged in the vicinity of the mating area of the electrical connector, wherein the acoustic sensor is configured to detect audible sound as soon as the electrical connector is mated. Furthermore, a connector identification sensor is provided, which is arranged in the vicinity of the electrical connector. The connector identification sensor is designed to be able to identify the presence of the electrical connector. Furthermore, the system comprises a controller, which is connected to the acoustic sensor and the connector identification sensor, wherein the controller receives a connector identification signal from the connector identification sensor and an acoustic signal from the acoustic sensor. The controller processes the connector identification signal and the acoustic signal for a safety detection of the mating connection. However, the connector identification sensor does not contribute to the evaluation of the plug-in connection, i.e. to the question of whether the connection is correct or incorrect, and therefore there is also a limitation in the resolution between a correct plug-in connection and an incorrect plug-in connection.
[0008] Furthermore, a system and a method for detecting a manually connected locked state of a lockable quick connector are known from FR 3 024 522 B1. Therein, a carrier is fixed to the operator, wherein at least one acoustic sensor is provided for measuring an acoustic signal emitted by the connection. The measured acoustic signal is acquired. The acquired acoustic signal is filtered and compared to an acoustic reference signal representing the locked state of the connector, while the result of the comparison is obtained. A message is issued to the operator, informing whether the locked state has been reached. Furthermore, the method comprises capturing the movement of the first hand of the operator for measuring the movement of the first hand representing the action of attempting to connect the connector. The movement capture is used to trigger the start of the acoustic signal measurement and recording. Furthermore, an auxiliary recording of the first hand movement measured during the movement recording is provided, as well as an auxiliary filtering of the recorded first hand movement, followed by an auxiliary comparison of the recorded and filtered first hand movement to a reference movement representing the connection attempt. The recording is triggered as soon as the movement of the first hand of the user is detected. The acoustic signal is recorded over a period of time, and the filter and comparison means process the signal over a time interval which lasts from a few tenths of a second before the trigger state to a few tenths of a second after it. A sequential two-stage check is thus carried out, wherein the evaluation of the quality of the plug-in connection, i.e. the judgment of whether it is correct or incorrect, is carried out only in the second step by the acoustic sensor alone. The movement signal only triggers the recording of the acoustic signal in the first stage.
[0009] A device and a method are known from DE 10 2014 016 153 A1, which are suitable for monitoring the assembly process of two components connected by a clasp, wherein a sensor for detecting the assembly force and a sound receiver are provided. The sensor for detecting the assembly force and / or the sound receiver are arranged on a glove. In the method for monitoring the assembly of two components connected by a clasp fastening, the two components are combined to perform the assembly by clasp fastening, during the assembly of the two components, the force exerted on at least one component is measured by means for connecting the two components, and the sound generated during the assembly of the two components. The course of the force over time and / or the course of the sound over time are evaluated, and a signal indicating the quality of the clasp fastening assembly is generated when the course of the force over time and / or the course of the sound over time comply with predetermined criteria. SUMMARY
[0010] The above-described devices and methods for monitoring the assembly connection mainly use acoustic detection, for example by detecting the click sound when a locking protrusion snaps into a corresponding anchoring or locking receptacle. Some devices and methods also contain pressure sensors or acceleration sensors. These devices are usually mainly limited to capturing signals on one finger or the thumb of the hand of the operator performing the plug-in process. It is therefore the task of the present invention to provide an identification system for an assembly lock which reliably identifies incorrectly installed plug-in connections.
[0011] The object is achieved by an identification system for identifying incorrectly installed plug connections of plug connectors, wherein the identification system comprises at least one plug attempt identification device for identifying a plug attempt, at least one measuring unit for acquiring plug process data, and at least one verification device for verifying the plug connection by means of a data profile of the acquired plug process data. The object is also achieved by a data acquisition system for collecting measurement data, comprising at least two measuring units, at least one data analysis unit and at least one flexible carrier, wherein the at least two measuring units and the data analysis unit are arranged on the flexible carrier next to each other, wherein the measuring units each comprise at least one acceleration sensor and at least one of the measuring units comprises at least one microphone. Further refinements of the invention are defined in the dependent claims.
[0012] Thereby, an identification system and a data acquisition system for collecting measurement data, in particular for collecting measurement data for such an identification system, are created, wherein on the one hand a plug attempt is identified by means of at least one plug attempt identification device and on the other hand a measuring unit for acquiring respective plug process data is provided and at least one verification device, by means of which a judgment of the respective plug connection quality can be made after completion of the plug process on the basis of the acquired plug process data by evaluating the recorded or acquired data profile. Thus, in order to assemble the lock, unlike the solutions of the prior art, an identification of incorrectly installed plug connections is proposed instead of a mere verification of correctly installed plug connections. For this purpose, the plug attempt is first identified and subsequently verified by means of a data profile of the plug process data.
[0013] Advantageously, at least one first measuring unit for identifying a plug attempt gesture and at least one second measuring unit for capturing the plug process are provided, in which second measuring unit data on acceleration and / or forces and energy released by sound are acquired.
[0014] Due to the complexity of the triggered hand movements to be analyzed, which are captured by at least one first measuring unit and analyzed by at least one plug-in attempt recognition device for the presence of a plug-in attempt, a rule-based data processing is usually not sufficient. Therefore, the recognition system advantageously comprises at least one artificial intelligence, for example one or more artificial neural networks, by means of which all measuring unit inputs as input can be converted or converted into a binary output for displaying a correct plug-in connection or an incorrect plug-in connection decision. By means of such a (artificial) neural network, all measuring unit or sensor inputs can be converted as input into a binary output, i.e. a plug-in connection OK decision (= presence of a correct plug-in connection) or a NOK decision (= absence of a correct or accurate plug-in connection).
[0015] The measuring units can be arranged on at least one finger and the thumb of at least one hand of the operator performing the plug-in process. The measuring units can in particular be arranged on at least one carrier, in particular a flexible carrier. Such a carrier can for example be constituted in the form of a glove, a finger glove, or in another manner suitable for being fixed on the hand of the operator. In the case of provision of at least one flexible carrier, the carrier can for example be constituted as a glove, a finger glove and / or in the form of at least two straps, which interconnect at least two measuring units and at least one wrist unit. For example, three island-like structures can be provided, wherein one measuring unit is arranged on each of two of the island-like structures and a wrist unit is arranged on the third island-like structure and interconnected by means of straps or other connecting means. On the connecting means, a cable extending between the measuring units and the wrist unit can be fixed. For example, two textile straps can be provided, on which a cable extending between the measuring units and the wrist unit is fixed. In order to be able to detachably fix the straps, and also the individual regions of the glove or finger glove, to one another in particular in order to obtain a secure and good hold on the hand of the operator, at least one Velcro fastener, at least one tie device or at least one other type of fastening device can for example be provided.
[0016] The recognition system also advantageously comprises at least one wrist unit for being arranged on the wrist of the operator performing the plug-in process. The at least one wrist unit advantageously comprises at least one microphone for picking up ambient noise and at least one microcontroller. In the sound data processing of the at least one microcontroller of the wrist unit, the acquired data of a measuring unit, which can also be referred to as a thumb unit, which can be arranged or is arranged on the thumb of the hand of the operator, are compared in order to improve the recognition of the sound signature of the locking of the plug-in partner of the plug-in connector. Thereby, the sound signature of the locking of the plug-in partner and the coupling partner as plug-in connector can be more precisely acquired in order to be able to better recognize this sound signature in the acquired data.
[0017] The at least one wrist unit advantageously also comprises at least one gyroscope or gyroscope device, wherein the gyroscope or gyroscope device acquires movement data of the hand of the operator, which movement data serve as a recognition trigger for opening a measurement window, wherein the presence of data or signals characteristic of a correct plugging process is checked within the measurement window.
[0018] The measurement units or sensors are preferably mounted on the fingers of one or both hands of the operator performing the plugging process, so that they do not cause any disturbance when the operator works with his hands, but still acquire all relevant measurement values. It is therefore proposed in one preferred embodiment that the measurement units can be or are configured in the middle or proximal segment position of the fingers and / or the thumb of at least one hand of the operator. In particular when the measurement units are arranged on or between the thumb and the index finger of at least one hand of the operator, the measurement units can or will be arranged in the metacarpal region of the hand. The sensors or measurement units, i.e. the sensing hardware units, are therefore not configured in the distal segment region of the fingers, but are configured in the middle segment phalanx region, preferably in the middle, i.e. on the proximal phalanx, or in the proximal segment region of the metacarpal region, wherein a proximal configuration is particularly preferred.
[0019] It is further advantageous for the measurement units to be arranged in a rotational manner or rotationally on or around the middle phalanx or the proximal phalanx. When arranged on the thumb of the hand of the operator, the at least one measurement unit can be arranged towards the inside of the index finger of the hand; when arranged on the index finger of the hand of the operator, the at least one measurement unit can be arranged towards the inside of the thumb. In particular, a rotation towards the upper side of the hand can be provided. When arranged on the middle finger and / or ring finger and / or little finger of the hand of the operator, an arrangement towards the upper side of the hand is particularly suitable.
[0020] The data acquisition system comprises at least two measurement units and at least one data analysis unit, wherein the at least two measurement units and the data analysis unit are mounted on a carrier, in particular a flexible carrier, in close proximity to one another. The measurement units each comprise at least one acceleration sensor, and all measurement units together comprise at least one microphone, i.e. at least one measurement unit comprises at least one microphone. By providing a respective acceleration sensor on each measurement unit, redundancy can be achieved. In relation to the provision of only one microphone, the advantageous provision of two microphones also creates greater variability.
[0021] Further advantageously, at least one microphone of the at least one measuring unit is aimed at the tip of the finger or the tip of the thumb of the hand of the operator wearing the measuring unit. Thereby, the acoustic signals occurring during the plugging process can be captured particularly well and more undisturbed. Furthermore, at least one opening can advantageously be provided in the housing of the measuring unit, which opening is covered by at least one membrane to prevent the intrusion of dust and water. The measuring unit and its housing are advantageously sealed with respect to the environment. The at least one microphone is arranged in the housing of the measuring unit in such a way that it is arranged in the opening area inside the housing or directly adjacent to the opening. To protect the microphone and other components of the measuring unit, which are arranged inside its housing, from dust and water, the at least one opening is equipped with or covered by at least one membrane. The opening is preferably oriented in the direction of the tip of the finger of the hand of the operator carrying the measuring unit. In order to be able to receive and evaluate the audio signals with the best quality, the microphone is arranged on the measuring unit mounted on the thumb of the hand of the operator performing the plugging process, also called thumb unit, in the opening area for sound transmission and the opening is provided with or covered by a membrane in particular to protect the microphone. The opening covered by the at least one membrane is advantageously oriented in the direction of the tip of the thumb in order to be able to better receive the audio signals of the plugging process and to distinguish with respect to the ambient noise. In order to collect the ambient noise, the at least one wrist unit comprises at least one microphone. Since at least one of the at least two measuring units also comprises a microphone, the microphone of the wrist unit is at least one second microphone for collecting the ambient noise. In the sound data processing of the at least one microcontroller of the wrist unit, the data collection of the measuring unit arranged on the thumb of the hand of the operator performing the plugging process is compared, so that the sound features of the locking can be better identified.
[0022] The at least one wrist unit also advantageously comprises at least one gyroscope or at least one gyroscope device and one three-axis acceleration sensor. Thereby, the acceleration signals and movement data of the hand of the operator can be captured particularly well, the latter serving as an identification trigger for opening the measuring window, as previously described, in which the presence of data or signals characterizing a correct plugging process is checked.
[0023] The data analysis unit can be mounted on the back of the hand of the operator performing the plugging process to be evaluated, since this position allows a better collection of movement data than the wrist area. The wrist can distort the movements performed during the assembly of the plug connector, or the movements collected by the wrist unit at the wrist can be incorrectly evaluated.
[0024] The provision of at least two measuring units proves to be particularly advantageous since the operating personnel adopt a so-called tweezers grip when performing the fine assembly task during the plugging of the plug-in connector. The tweezers grip refers to the grip of the assembly piece or the component of the connector, i.e. the plug component and the coupling component, with the index finger and the thumb. The provision of the measuring unit proximal end at the thumb and the index finger of the operating personnel's hand thus proves to be particularly advantageous. Depending on the type of plugging process, the way in which the plugging process is completed with the index finger or the thumb of the hand until the locking protrusion on the plug-in connector snaps into place can vary.
[0025] More complex plugging tasks can be performed with the aid of further fingers. In particular when plugging the connector components through narrow openings, the little finger can be used to push the plug component, which is helpful. This little finger is then advantageously equipped with a measuring unit in order to be able to receive and transmit signals of the plugging process. Depending on the application of the identification system or the data acquisition system, different numbers of measuring units and different arrangements of these measuring units can thus be provided on the fingers of at least one hand of the operating personnel performing the respective plugging process.
[0026] The at least one wrist unit can comprise at least one RFID unit with the aid of which the respective assembly station in which the wrist unit is used or the plug with the RFID tag in the same IT system can be identified or realized as identifiable as the plug-in connection verified by the data acquisition system. The wrist unit thus comprises at least one RFID unit with the aid of which the respective assembly station in which the wrist unit is used or the plug with the RFID tag in the same IT system can be identified or realized as identifiable as the plug-in connection verified by the data acquisition system.
[0027] The data acquisition system can further advantageously be equipped or provided with at least one transmission device for transmitting the acquired data to a data transmitter by means of wireless local area networks, LTE, Bluetooth and / or radio technology. The data transmitter can be a gateway, a server or an edge device. Furthermore, at least one local or cloud-based database for storing the acquired data, a cloud for analyzing the plugging process and at least one graphical analysis unit for displaying the analysis results are also provided. The operating personnel performing the plugging process wear the data acquisition system or the identification system or components thereof on at least one hand or wrist during the assembly of the plug-in connector. The data acquisition system or in particular the wrist unit thereof can transmit data to a data transmitter, such as a gateway, a server or an edge device, by means of wireless local area networks, LTE, Bluetooth or other radio technology. The data is stored in a local or cloud-based database. The analysis of the plugging process can be carried out in an internally or externally provided cloud and provided by means of a graphical evaluation.
[0028] In a method for controlling and evaluating the quality of a plug connection of a plug connector, which comprises at least one locking stage, a characteristic assembly movement pattern is captured, which first identifies so-called "events" by means of the movement pattern of the hand of the operator performing the plug-in process. In this case, such an event is understood to be a potential assembly attempt, i.e. a recognizable characteristic plug-in action. The event activates the acceleration pick-up of the acceleration sensor group or of one of the measuring units of the data acquisition system. When a rise is detected within a short time, the microphone is likewise activated. It is also possible for the acceleration sensor or the acceleration pick-up to permanently acquire data (i.e. streaming) and, upon the occurrence of an event, to analyze the last presettable n milliseconds or n seconds of data recorded, on the basis of which the microphone is activated. The same applies to the microphone, which can also perform acoustic signal acquisition or data streaming and discard all data until the occurrence of an event. If the event is not a plug-in attempt, the data is discarded anew. This results in the advantage of an energy-saving method, with a significant reduction in the acquisition of personal-related audio data compared to prior art solutions.
[0029] The following table lists five different embodiments 1 to 5 of the data acquisition system. The general list of features of the data acquisition system is listed in the first column of the above table, the respective implementation of these features in the data acquisition system in the respective columns. In the first embodiment of the data acquisition system, one 1-axis acceleration sensor is provided on the wrist unit as the number of sensor or measuring units input, for capturing the hand gestures of the hand of the operator performing the monitored plug-in process. The arrangement position on the wrist unit is on the upper side of the wrist. Two measuring units are provided, which are arranged on the glove. The data connection between the measuring units and the wrist unit is realized by means of a cable. The measuring units are in the middle position on the fingers or the thumb. The acceleration sensors in the measuring units are in the form of single-axis acceleration sensors. The start / stop activation is realized by means of a switch on the operating device, i.e. by means of a switch on the measuring unit and / or the wrist unit.
[0030] In a second embodiment of the data acquisition system, a six-channel gyroscope is provided on the wrist unit, the six channels as the number of sensor or measurement unit inputs for capturing the hand gesture control of the operator performing the monitored plugging process. The wrist unit is arranged on the upper hand surface. Three measurement units are provided, each arranged on two gloves. Thus, the measurement units are arranged on both hands of the operator performing the plugging process, i.e. the operator wears two corresponding equipped gloves when performing the plugging process in the assembly of the plug-in connector. The data connection between the measurement units and the wrist unit is implemented via Bluetooth. The measurement units are located on the proximal position on the fingers or the thumb and the fingers. The acceleration sensors in the measurement units are in the form of 3-axis acceleration sensors. The start / stop activation is implemented via geofencing. In a third embodiment of the data acquisition system, a gyroscope with nine channels is provided on the wrist unit, the nine channels as the number of sensor or measurement unit inputs for capturing the hand gesture control of the operator performing the monitored plugging process. Four measurement units are provided. The data connection between the measurement units and the wrist unit is implemented via Wifi (Wireless Local Area Network). The measurement units are located on the distal position on the fingers or the thumb and the fingers. The acceleration sensors in the measurement units are in the form of 6-axis gyroscopes. The start / stop activation is implemented via reading Auto-ID.
[0031] In a fourth embodiment of the data acquisition system, five measurement units are provided, and a proprietary radio is provided as the data connection between the measurement units and the wrist unit. The acceleration sensors in the measurement units are in the form of 9-axis gyroscopes.
[0032] In a fifth embodiment of the data acquisition system, the data connection between the measurement units and the wrist unit is provided as LTE.
[0033] The five embodiments show different embodiment examples of the data acquisition system in terms of the individual variable features described in the first column. Other embodiments can in particular be formed by combining each variant of any row in the above table with each variant of the other rows. Of course, in addition thereto, any mix of the different embodiments listed can also be provided. BRIEF DESCRIPTION OF DRAWINGS
[0034] For further illustrating the present application, the following embodiments of the present application will be described in details with reference to the accompanying drawings. In the drawings: Figure 1 Top view of the right hand of an operator, the right hand equipped with a fingered glove, the fingered glove equipped with a recognition system according to the application with a data acquisition system according to the application comprising five measurement units according to the application and one wrist unit according to the application.
[0035] Figure 2This is a schematic diagram of an operator's right hand, on which measuring units according to the invention are respectively provided on the index finger and thumb of the right hand, wherein the measuring unit provided on the thumb is equipped with an opening and a microphone provided behind it.
[0036] Figure 3 This is a diagram of the operator's left hand, used to illustrate the different configuration possibilities of the measuring unit on the hand, here on the thumb and index finger.
[0037] Figure 4 This is a schematic diagram of the principle of two measuring units according to the present invention.
[0038] Figure 5 This is a schematic diagram of the wrist unit according to the present invention.
[0039] Figure 6 This is a schematic diagram illustrating the communication path between the identification system and the data acquisition system according to the present invention.
[0040] Figure 7 This is a signal-time diagram used to represent a trigger cascade with a measurement or verification time window according to the invention.
[0041] Figure 8 The flowchart below illustrates the various steps of data acquisition according to the present invention. Detailed Implementation
[0042] Figure 1 A first embodiment of a data acquisition system 1 for acquiring measurement data according to the present invention is shown. The data acquisition system 1 includes a flexible carrier 2 in the form of a fingerless glove. Figure 1 In the embodiment shown, two measurement units 3 and 4 and one data analysis unit 5 are fixed on the flexible carrier 2. Furthermore, Figure 1 Other measuring units 6, 7, and 8 are also shown. These measuring units can also be formed as part of or fixed to the flexible carrier 2, or arranged separately on the hand 10 of the operator performing the mating process of the connector. Figure 1 Not shown in the diagram. One of the measuring units 3, 4, 6, 7, and 8 can be respectively set on each of the fingers 11, 12, 13, and 14 of the hand 10 and the thumb 15. For example... Figure 1As further shown, the data analysis unit 5 is arranged on the back of the right hand 10, fixed on the flexible carrier 2 in the form of a glove. The data analysis unit 5 comprises a motion sensor in order to be able to capture motion data of the operator's hand. The arrangement on the back of the hand is particularly suitable since an arrangement at the wrist can interfere with the motion during assembly. When arranging the data analysis unit 5 on a glove or a glove finger, this arrangement is particularly easy to implement since the positioning options on the flexible carrier 2 can be made very flexible. The arrangement of the measuring unit 3 on the thumb 15 and the measuring unit 4 on the index finger 11 of the operator's hand 10 makes it possible for the operator to perform the plug-in process in a tweezers grip in the case of a fine assembly task, wherein the respective assembly part, i.e. the component of the plug-in connector, is gripped between the index finger and the thumb. In order to be able to perform the plug-in process, in particular a successful plug-in process, unhindered on the one hand and to be able to capture the process well on the other hand, it is expedient to arrange the respective measuring units on the thumb and the index finger of the hand 10, respectively.
[0043] In Figure 1 In the illustrated embodiment, the two measuring units 3, 4 are arranged at the middle of the thumb 15 and the index finger 11, respectively. As Figure 3 shown, there are various ways of arranging the measuring units on the operator's hand, here the left hand 16. The respective measuring units 4 are here arranged in a distal position, i.e. mounted on the middle phalanx, wherein the distal arrangement is indicated by the reference 110; in a middle position, which arrangement is on the proximal phalanx, indicated by the reference 111; and in a proximal position, wherein the proximal arrangement is indicated by the reference 112. In Figure 3 the middle position, the proximal arrangement is arranged within the metacarpal region of the hand 16. The arrangement here does not necessarily have to be located directly above the metacarpal bone, but can also be arranged slightly offset with respect to the metacarpal bone. In Figure 3 the illustrated diagram, the measuring unit 3 on the thumb 15 is here arranged in the middle position, i.e. on the proximal phalanx of the thumb, which is indicated by the reference 113.
[0044] The respective arrangement of the measuring units 6, 7, 8 can not only be arranged on the index finger 11, but if necessary also on the other fingers 12, 13, 14 of the hand. For example when performing more complex plug-in tasks, the other measuring units 6, 7, 8 can also be arranged on the other fingers 12, 13, 14 of the operator's hand 10. For example in the plug-in process, if the plug-in part is to be inserted into a narrow opening of the coupling part of the plug-in connector to be connected, the little finger 14 can also be used to assist in the advancement of the plug-in part. Therefore, in such a plug-in process, it is expedient to arrange the measuring unit 8 on the little finger 14 of the operator's hand 10 in order to be able to receive the signals of the plug-in process and transmit them to the data analysis unit.
[0045] As Figure 2As shown, a click signal is captured on the index finger 11 and the thumb 15 of the operator's right hand 10 with two measuring units 3, 4 Figure 1 The measuring unit 3 arranged on the thumb 15 of the operator comprises a microphone 30. This can also be seen in the detailed view of the two measuring units 3, 4 in Figure 4 The measuring unit 3 comprises a housing 31 with an opening 32. In the area of the opening 32, the microphone 30 is arranged in an interior 33 of the housing 31 of the measuring unit 3. The opening 32 is sealed outwardly by a membrane 34 to prevent dirt and moisture from penetrating here. It is still possible for acoustic signals to penetrate the membrane 34. In order to be able to safely capture the click signal, which can characterize a correct plugging process together with other data and signals, the opening 32 in the housing 31 of the measuring unit 3 is aligned in the direction of the thumb tip 150 of the thumb 15 of the operator's hand 10. This is shown in Figure 2 and is also indicated by the arrow P1 in Figure 4 The arrow P1 points in the direction of the thumb tip 150. The measuring unit 3 also comprises a first acceleration sensor 35 and a second acceleration sensor 36 in its housing 31. With the acceleration sensors 35, 36, the acceleration of the hand 10 can be detected. Thus, the measuring unit 3 simultaneously acquires acoustic signals and acceleration signals. In order to be able to display to the operator a correct or incorrect plugging process, here optically, the measuring unit 3 also comprises an optical display device in the form of an LED 37 in its housing 31.
[0046] The measuring unit 4, which is also shown in Figure 4 and which is arranged on the index finger 11 of the hand 10 (see Figure 1 and Figure 2 ), likewise comprises a housing 40. In the interior 44 of the housing 40, an acceleration sensor 41 and electronic means, i.e. an electronic assembly 42, are arranged. Furthermore, the housing 40 of the measuring unit 4 also comprises an optical display device, here in the form of an LED 43. Of course, other types of optical display and / or haptic and / or acoustic or other display means can be used instead of the LEDs 37 and 43. With the acceleration sensor 41 of the measuring unit 4, the acceleration of the index finger 11 during plugging can be detected.
[0047] Since the opening 32 in the housing 31 of the measuring unit 3 is aligned in the direction of the thumb tip 150 on the thumb 15 of the operator's hand 10, the audio signal of the plugging process is well captured, despite ambient noise.
[0048] In Figure 5A wrist unit 9 is shown in Fig. 1, which likewise comprises a housing 90, which is provided with an opening 91. This opening 91 is likewise covered by a membrane 92 in order to be able to safely prevent dirt, dust and liquids from penetrating into the interior 93 of the housing 90. In the interior 93 of the housing 90 of the wrist unit 9, likewise in the region of the opening 91 in the housing 90, a microphone 94 is provided in order to be able to capture ambient noise. These signals are processed in the sound data processing by means of a microcontroller 95, which is likewise provided in the housing 90 of the wrist unit 9, in combination with the acoustic signals generated by the measuring unit 3 provided on the thumb 15 of the operator's hand 10. Thereby, it is possible to better identify a locking signal from the acoustic signals received by the measuring unit 3, which can provide information about whether the plug-in process was successfully performed. During the locking process of the coupling part and the plug part, or during the locking process of the plug-in partners of the connector, characteristic sound characteristics are generated, which can be filtered out from the acoustic signals captured by the microphone 30 of the measuring unit 3 by comparison with the acoustic signals received by the microphone 94 of the wrist unit 9.
[0049] The wrist unit 9 also comprises an acceleration sensor 96 and a gyroscope or gyroscopic device 97 for capturing general movement data, which are used as identification carriers for opening a measuring window or a verification window in order to verify a correct plug-in process or an incorrect plug-in process. The wrist unit and its configuration correspond to the data analysis unit 5, as shown in Figure 1 which is arranged on a flexible carrier.
[0050] In order to be able to transmit the results of the data analysis in the microcontroller 95 to a display device and / or to a device for monitoring the plug-in process externally, the wrist unit 9 comprises a transmission unit 99 in its housing 90, by means of which wireless data transmission is possible via a wireless local network and Bluetooth. Furthermore, the wrist unit 9 comprises an RFID antenna or gate 98 and an optical display device, here in the form of an LED 100. The optical display of the quality of the plug-in process, i.e. whether an incorrect plug-in process or a correct plug-in process has occurred, can be displayed directly on the wrist unit 9 by means of the LED 100.
[0051] By means of the RFID antenna or gate 98, it is possible to identify the respective current station at which the wrist unit or the measuring unit and the wrist unit, i.e. the data acquisition system 1, is deployed. This is shown in Figure 6As illustrated below. Here, the wrist unit 9 of the data acquisition system 1 is identified at each assembly station 200, 201, and 202, which are used for assembling plug-in connectors. Therefore, the portion of the data acquisition system 1 that is positioned on the operator 18 is identified at each assembly station 200, 201, and 202. Furthermore, plug-in connectors with RFID tags can also be identified in the same system as those verified by the data acquisition system 1 via the RFID antenna or gate 98 of the wrist unit 9.
[0052] exist Figure 6 It can also be seen that the data acquisition system 1 transmits data to a data transmitter, such as a gateway, server, or edge device, via technologies such as wireless LAN, LTE, Bluetooth, or other radio technologies. Figure 6 Here, a data transfer device 210 is shown as an example. Data transfer is indicated by three arrows 211. Data is stored locally or in an external cloud database. Such a database 212 is... Figure 6 This is also mentioned in the text. Analysis of the mating process is conducted internally or externally in cloud 213. The analysis results can be provided to various personnel through graphical evaluation. Figure 6 The diagram also illustrates a device for data processing or for graphics processing in the form of a display 214.
[0053] Figure 7 A trigger cascade is illustrated, meaning that instead of using a single trigger signal, a trigger cascade is used to trigger the check. That is, the check is only performed after multiple trigger signals are present to determine if the sought signal, such as a characteristic acoustic signal, exists within the verification time window. In the top signal-time diagram, an event is identified because the motion data of operator 18's hand 10 exceeds the threshold S1, thus identifying a potential assembly attempt, i.e., a characteristic insertion action of the hand. When the amplitude of the motion data exceeds the threshold S1, an event trigger T is identified. E The device activates the accelerometers 35, 36, 41, and 96 in measurement units 3 and 4 and wrist unit 9. Microphones 30 and 94 are activated when an increase in hand acceleration is detected over a short time span. The acceleration signal is... Figure 7 The second signal-time diagram is shown here. Here, the acceleration signal or the acceleration signal amplitude exceeding the threshold S2 shown in the diagram is triggered by the amplitude peak or by the assembly trigger T. MV An assembly attempt was detected. The assembly trigger T... MV Therefore, this is the second trigger indicating an assembly attempt. Subsequently, microphone 30 of measurement unit 3 and possibly microphone 94 of wrist unit 9 are activated. When the acoustic signal also exceeds the preset threshold S3 (e.g. Figure 7 (As shown in the third signal-time diagram), through this assembly amplitude MA It is determined that an assembly has taken place, i.e. an assembly verification is carried out. Acoustic signals captured after the microphone is started are used to determine whether an assembly verification is present, which lies in a verification time window or measurement window M V . The presence of the assembly verification M A triggers the opening of the verification time window or measurement window M V as a trigger. Accordingly, there are two trigger signals T V and T E before the verification time window or measurement window M MV is opened, in which window the presence of the assembly verification M A is queried. Thus, a trigger cascade is involved here.
[0054] It is also possible for the acceleration sensor group to permanently capture acceleration data, i.e. to stream, and for the last presettable n milliseconds or n seconds of the recording to be analysed only upon the presence of an event, i.e. upon the occurrence of an event trigger T E , and for the microphone, i.e. the microphone 30 of the measurement unit 3 and the microphone 94 of the wrist unit 9, to be switched on on the basis thereof. A corresponding operation can also be carried out on the microphones, i.e. acoustic signals are permanently captured by the microphones, but until the event occurs, i.e. until the event trigger T E and the assembly attempt trigger T MV are present, all captured data are only temporarily stored and, after checking whether the assembly amplitude M A is present, the data are discarded anew. If the event is not a plug-in attempt, all data are discarded anew. This makes the method or procedure energy-efficient and, within the framework of the General Data Protection Regulation, the capture of personal-related audio data can also be reduced to a minimum.
[0055] Figure 8 A flowchart showing the individual steps of the data capture system 1 carrying out data capture is shown. In a first step 220, the data capture system 1 is started. In a second step 221, optical and haptic feedback is provided, indicating that the data capture system 1 is ready for data capture and evaluation. In a third step 222, a start button or a corresponding switch is pressed, starting the data recording. In a fourth step 223, the capture of motion data is first carried out. In a fifth step 224, it is queried whether an assembly attempt is present. In a sixth step 225, it is queried whether an event is recognised, i.e. whether an event trigger is present. In the absence of an event trigger, a corresponding switch is operated by the operator 18 in a seventh step 226, which switch allows the captured data to be overwritten. In an eighth step 227, the captured data set is saved and sent to an artificial intelligence for training. After that, the capture of motion data is restarted as the next step, so that the process is continued by the fourth step 223.
[0056] In case an event is identified in the sixth step 225, the measurement window M is opened in a ninth step 228 V or the verification window, and the recording of acceleration and acoustic data is started. In a tenth step 229 it is determined whether the predefinable trigger time window has been exceeded. If so, the fitting attempt is ended in an eleventh step 230 and the acquisition of motion data is restarted from the fourth step 223, i.e. the acquisition of motion data is started anew. If the trigger time window has not yet been exceeded, it is queried in a twelfth step 231 whether the stop button has been pressed, i.e. whether a data collection interruption has been set. If so, the eleventh step 230 is continued, i.e. the fitting attempt is ended and the acquisition of motion data is restarted in the fourth step 223. If no stop operation has been performed, it is queried in a thirteenth step 232 whether a matching reception profile has been captured, i.e. whether a correct plugging process has been detected. If not, a corresponding NIO signal, i.e. a signal of a non-correct plugging process, is output in a fourteenth step 233. This signal can be implemented tactilely and / or visually, for example by means of the aforementioned LEDs 37 of the measurement unit 3, LEDs 43 of the measurement unit 4 or LEDs 100 of the wrist unit 9. If a correct plugging process is detected, i.e. a matching reception profile of a correct plugging process is detected, the fitting result is saved in a next fifteenth step 234 in order to be archived within a quality assurance framework. Subsequently, the acquisition of motion data can be restarted, i.e. the fourth step 223. The same applies if a normal plugging process is not identified (see step 233).
[0057] As Figure 8 The extended data acquisition procedure as shown in the flowchart in the middle is very efficient and enables an information feedback to artificial intelligence for continuous learning of the data acquisition system 1. As an alternative to a manual operation switch or button, the opening and closing triggers of the measurement window or the verification time window and the signal of the next plugging process can also be performed automatically, for example by entering and exiting a geofence (as in a real-time positioning system) or by reading an audio ID, a barcode, a data matrix code or an RFID tag.
[0058] Many other embodiments can be formed in addition to the data acquisition system embodiments described above and shown in the drawings (for acquiring measurement data, in particular for an identification system for identifying incorrectly installed plug connections of plug connectors) and such identification systems, in particular comprising any combination of the features described above, in which at least two measurement units, at least one data analysis unit and at least one flexible carrier can be respectively provided, for arranging the measurement units and the data analysis unit, in particular in the form of a wrist unit on the hand or wrist of an operating person performing a plug-in process. The at least two measurement units and the data analysis unit are arranged in close proximity to one another. The measurement units respectively comprise at least one acceleration sensor, and at least one of the measurement units comprises at least one microphone.
[0059] List of reference signs 1 data acquisition system 2 flexible carrier 3 measurement unit 4 measurement unit 5 data analysis unit 6 measurement unit 7 measurement unit 8 measurement unit 9 wrist unit 10 (right) hand 11 finger / index finger 12 finger / middle finger 13 finger / ring finger 14 finger / pinky finger 15 thumb 16 left hand 18 operating person 30 microphone 31 housing 32 opening 3331 interior 34 membrane 35 first acceleration sensor 36 second acceleration sensor 37 LED 40 housing 41 acceleration sensor 42 electronics 43 LED 4440 interior 90 housing 91 opening 92 membrane 9390 interior 94 microphone 95 microcontroller 96 acceleration sensor 97 gyroscope 98 RFID antenna / gating 99 sending unit 100 LED 110 distal arrangement 111 intermediate arrangement 112 proximal arrangement / within metacarpal region 113 intermediate arrangement 150 thumb tip 200 first assembly station 201 second assembly station 202 third assembly station 210 data transmitter 211 data transmission 212 database 213 cloud 214 user data processing / visualization device 220 first step 221 second step 222 third step 223 fourth step 224 fifth step 225 sixth step 226 seventh step 227 eighth step 228 ninth step 229 tenth step 230 eleventh step 231 twelfth step 232 thirteenth step 233 fourteenth step 234 fifteenth step P1 arrow S1 threshold T E event trigger S2 threshold T MV assembly trigger / attempt at assembly S3 threshold M A assembly amplitude / verification of assembly M V verification time window / measurement window.
Claims
1. An identification system for identifying an incorrectly installed plug connection of a plug connector, wherein The recognition system comprises at least one plug-in attempt recognition device for recognizing a plug-in attempt, at least one measuring unit (3, 4, 6, 7, 8) for capturing plug-in process data, and at least one verification device for verifying the plug-in connection by means of a data profile of the captured plug-in process data.
2. The identification system of claim 1, wherein, At least one first measuring unit is provided for recognizing the gesture of a plug-in attempt, and at least one second measuring unit is provided for capturing the plug-in process, wherein data on acceleration and / or force and release energy are captured by sound.
3. The identification system according to claim 1 or 2, characterized in that The recognition system comprises at least one artificial intelligence, by means of which all measuring unit inputs as input are converted into a binary output for displaying the result of the decision on a correct plug-in connection or an incorrect plug-in connection.
4. The identification system according to any of the preceding claims, characterized in that The measuring units can be arranged or have been arranged on at least one finger (11, 12, 13, 14) and the thumb (15) of at least one hand (10, 16) of an operating person (18) performing the plug-in process, in particular by arranging the measuring units (3, 4, 6, 7, 8) on or at at least one carrier, in particular a flexible carrier (2).
5. The identification system according to any of the preceding claims, characterized in that, The recognition system comprises at least one wrist unit (9) for arranging on the wrist of an operating person (18) performing a plug-in process, wherein the at least one wrist unit (9) comprises at least one microphone (94) for capturing ambient sound and at least one microcontroller (95), wherein in the sound data processing of the at least one microcontroller (95) of the wrist unit (9), data captured by a measuring unit (3) that can be arranged or arranged on the thumb (15) of a hand (10, 16) of an operating person (18) are compared in order to improve the recognition of the sound features of the locking of the plug-in partner of the plug-in connector.
6. The identification system of claim 5, wherein, The at least one wrist unit (9) comprises at least one gyroscope (97), wherein the gyroscope (97) acquires movement data of the hand (10, 16) of the operator (18), which are used as a recognition trigger for opening a measurement window (M V ) in which the presence of data or signals characteristic of a correct plugging process is checked. V 7. The identification system according to any one of claims 4 to 6, characterized in that, The measuring units (3, 4, 6, 7, 8) can be arranged or have been arranged in the middle or proximal position of a finger (11, 12, 13, 14) and / or the thumb (15) of at least one hand (10, 16) of an operating person (18), in particular when the measuring units (3, 4) are arranged on or between the thumb (15) and the index finger (11) of at least one hand (10) of an operating person (18), the measuring units (3, 4) can be arranged or have been arranged in the metacarpal region of the hand (10).
8. The identification system of claim 7, wherein, The measuring units (3, 4, 6, 7, 8) are arranged in a rotational or rotational manner on the middle phalanx or the proximal phalanx, in particular when arranged on the thumb (15) of a hand (10), facing the medial direction of the index finger (11) of this hand (10), when arranged on the index finger (11) of a hand (10), facing the medial direction of the thumb (15), in particular rotating towards the upper side direction of the hand (10), when arranged on the middle finger (12) and / or ring finger (13) and / or little finger (14) of a hand (10), arranged towards the upper side direction of the hand (10) of an operating person (18).
9. A data acquisition system (1) for acquiring measurement data, in particular for an identification system according to any one of the preceding claims, characterized in that The data acquisition system (1) comprises at least two measuring units (3, 4), at least one data analysis unit (5) and at least one flexible carrier (2), wherein the at least two measuring units (3, 4) and the data analysis unit (5) are arranged next to each other on the flexible carrier (2), wherein the measuring units (3, 4) each comprise at least one acceleration pick-up or acceleration sensor (35, 36) and at least one of the measuring units (3, 4) comprises at least one microphone (30).
10. The data acquisition system (1) according to claim 9, characterized in that The at least one microphone (30) in the at least one measuring unit (3, 4) is directed towards the tip of the thumb (150) of the hand (10) of the thumb (15) of an operator (18) wearing the measuring unit (3, 4, 6, 7, 8).
11. The data acquisition system (1) according to claim 10, characterized in that In the housing (31) of the measuring unit (3) at least one opening (32) is provided, which is covered by at least one membrane (34) to prevent dust and moisture.
12. The data acquisition system (1) according to any one of claims 9 to 11, characterized in that At least one wrist unit (9) is provided, wherein the at least one wrist unit (9) comprises at least one gyroscope (97) and one 3-axis acceleration pick-up (96).
13. The data acquisition system (1) according to claim 12, characterized in that The at least one wrist unit (9) comprises at least one microphone (94) for receiving ambient noise.
14. The data acquisition system (1) according to claim 12 or 13, characterized in that The at least one wrist unit (9) comprises at least one RFID unit (98) by means of which a corresponding assembly station (200, 201, 202) into which the wrist unit (9) is put into operation or a plug with an RFID tag in the same IT system can be identified or realized as identifiable as a plug connection verified by the data acquisition system (1).
15. The data acquisition system (1) according to any one of claims 9 to 14, characterized in that The data acquisition system (1) can be equipped or has been equipped with at least one transmission device (99) for transmitting the acquired data to a data transmitter (210), in particular a gateway, a server or an edge device as data transmitter, by means of wireless local area networks, LTE, Bluetooth and / or radio technology, with at least one local or cloud-based database (212) for storing the collected data, with a cloud (213) for performing an analysis of the plug-in process and with at least one graphical analysis unit (214) for displaying the analysis results.
16. The data acquisition system (1) according to any one of claims 9 to 15, characterized in that The at least one flexible carrier (2) is configured in the form of a glove, a finger glove and / or at least two straps, which interconnect the at least two measuring units (3, 4, 6, 7, 8) and the at least one wrist unit (9) with each other.
Citation Information
Patent Citations
Device and method for monitoring the assembly of two components to be joined by means of a clip fastening
DE102014016153A1
system AND METHOD FOR DETECTING THE LOCKING OF A MANUAL CONNECTION OF A QUICK CONNECTOR.
FR3024522B1
Control system and method for controlling the installation of a coupling device
WO2013131632A1
Connector mating assurance system and method
WO2015053936A1
Device and method for monitoring the assembly of two components to be connected using a clip fastening
WO2016070984A1