Boarding bridge control system
By introducing attention recognition devices into the boarding bridge control system, identifying and responding to operator attention abnormalities, the risk of operational errors caused by inattention is solved and safety is improved.
Patent Information
- Application Number
- CN202421549114.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Utility models(China)
- Current Assignee / Owner
- Filing Date
- 2024-07-01
- Publication Date
- 2025-03-21
- Estimated Expiration
- 2034-07-01
AI Technical Summary
The existing boarding bridge operators have increased the risk of operating errors due to inattention, causing safety hazards and potential accidents.
A boarding bridge control system is designed, including a boarding bridge remote control platform and attention recognition device. By identifying the operator's attention abnormality, alarm information or stop boarding bridge motion signals are output to the remote control platform.
By identifying and responding to abnormal attention of operators, the risk of errors in boarding bridge operation is reduced and safety hazards and potential accidents are avoided.
Smart Images

Figure CN222653285U_ABST
Abstract
Description
Technical Field
[0001] The utility model embodiment relates to the technical field of boarding bridge control, and in particular to a boarding bridge control system. Background Art
[0002] Passenger boarding bridges are special equipment that connect aircraft and terminal buildings. They are closed passageways for passengers to board and disembark. They not only provide passengers with a safe and comfortable transition space, but also protect the internal environment of the aircraft by reducing direct exposure to the aircraft door. With the development of technology, the design of modern boarding bridges pays more and more attention to flexibility and adaptability to meet the needs of different types of aircraft and airports of different sizes.
[0003] Usually, the operation of boarding bridges requires remote operation. However, when operators monitor the screen for a long time and perform repetitive tasks, they may lose concentration due to fatigue or environmental interference, which increases the risk of errors in boarding bridge operation, causing safety hazards and potential accidents. Utility Model Content
[0004] The utility model provides a boarding bridge control system to solve the problem that the risk of boarding bridge operation errors increases due to the lack of concentration of the existing boarding bridge operators, causing safety hazards and potential accidents.
[0005] According to one aspect of the utility model, there is provided a boarding bridge control system, comprising a boarding bridge remote control platform and an attention recognition device, wherein the boarding bridge remote control platform is communicatively connected to the attention recognition device, and the boarding bridge remote control platform is communicatively connected to the boarding bridge;
[0006] The boarding bridge remote control platform is used to output a first start signal to the boarding bridge, output a second start signal to the attention recognition device, and receive an alarm message and / or a signal to stop the boarding bridge movement output by the attention recognition device;
[0007] The attention recognition device is used to receive the second start signal, and when it is recognized that the attention of the operator corresponding to the boarding bridge is abnormal, it outputs an alarm message and / or stops the boarding bridge movement signal to the boarding bridge remote control platform.
[0008] The boarding bridge control system provided by the embodiment of the utility model includes a boarding bridge remote control platform and an attention recognition device, wherein the boarding bridge remote control platform is communicatively connected with the attention recognition device, and the boarding bridge remote control platform is communicatively connected with the boarding bridge; the boarding bridge remote control platform is used to output a first start signal to the boarding bridge, and output a second start signal to the attention recognition device, and receive an alarm message and / or a stop boarding bridge movement signal output by the attention recognition device; the attention recognition device is used to receive the second start signal, and when it is identified that the attention of the operator corresponding to the boarding bridge is abnormal, it outputs an alarm message and / or a stop boarding bridge movement signal to the boarding bridge remote control platform. Through the above technical scheme, the attention of the operator corresponding to the boarding bridge can be identified by adding an attention recognition device, and then when it is identified that the attention is abnormal, it can output an alarm message and / or a stop boarding bridge movement signal to the boarding bridge remote control platform, which can reduce the risk of boarding bridge operation errors and avoid safety hazards and potential accidents.
[0009] It should be understood that the contents described in this section are not intended to identify the key or important features of the embodiments of the present utility model, nor are they intended to limit the scope of the present utility model. Other features of the present utility model will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS
[0010] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.
[0011] Figure 1 It is a structural schematic diagram of a boarding bridge control system provided by the first embodiment of the utility model;
[0012] Figure 2 It is a structural schematic diagram of a boarding bridge control system provided by the utility model;
[0013] Figure 3 This is a structural schematic diagram of a boarding bridge control system provided by Embodiment 2 of the present utility model;
[0014] Figure 4 The utility model is a structural schematic diagram of a boarding bridge control system. DETAILED DESCRIPTION
[0015] In order to enable those skilled in the art to better understand the solution of the utility model, the technical solution in the embodiment of the utility model will be clearly and completely described below in conjunction with the drawings in the embodiment of the utility model. Obviously, the described embodiment is only a part of the embodiment of the utility model, not all of the embodiments. Based on the embodiment of the utility model, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of the utility model.
[0016] It should be noted that the terms "first", "second", etc. in the specification and claims of the utility model and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged where appropriate, so that the embodiments of the utility model described here can be implemented in an order other than those illustrated or described here. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions, for example, a process, system, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, systems, products or devices.
[0017] Embodiment 1
[0018] Figure 1 1 is a schematic diagram of a control system for a boarding bridge provided by the first embodiment of the utility model. This embodiment is applicable to the case where the operator's attention is identified when the operator remotely controls the movement of the boarding bridge at the airport. Figure 1 As shown, the boarding bridge control system 10 includes: a boarding bridge remote control platform 101 and an attention recognition device 102 , the boarding bridge remote control platform 101 is communicatively connected to the attention recognition device 102 , and the boarding bridge remote control platform 101 is communicatively connected to the boarding bridge 11 .
[0019] Among them, the boarding bridge remote control platform is used to output a first start signal to the boarding bridge, and output a second start signal to the attention identification device, and receive an alarm message and / or a stop boarding bridge movement signal output by the attention identification device; the attention identification device is used to receive the second start signal, and when it is identified that there is an abnormality in the attention of the operator corresponding to the boarding bridge, output an alarm message and / or a stop boarding bridge movement signal to the boarding bridge remote control platform.
[0020] In this embodiment, the boarding bridge can be understood as a mobile passage that enables passengers to enter the aircraft directly from the airport terminal safely and conveniently. The boarding bridge remote control platform is used to remotely control the movement of the boarding bridge to achieve the docking and separation of the boarding bridge and the aircraft. The attention recognition device is used to monitor the operator's concentration in real time when operating the boarding bridge, and the operator corresponding to the boarding bridge can remotely operate the boarding bridge through the boarding bridge remote control platform. The first start signal can be understood as a signal to start the movement of the boarding bridge. Among them, the movement of the boarding bridge includes the extension, rotation, lifting and docking and separation of the boarding bridge with the aircraft cabin door. The second start signal can be understood as a signal to start the operation of the attention device. The alarm information can be understood as a warning notice displayed on the boarding bridge remote control platform. The boarding bridge movement stop signal can be understood as a signal to stop the boarding bridge movement.
[0021] Optionally, the operator can set in advance whether to directly control the boarding bridge to stop moving when the boarding bridge remote control platform receives a signal to stop the boarding bridge movement.
[0022] The specific working process is as follows: the boarding bridge remote control platform outputs a first start signal to the boarding bridge to start the operation of the boarding bridge, and at the same time, the boarding bridge remote control platform outputs a second start signal to the attention recognition device to start the operation of the attention recognition device. The attention recognition device monitors the attention of the operator in real time, and when it is identified that the attention of the operator corresponding to the boarding bridge is abnormal, it outputs an alarm message and / or stops the movement of the boarding bridge to the remote control platform of the boarding bridge; the remote control platform of the boarding bridge receives the alarm message and / or stops the movement of the boarding bridge signal, and warns the operator.
[0023] Exemplarily, the attention recognition device is configured with a neural network model for attention recognition, through which it can be recognized whether the operator's attention is focused on the boarding bridge remote control platform. For example, if the neural network model recognizes that the operator's blinking times are less than the preset blinking times, and / or recognizes that the operator's yawning times exceed the preset yawning times, it is determined that the operator has entered a fatigue state, and at this time it is determined that the operator's attention is abnormal. The above neural network model can be an existing facial action recognition algorithm. The boarding bridge control system provided in the first embodiment of the utility model includes a boarding bridge remote control platform and an attention recognition device, wherein the boarding bridge remote control platform is communicatively connected with the attention recognition device, and the boarding bridge remote control platform is communicatively connected with the boarding bridge; the boarding bridge remote control platform is used to output a first start signal to the boarding bridge, and output a second start signal to the attention recognition device, and receive an alarm message and / or a stop boarding bridge movement signal output by the attention recognition device; the attention recognition device is used to receive the second start signal, and when it is identified that the attention of the operator corresponding to the boarding bridge is abnormal, it outputs an alarm message and / or a stop boarding bridge movement signal to the boarding bridge remote control platform. Through the above technical scheme, the attention of the operator corresponding to the boarding bridge can be identified by adding an attention recognition device, and then when it is identified that the attention is abnormal, it can output an alarm message and / or a stop boarding bridge movement signal to the boarding bridge remote control platform, which can reduce the risk of boarding bridge operation errors and avoid safety hazards and potential accidents.
[0024] In some embodiments, the attention identification device includes an industrial computer, a monitoring device and a signal conversion device; wherein the industrial computer is communicatively connected to the monitoring device and the signal conversion device respectively; the monitoring device is deployed above the remote control platform of the boarding bridge and facing the operator's seat; the signal conversion device is communicatively connected to the remote control platform of the boarding bridge.
[0025] In this embodiment, the monitoring device may include an eye acquisition module, a mouth acquisition module, and a face orientation acquisition module, wherein the eye acquisition module is used to obtain an eye image of the operator, the mouth acquisition module is used to obtain a mouth image of the operator, and the face orientation acquisition module is used to obtain a face orientation image of the operator. The industrial computer is used to identify whether the operator's attention is abnormal based on the image data collected by the monitoring device. The signal conversion device can be used to perform signal format conversion, for example, converting the received signal format into a signal that can be processed by the boarding bridge remote control platform, or converting the received signal into a signal that can be processed by the industrial computer.
[0026] Specifically, Figure 2This is a schematic diagram of the structure of a boarding bridge control system provided by the utility model. Figure 2 As shown, the boarding bridge control system 20 includes: a boarding bridge remote control platform 201 and an attention recognition device 202; the attention recognition device 202 includes an industrial computer 2021, a monitoring device 2022 and a signal conversion device 2023. Among them, the industrial computer 2021 is connected to the monitoring device 2022 and the signal conversion device 2023 in communication, the signal conversion device 2023 is connected to the boarding bridge remote control platform 201 in communication, and the boarding bridge remote control platform 201 is connected to the boarding bridge 21 in communication.
[0027] Among them, in actual application, the monitoring equipment is deployed above the remote control platform of the boarding bridge and directly opposite the operator's seat, that is, the monitoring range of the monitoring equipment covers the front of the operator operating the remote control platform of the boarding bridge.
[0028] In some embodiments, the monitoring device is used to output collected data to the industrial computer; the industrial computer is used to receive the collected data, and when it is determined that there is an abnormality in the operator's attention, output a first alarm message and / or a first stop boarding bridge movement signal to the signal conversion device; the signal conversion device is used to receive the first alarm message and / or the first stop boarding bridge movement signal, and output a second alarm message and / or a second stop boarding bridge movement signal to the boarding bridge remote control platform; the boarding bridge remote control platform is used to receive the second alarm message and / or the second stop boarding bridge movement signal.
[0029] Specifically, when the industrial computer, monitoring equipment and signal conversion equipment are started, the monitoring equipment will obtain the collected data of the operator, which may include eye pictures, mouth pictures and facial orientation pictures, and output the collected data to the industrial computer. The industrial computer receives the collected data and determines whether there is any abnormality in the operator's attention based on the collected data. When it is determined that there is any abnormality in the attention, it outputs the first alarm information and / or the first stop boarding bridge movement signal to the signal conversion equipment; the signal conversion equipment receives the first alarm information and / or the first stop boarding bridge movement signal and converts it into the second alarm information and / or the second stop boarding bridge movement signal that can be processed by the boarding bridge remote control platform, and outputs it to the boarding bridge remote control platform; after receiving the second alarm information and / or the second stop boarding bridge movement signal, the boarding bridge remote control platform can remind the operator.
[0030] Optionally, the operator may pre-set whether to stop the movement of the boarding bridge directly after the boarding bridge remote control platform receives the second signal to stop the movement of the boarding bridge.
[0031] Optionally, the industrial computer can store the received collected data.
[0032] Optionally, the industrial computer can judge the abnormality of attention in the following ways:
[0033] Identify the number of eye blinks, mouth yawns and face orientation in the data collected within a preset time period, and judge whether the operator's attention is abnormal based on the number of eye blinks, mouth yawns and face orientation.
[0034] Embodiment 2
[0035] Figure 3 This is a schematic diagram of the structure of a boarding bridge control system provided by the second embodiment of the utility model. This embodiment is optimized and expanded on the basis of the above optional embodiments. The attention recognition device also includes a warning device, wherein the warning device is connected to the industrial computer for communication; the industrial computer is also used to output an alarm signal to the warning device; the warning device is used to receive the alarm signal and issue an alarm. Figure 3 As shown, the boarding bridge control system 30 includes: a boarding bridge remote control platform 301 and an attention recognition device 302; the attention recognition device 302 includes an industrial computer 3021, a monitoring device 3022, a signal conversion device 3023 and a warning device 3024; wherein the industrial computer 3021 is respectively communicated with the monitoring device 3022, the signal conversion device 3023 and the warning device 3024, the signal conversion device 3023 is communicated with the boarding bridge remote control platform 301, and the boarding bridge remote control platform 302 is communicated with the boarding bridge 31.
[0036] The specific working process is as follows:
[0037] When the industrial computer, monitoring equipment and signal conversion equipment are started, the monitoring equipment will obtain the collected data of the operator, which may include eye pictures, mouth pictures and face orientation pictures, and output the collected data to the industrial computer. The industrial computer receives the collected data and outputs the first alarm information and / or the first stop boarding bridge movement signal to the signal conversion equipment when it recognizes that there is an abnormality in attention; the signal conversion equipment receives the first alarm information and / or the first stop boarding bridge movement signal and converts it into the second alarm information and / or the second stop boarding bridge movement signal that can be processed by the boarding bridge remote control platform, and outputs it to the boarding bridge remote control platform; after receiving the second alarm information and / or the second stop boarding bridge movement signal, the boarding bridge remote control platform can remind the operator; at the same time, the industrial computer will also send an alarm signal to the warning device, so that the warning device will alarm the operator after receiving the alarm signal. Among them, the warning device can be a warning light, a vibrator, a sound alarm, etc.
[0038] The boarding bridge control system provided in the second embodiment of the present utility model can effectively improve the safety and response speed of the system and further enhance the reliability of the system by alarming the operator through the warning device.
[0039] In some embodiments, the boarding bridge remote control platform is further used to output the second start signal to the signal conversion device; the industrial computer is further used to output a third start signal to the monitoring device.
[0040] Specifically, the boarding bridge remote control platform outputs a first start signal to the boarding bridge, and while starting the boarding bridge, it outputs a second start signal to the signal conversion device. After receiving the second start signal, the signal conversion device converts the second start signal into a conversion start signal that can be received by the industrial computer, and outputs it to the industrial computer to start the operation of the industrial computer. Then the industrial computer will output a third start signal to the monitoring device to start the operation of the monitoring device. Through the transmission and conversion of the start signal, the boarding bridge and its related equipment are started safely, efficiently and orderly, and the overall operation efficiency and reliability of the system are improved.
[0041] In some embodiments, the monitoring device includes an artificial intelligence camera.
[0042] In this embodiment, in order to provide more accurate image capture and scene adaptation capabilities, the monitoring device adopts an artificial intelligence camera.
[0043] In some embodiments, the warning device includes a vibrator and / or a warning light.
[0044] In this embodiment, in order to warn the operator more promptly and improve the response speed of the warning, the warning device may use a vibrator and / or a warning light.
[0045] In some embodiments, the industrial computer includes a reset button.
[0046] Among them, the reset button is used to immediately reset the device to its initial state or preset configuration.
[0047] In some embodiments, the industrial computer is further configured to output a first reset signal to the warning device and a second reset signal to the signal conversion device when a reset button is in a pressed state.
[0048] Specifically, when the reset button is pressed, the industrial computer outputs a first reset signal to the warning device to restore the warning device to its initial state or preset configuration, and clears the alarm signal output by the industrial computer to the warning device. At the same time, a second reset signal is output to the signal conversion device to restore the signal conversion device to its initial state or preset configuration, clear the alarm information output by the industrial computer to the signal conversion device and / or stop the boarding bridge movement signal. This improves the response speed and safety of the system and avoids unnecessary downtime.
[0049] In some embodiments, the industrial computer is configured with an artificial intelligence model for identifying whether there is any abnormality in the attention of the operator corresponding to the boarding bridge.
[0050] Specifically, an artificial intelligence model for identifying whether the operator's attention corresponding to the boarding bridge is abnormal is configured in the industrial computer. The monitoring device obtains the collected data and outputs the collected data to the artificial intelligence model of the industrial computer. The artificial intelligence model will identify the features of the collected data, such as the number of eye blinks, the number of yawns, and the direction of the face, and judge whether the operator's attention is abnormal based on the identified features.
[0051] Optionally, the industrial computer can also be used to store collected data. After the real-time monitoring is completed, the collected data is automatically labeled using artificial intelligence models and automated labeling tools to generate a real-time training set. Then, the models to be trained of different sizes are determined through preset parameters and artificial intelligence models. The target training model is determined in order of size from small to large, and the target training model is trained and verified using the real-time training set. If the verification result does not meet the preset requirements, a model to be trained of another size is used as the target training model for training. If the preset requirements are met, the trained model is compared with the artificial intelligence model. If the verification result is better than the result of the artificial intelligence model, the artificial intelligence model is replaced. Otherwise, the original artificial intelligence model is kept and only the data set is filled.
[0052] As an example, Figure 4 This is a schematic diagram of the structure of a boarding bridge control system provided by the utility model. Figure 4As shown, it includes a boarding bridge remote control platform, a signal conversion device, an industrial computer, an artificial intelligence (AI) camera, a vibrator and a warning light. When the boarding bridge remote control platform starts running, the signal conversion device triggers the industrial computer to run, and the industrial computer triggers the operation of the AI camera. The AI camera obtains the operator's collection data and inputs it into the industrial computer. The industrial computer begins to recognize the number of eye blinks, the number of mouth yawns, and the face orientation, and uses this to judge the operator's concentration. Among them, the industrial computer refreshes the count every 20 seconds. If it is determined that the attention is abnormal, the vibrator and the warning light are started, and a signal to stop the boarding bridge movement is sent to the remote control platform through the signal conversion module. The operator can set whether to stop the boarding bridge movement directly when receiving the signal to stop the boarding bridge movement. During the operation, this system will automatically store the collected data, and after the real-time monitoring operation is completed, the collected data will be automatically labeled to generate a real-time training set to train the artificial intelligence model online to further improve the accuracy of operator attention recognition.
[0053] Note that the above are only preferred embodiments of the present invention and the technical principles used. Those skilled in the art will understand that the present invention is not limited to the specific embodiments described herein, and that various obvious changes, readjustments and substitutions can be made by those skilled in the art without departing from the scope of protection of the present invention. Therefore, although the present invention is described in more detail through the above embodiments, the present invention is not limited to the above embodiments, and may include more other equivalent embodiments without departing from the concept of the present invention, and the scope of the present invention is determined by the scope of the appended claims.
Claims
1. A boarding bridge control system, characterized in that: It includes a boarding bridge remote control platform and an attention recognition device, wherein the boarding bridge remote control platform is communicatively connected to the attention recognition device, and the boarding bridge remote control platform is communicatively connected to the boarding bridge; The boarding bridge remote control platform is used to output a first start signal to the boarding bridge, output a second start signal to the attention recognition device, and receive an alarm message and / or a signal to stop the boarding bridge movement output by the attention recognition device; The attention recognition device is used to receive the second start signal, and when it is recognized that the attention of the operator corresponding to the boarding bridge is abnormal, it outputs an alarm message and / or stops the boarding bridge movement signal to the boarding bridge remote control platform.
2. The system according to claim 1, characterized in that The attention recognition device includes an industrial computer, a monitoring device and a signal conversion device; wherein, The industrial computer is communicatively connected with the monitoring device and the signal conversion device respectively; The monitoring device is deployed above the remote control platform of the boarding bridge and directly facing the seat of the operator; The signal conversion device is communicatively connected to the boarding bridge remote control platform.
3. The system according to claim 2, characterized in that The monitoring device is used to output the collected data to the industrial computer; The industrial computer is used to receive the collected data, and when determining that the operator's attention is abnormal, output a first alarm message and / or a first stop boarding bridge movement signal to the signal conversion device; The signal conversion device is used to receive the first alarm information and / or the first stop boarding bridge movement signal, and output the second alarm information and / or the second stop boarding bridge movement signal to the boarding bridge remote control platform; The boarding bridge remote control platform is used to receive the second alarm information and / or the second signal to stop the boarding bridge movement.
4. The system according to claim 2, characterized in that The attention recognition device further comprises a warning device, wherein the warning device is communicatively connected to the industrial computer; The industrial computer is also used to output an alarm signal to the warning device; The warning device is used to receive the alarm signal and issue an alarm.
5. The system according to claim 2, characterized in that The boarding bridge remote control platform is also used to output the second start signal to the signal conversion device; the industrial computer is also used to output the third start signal to the monitoring device.
6. The system according to claim 2, characterized in that The monitoring equipment includes an artificial intelligence camera.
7. The system according to claim 4, characterized in that The warning device includes a vibrator and / or a warning light.
8. The system according to claim 7, characterized in that The industrial computer comprises a reset button.
9. The system according to claim 8, characterized in that The industrial computer is also used to output a first reset signal to the warning device and a second reset signal to the signal conversion device when the reset button is in a pressed state.
10. The system according to claim 2, characterized in that The industrial computer is configured with an artificial intelligence model for identifying whether there is an abnormality in the attention of the operator corresponding to the boarding bridge.