Intelligent man-machine safety active early warning system of loading machine
The intelligent human-machine safety proactive early warning system for loaders utilizes AI humanoid cameras and sound and light alarms to solve the accident risks caused by limited visibility during loader operation, achieving efficient identification of personnel and timely alarms, thus reducing the probability of accidents.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-08-27
- Publication Date
- 2026-03-13
AI Technical Summary
The interaction between large loaders and personnel during operations is hampered by limited visibility, which increases the risk of accidents. Traditional safety management methods are unable to effectively reduce the probability of accidents.
The loader adopts an intelligent human-machine safety active early warning system, which includes an integrated alarm display host installed in the cab, an outdoor controller, and multiple AI humanoid cameras. It identifies personnel positions through image processing and analysis, sets warning boundaries, and issues timely audible and visual alarms when visibility is limited.
It achieves high-intensity identification and sensitive response to personnel, can promptly issue alarms, reduce the risk of accidents during loader operation, and ensure the safety of personnel within the safety warning range.
Smart Images

Figure CN121661771A_ABST
Abstract
Description
Technical Field
[0001] This invention relates to the field of loader technology, specifically to an intelligent human-machine safety proactive early warning system for loaders. Background Technology
[0002] In large industrial and mining enterprises, port terminals, and logistics and warehousing industries, there is frequent interaction between large loaders and personnel. However, due to the significant blind spots of large machinery, accidents involving machinery and personnel often occur. Currently, these work environments typically manage the safe distance between machinery and personnel by setting up warning lines and having personnel provide on-site reminders. However, this traditional method has many problems: on the one hand, personnel may become complacent about warning lines due to long-term inertia, or be unable to fully perceive their surroundings due to limited visibility. On the other hand, especially at night, poor visibility increases the risk of accidents and seriously threatens the personal safety of personnel. Summary of the Invention
[0003] In view of this, the purpose of the present invention is to provide an intelligent human-machine safety active early warning system for loaders, so as to solve the problem that loaders cannot fully grasp the surrounding environment due to limited visibility during operation, which leads to an increased risk of accidents.
[0004] Based on the above objectives, the present invention provides the following technical solution: an intelligent human-machine safety active early warning system for loaders, including an integrated alarm and display host installed in the cab of the loader;
[0005] An outdoor controller installed outside the loader's cab;
[0006] AI humanoid cameras are installed under the vehicle body and bucket, and multiple AI humanoid cameras are installed.
[0007] The alarm display unit is connected to the outdoor controller via a wire, and the AI humanoid camera is connected to the outdoor controller via a network cable.
[0008] Preferably, the alarm display all-in-one machine is equipped with a data computing module, an image processing core module connected to the data computer module, an I / O input / output module, an image storage module, a WIFI / GPRS network module, an alarm reminder voice module, and a display screen brightness intelligent adjustment module.
[0009] Preferably, the outdoor controller is connected to multiple AI humanoid cameras.
[0010] Preferably, the outdoor controller is externally connected to an audible and visual alarm and a voice speaker.
[0011] Preferably, the AI humanoid camera is used to set warning boundaries.
[0012] Preferably, the AI humanoid camera is used to analyze and judge the human shape, the human's limbs, the human's clothing features, and the number of people sensed.
[0013] Compared with the prior art, the beneficial effects of the present invention are as follows:
[0014] This invention provides an intelligent human-machine safety proactive early warning system for loaders. Through the integration of an alarm display host, an outdoor controller, and an AI human-shaped camera, it can accurately analyze and calculate the human shape, limb parts, clothing features, and quantity. It boasts advantages such as high-intensity recognition, sensitive response, and timely alarm. Furthermore, it allows for setting warning zones in any shape and adjusting the sensitivity of personnel sensors. It can simultaneously alert the loader driver and personnel entering the warning zone. Applicable to various operational scenarios, it meets the needs of different users, effectively reducing the risk of accidents during loader operation and ensuring the safety of personnel within the safety warning range. Attached Figure Description
[0015] To more clearly illustrate the technical solutions in this invention or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only for this invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.
[0016] Figure 1 This is an overall framework diagram of the present invention. Detailed Implementation
[0017] To make the objectives, technical solutions, and advantages of this invention clearer, the invention will be further described in detail below with reference to specific embodiments.
[0018] It should be noted that, unless otherwise defined, the technical or scientific terms used in this invention should have the ordinary meaning understood by one of ordinary skill in the art to which this invention pertains. The terms "first," "second," and similar terms used in this invention do not indicate any order, quantity, or importance, but are merely used to distinguish different components. Terms such as "comprising" or "including" mean that the element or object preceding the word encompasses the elements or objects listed following the word and their equivalents, without excluding other elements or objects. Terms such as "connected" or "linked" are not limited to physical or mechanical connections, but can include electrical connections, whether direct or indirect. Terms such as "upper," "lower," "left," and "right" are used only to indicate relative positional relationships; when the absolute position of the described object changes, the relative positional relationship may also change accordingly.
[0019] The present invention will be further described below with reference to embodiments.
[0020] Combination Figure 1 This invention discloses an intelligent human-machine safety proactive early warning system for loaders, comprising an integrated alarm and display host, an outdoor controller, and AI humanoid cameras. Multiple AI humanoid cameras are installed under the vehicle body and bucket. These cameras analyze and judge human figures, limbs, clothing characteristics, and the number of personnel. They also set early warning boundaries, which can be defined through the camera's management interface. These boundaries can be the entire field of view, a specific area, or a line, adapting to different application scenarios. The warning distance can be set between 0 and 20 meters. The integrated alarm and display host is installed in the loader's cab, and the outdoor controller is installed outside the cab. The outdoor controller is connected to multiple AI humanoid cameras, which are connected via network cables. The outdoor controller is equipped with an external audible and visual alarm and a speaker. The speaker consists of a speaker unit, an audio processor, a controller, a memory, a power module, a housing, and a mounting bracket.
[0021] The speaker unit is the core component of a loudspeaker, responsible for converting electrical signals into sound signals and amplifying them for output. It typically consists of one or more speaker units and possesses excellent sound transmission and diffusion performance, effectively propagating sound into the surrounding environment. The audio processor is the control center of the loudspeaker, responsible for receiving, decoding, and processing the input audio signals. An audio processor usually includes a digital signal processor (DSP) or audio decoder, enabling real-time processing and optimization of the audio signals to ensure clear and stable output sound quality. The loudspeaker controller is the main intelligent control unit, responsible for managing and regulating the speaker's various functions and parameters. This controller typically includes a microprocessor or control chip, capable of triggering voice playback based on preset logic and conditions, and controlling parameters such as volume and playback mode. The speaker's internal memory stores preset voice content, such as alarm messages and broadcast notifications. This memory typically includes a flash memory chip or memory card, capable of storing a large number of voice files and supporting fast reading and updating. A power module provides the speaker with the necessary power, usually including a power converter or battery, which converts the power input to the appropriate voltage and current for the speaker and controller. The housing and mounting bracket serve as the external packaging and support for the speaker, protecting the internal electronic components from external environmental influences and facilitating installation in locations where voice playback is required, such as on an outdoor controller housing. These components work together to enable the speaker to play preset voice content, such as alarms, notifications, and broadcasts, when needed, providing information and guidance to people, thereby achieving functions such as safety management and emergency response.
[0022] The sound and light alarm can emit a bright flashing light and a loud alarm sound to attract people's attention and alert people in the vicinity that there is danger. This will remind people who have entered the warning area. At the same time, the voice speaker can play pre-recorded warning voice messages to further enhance the warning effect and remind people to take action to avoid potential dangers.
[0023] A sound and light alarm consists of a sound generator, a light generator, a controller, a power module, a housing, and a mounting bracket. The sound generator is one of the core components, responsible for producing the alarm sound. It typically includes one or more speaker units, capable of emitting a high-volume alarm sound to attract the attention of those nearby. The light generator usually includes one or more flashing lights or LEDs, responsible for producing bright, flashing light. When the alarm is triggered, the light generator enhances the visibility of the alarm by flashing, attracting people's attention. The controller is the intelligent core of the sound and light alarm, responsible for receiving external signals and controlling the generation of sound and light. The controller typically... It includes a microprocessor or control chip that can trigger an alarm according to preset logic and conditions. The power module provides the power required by the audible and visual alarm. It usually includes a power converter or battery that can convert the power input into voltage and current suitable for the sound generator and light generator. The housing and mounting bracket are the external packaging and installation support of the audible and visual alarm, which can protect the internal electronic components from the influence of the external environment and facilitate installation in the location where the alarm is needed, such as on the outdoor controller housing. These components work together to enable the audible and visual alarm to emit a clear alarm signal when needed, reminding people to pay attention to the surrounding safety situation, thereby reducing the occurrence of accidents.
[0024] Combination Figure 1 The alarm display unit is connected to the outdoor controller via a wire. The alarm display unit is equipped with a data calculation module, an image processing core module connected to the data calculation module, an I / O input / output module, an image storage module, a WIFI / GPRS network module, an alarm reminder voice module, and an intelligent brightness adjustment module for the display screen.
[0025] Combination Figure 1 The data calculation module is the central control unit within the alarm display all-in-one machine, and it communicates and controls the image processing core module, I / O input / output module, image storage module, WIFI / GPRS network module, alarm reminder voice module, and display screen brightness intelligent adjustment module.
[0026] The image processing core module is connected to the data computing module, which is used to process the image data captured by the camera.
[0027] The I / O input / output module is responsible for receiving external signals or transmitting alarm information and interacting with the data calculation module. This I / O input / output module usually includes various types of interfaces and ports for connecting the loader operator console or other computer systems with external devices, thereby establishing data transmission and communication between various devices, enabling the system to interact with the outside world and realize various functions and applications.
[0028] Image storage modules are typically connected to data processing modules and are used to store processed image data.
[0029] The Wi-Fi / GPRS network module connects to the data computing module for network communication, sending alarm information, or receiving remote commands. Wi-Fi is a local area network (LAN) technology typically used for wirelessly connecting devices to the internet or other devices over short distances. GPRS is a mobile communication technology used for data transmission over mobile networks. GPRS technology allows mobile devices to connect to the internet via wireless networks and supports a range of data services, such as video images, web browsing, and instant messaging. The Wi-Fi / GPRS network module integrates Wi-Fi and GPRS functionality, enabling devices to simultaneously support both Wi-Fi and GPRS network connections. This achieves wider network coverage and more flexible communication methods, improving transmission efficiency between modules and devices.
[0030] The alarm notification voice module is connected to the data computing module and is used to issue alarm sounds or voice prompts;
[0031] The intelligent brightness adjustment module for the display screen is connected to the data calculation module and is used to adjust the brightness of the display screen.
[0032] In this embodiment, the data calculation module is responsible for receiving and processing data from various AI humanoid cameras, executing various algorithms to detect anomalies and trigger corresponding alarms. The image processing core module is responsible for processing image data captured from the cameras, performing image recognition, analysis, and processing to detect humanoid figures, vehicles, or other objects, and determining their location, movement trajectory, and other information. The I / O input / output module provides input and output interfaces for connecting to external devices to receive external data or send control signals. The image storage module stores image and video data captured by the AI humanoid cameras for later viewing, analysis, or use as evidence. The WIFI / GPRS network module provides wireless network connectivity and communicates with other devices or servers, such as sending alarm information or receiving remote control commands. The alarm reminder voice module generates and plays alarm sounds or voice prompts to alert the surrounding environment to potential dangers. The intelligent brightness adjustment module controls the brightness of the display screen, intelligently adjusting it according to ambient light and user settings to ensure visibility and comfort under different lighting conditions. Through the collaborative work of these modules, the functions of the alarm display all-in-one machine are constituted.
[0033] In summary, setting the detection range and warning lines for AI humanoid cameras in the user interface is a crucial task, especially in environments where ensuring construction site safety is paramount. Operators can utilize specialized software to precisely specify the shape and size of the detection area, as well as the location and specific parameters of the warning lines. Typically, operators can define the detection area on a construction site map or live camera feed using simple drag-and-drop or drawing to ensure coverage of critical areas. Then, the location and trigger conditions of the warning lines can be set according to actual needs. For example, an alarm can be triggered when personnel enter or leave the detection area, or a notification can be set for specific personnel entering a restricted area. This flexibility allows AI humanoid cameras to accurately identify and promptly respond to potential safety risks within their monitoring range, effectively reducing the likelihood of accidents. In construction site environments, configuring multiple AI humanoid cameras on loaders and using their coordinated monitoring enables comprehensive monitoring of the vehicle and the surrounding environment of the bucket, ensuring no blind spots. These AI humanoid cameras are highly intelligent, capable of accurately recognizing human figures, limbs, and even clothing features to detect potential hazards. To quickly and accurately assess dangerous behavior, the AI cameras are connected to the outdoor controller via network cable. The outdoor controller collects image data from each camera and transmits it to the data processing module and image processing core module of the alarm display host for further processing. The image processing core module receives and analyzes the images, identifying human figures, body movements, and clothing characteristics within the monitoring area in real time, and accurately determining their location, movement trajectory, and other key information. Once someone enters the designated warning area, the image processing core module will quickly identify and trigger an alarm. Upon receiving the alarm, the alarm display host will immediately flash a warning message on the screen and simultaneously issue a clear voice warning to the driver and personnel entering the warning area through the alarm reminder voice module. This design ensures that even when the driver's vision is limited or their attention is distracted, attention can still be drawn in time, thus avoiding potential dangers. At the same time, when an abnormality is detected, the sound and light alarm will issue a strong alarm and reminder to the surrounding environment through both sound and light, effectively preventing potential dangers from occurring and prompting construction site personnel to quickly take corresponding safety measures to ensure the overall safety of the construction site.
[0034] Those skilled in the art should understand that the discussion of any of the above embodiments is merely exemplary and is not intended to imply that the scope of the invention (including the claims) is limited to these examples; within the framework of the invention, the technical features of the above embodiments or different embodiments can also be combined, the steps can be implemented in any order, and there are many other variations of the different aspects of the invention as described above, which are not provided in the details for the sake of brevity.
[0035] This invention is intended to cover all such substitutions, modifications, and variations that fall within the broad scope of the appended claims. Therefore, any omissions, modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of this invention should be included within the scope of protection of this invention.
Claims
1. A loader intelligent human-machine safety active early warning system, characterized in that, include: An integrated alarm and display unit installed in the loader's cab; An outdoor controller installed outside the loader's cab; AI humanoid cameras are installed under the vehicle body and bucket, and multiple AI humanoid cameras are installed. The alarm display unit is connected to the outdoor controller via a wire, and the AI humanoid camera is connected to the outdoor controller via a network cable.
2. The intelligent human-machine safety active early warning system for loaders according to claim 1, characterized in that: The alarm display all-in-one machine is equipped with a data computing module, an image processing core module connected to the data computer module, an I / O input / output module, an image storage module, a WIFI / GPRS network module, an alarm reminder voice module, and a display screen brightness intelligent adjustment module.
3. The intelligent human-machine safety active early warning system for loaders according to claim 2, characterized in that: The data calculation module is the central control unit within the alarm display all-in-one machine, and it communicates and controls the image processing core module, I / O input / output module, image storage module, WIFI / GPRS network module, alarm reminder voice module, and display screen brightness intelligent adjustment module.
4. The intelligent human-machine safety active early warning system for loaders according to claim 3, characterized in that: The image processing core module is connected to the data computing module and is used to process the image data captured by the camera. The I / O input / output module is responsible for receiving external signals or transmitting alarm information and interacting with the data calculation module; Image storage modules are typically connected to data processing modules and are used to store processed image data. The WIFI / GPRS network module is connected to the data computing module for communicating with the network, sending alarm information, or receiving remote commands. The alarm notification voice module is connected to the data computing module and is used to issue alarm sounds or voice prompts; The display screen brightness intelligent adjustment module is connected to the data calculation module and is used to adjust the brightness of the display screen.
5. The intelligent human-machine safety active early warning system for loaders according to claim 4, characterized in that: The outdoor controller is connected to multiple AI humanoid cameras.
6. The intelligent human-machine safety active early warning system for loaders according to claim 5, characterized in that: The outdoor controller is equipped with an external audible and visual alarm and a voice speaker.
7. The intelligent human-machine safety active early warning system for loaders according to claim 6, characterized in that: The AI humanoid camera is used to set early warning boundaries.
8. The intelligent human-machine safety active early warning system for loaders according to claim 7, characterized in that: The AI humanoid camera is used to analyze and judge the human shape, the human body parts, the human's clothing characteristics, and the number of people sensed.