AI-powered forklift intelligent safety assistance system with integrated screen control

Abstract

This invention relates to the field of forklift safe driving technology, specifically to an integrated AI-powered forklift intelligent safety assistance system with screen control. It solves the problems of existing forklift safety assistance systems, which require too many parts, are complex to install, and have non-systematic components that not only make it difficult to monitor all situations at all times but may also interfere with each other during installation, hindering timely data feedback due to the complexity of the data. The system includes a data acquisition module for collecting driving data from the driver while operating the forklift. This module collects data on obstacles around the forklift, the driver's driving status, the forklift's real-time speed, and seatbelt wearing status through ADAS cameras, DMS cameras, speed sensors, and seatbelt sensors. This invention provides real-time AI intelligent monitoring and analysis of various data during forklift operation, enabling early warning and risk avoidance, and providing safe driving assistance.

Description

Technical Field

[0001] This invention relates to the field of forklift safe driving technology, specifically to an AI-powered intelligent safety assistance system for forklifts with integrated screen control. Background Technology

[0002] Forklifts, as a tool to assist people in material handling, are increasingly becoming a part of our lives, serving our needs. Forklift operation requires professional skills and strict operating procedures. Forklift drivers must be licensed and wear appropriate protective equipment. Before operation, drivers need to conduct a routine inspection of the equipment to ensure all components are functioning properly. Drivers must be correctly positioned and fasten their seatbelts. During operation, drivers must adhere to the rules and regulations of the work site. In the current environment, installing safety assistance systems on forklifts can improve driving safety. Forklift driving safety assistance involves multiple factors.

[0003] Existing safety assistance systems for forklifts require too many parts, are complex to install, and are not only difficult to monitor the entire situation at all times during use due to the non-systematic nature of the parts, but may also interfere with each other during installation, affecting their operation. Moreover, due to the complexity of the data, it is difficult to obtain timely data feedback. Therefore, they do not meet the existing needs. In response, we have proposed an AI-powered intelligent safety assistance system for forklifts with integrated screen control. Summary of the Invention

[0004] The purpose of this invention is to provide an AI-powered intelligent safety assistance system for forklifts with integrated screen control, in order to solve the problems mentioned in the background art, such as the excessive number of parts required for existing safety assistance systems for forklifts, complex installation, difficulty in monitoring all situations during use due to non-systematic parts, potential interference between parts during installation, and difficulty in obtaining timely data feedback due to the complexity of the data.

[0005] To achieve the above objectives, the present invention provides the following technical solution: an integrated AI forklift intelligent safety assistance system with screen control, comprising:

[0006] The data acquisition module is used to collect driving data of the driver when driving the forklift. It collects data on obstacles around the forklift, driver status, real-time speed of the forklift and seat belt wearing status through ADAS camera, DMS camera, speed sensor and seat belt sensor. The driver status includes the driver's fatigue level, hand position and eye field of vision.

[0007] The data processing module is used to analyze and process the data collected by the data acquisition module and compare it with the feature information in the cloud platform and local database to identify people around the forklift and the driver's driving status.

[0008] The control display module is used to coordinate the transmission of multiple data processed by the data processing module to the edge controller, and to adjust the limit thresholds of multiple data through the touch screen. When the data limit threshold is exceeded, an instruction is issued.

[0009] The action execution module is used to receive and execute instructions from the control display module that exceed the limit threshold data, drive the braking system to perform emergency braking on the forklift, and provide dual alarms and reminders through sound and light alarms;

[0010] The data processing module is located inside the edge controller, and the touch screen is fixedly embedded on the surface of the edge controller. The display direction of the touch screen is the driver's seat of the forklift.

[0011] Preferably, the data acquisition module includes an ADAS camera, a DMS camera, a speed sensor, and a seatbelt sensor. There are three ADAS cameras. The ADAS cameras and DMS cameras are both fixedly installed in the cab of the forklift. The seatbelt sensor is fixedly installed inside the seatbelt buckle, and the speed sensor is fixed on the wheel hub of the forklift.

[0012] Preferably, the ADAS camera, DMS camera, and seatbelt sensor are all connected to the edge controller via wires, and the speed sensor is wirelessly connected to the edge controller via Bluetooth.

[0013] Preferably, the data processing module includes a processor, a circuit board, and a storage unit, which are electrically connected. The storage unit includes a cloud platform and a local database, and the cloud platform and the local database contain feature information.

[0014] Preferably, the edge controller is powered by 12V. The ADAS camera and DMS camera transmit image information about the forklift's surroundings and the driver's driving status to the edge controller via wires. The wires connecting the touch screen to the edge controller are hidden. The surface of the edge controller is provided with an electromagnetic shielding layer.

[0015] Preferably, the braking system includes a motor, a brake pedal, and a brake disc. The motor is electrically connected to the edge controller. The motor receives instructions from the edge controller and drives the brake pedal and brake disc to brake the forklift. The audible and visual alarm includes a warning light and an alarm horn. Both the warning light and the alarm horn have internally recorded alarm data. The warning light and the alarm horn receive instructions from the edge controller and emit lights and sounds representing different warning functions.

[0016] Preferably, the surfaces of the three ADAS cameras and DMS cameras are all provided with a dustproof film. Each ADAS camera and DMS camera includes a lens, a sealed housing, and a camera body. A radar is provided between the lens and the housing, and the radar is used to monitor when the lens surface is contaminated.

[0017] Preferably, the edge controller includes a controller housing, multiple data interfaces, and a wireless transmission module, and the data acquisition module and the data processing module are connected through the multiple data interfaces.

[0018] Preferably, the wireless transmission module is connected to the speed sensor via Bluetooth, a cover plate is fixedly provided on the controller housing, a sealing strip is provided between the controller housing and the touch display screen, and the touch display screen is installed between the controller housing and the cover plate.

[0019] Preferably, the touch screen is a 7-inch color screen with a resolution of 1280x800. The screen is divided into multiple display areas, which are time area, vehicle status area, driving direction area, seat belt status area, face status area, location prompt area, signal sign area, road conditions around the vehicle area and driver status area. The road conditions around the vehicle area is composed of road conditions to the left front, road conditions to the right front and road conditions to the rear.

[0020] Compared with the prior art, the beneficial effects of the present invention are:

[0021] 1. This invention uses ADAS cameras, DMS cameras, speed sensors, and seat belt sensors to monitor pedestrian intrusion behavior around the forklift, driver's driving status, forklift real-time speed, and seat belt wearing status in real time, effectively improving driving safety. The edge controller integrates multiple data points and uses the data processing module to analyze and compare them to determine whether each data point exceeds the limit threshold. At the same time, the limit threshold can be adjusted through the touch screen to meet the different driving conditions and environments of the forklift. The touch screen can also display various data in real time during the driving process, which is convenient for the driver to observe and improves the driver's control and safety of driving the forklift.

[0022] 2. When a pedestrian is detected entering a dangerous area, the present invention sends a command to the action execution module through the edge controller, enabling the braking system in the action execution module to perform active braking and emergency braking operations, thereby realizing intelligent safety assistance operation for forklift driving. The warning lights and alarm horn are equipped with alarm data recorded inside. The warning lights and alarm horn receive the command from the edge controller and emit lights and sounds representing different warning functions, so as to promptly provide synchronized light and sound alarms and reminders before a risk occurs, thereby avoiding driving risks for the driver.

[0023] 3. This invention conceals the wiring connecting the touchscreen and the edge controller, and the surface of the edge controller is equipped with an electromagnetic shielding layer. By assembling the touchscreen and the edge controller into a single unit, the stability of use can be effectively improved, and external interference can be avoided. The touchscreen has no physical buttons, so it is more waterproof and dustproof, and there is no issue with the lifespan of physical buttons, making it more durable. The screen can not only display information, but also configure different functions through touch, and add various sensor accessories to achieve multi-functional integration. Communication between the touchscreen and the edge controller can be carried out inside the housing, with shorter wiring, better shielding, and less susceptibility to external electromagnetic interference. Attached Figure Description

[0024] Figure 1 This is a schematic diagram of the intelligent safety assistance system of the present invention;

[0025] Figure 2 This is a schematic diagram of the data processing module of the present invention;

[0026] Figure 3 This is a schematic diagram showing the installation locations of each module in the system of the present invention;

[0027] Figure 4 This is a schematic diagram of the power connection of the control display module of the present invention;

[0028] Figure 5 This is a schematic diagram of the edge controller of the present invention;

[0029] Figure 6 This is a schematic diagram of the screen partitioning of the touch display screen of the present invention;

[0030] Figure 7 This is a test data table for the intelligent safety assistance system of the present invention.

[0031] In the diagram: 1. Controller housing; 2. Data interface; 3. Wireless transmission module. Detailed Implementation

[0032] The technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings of the embodiments of the present invention. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments.

[0033] This invention provides two embodiments; please refer to them. Figures 1 to 4 The first embodiment of the present invention is shown, which is a screen-controlled integrated AI forklift intelligent safety assistance system, comprising:

[0034] The data acquisition module is used to collect driving data of the driver while driving the forklift. It collects data on obstacles around the forklift, driver status, real-time speed of the forklift, and seat belt wearing status through ADAS cameras, DMS cameras, speed sensors, and seat belt sensors. Driver status includes driver fatigue level, hand position, and eye field of vision. The data acquisition module includes ADAS cameras, DMS cameras, speed sensors, and seat belt sensors. There are three ADAS cameras. The ADAS cameras and DMS cameras are fixedly installed in the cab of the forklift. The seat belt sensor is fixedly installed inside the seat belt buckle. The speed sensor is fixed on the wheel hub of the forklift. The ADAS cameras, DMS cameras, speed sensors, and seat belt sensors monitor the driving of the forklift in real time, and can provide early warning and avoidance of driving risks in a timely manner.

[0035] The data processing module is used to analyze and process the data collected by the data acquisition module and compare it with the feature information in the cloud platform and local database to identify people around the forklift and the driver's driving status. The data processing module includes a processor, a circuit board and a storage unit. The processor, circuit board and storage unit are electrically connected. The storage unit includes the cloud platform and the local database. The cloud platform and the local database contain feature information. The advanced computing power of the data processing module is 2T.

[0036] The control display module is used to coordinate the transmission of multiple data from the data processing module to the edge controller, and to adjust the limit thresholds of multiple data through the touch screen. When the data limit threshold is exceeded, an instruction is issued. The data processing module is located inside the edge controller, and the touch screen is fixedly embedded on the surface of the edge controller. The display direction of the touch screen is the driver's seat of the forklift. The ADAS camera, DMS camera, and seat belt sensor are all connected to the edge controller through wires. The speed sensor is wirelessly connected to the edge controller via Bluetooth. The edge controller is powered by 12V. The ADAS camera and DMS camera transmit image information of the forklift's surroundings and the driver's driving status to the edge controller through wires. The accuracy of the above-mentioned cameras is ±2%, and the response time is less than 1 second.

[0037] The wires connecting the touchscreen and edge controller are concealed, and the edge controller has an electromagnetic shielding layer on its surface. This integrated assembly of the touchscreen and edge controller effectively improves stability and prevents external interference. The touchscreen is a unique 7-inch integrated screen with a 1280x800 color resolution. Because of this, the screen size can be reduced, improving space utilization. The absence of physical buttons enhances waterproofing and dust resistance, eliminating the lifespan issues associated with physical buttons and increasing durability. The screen not only displays information but also allows for touch-based configuration of various functions and the addition of various sensor accessories, enabling multi-functional integration. Communication between the touchscreen and edge controller occurs within the housing, resulting in shorter wiring, better shielding, and reduced susceptibility to external electromagnetic interference.

[0038] The action execution module receives and executes commands from the control display module that exceed the limit threshold data, drives the braking system to perform emergency braking on the forklift, and provides dual alarms and warnings via sound and light through an audible and visual alarm. The braking system includes a motor, brake pedal, and brake disc. The motor is electrically connected to the edge controller. The motor receives commands from the edge controller and drives the brake pedal and brake disc to achieve braking action on the forklift. The audible and visual alarm includes a warning light and an alarm horn. Both the warning light and the alarm horn have internally recorded alarm data. The warning light and the alarm horn receive commands from the edge controller and emit lights and sounds representing different warning functions. The audible and visual alarm can provide timely alarms and warnings via lights and sounds before a risk occurs, avoiding driving risks for the driver.

[0039] Please see Figures 4 to 6 Based on the first embodiment, as a second embodiment, the surfaces of the three ADAS cameras and DMS cameras are all provided with a dustproof film. The ADAS cameras and DMS cameras each include a lens, a sealed housing and a camera body. A radar is provided between the lens and the housing. When the lens surface is contaminated, it is monitored by the radar. The radar monitors the lens in real time and can promptly remind when dust accumulates on the lens surface, thus preventing the ADAS cameras and DMS cameras from malfunctioning.

[0040] The edge controller includes a controller housing 1, multiple data interfaces 2, and a wireless transmission module 3. The data acquisition module and data processing module are connected through the multiple data interfaces 2. The wireless transmission module 3 is connected to the speed sensor via Bluetooth. A cover plate is fixed on the controller housing 1. A sealing strip is provided between the controller housing 1 and the touch screen. The touch screen is installed between the controller housing 1 and the cover plate. The screen is divided into multiple display areas, namely a time area, a vehicle status area, a driving direction area, a seat belt status area, a face status area, a location prompt area, a signal sign area, a road condition area around the vehicle, and a driver status area. The road condition area around the vehicle consists of road conditions to the left front, right front, and rear. By dividing the touch screen, the driver can easily observe various monitoring data of the forklift.

[0041] In summary, an edge controller is fixed in the forklift cab, and a touch screen is embedded in its surface. The edge controller connects to a DMS camera, an ADAS camera, and a seatbelt sensor via wires, and to a speed sensor on the forklift wheel hub via Bluetooth. The three ADAS cameras collect and transmit real-time images of the forklift's surroundings to the edge controller, as well as images of the driver. Simultaneously, the seatbelt and speed sensors monitor the seatbelt's wearing status and the forklift's speed. The edge controller integrates and transmits this data to a data processing module, which analyzes and compares the data using a cloud platform and a local database to determine if any data exceeds threshold limits. The touch screen... The touchscreen display adjusts the limit thresholds to suit different driving conditions and environments for the forklift. It also displays various data in real-time during operation, facilitating driver observation and improving control and safety. When data exceeds the limit thresholds, the edge controller sends commands to the motion execution module, enabling the braking system to perform active and emergency braking, providing intelligent safety assistance during forklift operation. The warning lights and horn are internally recorded with alarm data. They receive commands from the edge controller and emit lights and sounds representing different warnings, providing timely warnings and alerts before risks occur, thus preventing driver accidents.

[0042] It will be apparent to those skilled in the art that the present invention is not limited to the details of the exemplary embodiments described above, and that the invention can be implemented in other specific forms without departing from its spirit or essential characteristics. Therefore, the embodiments should be considered in all respects as exemplary and non-limiting, and the scope of the invention is defined by the appended claims rather than the foregoing description. Thus, all variations falling within the meaning and scope of equivalents of the claims are intended to be included within the present invention. No reference numerals in the claims should be construed as limiting the scope of the claims.

Claims

1. A screen-controlled integrated AI forklift intelligent safety assistance system, characterized in that: include: The data acquisition module is used to collect driving data of the driver when driving the forklift. It collects data on obstacles around the forklift, driver status, real-time speed of the forklift and seat belt wearing status through ADAS camera, DMS camera, speed sensor and seat belt sensor. The driver status includes the driver's fatigue level, hand position and eye field of vision. The data processing module is used to analyze and process the data collected by the data acquisition module and compare it with the feature information in the cloud platform and local database to identify people around the forklift and the driver's driving status. The control display module is used to coordinate the transmission of multiple data processed by the data processing module to the edge controller, and to adjust the limit thresholds of multiple data through the touch screen. When the data limit threshold is exceeded, an instruction is issued. The action execution module is used to receive and execute instructions from the control display module that exceed the limit threshold data, drive the braking system to perform emergency braking on the forklift, and provide dual alarms and reminders through sound and light alarms; The data processing module is located inside the edge controller, and the touch screen is fixedly embedded on the surface of the edge controller. The display direction of the touch screen is the driver's seat of the forklift. The edge controller includes a controller housing (1), multiple data interfaces (2) and a wireless transmission module (3), and the data acquisition module and the data processing module are connected through the multiple data interfaces (2); The wireless transmission module (3) is connected to the speed sensor via Bluetooth. A cover plate is fixedly provided on the controller housing (1). A sealing strip is provided between the controller housing (1) and the touch screen. The touch screen is installed between the controller housing (1) and the cover plate. The touch screen is 7 inches in size and has a resolution of 1280x800. The screen is divided into multiple display areas, which are time area, vehicle status area, driving direction area, seat belt status area, face status area, location prompt area, signal sign area, vehicle surrounding road condition area and driver status area. The vehicle surrounding road condition area is composed of left front road condition, right front road condition and rear road condition. The data acquisition module includes an ADAS camera, a DMS camera, a speed sensor, and a seat belt sensor. There are three ADAS cameras. The ADAS camera and the DMS camera are both fixedly installed in the cab of the forklift. The seat belt sensor is fixedly installed inside the seat belt buckle. The speed sensor is fixed on the wheel hub of the forklift. The surfaces of the three ADAS cameras and DMS cameras are all covered with a dustproof film. Each ADAS camera and DMS camera includes a lens, a sealed housing, and a camera body. A radar is provided between the lens and the housing, and the radar is used to monitor when the lens surface is contaminated.

2. The integrated AI forklift intelligent safety assistance system with screen control according to claim 1, characterized in that: The ADAS camera, DMS camera, and seatbelt sensor are all connected to the edge controller via wires, and the speed sensor is wirelessly connected to the edge controller via Bluetooth.

3. The integrated AI forklift intelligent safety assistance system with screen control according to claim 2, characterized in that: The data processing module includes a processor, a circuit board, and a storage unit, which are electrically connected. The storage unit includes a cloud platform and a local database, and the cloud platform and the local database contain feature information.

4. The integrated AI forklift intelligent safety assistance system with screen control according to claim 3, characterized in that: The edge controller is powered by 12V. The ADAS camera and DMS camera transmit image information about the forklift's surroundings and the driver's driving status to the edge controller via wires. The wires connecting the touch screen to the edge controller are hidden. The surface of the edge controller is provided with an electromagnetic shielding layer.

5. The integrated AI forklift intelligent safety assistance system with screen control according to claim 4, characterized in that: The braking system includes a motor, a brake pedal, and a brake disc. The motor is electrically connected to the edge controller. The motor receives instructions from the edge controller and drives the brake pedal and brake disc to brake the forklift. The audible and visual alarm includes a warning light and an alarm horn. Both the warning light and the alarm horn have internally recorded alarm data. The warning light and the alarm horn receive instructions from the edge controller and emit lights and sounds representing different warning functions.

Images