Screen control integrated AI forklift intelligent safety auxiliary system

Abstract

The invention relates to the technical field of safe driving of forklifts, in particular to a screen-control AI forklift intelligent safety auxiliary system, and solves the problems that an existing safety auxiliary system for a forklift needs too many parts and is complex to install, all conditions are difficult to grasp constantly in the using process of non-systematic parts, and the safety of the forklift is affected. The system comprises a data acquisition module used for collecting driving data when a driver drives a forklift truck, a data processing module used for processing the driving data, and a data processing module used for processing the driving data, data of obstacles around the forklift, the driving state of a driver, the real-time speed of the forklift and the wearing condition of a safety belt are collected through an ADAS camera, a DMS camera, a speed sensor and a safety belt sensor. According to the invention, real-time AI intelligent monitoring and analysis are carried out on various data during driving of the forklift, so that early warning and risk avoidance can be carried out in advance, and driving safety assistance is provided.

Description

Technical Field

[0001] The present invention relates to the technical field of safe driving of forklifts, and specifically to a screen-controlled integrated AI forklift intelligent safety assistance system. Background Art

[0002] As a tool to assist people in handling, forklifts are getting closer and closer to our lives and serving people. Forklift driving is a job that requires professional skills and strict operating procedures. Forklift drivers must be certified and wear appropriate protective equipment. Before operating, the driver needs to conduct routine inspections of the equipment to ensure that all parts are functioning properly. The driver needs to be in the correct position and fasten the seat belt. During driving, the driver must abide by the rules and regulations of the work site. In the current environment, installing a safety assistance system on a forklift can improve the safety of driving a forklift. Forklift driving safety assistance includes many factors.

[0003] The existing safety assistance systems for forklifts require too many parts and are complex to install. Not only is it difficult to keep track of all situations at all times during use, the non-systematic parts may also interfere with each other during installation and affect use. In addition, it is difficult to obtain timely data feedback due to the complexity of the data. Therefore, it does not meet existing needs. In response to this, we have proposed an integrated screen-controlled AI forklift intelligent safety assistance system. Summary of the invention

[0004] The purpose of the present invention is to provide an integrated screen-controlled AI forklift intelligent safety assistance system to solve the problem proposed in the above background technology that the existing safety assistance system for forklifts requires too many parts, is complicated to install, and the non-systematic parts are not only difficult to grasp all situations at all times during use, but may also interfere with each other during installation and affect use, and it is difficult to obtain timely data feedback due to the complexity of the data.

[0005] To achieve the above purpose, the present invention provides the following technical solution: a screen-controlled integrated AI forklift intelligent safety assistance system, comprising: The data acquisition module is used to collect the driving data of the driver when driving the forklift. The data of obstacles around the forklift, the driver's driving status, the real-time speed of the forklift and the wearing status of the seat belt are collected through the ADAS camera, the DMS camera, the speed sensor and the seat belt sensor. The driver's driving status includes the driver's fatigue level, hand position and eye field. The data processing module is used to analyze and process the data collected by the data acquisition module and compare it with the feature information on the cloud platform and the local database to distinguish the people around the forklift and the driving status of the driver; A control display module is used to transmit multiple data processed by the data processing module to the edge controller for overall planning, and to adjust the limit thresholds of multiple data through the touch display screen, and to issue instructions when the data limit threshold exceeds the limit threshold; An action execution module is used to receive and execute instructions in the control display module for data exceeding the limit threshold, and drive the brake system to perform emergency braking on the forklift, and perform dual alarms and reminders of sound and light through the sound and light alarm; The data processing module is located inside the edge controller, the touch display screen is fixedly embedded on the surface of the edge controller, and the display direction of the touch display screen is the driving position of the forklift.

[0006] Preferably, the data acquisition module includes an ADAS camera, a DMS camera, a speed sensor and a seat belt sensor. There are three ADAS cameras. The ADAS camera and the DMS camera are both fixedly installed in the cab of the forklift. The seat belt sensor is fixedly installed on the inner side of the seat belt buckle, and the speed sensor is fixed on the wheel hub of the forklift.

[0007] Preferably, the ADAS camera, DMS camera and seat belt sensor are all connected to the edge controller via wires, and the speed sensor is wirelessly connected to the edge controller via Bluetooth.

[0008] Preferably, the data processing module includes a processor, a circuit main board and a storage unit, the processor, the circuit main board and the storage unit are electrically connected, the storage unit includes a cloud platform and a local database, and the cloud platform and the local database have characteristic information entered therein.

[0009] Preferably, the power supply voltage of the edge controller is 12V, the ADAS camera and the DMS camera respectively transmit the image information of the forklift's surroundings and the driver's driving status to the edge controller through wires, the wires connecting the touch display screen and the edge controller are hidden, and the surface of the edge controller is provided with an electromagnetic shielding layer.

[0010] Preferably, the braking system includes a motor, a brake pedal and a brake disc, and the motor is electrically connected to the edge controller. The motor brakes the forklift by receiving instructions from the edge controller and driving the brake pedal and brake disc. The sound and light alarm includes a warning light and an alarm horn. The warning light and the alarm horn are both equipped with recorded alarm data. The warning light and the alarm horn respectively receive instructions from the edge controller and emit lights and sounds representing different warning effects.

[0011] Preferably, the surfaces of the three ADAS cameras and the DMS camera are all provided with a dustproof film, and the ADAS camera and the DMS camera each include a lens, a sealed shell and a camera body, and a radar is provided between the lens and the shell, and the radar is used to monitor when the lens surface is contaminated.

[0012] Preferably, the edge controller includes a controller housing, multiple data interfaces and a wireless transmission module, and the data acquisition module and the data processing module are connected via the multiple data interfaces.

[0013] Preferably, the wireless transmission module is connected to the speed sensor via Bluetooth, a cover plate is fixedly provided on the controller housing, a sealing strip is provided between the controller housing and the touch display screen, and the touch display screen is installed between the controller housing and the cover plate.

[0014] Preferably, the touch display screen has a screen size of 7 inches and a color screen with a resolution of 1280x800. The screen of the display screen is divided into multiple display areas, and the multiple display areas are respectively a time area, a vehicle status area, a driving direction area, a seat belt status area, a face status area, a positioning prompt area, a signal identification area, a vehicle surrounding road condition area and a driver status area. The vehicle surrounding road condition area is composed of the left front road condition, the right front road condition and the rear road condition.

[0015] Compared with the prior art, the present invention has the following beneficial effects: 1. The present invention uses ADAS cameras, DMS cameras, speed sensors and seat belt sensors to monitor pedestrian intrusion behavior around forklifts, driver driving status, forklift real-time speed and seat belt wearing status in real time, effectively improving driving safety. The edge controller integrates multiple data and uses the data processing module to analyze and compare them to determine whether each data exceeds the limit threshold. At the same time, the limit threshold is adjusted through the touch display screen to meet the different driving states and driving environments of the forklift. The touch display screen can display various data in real time during driving, which is convenient for the driver to observe and improve the driver's control and safety of forklift driving. 2. When the present invention detects that a pedestrian has invaded a dangerous area, the edge controller sends a command to the action execution module, so that the brake system in the action execution module can actively brake and perform emergency braking operations, thereby realizing intelligent safety auxiliary operations when driving a forklift. The warning light and the alarm horn are both provided with recorded alarm data. The warning light and the alarm horn receive the command of the edge controller and send out lights and sounds representing different warning effects, and then the sound and light alarm is used to timely send out synchronous alarms and reminders of lights and sounds before the risk occurs, thereby avoiding driving risks for the driver; 3. The present invention hides the wires connecting the touch display screen and the edge controller, and an electromagnetic shielding layer is provided on the surface of the edge controller. By assembling the touch display screen and the edge controller in one piece, the stability of use can be effectively improved to avoid external interference. The touch display screen has no physical buttons, and can be better waterproof and dustproof. There is no problem with the life of physical buttons, and it is more durable. The screen can not only display information, but also configure different functions through touch, and add various sensor accessories to achieve multi-functional integration. The communication between the touch display screen and the edge controller can be carried out inside the shell, with shorter wiring, better shielding, and less susceptible to external electromagnetic interference. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] Figure 1 It is a structural schematic diagram of the intelligent safety assistance system of the present invention; Figure 2 It is a structural schematic diagram of the data processing module of the present invention; Figure 3 It is a schematic diagram of the installation position of each module of the system of the present invention; Figure 4 This is a schematic diagram of power connection of the control display module of the present invention; Figure 5 It is a schematic diagram of the structure of the edge controller of the present invention; Figure 6 A schematic diagram of screen partitioning of a touch display screen of the present invention; Figure 7 This is a test data table of the intelligent safety assistance system of the present invention.

[0017] In the figure: 1. Controller housing; 2. Data interface; 3. Wireless transmission module. DETAILED DESCRIPTION

[0018] The technical solutions in the embodiments of the present invention will be described clearly and completely below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, rather than all the embodiments.

[0019] The present invention provides two embodiments, please refer to Figures 1 to 4 , shows the first embodiment of the present invention, the screen-controlled integrated AI forklift intelligent safety assistance system comprises: The data acquisition module is used to collect the driving data of the driver when driving the forklift. The data of obstacles around the forklift, the driver's driving status, the real-time speed of the forklift and the wearing status of the seat belt are collected through the ADAS camera, DMS camera, speed sensor and seat belt sensor. The driver's driving status includes the driver's fatigue level, hand position and eye field. The data acquisition module includes the ADAS camera, DMS camera, speed sensor and seat belt sensor. There are three ADAS cameras. The ADAS camera and the DMS camera are fixedly installed in the cab of the forklift. The seat belt sensor is fixedly installed on the inner side of the seat belt buckle. The speed sensor is fixed on the wheel hub of the forklift. The ADAS camera, DMS camera, speed sensor and seat belt sensor are used to monitor the driving of the forklift in real time, so as to timely give early warning and avoid driving risks; The data processing module is used to analyze and process the data collected by the data acquisition module and compare it with the characteristic information in the cloud platform and the local database to distinguish the people around the forklift and the driving status of the driver. The data processing module includes a processor, a circuit main board and a storage unit. The processor, the circuit main board and the storage unit are electrically connected. The storage unit includes a cloud platform and a local database. The cloud platform and the local database have characteristic information entered. The advanced computing power of the data processing module is 2T; The control display module is used to transmit the multiple data processed by the data processing module to the edge controller for overall planning, and adjust the limit thresholds of the multiple data through the touch display screen, and issue a command when the data limit threshold exceeds the limit threshold. The data processing module is located inside the edge controller, and the touch display screen is fixedly embedded on the surface of the edge controller. The display direction of the touch display screen is the driving position of the forklift. The ADAS camera, DMS camera and seat belt sensor are all connected to the edge controller through wires. The speed sensor is connected to the edge controller wirelessly through Bluetooth. The power supply voltage of the edge controller is 12V. The ADAS camera and the DMS camera transmit the image information of the forklift surroundings and the driver's driving status to the edge controller through wires. The camera accuracy of the above-mentioned cameras is ±2%, and the response time is less than 1 second. The wires connecting the touch display and the edge controller are hidden, and the surface of the edge controller is provided with an electromagnetic shielding layer. By assembling the touch display and the edge controller in one piece, the stability of use can be effectively improved and external interference can be avoided. The touch display has a screen size of 7 inches, which is a unique 7-inch integrated screen and controller with a resolution of 1280x800 color screen. Because the screen volume of the same size can be made smaller, the space utilization rate is improved; there are no physical buttons, so the waterproof and dustproof can be better, and there is no problem with the life of physical buttons, which is more durable; the screen can not only display information, but also configure different functions through touch, add various sensor accessories, and realize multi-function integration; the communication between the touch display and the edge controller can be carried out inside the shell, with shorter wiring, better shielding, and less susceptible to external electromagnetic interference; An action execution module is used to receive and execute instructions in the control display module that exceed the limit threshold data, and drive the brake system to perform emergency braking on the forklift, and use the sound and light alarm to perform dual alarms and reminders of sound and light. The brake system includes a motor, a brake pedal and a brake disc. The motor is electrically connected to the edge controller. The motor receives instructions from the edge controller and drives the brake pedal and brake disc to achieve the braking action of the forklift. The sound and light alarm includes a warning light and an alarm horn. The warning light and the alarm horn are both equipped with recorded alarm data. The warning light and the alarm horn receive instructions from the edge controller and emit lights and sounds representing different warning effects, respectively. The sound and light alarm can timely perform synchronous alarms and reminders of light and sound before a risk occurs, thereby avoiding driving risks for the driver; See also Figures 4 to 6 , as a second embodiment, based on the first embodiment, the surfaces of the above three ADAS cameras and DMS cameras are all provided with dustproof films, the ADAS camera and the DMS camera each include a lens, a sealed housing and a camera body, a radar is provided between the lens and the housing, and the radar is used to monitor when the lens surface is contaminated. The radar is used to monitor the lens in real time, and timely reminders can be given when dust accumulates on the lens surface, thereby avoiding the failure of the ADAS camera and the DMS camera; The edge controller includes a controller shell 1, multiple data interfaces 2 and a wireless transmission module 3. The data acquisition module and the data processing module are connected through multiple data interfaces 2. The wireless transmission module 3 is connected to the speed sensor through Bluetooth. A cover plate is fixed on the controller shell 1. A sealing strip is provided between the controller shell 1 and the touch display screen. The touch display screen is installed between the controller shell 1 and the cover plate. The screen of the display screen is divided into multiple display areas. The multiple display areas are respectively a time area, a vehicle status area, a driving direction area, a seat belt status area, a face status area, a positioning prompt area, a signal identification area, a vehicle surrounding road condition area and a driver status area. The vehicle surrounding road condition area is composed of the left front road condition, the right front road condition and the rear road condition. By dividing the screen of the touch display screen, it is convenient for the driver to observe various monitoring data of the forklift.

[0020] In summary, an edge controller is fixed in the cab of the forklift, and a touch display screen is embedded and fixed on the surface of the edge controller, so that the edge controller is connected to the DMS camera, ADAS camera and seat belt sensor through wires, and is connected to the speed sensor on the wheel hub of the forklift through Bluetooth. The surrounding image information of the forklift is collected in real time through the three ADAS cameras and transmitted to the edge controller, and the image information of the driver is collected and transmitted to the edge controller through the ADAS camera. At the same time, the wearing status of the seat belt and the speed of the forklift are monitored through the seat belt sensor and the speed sensor. The edge controller integrates the above multiple data and transmits them to the data processing module, so that the data processing module uses the cloud platform and the local database for analysis and comparison to determine whether each data exceeds the limit threshold. At the same time, through the touch The touch screen adjusts the limit threshold to meet the different driving conditions and driving environments of the forklift, and the touch screen can display various data in the driving process in real time, which is convenient for the driver to observe and improve the driver's control and safety of forklift driving. When the data exceeds the limit threshold, the edge controller sends instructions to the action execution module, so that the brake system in the action execution module can actively brake and emergency brake, and realize intelligent safety auxiliary operation when driving the forklift. The warning lights and alarm horns are equipped with recorded alarm data. The warning lights and alarm horns receive instructions from the edge controller and emit lights and sounds representing different warning effects, and then use the sound and light alarm to send synchronous alarms and reminders of lights and sounds in time before the risk occurs, so as to avoid driving risks for the driver.

[0021] It will be apparent to those skilled in the art that the invention is not limited to the details of the exemplary embodiments described above and that the invention can be implemented in other specific forms without departing from the spirit or essential features of the invention. Therefore, the embodiments should be considered exemplary and non-limiting in all respects, and the scope of the invention is defined by the appended claims rather than the foregoing description, and it is intended that all variations falling within the meaning and scope of the equivalent elements of the claims be included in the invention. Any reference numeral in a claim should not be considered as limiting the claim to which it relates.

Claims

1. The screen-controlled integrated AI forklift intelligent safety assistance system is characterized by: include: The data acquisition module is used to collect the driving data of the driver when driving the forklift. The data of obstacles around the forklift, the driver's driving status, the real-time speed of the forklift and the wearing status of the seat belt are collected through the ADAS camera, the DMS camera, the speed sensor and the seat belt sensor. The driver's driving status includes the driver's fatigue level, hand position and eye field. The data processing module is used to analyze and process the data collected by the data acquisition module and compare it with the feature information on the cloud platform and the local database to distinguish the people around the forklift and the driving status of the driver; A control display module is used to transmit multiple data processed by the data processing module to the edge controller for overall planning, and to adjust the limit thresholds of multiple data through the touch display screen, and to issue instructions when the data limit threshold exceeds the limit threshold; An action execution module is used to receive and execute instructions in the control display module for data exceeding the limit threshold, and drive the brake system to perform emergency braking on the forklift, and perform dual alarms and reminders of sound and light through the sound and light alarm; The data processing module is located inside the edge controller, the touch display screen is fixedly embedded on the surface of the edge controller, and the display direction of the touch display screen is the driving position of the forklift; The edge controller comprises a controller housing (1), a plurality of data interfaces (2) and a wireless transmission module (3), and the data acquisition module and the data processing module are connected via the plurality of data interfaces (2); The wireless transmission module (3) is connected to the speed sensor via Bluetooth, a cover plate is fixedly provided on the controller housing (1), a sealing strip is provided between the controller housing (1) and the touch display screen, and the touch display screen is installed between the controller housing (1) and the cover plate; The screen size of the touch display screen is 7 inches, and the resolution is 1280x800 color screen. The screen of the display screen is divided into multiple display areas, and the multiple display areas are respectively time area, vehicle status area, driving direction area, seat belt status area, face status area, positioning prompt area, signal identification area, vehicle surrounding road condition area and driver status area. The vehicle surrounding road condition area is composed of left front road condition, right front road condition and rear road condition.

2. The screen-controlled integrated AI forklift intelligent safety assistance system according to claim 1 is characterized by: The data acquisition module includes an ADAS camera, a DMS camera, a speed sensor and a seat belt sensor. There are three ADAS cameras. The ADAS camera and the DMS camera are both fixedly installed in the cab of the forklift. The seat belt sensor is fixedly installed on the inner side of the seat belt buckle. The speed sensor is fixed on the wheel hub of the forklift.

3. The screen-controlled integrated AI forklift intelligent safety assistance system according to claim 2 is characterized by: The ADAS camera, DMS camera and seat belt sensor are all connected to the edge controller via wires, and the speed sensor is wirelessly connected to the edge controller via Bluetooth.

4. The screen-controlled integrated AI forklift intelligent safety assistance system according to claim 3 is characterized by: The data processing module includes a processor, a circuit mainboard and a storage unit, wherein the processor, the circuit mainboard and the storage unit are electrically connected, and the storage unit includes a cloud platform and a local database, wherein feature information is recorded in the cloud platform and the local database.

5. The screen-controlled integrated AI forklift intelligent safety assistance system according to claim 4 is characterized by: The power supply voltage of the edge controller is 12V. The ADAS camera and the DMS camera transmit the image information of the forklift's surroundings and the driver's driving status to the edge controller through wires respectively. The wires connecting the touch display screen and the edge controller are hidden, and the surface of the edge controller is provided with an electromagnetic shielding layer.

6. The screen-controlled integrated AI forklift intelligent safety assistance system according to claim 5 is characterized by: The brake system includes a motor, a brake pedal and a brake disc. The motor is electrically connected to the edge controller. The motor receives instructions from the edge controller and drives the brake pedal and brake disc to achieve braking action on the forklift. The sound and light alarm includes a warning light and an alarm horn. The warning light and the alarm horn are both equipped with recorded alarm data. The warning light and the alarm horn receive instructions from the edge controller and emit lights and sounds representing different warning effects.

7. The screen-controlled integrated AI forklift intelligent safety assistance system according to claim 6 is characterized by: The surfaces of the three ADAS cameras and the DMS camera are all provided with dustproof films. The ADAS camera and the DMS camera each include a lens, a sealed shell and a camera body. A radar is provided between the lens and the shell. When the surface of the lens is contaminated, it is monitored by the radar.

Images