DLP (Digital Light Processing) technology-based effective pre-warning system for projection operation safety area outside vehicle and working method thereof

Abstract

The invention discloses a DLP technology-based effective early warning system for a safe area of projection operation outside a vehicle and a working method thereof, and the system comprises an application layer which is used for a man-machine cooperation task distribution mechanism based on skill driving, and achieves a logic function through different business modules for man-machine and intermodulation; the business logic layer comprises high-level early warning, low-level early warning and animal early warning; the function module layer comprises a data operation analysis module and a DLP control module; and the hardware driving layer is used for monitoring the vehicle body and the environment through a sensor. According to the DLP technology-based effective pre-warning system for the projection operation safety area outside the vehicle and the working method of the DLP technology-based effective pre-warning system, the adaptability and the response capability of a man-machine system in a complex environment are improved, the interaction mode between a driver and equipment is improved, and a safer and more comfortable working environment is brought to the driver.

Description

Technical Field

[0001] The invention relates to an effective early warning system for a safe area of ​​an off-vehicle projection operation based on DLP technology and a working method thereof, and belongs to the technical field of computer vision and artificial intelligence. Background Art

[0002] The construction vehicle safety area is a specific area designated at the construction site to ensure the safety of vehicle operations. This area usually surrounds the construction vehicle, including its driving path and operating range, and is intended to reduce the risk of accidents and protect the safety of personnel and equipment.

[0003] Warning signs for construction vehicle safety areas are usually in the form of physical safety warning signs or fences to remind people. However, this physical form will bring inconvenience to operators in actual use, and the visibility is not high during night construction.

[0004] Therefore, those skilled in the art urgently need to improve the early warning method for the safety area of ​​engineering vehicles. Summary of the invention

[0005] Purpose: In order to overcome the deficiencies in the prior art, the present invention provides an effective warning system for vehicle exterior projection operation safety area based on DLP technology and a working method thereof.

[0006] Technical solution: To solve the above technical problems, the technical solution adopted by the present invention is:

[0007] Firstly, an effective warning system for the safe area of ​​off-vehicle projection operation based on DLP technology specifically includes: an application layer, a business logic layer, a functional module layer and a hardware driver layer.

[0008] Among them, the application layer is used for the skill-driven human-machine collaborative task allocation mechanism, which completes the logical functions through human-machine and mutual calls to different business modules.

[0009] The business logic layer includes: high-level warning, low-level warning and animal warning.

[0010] Among them, the high-level warning is used when the vehicle speed and the safety area of ​​the vehicle exceed the normal range. The warning level is the highest. The excavator takes intelligent braking, the projection light flashes the external lighting effect through the DLP control module, and the HMI (human-machine interface) synchronously displays the surround scene of the safety area outside the vehicle. The external voice speaker of the vehicle gives prompts to the outside personnel. At the same time, the driver in the driving seat can also speak to the outside world through the external voice speaker.

[0011] The low-level warning is used when the vehicle speed and the safety area of ​​the vehicle are within a reasonable range. The warning level is low. The warning response uses a projection lamp to flash the exterior lighting effect through the DLP control module, the vehicle's external voice speaker gives prompts to peripheral personnel, and the HMI synchronously displays the surround scene of the safety area outside the vehicle.

[0012] The animal warning: When the warning target is an animal, the vehicle's external voice speaker effectively drives it away by simulating sound.

[0013] The functional module layer includes: a data calculation and analysis module and a DLP control module.

[0014] Among them, the data calculation and analysis module is used to convert the collected analog signals and transmit them to the single-chip microcomputer processing module, and determine the warning target and warning level through image recognition algorithm analysis and calculation.

[0015] The DLP control module is used to, after receiving a warning level signal, form a color image from the white light emitted by the light source through a series of optical processing and digital micromirror control and project it onto the ground to perform a fixed-point flashing response warning for the warning target.

[0016] The hardware driver layer is used to collect information from the vehicle body and the environment through sensors.

[0017] As a preferred solution, the application layer is used for when the working environment is normal, the operator is responsible for "intuitive" and "non-linear" working operations; when the working environment warns, the machine is responsible for "linear" work, executes the warning function, and gives accurate feedback to the outside world and the operator according to the warning level. With the assistance of DLP projection technology, an immersive visual scene multi-modal warning effect is achieved, and intelligent braking of the excavator is performed in time when necessary.

[0018] As a preferred solution, the single-chip microcomputer adopts a 32-bit ARM architecture MCU processor and is equipped with a 16-bit precision A / D converter.

[0019] As a preferred solution, the hardware driver layer includes but is not limited to: a surround view camera, an infrared sensor, a speed sensor and a laser rangefinder.

[0020] As a preferred solution, the hardware driver layer deploys sensors at key locations of mechanical equipment according to acquisition requirements to ensure stability and reliability of signal transmission.

[0021] In the second aspect, a working method of an effective warning system for an off-vehicle projection operation safety area based on DLP technology specifically includes:

[0022] Start the excavator, and the hardware driver layer monitors the vehicle body and the environment to obtain the monitored signal.

[0023] The monitored signal is sent to the data operation and analysis module through the input interface.

[0024] The data operation and analysis module converts the monitored signal into a digital signal.

[0025] By identifying the image signal and distance signal in the digital signal, the category of the target is determined.

[0026] When the target is an obstacle, the HMI display will synchronously show the surround scene of the safe area outside the vehicle, and prompt that the target is an obstacle, and the voice speaker will issue a voice warning to clear the obstacle.

[0027] As a preferred solution, it also includes: when the target is a ravine, the surround scene of the safe area outside the vehicle is synchronously displayed through the HMI display, and a prompt is given that the target is a ravine, and the voice speaker issues a voice warning to leave the ravine.

[0028] As a preferred solution, it also includes: when the target is a person and enters the safe area of ​​the car, the projection light flashes the external lighting effect through the DLP control module, the HMI simultaneously displays the surround scene of the safe area outside the car, the external voice speaker of the car gives prompts to the outside people, and the driver in the driving seat can also speak to the outside world through the external voice speaker.

[0029] As a preferred solution, it also includes: when the target is an animal and the target enters the safe area of ​​the vehicle, the vehicle's external voice speaker effectively drives it away by simulating sound.

[0030] As a preferred solution, it also includes: by identifying the vehicle body signal in the digital signal, when the vehicle speed exceeds the normal range value, the excavator adopts intelligent braking.

[0031] Beneficial effects: Compared with the prior art, the effective warning system for the safe area of ​​off-vehicle projection operation based on DLP technology and the working method thereof provided by the present invention have the following advantages:

[0032] (1) The present invention adopts DLP technology with higher stability: If the vehicle is often in an environment with direct sunlight, the high contrast and heat resistance of DLP are more suitable. DLP technology not only has better performance in heat resistance, but its sealed optical path design can also effectively reduce dust from falling in, which is suitable for long-term high-intensity use of light;

[0033] (2) The present invention adopts DLP technology for projection and is not restricted by light source: Since DLP technology is a reflection-based technology, any type of light source can be used, including LED and laser diode.

[0034] (3) The present invention innovatively introduces a self-created skill-driven human-machine collaborative task allocation mechanism. Under the human-machine collaborative framework of the excavator, the clear allocation mechanism enhances human-machine integration and collaboration, improves the adaptability and responsiveness of the human-machine system in complex environments, and not only improves the interaction between the operator and the equipment, but also provides the operator with a safer and more comfortable working environment. BRIEF DESCRIPTION OF THE DRAWINGS

[0035] Figure 1 It is a schematic diagram of the framework of the effective warning system for the safe area of ​​the vehicle exterior projection operation based on the DLP technology of the present invention.

[0036] Figure 2 It is a schematic diagram of the working method of the effective warning system for the safe area of ​​the vehicle exterior projection operation based on the DLP technology of the present invention.

[0037] Figure 3 This is a flow chart of the interaction between vehicle and external warning.

[0038] Figure 4 Projecting an effective warning diagram of the safety area outside the car DETAILED DESCRIPTION

[0039] The following is a clear and complete description of the technical solutions in the examples of the present invention in conjunction with the accompanying drawings in the examples of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative work are within the protection scope of the present invention.

[0040] The present invention will be further described below in conjunction with specific embodiments.

[0041] Embodiment 1:

[0042] This embodiment introduces an effective warning system for vehicle exterior projection operation safety areas based on DLP technology. Figure 1 As shown, it specifically includes: application layer, business logic layer, functional module layer and hardware driver layer.

[0043] Among them, the application layer is used when the working environment is normal, and the operator is responsible for "intuitive" and "non-linear" working operations; when the working environment warns, the machine is responsible for "linear" work and executes the warning function, giving accurate feedback to the outside world and the operator according to the warning level, and through the assistance of DLP projection technology, an immersive visual scene multi-modal warning effect is achieved, and intelligent braking of the excavator is performed in time when necessary.

[0044] Furthermore, the application layer adopts a skill-driven human-machine collaborative task allocation interaction design mechanism, including: Modern intelligent system design is based on rules and algorithms, which is difficult to simulate the deep and nonlinear characteristics of human intuition. Therefore, human intuition plays a key role in human-machine collaboration, and the machine can provide timely and accurate feedback to maintain the human's immersion state, so that human-machine collaboration is efficient. Such human-machine cooperation allows the operator and the excavator to work together to achieve error-free, efficient and safe operation.

[0045] The business logic layer includes: high-level warning, low-level warning and animal warning.

[0046] Among them, the high-level warning is used when the vehicle speed and the safety area of ​​the vehicle exceed the normal range. The warning level is the highest, the excavator takes intelligent braking, the projection light flashes the external lighting effect through the DLP control module, the HMI simultaneously displays the surround scene of the safety area outside the vehicle, and the external voice speaker of the vehicle gives prompts to the outside personnel. At the same time, the driver in the driving seat can also speak to the outside world through the external voice speaker.

[0047] The low-level warning is used when the vehicle speed and the safety area of ​​the vehicle are within a reasonable range. The warning level is low. The warning response uses a projection lamp to flash the exterior lighting effect through the DLP control module, the vehicle's external voice speaker gives prompts to peripheral personnel, and the HMI synchronously displays the surround scene of the safety area outside the vehicle.

[0048] The animal warning: When the warning target is an animal, whether it is a high-level warning or a low-level warning, the vehicle's external voice speaker can effectively drive away the animal by simulating sound.

[0049] The functional module layer includes: a data calculation and analysis module and a DLP control module.

[0050] Among them, the data operation and analysis module is used to convert the collected analog signals and transmit them to the single-chip microcomputer (MCU) processing module, and determine the warning target and warning level through image recognition algorithm analysis and operation.

[0051] The DLP control module is used to, after receiving a warning level signal, form a color image from the white light emitted by the light source through a series of optical processing and digital micromirror control and project it onto the ground to perform a fixed-point flashing response warning for the warning target.

[0052] The hardware driver layer includes: a surround view camera, an infrared sensor, a speed sensor and a laser rangefinder.

[0053] Among them, the surround-view camera is used to provide an all-round field of view, covering blind spots that traditional cameras cannot reach, and achieving no-dead-angle monitoring. When an abnormality is detected in the excavator's working environment, the captured image information is immediately obtained for identification.

[0054] Infrared sensor: used for environmental perception and feature recognition. It can assist in identifying the target category more accurately by identifying the target temperature and gas composition.

[0055] Speed ​​sensor: used to obtain the speed of the engineering vehicle and the speed of the target point.

[0056] Laser rangefinder: used to quickly and accurately measure the safe distance between the target point and the excavator by emitting a laser beam and receiving its reflected signal.

[0057] Furthermore, according to the collection requirements, sensors are placed at key parts of mechanical equipment to ensure the stability and reliability of signal transmission:

[0058] Embodiment 2:

[0059] This embodiment introduces a working method of an effective early warning system for vehicle exterior projection operation safety area based on DLP technology, such as Figure 2 , as shown in 3, specifically including:

[0060] Start the excavator, and the hardware driver layer monitors the vehicle body and the environment to obtain the monitored signal.

[0061] The monitored signal is sent to the data operation and analysis module through the input interface.

[0062] The data operation and analysis module converts the monitored signal into a digital signal.

[0063] By identifying the image signal and distance signal in the digital signal, the category of the target is determined.

[0064] When the target is an obstacle, the HMI display will synchronously show the surround scene of the safe area outside the vehicle, and prompt that the target is an obstacle, and the voice speaker will issue a voice warning to clear the obstacle.

[0065] When the target is a ravine, the HMI display will synchronously show the surround scene of the safe area outside the vehicle, and prompt that the target is a ravine, and the voice speaker will issue a voice warning to leave the ravine.

[0066] like Figure 4 As shown in the figure, when the target is a person and enters the safe area of ​​the car, the projection light flashes the external lighting effect through the DLP control module, the HMI simultaneously displays the surround scene of the safe area outside the car, the external voice speaker of the car gives prompts to the outside personnel, and the driver in the driving seat can also speak to the outside world through the external voice speaker.

[0067] When the target is an animal and it enters the safe area of ​​the car, the car's external voice speaker can effectively drive it away by simulating sound.

[0068] By identifying the vehicle body signal in the digital signal, the excavator takes intelligent braking when the vehicle speed exceeds the normal range.

[0069] The present invention completes the functions of collecting environmental data of the safe area outside the vehicle, data processing, identifying warnings, responding to warnings, and processing warnings through the combination of software and hardware. When the operator starts to operate the excavator, the vehicle body will enter the environmental monitoring state, and the sensors play their respective roles to ensure the safety of the operation. When an abnormality is detected, the abnormal signal is converted and transmitted to the MCU processor, and the warning target category, speed, distance and other information are determined through algorithm analysis operations such as image recognition to judge the warning level to respond to the functional effects of different warning levels.

[0070] The off-vehicle projection safety area warning function of the present invention adopts an interactive design mechanism and carries out design innovation for relevant problems and pain points arising during the operation of the excavator environment.

[0071] The present invention integrates DLP projection technology with composite sensors and image recognition algorithms to enable the excavator to accurately monitor the safety area in real time in the operation scene, and completes the warning task through intelligent braking and multi-modal visual warning outside the vehicle. It improves the accuracy and speed of monitoring image processing and greatly improves the effective warning capability. At the same time, it also provides more possible solutions for problems such as warning processing in the process of human-computer interaction in more complex application scenarios.

[0072] The present invention uses a skill-driven human-machine collaborative task allocation mechanism design to solve the problems of human-machine interaction adaptability and responsiveness when the excavator issues warnings in complex scene operations. Through the division of "functions", the operator and the equipment play their respective skills. When necessary, the equipment can replace the operator to execute warning decisions, and timely and effectively perform multi-modal warning responses, bringing a safer and more comfortable working environment for the operator; while the traditional excavator human-machine interaction process always has problems such as untimely or no warning response, separation of man and machine, and inability to effectively integrate.

[0073] The above is only a preferred embodiment of the present invention. It should be pointed out that for ordinary technicians in this technical field, several improvements and modifications can be made without departing from the principle of the present invention. These improvements and modifications should also be regarded as the scope of protection of the present invention.

Claims

1. An effective warning system for vehicle exterior projection operation safety area based on DLP technology, characterized by: Specifically include: Application layer, business logic layer, functional module layer and hardware driver layer; The application layer is used for the human-machine collaborative task allocation mechanism based on skill-driven, and completes the logical functions through human-machine and mutual calling of different business modules; The business logic layer specifically includes: High-level warning: When the vehicle speed and the vehicle's safety zone exceed the normal range, the warning level is the highest. The excavator takes intelligent braking, the projection light flashes the exterior lighting effect through the DLP control module, the HMI simultaneously displays the surround scene of the safety zone outside the vehicle, and the vehicle's external voice speaker gives reminders to peripheral personnel. At the same time, the driver can also shout to the outside world through the external voice speaker; Low-level warning: When the vehicle speed and the vehicle's safety zone are within a reasonable range, the warning level is low. The warning response uses a projection lamp to flash the exterior lighting effect through the DLP control module, the vehicle's external voice speaker gives peripheral personnel a reminder, and the HMI simultaneously displays the surround view of the safety zone outside the vehicle; Animal warning: When the warning target is an animal, the vehicle's external voice speaker can effectively drive it away by simulating sound; The functional module layer specifically includes: The data operation and analysis module is used to convert and transmit the collected analog signals to the single-chip microcomputer processing module, and determine the warning target and warning level through image recognition algorithm analysis and operation; The DLP control module is used to, after receiving the warning level signal, form a color image from the white light emitted by the light source after a series of optical processing and digital micro-mirror control, and project it onto the ground to perform a fixed-point flashing response warning for the warning target; The hardware driver layer is used to collect information from the vehicle body and the environment through sensors.

2. According to the DLP technology-based effective warning system for vehicle exterior projection operation safety area of ​​claim 1, it is characterized by: The application layer is used when the working environment is normal, and the operator is responsible for "intuitive" and "non-linear" working operations; when the working environment warns, the machine is responsible for "linear" work and executes the warning function, giving accurate feedback to the outside world and the operator according to the warning level, and realizing immersive visualization scene multi-modal warning effects with the assistance of DLP projection technology, and performing intelligent braking of the excavator in time when necessary.

3. According to claim 1, the effective warning system for vehicle exterior projection operation safety area based on DLP technology is characterized by: The single-chip microcomputer adopts a 32-bit ARM architecture MCU processor and is equipped with a 16-bit precision A / D converter.

4. According to claim 1, the effective warning system for vehicle exterior projection operation safety area based on DLP technology is characterized by: The hardware driver layer includes, but is not limited to: a surround view camera, an infrared sensor, a speed sensor, and a laser rangefinder.

5. According to claim 1, the effective warning system for vehicle exterior projection operation safety area based on DLP technology is characterized by: The hardware driver layer deploys sensors at key locations of mechanical equipment according to acquisition requirements to ensure the stability and reliability of signal transmission.

6. A working method of an effective warning system for an off-vehicle projection operation safety area based on DLP technology, characterized in that: Start the excavator, and the hardware driver layer monitors the vehicle body and the environment to obtain the monitored signal; The monitored signal is sent to the data operation and analysis module through the input interface; The data operation and analysis module converts the monitored signal into a digital signal; By identifying the image signal and distance signal in the digital signal, the category of the target is determined; When the target is an obstacle, the HMI display will synchronously show the surround scene of the safe area outside the vehicle, and prompt that the target is an obstacle, and the voice speaker will issue a voice warning to clear the obstacle.

7. The working method according to claim 6, characterized in that: Also includes: When the target is a ravine, the HMI display synchronously shows the surround scene of the safe area outside the vehicle, and prompts that the target is a ravine, and the voice speaker issues a voice warning to leave the ravine.

8. The working method according to claim 6, characterized in that: Also includes: When the target is a person and enters the safe area of ​​the car, the projection light flashes the exterior lighting effect through the DLP control module, the HMI simultaneously displays the surround scene of the safe area outside the car, the external voice speaker of the car gives prompts to the outside personnel, and the driver in the driving seat can also speak to the outside world through the external voice speaker.

9. The working method according to claim 6, characterized in that: Also includes: When the target is an animal and it enters the safe area of ​​the car, the car's external voice speaker can effectively drive it away by simulating sound.

10. The working method according to claim 6, characterized in that: Also includes: By identifying the vehicle body signal in the digital signal, the excavator takes intelligent braking when the vehicle speed exceeds the normal range.

Images