Blind zone display device of construction equipment

Abstract

The present invention relates to a blind area display device for construction equipment, comprising: a detection unit which is provided in construction equipment and detects objects around the construction equipment; the display part is arranged in front of the eyeballs of a driver of the construction equipment; a gaze tracking unit for tracking the gaze direction of the driver; and a control unit that acquires information from the detection unit and the gaze tracking unit and analyzes information about a direction that coincides with the gaze of the driver, the control unit being capable of displaying, on the display unit, a mark of an object included in the direction of the gaze of the driver.

Description

Technical Field

[0001] The invention relates to a blind area display device for construction equipment. Background Art

[0002] Generally, various types of construction equipment such as cranes, dump trucks, bulldozers, excavators, forklifts, etc. are widely used at construction sites, civil engineering sites, or various industrial sites.

[0003] Since most construction equipment is large and heavy and generates enormous power, drivers of construction equipment need to pay special attention to prevent accidents, and there is often a worry that a major accident may occur due to a momentary mistake.

[0004] Construction equipment is generally driven by one driver. It is impossible for the driver to recognize all the conditions around the construction equipment with the naked eye. Even if wireless communication is established with other workers nearby, there is still a risk of accidents while the construction equipment is being used.

[0005] Especially for construction equipment such as excavators and forklifts, the windows of the cab are relatively wide, which makes it easy to observe the front, but it is difficult to observe the left, right and rear due to the equipment carried by the vehicle body.

[0006] Therefore, the driver usually operates the construction equipment while monitoring the surroundings of the construction equipment through various mirrors such as the rearview mirror located in the construction equipment room or the left and right side mirrors, but there is a blind spot in the range that the driver can monitor with the naked eye from the driver's seat.

[0007] Such blind spots pose a big problem for the safe operation of construction equipment. In fact, most of the fatal accidents or structural damage accidents that occur during the driving of construction equipment occur in the blind spots on the left, right and rear that are difficult for the driver to observe. Therefore, construction equipment drivers and surrounding workers on site need to pay special attention.

[0008] Despite such precautions, accidents caused by construction equipment still frequently occur during operation due to negligence of the driver or surrounding workers. Such accidents are mainly caused by the driver of the construction equipment failing to promptly identify surrounding workers working behind the construction equipment or in blind spots during driving. For example, in the case of excavators, most accidents occur in which the rotating boom hits surrounding workers or causes injuries during the backward movement of the construction equipment.

[0009] In order to solve this problem, peripheral recognition systems using various sensors or cameras are currently being developed. Among them, Korean authorized patent No. 10-2007535 applies an AVM (Around View Monitoring) system to a construction machine by using cameras installed in the front, rear, left and right directions to display the surroundings of the construction machine, so that the driver can identify blind spots. However, since the AVM screen is displayed on a monitor installed on the construction machine, the driver needs to turn his eyes to the monitor during the operation, so there is a problem of losing sight of the work site and being unable to respond immediately. Summary of the invention

[0010] The present invention is proposed to solve the prior art problems as described above. The purpose of the present invention is to provide a blind spot display device for construction equipment that provides blind spot information to the driver of construction equipment through smart glass, thereby reducing the impact of the external environment and minimizing the driver's line of sight movement during operation, thereby improving work efficiency and preventing safety accidents.

[0011] The present invention relates to a blind spot display device for construction equipment, which may include: a detection unit, which is arranged on the construction equipment and detects objects around the above-mentioned construction equipment; a display unit, which is arranged in front of the eyeballs of the driver of the above-mentioned construction equipment; a line of sight tracking unit, which tracks the line of sight direction of the above-mentioned driver; and a control unit, which obtains information from the above-mentioned detection unit and the above-mentioned line of sight tracking unit, analyzes information in a direction consistent with the line of sight of the above-mentioned driver, and the above-mentioned control unit displays a mark of the above-mentioned object contained in the above-mentioned line of sight direction of the above-mentioned driver on the above-mentioned display unit.

[0012] Specifically, the control unit may also display a mark on the display unit for the object included in the line of sight direction but existing in a blind spot of the driver's line of sight, so as to let the driver know the object existing in the blind spot.

[0013] Specifically, the control unit may further include: a pupil sensor unit for identifying the pupil in the eyeball of the driver; and an angle sensor unit for identifying the angle change of the display unit, and the control unit analyzes information from the pupil sensor unit, the line of sight tracking unit and the angle sensor unit, and modifies the display position of the mark on the display unit corresponding to the angle change.

[0014] Specifically, the control unit may further include an alarm unit for providing an alarm for the object, and when the object is located within the operation radius of the construction equipment, the control unit operates the alarm unit to inform the driver of the object.

[0015] Specifically, the detection unit may include at least one of a camera, a radar, a lidar and an ultrasonic sensor, and the detection unit may be arranged in front, rear, left and right of the construction equipment, and also in front of a structure of the construction equipment that induces the blind spot.

[0016] Specifically, the display unit may provide the driver with an interface for setting and modifying the functions of the control unit.

[0017] Specifically, when the construction equipment is an excavator, the blind area may be formed by a boom structure of the excavator, and the operation radius may be set according to the length of the boom structure.

[0018] Specifically, the mark may include: an outline of the object, a wireframe containing the object, or an image of the object projected in the blind spot.

[0019] Specifically, the control unit may provide an alarm through the alarm unit when the amount of eyeball movement obtained through the pupil sensor unit or the line of sight tracking unit is below a set value, and the display unit may be provided on smart glass.

[0020] The blind spot display device for construction equipment of the present invention provides blind spot information to the driver of the construction equipment through smart glass, so that the driver is less affected by the external environment and minimizes the movement of the driver's line of sight, thereby improving work efficiency and preventing safety accidents. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] Figure 1 is a conceptual diagram of a construction device according to an embodiment of the present invention.

[0022] Figure 2 FIG. 4 is a perspective view of a detection unit according to a first embodiment of the present invention.

[0023] Figure 3 FIG. 4 is a perspective view of a detection unit according to a second embodiment of the present invention.

[0024] Figure 4 FIG. 4 is a perspective view of a detection unit according to a third embodiment of the present invention.

[0025] Figure 5 A block diagram showing a blind spot display device for construction equipment according to an embodiment of the present invention.

[0026] Figure 6 4 is a conceptual diagram of a blind spot display device for construction equipment according to an embodiment of the present invention. DETAILED DESCRIPTION

[0027] The purpose, specific advantages and novel features of the present invention will become more apparent based on the attached drawings and the following related detailed description and preferred embodiments. In this specification, with respect to the reference numerals attached to the constituent elements of each drawing, it should be noted that for the same constituent element, even if marked on different drawings, they are marked with the same number as much as possible. In addition, in the description of the present invention, when it is considered that the detailed description of the relevant known technology may unnecessarily confuse the main purpose of the present invention, its detailed description will be omitted.

[0028] Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings.

[0029] Figure 1 is a conceptual diagram of a construction device according to an embodiment of the present invention, Figure 2 is a three-dimensional diagram of a detection unit according to a first embodiment of the present invention, Figure 3 is a three-dimensional diagram of a detection unit according to a second embodiment of the present invention. Figure 4 FIG. 4 is a perspective view of a detection unit according to a third embodiment of the present invention.

[0030] Reference Figure 1 Although an excavator is shown as the construction equipment 4 , a crane, a dump truck, a bulldozer, a forklift, etc. used in various construction sites may be included in the construction equipment 4 .

[0031] The blind spot display device of the construction equipment 4 of the present invention includes a detection unit 11, a display unit 12, a pupil sensor unit 21, a sight tracking unit 22, an angle sensor unit 23, an alarm unit 24 and a control unit 31 provided in the construction equipment 4.

[0032] A plurality of detection units 11 may be provided on the construction equipment 4 , and may be provided in front of, behind, on the left side, and on the right side of the construction equipment 4 .

[0033] Reference Figure 1 The detection unit 11 is disposed in front of, behind, on the left side, and on the right side of the construction equipment 4 , and may also be disposed in front of a structure of the construction equipment 4 that induces a blind spot of the driver of the construction equipment 4 .

[0034] When the construction equipment 4 is an excavator, the driver's blind spot may be formed by the boom structure of the excavator. When the construction equipment 4 is a forklift, the driver's blind spot may be formed by the gantry or the forks.

[0035] Reference Figure 1 As the construction equipment 4, an excavator is shown. The blind spot is formed by the boom structure 6, which induces a blind spot in the driver's vision. The driver may not be able to know the objects 5 (including people) in the part blocked by the boom structure 6.

[0036] Therefore, the objects 5 in front of and to the side of the boom structure 6 are located in the driver's blind spot, and the driver cannot know it with the naked eye. For this reason, the blind spot display device of the construction equipment 4 of the present invention is provided with a detection unit 11 even in front of the boom structure 6, so that the objects 5 in the driver's blind spot can also be detected, thereby preventing safety accidents.

[0037] The detection unit 11 capable of detecting the object 5 around the construction equipment 4 may include at least one of a camera, a radar, a laser radar, and an ultrasonic sensor.

[0038] The camera is a common device for monitoring the periphery of the construction equipment 4, and a plurality of cameras may be provided. Instead of simply capturing an image and transmitting it to the control unit 31, the camera recognizes objects 5 in the image using an image-based detection system, namely, IMOD. In addition, an object may also be recognized in an image by AI.

[0039] Reference Figure 2 and Figure 3 It can be seen that one embodiment of the detection unit 11 is a camera. The camera includes a lens, and in order to be mounted on the construction equipment 4, it may also have a fixing plate mounted on the construction equipment 4 by screws or welding.

[0040] Reference Figure 2 In addition to the lens, the camera may also be provided with an LED so that objects can be identified even in a dark environment. A camera cover may also be provided to prevent glare or inability to identify objects when direct light or other light hits the lens.

[0041] In addition, the side of the camera is arranged as a pivot structure, and the vertical angle of the camera can be adjusted to be able to identify the object 5. The fixing plate for fixing the camera is connected to the construction equipment 4 through a pivot structure, and the horizontal angle of the camera can be adjusted so that the object 5 that is out of the field of view of the camera does not exist.

[0042] Reference Figure 3 ,and Figure 2 In contrast, the camera can be arranged so that the lens protrudes and the diameter of the lens is larger. Since the performance of the camera can be improved in proportion to the size of the lens, high-quality images can be taken, and the resolution is also improved, so the recognition degree of the object 5 can also be improved.

[0043] In addition, the side of the camera and the fixing plate of the camera are arranged in a pivot structure so as to be able to adjust the vertical and horizontal angles of the camera, thereby making it possible to eliminate objects 5 out of the camera's field of view and to arrange multiple cameras in such a way that the field of view overlaps.

[0044] The plurality of cameras provided in the construction equipment 4 may have the same performance, and different lenses may be used depending on the locations of the configuration, thereby configuring cameras with different performances.

[0045] Regarding the image quality of the camera, a VGA-level analog camera can be used, or a clearer HD-level digital camera can be used to capture images with high resolution, and IMOD can be used to improve the recognition of objects 5 in the image.

[0046] Radar is a device that can detect and measure distance using radio waves. It can detect objects and determine direction, distance, speed, etc. by measuring the reflected waves returned after the irradiated radio waves hit the target.

[0047] Therefore, if the distance between the construction equipment 4 and the object 5 changes due to the movement of the construction equipment 4 or the movement of the surrounding object 5, the time for the radio wave emitted from the radar to return changes, so it can be known whether there is a collision with the construction equipment 4, and it can be transmitted to the control unit 31.

[0048] A plurality of radars may be provided in the construction equipment 4 and may be used alone, but since there may be errors in the detection range, they may be used together with a camera in order to minimize safety accidents and to improve the recognition accuracy of the object 5 .

[0049] Reference Figure 4 The radar can be installed in a state where a part of it is fixed to the construction equipment 4, and can be installed behind the construction equipment 4 where the driver's field of vision cannot reach.

[0050] The radar can be arranged in a form in which the main body is attached to the construction equipment 4 or separated from the main equipment, and the connecting part and the construction equipment 4 are arranged in a pivot structure so that the horizontal angle can be adjusted.

[0051] Laser radar (LiDAR) is a device different from radar. It is a sensor that creates a map of the surrounding area by measuring the time difference between emitting laser light to hit an object and returning to the surrounding area to help the construction equipment 4 grasp its position by itself.

[0052] LiDAR has a laser inside a cylindrical cover that can rotate 360 ​​degrees to emit laser light and receive reflected laser light to create a map of the surrounding area. This can be done by spinning or rotating.

[0053] However, since this method involves a motor, there may be problems with failure and continuity, so it is also possible to use a method in which the laser is fixed and then heated to change the refractive index to emit radar, or a method in which a mirror or liquid crystal is used to change the phase.

[0054] Ultrasonic sensors use ultrasonic waves with an audio frequency that is beyond the human hearing range. By measuring the time it takes for the emitted ultrasonic wave to reflect after hitting the object 5, the distance to the object 5 can be measured. The measurement principles of radar and ultrasonic waves are similar, but there is a difference that radar uses electromagnetic waves and ultrasonic waves use sound waves. Ultrasonic sensors have a long life and are low-priced, so multiple ones can be installed in the construction equipment 4.

[0055] The display unit 12 can be set in front of the eyeballs of the driver of the construction equipment 4. The bracket (not shown) supporting the display unit 12 can be in various forms as long as it can move with the driver's head movement, for example, it can be set in the form of glasses or attached to a helmet, etc.

[0056] Therefore, unlike existing monitors and HUDs that are fixed at a specific location to display information, the display unit 12 is set in front of the driver's eyeballs and can move with the driver's head movements in the front, rear, side (left and right directions), etc., so that the position of the display unit 12 can be changed.

[0057] The display unit 12 may provide an interface for modifying the function setting or value adjustment of the control unit 31 described later, so even if the information is the same, the form displayed by the display unit 12 may be different according to the interface adjustment.

[0058] The display unit 12 can not only display information from the control unit 31 to the driver, but can also be made of a transparent material such as glass so that the driver can perform operations through the display unit 12. Therefore, if the display unit 12 does not provide information, the real world seen by the driver is the same regardless of whether the display unit 12 exists.

[0059] The mark 7 described later may include an AR (augmented reality-overlay) concept, that is, it is displayed on the display unit 12 in an overlapping manner with the real world viewed by the driver through the display unit 12 to enhance reality.

[0060] The pupil sensor unit 21 is configured to recognize the pupil of the driver's eyeball and can recognize the pupil by irradiating infrared light to the pupil. The pupil sensor unit 21 can be provided around the display unit 12, and a plurality of pupil sensors 21 can be provided to recognize the left and right pupils respectively.

[0061] The sight tracking unit 22 is a device that tracks the direction of the driver's sight line to the information such as the mark 7 displayed on the display unit 12, and can obtain the information of the driver's sight line, just like the pupil sensor unit 21. Therefore, even if the position of the display unit 12 does not change, the information displayed on the display unit 12 can provide different information according to the direction of the driver's sight line, and even if the information is the same, the display position can be changed.

[0062] The pupil sensor unit 21 and the sight tracking unit 22 can detect the driver's eye movement. If the eye movement is below a set value, a signal can be provided to the control unit 31, and the control unit 31 can provide an alarm to the driver.

[0063] Since the pupil cannot be recognized when the eye movement is below the set value, an alarm can be used to remind the driver when the driver cannot concentrate on the work or falls asleep, thereby preventing safety accidents. This function can also be operated while the driver is resting, so it can have an on / off function.

[0064] The angle sensor unit 23 can identify the angle change of the display unit 12. Since the display unit 12 is provided in front of the driver's eyeballs, the angle change of the display unit 12 and the angle change of the driver's head can be the same.

[0065] The angle sensor unit 23 may use a sensor that identifies the inclination of the display unit 12. Since it is necessary to identify the up, down, left, and right angles, at least two sensors that identify the vertical and horizontal angles may be provided. For the sake of accuracy, multiple sensors may be provided.

[0066] Therefore, the angle sensor unit 23 can recognize that the driver moves his head up, down, left, and right during the operation. The angle sensor unit 23 can transmit the information of the angle change to the control unit 31, and the control unit 31 can modify the display position relative to the information displayed on the display unit 12.

[0067] The angle sensor unit 23 can also identify the situation where the driver moves his head up, down, left, and right while looking forward, and the situation where the driver moves his head while looking to the side and rear. Therefore, even if the driver does not use the side mirror (not shown) or rear mirror (not shown in the figure) provided on the construction equipment 4, the existence of the object 5 located to the side and rear of the construction equipment 4 can be known through the blind spot display device of the construction equipment 4 of the present invention.

[0068] The alarm unit 24 provides an alarm for objects 5 around the construction equipment 4 . When the object 5 is located within the operation radius of the construction equipment 4 , an alarm may be provided, which may be controlled by the control unit 31 .

[0069] Vibration or sound may be provided as the alarm, and the magnitude of the vibration or sound and the switch function may be changed by the control unit 31 .

[0070] The operating radius of the construction equipment 4 may vary depending on the construction equipment 4, but in the case of an excavator, a boom structure 6 is provided, and the boom structure 6 is composed of a boom and an arm, and can change the height and length during operation. Therefore, the operating radius of the excavator can be set according to the length of the boom structure 6.

[0071] In addition, the alarm unit 24 can receive a signal from the control unit 31 and provide an alarm to the driver when the amount of eye movement is below the set value. Since the amount of eye movement below the set value may be a situation where the driver is dozing off or unable to concentrate on the work, the alarm can be used to remind the driver.

[0072] The control unit 31 may collect and analyze information on the blind spot display device of the construction equipment 4 of the present invention.

[0073] The control unit 31 may acquire information from the detection unit 11 that detects the surrounding objects 5 of the construction equipment 4 and the sight line tracking unit 22 that tracks the sight line direction of the driver, and analyze information in the direction consistent with the sight line of the driver.

[0074] In addition, information is received and analyzed from the pupil sensor unit 21 and the angle sensor unit 23 that recognize the driver's pupil, and the mark 7 for the object 5 included in the driver's line of sight can be displayed on the display unit 12 .

[0075] The mark 7 shows the surrounding objects 5 of the construction equipment 4 detected by the detection unit 11, and can be displayed on the display unit 12 for the driver to identify during the operation. The display of the mark 7 can have various forms, such as the outline of the object 5, the wireframe form of various colors including the object 5, and the image or video projected on the blind spot when the object 5 exists in the blind spot of the driver's vision.

[0076] Since the display of the mark 7 can be modified in the interface provided by the display unit 12, the display of the mark 7 used by each driver may be different. Since the mark 7 is displayed on the display unit 12 overlapping with the real world seen by the driver through the display, an augmented reality or AR function can be included.

[0077] In addition, although the alarm of the alarm unit 24 is provided when the object 5 is within the operating radius of the construction equipment 4, the display of the mark 7 can be changed according to whether the object 5 existing in the blind spot is within the operating radius of the construction equipment 4. For example, if the object 5 is within the operating radius, it can be displayed in a red wireframe form, and when the object 5 is beyond the operating radius, it can be displayed in a green wireframe form for distinction.

[0078] The control unit 31 analyzes the information included in the driver's sight line direction and displays it on the display unit 12 , wherein the construction equipment 4 may have a blind spot in the driver's sight line.

[0079] In construction equipment 4 such as an excavator or a forklift, the windows of the cab are relatively wide and it is easy to see forward, but it is difficult to see left, right and rear because the equipment is mounted on the vehicle body.

[0080] Especially in the case of an excavator, since a boom structure 6 is provided on one side of the construction equipment 4 and the driver deviates to the other side to perform the operation, the visual field information that the driver can see with the naked eye is limited, and since the boom structure 6 may change at any time during the operation, the blind spot may also change at any time even during the operation.

[0081] Therefore, the control unit 31 can display the object 5 that is included in the driver's sight line direction but exists in the blind spot on the display unit 12 using the mark 7 , so the driver can recognize the object 5 that exists in the blind spot.

[0082] The existing equipment for identifying and displaying the surrounding objects 5 of the construction equipment 4 has another monitor and is arranged around the driver. Therefore, there is the cumbersomeness that the driver must check the monitor at any time while working, and there is a problem that the driver's line of sight is out of the work place during the work and cannot respond immediately. However, the blind spot display device of the construction equipment 4 of the present invention is provided with a display unit 12 in front of the driver's eyeballs, and the mark 7 of the surrounding objects 5 is displayed on the display unit 12, so that the driver can identify the surrounding objects 5 while working without changing his line of sight.

[0083] Figure 5 A block diagram showing a blind spot display device for construction equipment according to an embodiment of the present invention.

[0084] The control unit 31 can obtain information from the detection unit 11, the pupil sensor unit 21, the sight tracking unit 22, and the angle sensor unit 23, analyze the information of the driver's sight direction, and display the analyzed information on the display unit 12. In addition, a signal can be sent to the alarm unit 24 so that the alarm unit 24 provides an alarm to the driver, and gives a reminder when the object 5 is within the operating radius of the construction equipment 4 or the driver is drowsy.

[0085] Since the detection unit 11 is arranged in the construction equipment 4, it can communicate wirelessly with the control unit 31, and since the pupil sensor unit 21 and the line of sight tracking unit 22 are arranged around the driver's eyeball, and the angle sensor unit 23 is arranged in the display unit 12, the pupil sensor unit 21, the line of sight tracking unit 22 and the angle sensor unit 23 can communicate wirelessly or wired with the control unit 31.

[0086] The control unit 31 can modify the information of objects 5 around the construction equipment 4 detected by the detection unit 11 according to the driver's visual information and provide it to the display unit 12, so that it can receive information from the pupil sensor unit 21, the line of sight tracking unit 22 and the angle sensor unit 23 in real time.

[0087] Since an interface for setting and modifying the function of the control unit 31 is provided on the display unit 12 , the driver can adjust the function of the control unit 31 mentioned above, and in particular, the driver can select the display form of the mark 7 .

[0088] Figure 6 4 is a conceptual diagram of a blind spot display device for construction equipment according to an embodiment of the present invention.

[0089] The display unit 12 is disposed in front of the driver's eyeballs, and may be in the form of goggles or glasses, or may be disposed in front of only one eyeball.

[0090] Reference Figure 6 According to an embodiment of the present invention, the blind spot display device of the construction equipment 4 is in the form of glasses, which may be smart glass. Therefore, the display unit 12 may be provided on the smart glass, and the driver may recognize the construction site in the real world through the display unit 12 even if the display unit 12 does not display information.

[0091] Figure 6 An opaque or colored display portion 12 is shown, but this is just an example, and the display portion 12 may be set to be transparent.

[0092] Reference Figure 6 , there are 5 images, each image displays text, the center represents the central image, the top represents the top image, the bottom represents the bottom image, the left represents the left image, and the right represents the right image.

[0093] Figure 6 It is the field of vision of the driver when he is sitting in the construction equipment 4 and looking forward to perform work. The central image indicates that the driver's field of vision is in the center. The up, down, left and right directions respectively represent the situation of the driver turning his field of vision up, down, left and right with the central image as the center.

[0094] In the case of the central image, it can be seen that a blind spot is formed in the driver's field of vision due to the boom structure 6. Since the boom structure 6 changes at any time during the operation, the blind spot can also change at any time. In the central image, the wireframe on the display unit 12 is the surrounding objects 5 of the construction equipment 4 displayed by the mark 7, and its shape can change according to the setting of the mark 7.

[0095] From the central image, objects 5 surrounding the two construction equipment 4 are detected by the detection unit 11. The surrounding objects 5 exist in the blind spot caused by the boom structure 6 and are in a place that is difficult for the driver to identify with the naked eye. However, the control unit 31 also provides a mark 7 for the object 5 existing in the blind spot on the display unit 12, so the driver can identify the object 5 existing in the blind spot through the mark 7.

[0096] For ease of understanding, the up, down, left, and right images are obtained when the driver's line of sight and head angle change when the construction equipment 4 and the object 5 are stationary.

[0097] The upper image is the driver's line of sight and head angle in the upper direction, and the position of the mark 7 is located at the lower side on the display unit 12. The control unit 31 analyzes the information of the pupil sensor unit 21, the line of sight tracking unit 22 and the angle sensor unit 23, and modifies the display position of the mark 7 on the display unit 12 corresponding to the change in the driver's angle.

[0098] Therefore, when the driver's line of sight and head angle are in an upward direction, the mark 7 for the object 5 in the center can be relatively located at the lower side on the display unit 12 .

[0099] From the above images, we can compare the construction equipment 4 before and after the blind spot display device of the present invention is installed. In the construction site before the present invention is installed, the object 5 is located in the blind spot and is difficult to identify with the naked eye. The driver of the construction equipment 4 may work without identifying the object 5, which may cause a safety accident.

[0100] After being equipped with the present invention, the object 5 is displayed as a mark 7 on the display unit 12, which the driver can intuitively identify, and since the object 5 is identified through the display unit 12 set in front of the driver's eyeball rather than through other monitors, the change of vision in the construction site can be minimized.

[0101] The lower image is the direction in which the driver's sight line and head angle are in the lower direction, and the position of the mark 7 is located on the upper side on the display unit 12. Compared with the upper image, the size of the mark 7 may be different, because the size of the mark 7 displayed on the display unit 12 along the driver's sight line direction may be different depending on the driver's head angle.

[0102] The left image is when the driver's line of sight and head angle are in the left direction, and the position of the mark 7 is located on the right side on the display unit 12. Even if the driver changes the line of sight and head to the left direction, the mark 7 is displayed in a relatively small form on the right part of the display unit 12, so the driver can recognize the object 5.

[0103] The right image is when the driver's line of sight and head angle are in the right direction. The position of the mark 7 is relatively to the left compared to the central image on the display unit 12, but the object 5 in the blind spot is displayed as the mark 7, so the driver can recognize it.

[0104] Figure 6 The situation is that the driver turns his head up, down, left, and right while looking forward while working in the construction equipment 4, and the same is also applicable to the situation that the driver looks to the side and rear.

[0105] The control unit 31 can display a mark 7 for an object 5 included in the driver's line of sight on the display unit 12, but the driver's line of sight can be the front, side and rear, and the driver can know the object 5 located in the driver's blind spot through the blind spot display device of the construction equipment 4 of the present invention.

[0106] The driver's blind spot can also be formed by the boom structure of the excavator and the position where the driver sits in the construction equipment 4, that is, the cab (not shown in the figure). Generally, the driver can identify the object 5 located to the side or rear of the cab through the side mirror or rearview mirror provided on the construction equipment 4, but the driver needs to move his sight at the work site and may not be able to identify the object 5 during the work process, so there may be a disadvantage of limited field of view that can be seen through the side mirror or rearview mirror.

[0107] The blind spot display device of the construction equipment 4 of the present invention can overcome these shortcomings and can identify objects 5 in all directions of the driver's line of sight including the driver's blind spot and display them as marks 7, so that the driver can not only identify the front of the construction equipment 4, but also identify objects 5 located on the side and rear.

[0108] Therefore, the driver does not need to turn his or her sight to another monitor or the like in order to identify surrounding objects 5, so he or she can concentrate on the work, which can improve work efficiency, and can also respond immediately to objects 5 that are in unexpected positions of the driver. Therefore, the blind spot display device of the construction equipment 4 of the present invention can prevent safety accidents by minimizing the movement of the driver's sight.

[0109] The present invention is not limited to the embodiments described above, and other embodiments may include a combination of the above embodiments or a combination of at least any one of the above embodiments with a known technology.

[0110] The present invention has been described in detail above through specific embodiments, but this is for the purpose of specifically illustrating the present invention and the present invention is not limited thereto. Obviously, those skilled in the art can make variations or improvements within the technical concept of the present invention.

[0111] Simple deformation and even modification of the present invention belong to the scope of the present invention, and the specific protection scope of the present invention is explained by the appended claims.

Claims

1. A blind spot display device for construction equipment, in, include: A detection unit, disposed on the construction equipment, for detecting objects around the construction equipment; A display unit is arranged in front of the eyeball of the construction equipment driver; A sight line tracking unit, which tracks the sight line direction of the driver; and a control unit, which acquires information from the detection unit and the sight line tracking unit, and analyzes information in a direction consistent with the sight line of the driver, The control unit displays, on the display unit, a mark of the object included in the sight line direction of the driver.

2. The blind spot display device for construction equipment according to claim 1, wherein: The control unit also displays a mark of the object on the display unit for the object included in the line of sight direction but existing in a blind spot in the line of sight direction of the driver, so as to inform the driver of the object existing in the blind spot.

3. The blind spot display device for construction equipment according to claim 2, wherein: The control unit also includes: a pupil sensor unit for identifying a pupil in the eyeball of the driver; and an angle sensor unit for identifying a change in an angle of the display unit, The control unit analyzes information from the pupil sensor unit, the sight line tracking unit, and the angle sensor unit, and modifies a display position of the mark on the display unit in accordance with the angle change.

4. The blind spot display device for construction equipment according to claim 3, wherein: Also includes an alarm unit for providing an alarm of the thing, When the object is within the working radius of the construction equipment, the control unit operates the alarm unit to inform the driver of the object.

5. The blind spot display device for construction equipment according to claim 4, wherein: The detection unit includes at least one of a camera, a radar, a laser radar and an ultrasonic sensor. The detection unit is arranged in front of, behind, on the left side and on the right side of the construction equipment, and is also arranged in front of a structure of the construction equipment that induces the blind spot.

6. The blind spot display device for construction equipment according to claim 5, wherein: The display unit provides the driver with an interface for setting and modifying the function of the control unit.

7. The blind spot display device for construction equipment according to claim 6, wherein: When the construction equipment is an excavator, The blind area is formed by the boom structure of the excavator. The operating radius is set according to the length of the boom structure.

8. The blind spot display device for construction equipment according to claim 7, wherein: The mark includes: an outline of the object, a wireframe containing the object, or an image of the object projected on the blind spot.

9. The blind spot display device for construction equipment according to claim 8, wherein: The control unit generates an alarm through the alarm unit when the amount of movement of the eyeball obtained by the pupil sensor unit or the sight line tracking unit is equal to or less than a set value.

10. The blind spot display device for construction equipment according to claim 1, wherein: The display unit is arranged on the smart glass.

Images