Display device for blind spots in construction machinery

Abstract

The present invention is a blind spot display device for construction machinery, including a detection unit provided on the construction machinery to detect objects around the construction machinery, a display unit provided in front of the eyes of the operator of the construction machinery, a line-of-sight tracking unit that follows the line-of-sight direction of the operator, and a control unit that acquires information from the detection unit and the line-of-sight tracking unit and analyzes information in the direction that coincides with the line-of-sight of the operator. The control unit can display a marker for an object included in the line-of-sight direction of the operator on the display unit.

Description

Technical Field

[0001] The present invention relates to a blind spot display device for construction machinery.

Background Art

[0002] Generally, various types of construction machinery such as cranes, dump trucks, bulldozers, excavators, forklifts, etc. are widely used at construction sites, civil engineering sites or various industrial sites.

[0003] Most construction machinery has a large and heavy body and generates enormous power. Therefore, the operator who drives the construction machinery needs to be extremely careful to prevent accidents, and there is always a risk of causing a major accident due to a momentary mistake.

[0004] Construction machinery is generally driven by a single operator, and it is impossible for the operator of the corresponding construction machinery to visually recognize all the situations around the construction machinery. Even if wireless communication is carried out with other workers around, there is a risk of accidents while working with the construction machinery.

[0005] In particular, construction machinery such as excavators and forklifts has relatively large windows in the cab and it is easy to observe the front, but it is difficult to observe the left, right and rear due to the machinery mounted on the vehicle body.

[0006] Therefore, usually, the operator operates the construction machinery while monitoring the surroundings of the construction machinery through various mirrors such as a rearview mirror located inside the construction machinery or sideview mirrors located on the left and right. However, there are blind spots within the range that the operator can visually monitor from the driver's seat.

[0007] Such blind spots pose a major problem in the safe operation of construction machinery. In fact, most accidents such as fatal accidents and damage to structures that occur during the operation of construction machinery occur in the left, right and rear blind spots where it is difficult for the operator to observe. Therefore, at the site, the operator of the construction machinery and the surrounding workers need to be extremely careful.

[0008] Despite these precautions, accidents involving construction machinery frequently occur due to negligence on the part of the operator or surrounding workers during operation. These accidents mainly occur when the operator fails to recognize surrounding workers working behind or in the blind spots of the construction machinery while operating it. In the case of excavators, this often results in the boom platform rotating and striking nearby workers, or injuries occurring during the reverse movement of the construction machinery.

[0009] To solve this problem, various surrounding recognition systems utilizing sensors and cameras are currently being developed. Among these, Korean registered patent 10-2007535 applies an AVM (Around View Monitoring) system that displays the surroundings of construction machinery via cameras installed in the front, rear, left, and right directions, allowing the driver to recognize blind spots. However, this system has the problem that the AVM screen is displayed on a monitor installed on the construction machinery, and the driver must shift their gaze to the monitor while working, thus taking their eyes off the work site and preventing immediate response. [Overview of the project] [Problems that the invention aims to solve]

[0010] The present invention was created to solve the problems of the prior art described above, and the objective of the present invention is to provide a blind spot display device for construction machinery that can improve work efficiency and prevent accidents due to inattention by providing blind spot information to the operator of the construction machinery through smart glass, thereby reducing the influence of the external environment and minimizing the movement of the operator's gaze during work. [Means for solving the problem]

[0011] The present invention is a blind spot display device for construction machinery, comprising: a detection unit provided on the construction machinery for detecting objects around the construction machinery; a display unit provided in front of the eyes of the operator of the construction machinery; an eye-tracking unit that tracks the direction of the operator's gaze; and a control unit that acquires information from the detection unit and the eye-tracking unit and analyzes information in a direction that matches the operator's gaze, wherein the control unit can display markers on the display unit for objects included in the direction of the operator's gaze.

[0012] Specifically, the control unit can display a marker for an object that is included in the line of sight but is located in the driver's blind spot, allowing the driver to recognize the object in the blind spot.

[0013] Specifically, the control unit further includes a pupil sensor unit that recognizes the pupil of the driver's eyeball, and an angle sensor unit that recognizes changes in the angle of the display unit. The control unit can analyze the information from the pupil sensor unit, the gaze tracking unit, and the angle sensor unit to correct the display position of the marker on the display unit in response to the changes in angle.

[0014] Specifically, the system further includes an alarm unit that provides an alarm for the object, and the control unit can activate the alarm unit to allow the driver to recognize the object when the object is located within the working radius of the construction machine.

[0015] Specifically, the detection unit includes at least one of a camera, radar, lidar, and ultrasonic sensor, and is installed in front of, behind, to the left and to the right of the construction machine, and can also be installed in front of the configuration of the construction machine that induces the blind spot.

[0016] Specifically, the display unit can provide the driver with an interface for setting and correcting the functions of the control unit.

[0017] Specifically, when the construction machine is an excavator, the blind spot is formed by the boom structure of the excavator, and the working radius can be set based on the length of the boom structure.

[0018] Specifically, the marker can include the contour line of the object, a box shape including the object, or an image in which the object is projected onto the blind spot.

[0019] Specifically, when the movement of the eyeball through the pupil sensor unit or the gaze tracking unit is below a set value, the control unit can provide an alarm via the alarm unit, and the display unit can be provided on the smart glass.

Advantages of the Invention

[0020] The blind spot display device for a construction machine of the present invention provides information on blind spots to the operator of the construction machine through smart glasses, is less affected by the external environment, and minimizes the movement of the operator's line of sight during work, thereby improving work efficiency and preventing accidents due to carelessness.

Brief Description of the Drawings

[0021] [Figure 1] It is a conceptual diagram of a construction machine according to an embodiment of the present invention. [Figure 2] It is a perspective view of a detection unit according to a first embodiment of the present invention. [Figure 3] It is a perspective view of a detection unit according to a second embodiment of the present invention. [Figure 4] It is a perspective view of a detection unit according to a third embodiment of the present invention. [Figure 5] It is a block diagram showing a blind spot display device for a construction machine according to an embodiment of the present invention. [Figure 6] It is a conceptual diagram of a blind spot display device for a construction machine according to an embodiment of the present invention.

Modes for Carrying Out the Invention

[0022] The objects, specific advantages, and novel features of the present invention will become more apparent from the following detailed description and preferred embodiments in connection with the accompanying drawings. In this specification, when referring to the components of each drawing, it should be noted that, as long as they are the same components, the same reference numbers are assigned as much as possible even if they are shown on other drawings. In addition, when explaining the present invention, if it is determined that the specific description of the related known technology makes the gist of the present invention unnecessarily unclear, the detailed description thereof will be omitted.

[0023] Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings.

[0024] FIG. 1 is a conceptual diagram of a construction machine according to an embodiment of the present invention, FIG. 2 is a perspective view of a detection unit according to a first embodiment of the present invention, and FIG. 3 is a perspective view of a detection unit according to a second embodiment of the present invention. Further, FIG. 4 is a perspective view of a detection unit according to a third embodiment of the present invention.

[0025] Referring to FIG. 1, an excavator is shown as the construction machine 4, but a crane, dump truck, bulldozer, forklift, etc. used at various construction sites may also be included in the construction machine 4.

[0026] The blind spot display device of the construction machine 4 according to the present invention includes a detection unit 11, a display unit 12, a pupil sensor unit 21, a gaze tracking unit 22, an angle sensor unit 23, an alarm unit 24, and a control unit 31 provided on the construction machine 4.

[0027] A plurality of detection units 11 may be provided on the construction machine 4, and they may be provided in front of, behind, on the left side, and on the right side of the construction machine 4, respectively.

[0028] Referring to FIG. 1, the detection units 11 are provided in front of, behind, on the left side, and on the right side of the construction machine 4, and can also be provided in front of the configuration of the construction machine 4 that induces the blind spot of the driver's line of sight of the construction machine 4.

[0029] If construction machine 4 is an excavator, the driver's blind spot can be formed by the boom structure of the excavator; if construction machine 4 is a forklift, the driver's blind spot can be formed by the mast or forks.

[0030] Referring to Figure 1, the construction machine 4 is shown to be an excavator, and the blind spot is formed by the boom structure 6, which induces a blind spot in the driver's line of sight, and the driver may not be able to perceive objects 5 (including people) in the part hidden by the boom structure 6.

[0031] Therefore, since the objects 5 located in front of and to the sides of the boom structure 6 are in the driver's blind spot and cannot be seen by the driver with the naked eye, the blind spot display device of the construction machine 4 of the present invention is also equipped with a detection unit 11 in front of the boom structure 6, so that objects 5 located in the driver's blind spot can also be detected, thereby preventing accidents caused by inattention.

[0032] The detection unit 11, which can detect objects 5 around the construction machine 4, may include at least one of the following: a camera, radar, lidar, and ultrasonic sensor.

[0033] Cameras are commonly used for monitoring the surroundings of construction machinery 4, and multiple cameras may be installed. They not only capture images and transmit them to the control unit 31, but can also recognize objects 5 from the images using the IMOD (Image-Based Detection System). Furthermore, object recognition from the images can be achieved through AI.

[0034] Referring to Figures 2 and 3, one embodiment of the detection unit 11, the camera, can be seen. The camera includes a lens and may have a fixing plate that can be attached to the construction machine 4 by screws or welding so that it can be mounted on the construction machine 4.

[0035] Referring to Figure 2, the camera may be equipped with an LED along with the lens, allowing it to identify object 5 even in dark surrounding environments. A camera cover may also be provided to prevent blurring of light or failure to recognize object 5 when other light, such as direct sunlight, shines on the lens.

[0036] Furthermore, the camera's side has a pivot structure that allows for adjustment of the camera's vertical angle to recognize objects 5, and the fixing plate that secures the camera is connected to the construction machine 4 with a pivot structure, allowing for adjustment of the camera's horizontal angle, thus eliminating objects 5 that fall outside the camera's field of view.

[0037] Referring to Figure 3, the camera may have a more protruding lens and a larger lens diameter compared to Figure 2. Since the camera's performance can be improved in proportion to the lens size, high-quality video capture is possible, and the resolution can also be improved, increasing the recognition rate of object 5.

[0038] Furthermore, the side of the camera and the fixing plate that secures the camera may have a pivot structure that allows for adjustment of the vertical and horizontal angles of the camera, thereby eliminating objects 5 that fall outside the camera's field of view, and the cameras may be arranged so that the fields of view of multiple cameras overlap with each other.

[0039] Multiple cameras installed on the construction machine 4 may have the same performance, and different lenses may be used depending on their placement, so cameras with different performance characteristics can be installed.

[0040] The camera image quality can be that of a VGA-class analog camera, or a clearer HD-class digital camera can be used to capture high-resolution images, and IMOD can be used to improve the recognition of object 5 from the images.

[0041] Radar is a device that uses radio waves to detect and measure distances. It detects objects by measuring the reflected waves that return after the emitted radio waves hit a target, and can determine their direction, distance, speed, etc.

[0042] Therefore, when the distance between the construction machine 4 and the surrounding object 5 changes due to the movement of the construction machine 4 or the movement of the surrounding object 5, the time it takes for the radio waves emitted from the radar to return changes, so it is possible to determine whether or not there has been a collision with the construction machine 4, and this can be transmitted to the control unit 31.

[0043] Multiple radars may be installed on the construction machine 4, or they may be used individually, but because there may be errors in the detection range, they can be used together with cameras to minimize accidents due to carelessness and to improve the accuracy of object recognition 5.

[0044] Figure 4 shows the radar configuration. The radar may be partially fixed to the construction machine 4, or it may be concentrated at the rear of the construction machine 4 where it is out of the driver's line of sight.

[0045] The radar may be mounted on the construction machine 4 or installed separately from the main machine, and the connection between the radar and the construction machine 4 may be provided with a pivot structure that allows for adjustment of the horizontal angle.

[0046] LiDAR is a different type of device from radar. It is a sensor that helps construction machinery 4 determine its own position by emitting a laser into the surrounding area, measuring the time difference between when the laser hits an object and when it returns, and creating a map of the surrounding area.

[0047] A lidar device has a laser housed within a cylindrical cover, which rotates 360 degrees while emitting light and receiving the reflected laser to create a map of the surrounding area. This can be done using a spinning or rotational method.

[0048] However, because this method involves a motor, it may have issues with malfunction and sustainability. Therefore, methods such as fixing the laser and then applying heat to change its refractive index to illuminate the radar, or using mirrors or liquid crystals to change the phase, can also be used.

[0049] Ultrasonic sensors use ultrasound, which is an audio frequency outside the range of human hearing. The distance to object 5 can be measured by measuring the time it takes for the emitted ultrasound to strike object 5 and reflect. While radar and ultrasound have similar measurement principles, they differ in that radar uses electromagnetic waves, while ultrasound uses sound waves. Ultrasonic sensors have a long lifespan and are inexpensive, allowing multiple sensors to be installed on construction machinery 4.

[0050] The display unit 12 may be positioned in front of the eyes of the operator of the construction machine 4, and the support stand (not shown) that supports the display unit 12 can take various forms, such as being provided in the shape of eyeglasses or being attached to a helmet, as long as it can move together with the operator's head movements.

[0051] Therefore, while existing monitors and HUDs are fixed at specific points to display information, the display unit 12 is positioned in front of the driver's eyes and can move along with the driver's head movements, such as forward, backward, and sideways (left and right), allowing the position of the display unit 12 to be changed.

[0052] The display unit 12 can provide an interface for setting the functions of the control unit 31 (described later) or for making corrections such as numerical adjustments. Even with the same information, the form in which it is displayed on the display unit 12 can change through interface adjustments.

[0053] The display unit 12 not only displays information from the control unit 31 to the driver, but can also be made of a transparent material such as glass, allowing the driver to perform tasks through the display unit 12. Therefore, if no information is provided by the display unit 12, the real world the driver sees can be the same regardless of whether the display unit 12 is present or not.

[0054] The marker 7, described later, is displayed on the display unit 12, superimposed on the real world that the driver sees through the display unit 12, and can incorporate the concept of augmented reality (AR-overlay).

[0055] The pupil sensor unit 21 is configured to recognize the pupil of the driver's eyeball, and can recognize the pupil by shining infrared light on it. The pupil sensor unit 21 may be provided around the display unit 12, and multiple units may be provided to recognize the left and right pupils separately.

[0056] The eye-tracking unit 22 is a device that tracks the driver's gaze direction in relation to information such as markers 7 displayed on the display unit 12, and can obtain information about the driver's gaze, similar to the pupil sensor unit 21. Therefore, even if the position of the display unit 12 does not change, different information can be provided on the display unit 12 depending on the driver's gaze direction, and the position in which the same information is displayed can change.

[0057] The driver's eye movements can be detected through the pupil sensor unit 21 and the gaze tracking unit 22. If the eye movements are below a set value, a signal is sent to the control unit 31, which then provides an alarm to the driver.

[0058] This may include cases where the pupil cannot be recognized if eye movement is below a set value. This allows the system to alert the driver with an alarm if they are unable to concentrate on their work or become drowsy, thus preventing accidents caused by inattention. This function can also be activated while the driver is resting, and therefore can be equipped with an on / off function.

[0059] The angle sensor unit 23 can recognize changes in the angle of the display unit 12, and since the display unit 12 is positioned in front of the driver's eyes, the change in the angle of the display unit 12 and the change in the angle of the driver's neck can be the same.

[0060] The angle sensor unit 23 can use a sensor that recognizes the tilt of the display unit 12, and since it must recognize angles in all directions (up, down, left, and right), at least two sensors that recognize vertical and horizontal angles may be provided, and multiple sensors may be provided for accuracy.

[0061] Therefore, the angle sensor unit 23 can recognize when the driver moves their head up, down, left, or right while working, and the angle sensor unit 23 transmits information regarding the angle change to the control unit 31, which can then correct the display position of the information displayed on the display unit 12.

[0062] The angle sensor unit 23 can recognize when the driver moves their head up, down, left, and right while looking forward, as well as when the driver moves their head while looking to the side and rear. Therefore, the driver can detect the presence of objects 5 located to the side and rear of the construction machine 4 using the blind spot display device of the construction machine 4 according to the present invention, without needing to use the side mirrors (not shown) or rearview mirrors (not shown) provided on the construction machine 4.

[0063] The alarm unit 24 provides an alarm for objects 5 around the construction machine 4, and can provide an alarm when an object 5 is located within the working radius of the construction machine 4, which can be controlled by the control unit 31.

[0064] The alarm may be provided by vibration or sound, and the magnitude of the vibration or sound and the on / off function can be changed by the control unit 31.

[0065] The working radius of the construction machine 4 may vary depending on the construction machine 4, but in the case of an excavator, a boom structure 6 is provided, and the boom structure 6 consists of a boom and an arm, and its height and length can be changed during operation. Therefore, the working radius of the excavator can be set based on the length of the boom structure 6.

[0066] Furthermore, the alarm unit 24 can receive a signal from the control unit 31 and provide an alarm to the driver if the eye movement is below a set value. Since eye movement below a set value may indicate that the driver is dozing off or unable to concentrate on their work, the alarm can alert the driver.

[0067] The control unit 31 can collect and analyze information related to the display device for blind spots of the construction machine 4 according to the present invention.

[0068] The control unit 31 can acquire information from the detection unit 11, which detects objects 5 around the construction machine 4, and the eye-tracking unit 22, which tracks the direction of the driver's gaze, and analyze information about the direction that matches the driver's gaze.

[0069] Furthermore, the system can receive and analyze information from the pupil sensor unit 21 and angle sensor unit 23, which recognize the driver's pupils, and display markers 7 on the display unit 12 for objects 5 included in the driver's line of sight.

[0070] Marker 7 displays objects 5 surrounding the construction machine 4 detected by the detection unit 11, and is displayed on the display unit 12 so that the operator can recognize it while working. The display of Marker 7 can take various forms, including the outline of the object 5, a box shape of various colors containing the object 5, and, if the object 5 is in the blind spot of the operator's line of sight, an image or video projected into the blind spot.

[0071] Since the display of marker 7 can be modified using the interface provided by the display unit 12, the display of marker 7 used by each driver may differ. Furthermore, because marker 7 is displayed on the display unit 12 superimposed on the real world that the driver sees through the display, it can incorporate augmented reality (AR) functionality.

[0072] Furthermore, an alarm is provided by the alarm unit 24 when an object 5 is located within the working radius of the construction machine 4. The display of the marker 7 can be made different depending on whether the object 5, which is in a blind spot, is within the working radius of the construction machine 4 or not. For example, if the object 5 is within the working radius, it can be displayed as a red box, and if the object 5 is outside the working radius, it can be displayed as a green box to distinguish between the two.

[0073] The control unit 31 analyzes the information contained in the driver's line of sight and displays it on the display unit 12, but there may be blind spots in the driver's line of sight of the construction machine 4.

[0074] Construction machinery such as excavators and forklifts have relatively large windows in the driver's cab, making it easy to observe what is in front, but the machinery mounted on the vehicle makes it difficult to observe what is to the left, right, and rear.

[0075] In particular, in the case of an excavator, the boom structure 6 is installed on one side of the construction machine 4, causing the operator to work biased to the opposite side. As a result, there are limitations to the field of view that the operator can see with the naked eye, and since the boom structure 6 can be changed at any time during operation, blind spots can also be changed at any time during operation.

[0076] Therefore, the control unit 31 can display objects 5 that are within the driver's line of sight but are in a blind spot using markers 7 on the display unit 12, allowing the driver to recognize objects 5 even in the blind spot.

[0077] In existing construction machinery 4, the equipment that recognizes and displays surrounding objects 5 was a separate monitor placed around the driver. Consequently, the driver had to constantly look at the monitor while working, which was inconvenient, and there was a problem that the driver's gaze was taken away from the work area during work and they could not respond immediately. However, the present invention, a blind spot display device for construction machinery 4, has a display unit 12 in front of the driver's eyes, and markers 7 for surrounding objects 5 are displayed on the display unit 12, so the driver can recognize surrounding objects 5 while working without changing their gaze.

[0078] Figure 5 is a block diagram showing a display device for blind spots in construction machinery according to one embodiment of the present invention.

[0079] The control unit 31 can acquire information from the detection unit 11, pupil sensor unit 21, gaze tracking unit 22, and angle sensor unit 23 to analyze the driver's gaze direction and display the analyzed information on the display unit 12. It can also send a signal to the alarm unit 24, which can provide an alarm to the driver if an object 5 is located within the working radius of the construction machine 4 or if the driver becomes drowsy.

[0080] Since the detection unit 11 is installed on the construction machine 4, it may communicate wirelessly with the control unit 31. The pupil sensor unit 21 and the gaze tracking unit 22 are installed around the driver's eyeballs, and the angle sensor unit 23 is installed on the display unit 12. The pupil sensor unit 21, the gaze tracking unit 22, and the angle sensor unit 23 can communicate wirelessly or via wired communication with the control unit 31.

[0081] The control unit 31 can modify the information about the objects 5 surrounding the construction machine 4 obtained by the detection unit 11 to correspond to the driver's visual information and provide it to the display unit 12, thereby enabling it to receive information in real time from the pupil sensor unit 21, the gaze tracking unit 22, and the angle sensor unit 23.

[0082] The display unit 12 is provided with an interface for setting and correcting the functions of the control unit 31, allowing the driver to adjust the functions of the control unit 31, and in particular, to select the display mode of the marker 7.

[0083] Figure 6 is a conceptual diagram of a blind spot display device for construction machinery according to one embodiment of the present invention.

[0084] The display unit 12 is positioned in front of the driver's eyeballs, but can be goggle-shaped or eyeglass-shaped depending on its form, and may be positioned in front of only one eyeball.

[0085] Referring to Figure 6, the blind spot display device for the construction machine 4 according to one embodiment of the present invention is spectacle-shaped, or it may be smart glass. Therefore, the display unit 12 may be provided on smart glass, and even if no information is displayed on the display unit 12, the driver can perceive the real world, which is the construction site, through the display unit 12.

[0086] In Figure 6, the display unit 12 is shown as opaque or colored, but this is merely an example, and it may also be provided transparently.

[0087] Referring to Figure 6, five images are provided, with text displayed for each image. The center image represents the central image, the top image represents the top image, the bottom image represents the bottom image, the left image represents the left image, and the right image represents the right image.

[0088] Figure 6 shows the field of view when the operator is inside the construction machine 4 and working while looking forward. The central image shows the operator's field of view when it is in the center, and the up, down, left, and right directions show the operator's field of view when it moves up, down, left, and right, respectively, with the central image as the center.

[0089] In the central image, it can be seen that a blind spot is formed in the driver's field of view by the boom structure 6. Since the boom structure 6 is changed as needed during operation, the blind spot can also be changed as needed. In the central image, the box on the display unit 12 represents the surrounding objects 5 of the construction machine 4 displayed with markers 7, and the shape may change depending on the settings of the markers 7.

[0090] Looking at the central image, the detection unit 11 detects two objects 5 surrounding the construction machine 4. The surrounding objects 5 are located in a blind spot created by the boom structure 6 and are difficult for the driver to see with the naked eye. However, the control unit 31 also provides markers 7 to the display unit 12 for the objects 5 located in the blind spot, so the driver can recognize the objects 5 located in the blind spot by the markers 7.

[0091] For ease of understanding, the images showing the up, down, left, and right views are based on the driver's line of sight and neck angle while the construction machine 4 and object 5 are stationary.

[0092] In the image above, the driver's gaze and neck angle are directed upwards, and the position of marker 7 is located on the lower side of the display unit 12. The control unit 31 analyzes the information from the pupil sensor unit 21, the gaze tracking unit 22, and the angle sensor unit 23 and can correct the display position of marker 7 on the display unit 12 in response to changes in the driver's angle.

[0093] Therefore, if the driver's line of sight and neck angle are upward, the marker 7 relative to the centrally located object 5 can be positioned lower on the display unit 12.

[0094] The image above shows a comparison of the construction machine 4 before and after the use of the blind spot display device of the present invention. Before the use of the present invention, at the construction site, object 5 was located in a blind spot and was difficult to recognize with the naked eye. As a result, the operator of the construction machine 4 could perform work without recognizing object 5, which could lead to accidents due to inattention.

[0095] After wearing the present invention, the object 5 is displayed on the display unit 12 with a marker 7, allowing the driver to recognize it intuitively. Since the object 5 is recognized via the display unit 12 located in front of the driver's eyes, without needing to recognize the object 5 via another monitor, changes in the driver's line of sight can be minimized at the work site.

[0096] In the image below, the driver's line of sight and neck angle are directed downwards, and the position of marker 7 is located on the upper side of the display unit 12. Compared to the image above, the size of marker 7 can be changed because the size of marker 7 displayed on the display unit 12 can change according to the driver's line of sight, depending on the angle of the driver's neck.

[0097] In the image on the left, the driver's gaze and neck angle are directed to the left, and the position of marker 7 is on the right side of the display unit 12. Even if the driver changes their gaze and neck to the left, marker 7 is displayed in a relatively small shape on the right side of the display unit 12, allowing the driver to recognize object 5.

[0098] In the image on the right, the driver's gaze and neck angle are directed to the right, and the position of marker 7 is relatively to the left on the display unit 12 compared to the central image. However, the object 5 in the blind spot is displayed by marker 7, allowing the driver to recognize it.

[0099] Figure 6 shows the case where the driver moves their head up, down, left, and right while working inside the construction machine 4 and looking forward. The same can be applied when the driver looks to the side and behind.

[0100] The control unit 31 can display markers 7 on the display unit 12 for objects 5 that are included in the driver's line of sight. The driver's line of sight can be forward, to the side, or backward, and the driver can recognize objects 5 located in the blind spot of the driver's line of sight via the blind spot display device of the construction machine 4 according to the present invention.

[0101] Blind spots in the driver's line of sight can also be formed by the boom structure of the excavator and the cabin (not shown in the diagram), which is the position in the construction machine 4 where the driver is seated. Generally, the driver can recognize objects 5 located to the side or rear of the cabin through the side mirrors or rearview mirrors provided on the construction machine 4. However, this has the disadvantage that the driver must shift their gaze away from the work site, and may not be able to fully recognize objects 5 during work, and there are limitations to the field of view that can be seen through the side mirrors or rearview mirrors.

[0102] The blind spot display device for the construction machine 4 of the present invention can overcome these drawbacks and can recognize objects 5 in all directions of the driver's line of sight, including the driver's blind spot, and display them with markers 7. Therefore, the driver can recognize objects 5 located not only in front of the construction machine 4, but also to the sides and behind it.

[0103] Therefore, since the driver does not need to shift their gaze to a separate monitor or the like to recognize surrounding objects 5, they can concentrate on their work, improving work efficiency, and they can immediately respond to objects 5 that are in unexpected positions. Thus, the blind spot display device for the construction machine 4 of the present invention can minimize the driver's eye movement and prevent accidents caused by inattention.

[0104] The present invention is not limited to the above embodiments, and may further include combinations of the above embodiments or combinations of at least one of the above embodiments with known technology as other embodiments.

[0105] Although the present invention has been described in detail through specific examples above, this is for the purpose of specifically illustrating the present invention, and it is clear that the present invention is not limited thereto, and that modifications and improvements can be made within the technical concept of the present invention by those with ordinary skill in the art.

[0106] Any mere modification or alteration of the present invention falls within the scope of the present invention, and the specific scope of protection of the present invention will be made clear by the appended claims.

Claims

1. A detection unit provided on the construction machine for detecting objects in the vicinity of the construction machine, A display unit is provided in front of the eyes of the operator of the construction machine, The aforementioned eye-tracking unit tracks the direction of the driver's gaze, The control unit includes a detection unit and a gaze tracking unit that acquire information from these units and analyzes information about the direction that matches the driver's gaze, The aforementioned construction machine is an excavator, The blind spot is formed by the boom structure or cabin of the excavator. The aforementioned display unit is provided on smart glass. The control unit, The display unit displays markers for objects included in the driver's line of sight and blind spot, and The aforementioned blind spot can be changed in accordance with the movement of the boom structure or the cabin while the excavator is in operation. A display device for detecting blind spots in construction machinery.

2. The control unit, A blind spot display device for a construction machine according to claim 1, wherein a marker for an object that is included in the line of sight but is located in the blind spot of the driver's line of sight is displayed on the display unit, thereby allowing the driver to recognize the object located in the blind spot.

3. The control unit, A pupil sensor unit that recognizes the pupil of the driver's eyeball, The system further includes an angle sensor unit that recognizes changes in the angle of the display unit, The control unit, A blind spot display device for a construction machine according to claim 2, wherein the device analyzes information from the pupil sensor unit, the gaze tracking unit, and the angle sensor unit and corrects the display position of the marker on the display unit in response to the change in angle.

4. The system further includes an alarm unit that provides an alarm for the aforementioned object, The control unit, The blind spot display device for a construction machine according to claim 3, wherein when the object is located within the working radius of the construction machine, the alarm unit is activated to cause the driver to recognize the object.

5. The detection unit is It includes at least one of the following: camera, radar, lidar, ultrasonic sensor, A blind spot display device for a construction machine according to claim 4, which is provided on the front, rear, left, and right sides of the construction machine, and is also provided in front of the components of the construction machine that induce the blind spot.

6. The aforementioned display unit is The blind spot display device for a construction machine according to claim 5, further providing the driver with an interface for setting and correcting the functions of the control unit.

7. The working radius is A display device for a blind spot of a construction machine according to claim 6, which is set based on the length of the boom structure.

8. The aforementioned marker, A display device for a blind spot of a construction machine according to claim 7, comprising the outline of the object, a box shape including the object, or an image of the object projected into the blind spot.

9. The control unit, A blind spot display device for a construction machine according to claim 8, wherein if the movement of the eyeball via the pupil sensor unit or the gaze tracking unit is below a set value, an alarm is provided via the alarm unit.

Images