Blind Spot Display Device for Construction Machinery

Abstract

The present invention is a blind spot display device for construction machinery, including a detection unit provided on the construction machinery to detect objects around the construction machinery, a display unit provided in front of the eyes of the operator of the construction machinery, a line-of-sight tracking unit that follows the line-of-sight direction of the operator, and a control unit that acquires information from the detection unit and the line-of-sight tracking unit and analyzes information in the direction that coincides with the line-of-sight of the operator. The control unit can display a marker for an object included in the line-of-sight direction of the operator on the display unit.

Description

Technical Field

[0001] The present invention relates to a blind spot display device for construction machinery.

Background Art

[0002] Generally, various types of construction machinery such as cranes, dump trucks, bulldozers, excavators, forklifts, etc. are widely used at construction sites, civil engineering sites or various industrial sites.

[0003] Most construction machinery has a large and heavy body and generates enormous power. Therefore, the operator who drives the construction machinery needs to be extremely careful to prevent accidents, and there is always a risk of causing a major accident due to a momentary mistake.

[0004] Construction machinery is generally driven by a single operator, and it is impossible for the operator of the corresponding construction machinery to visually recognize all the situations around the construction machinery. Even if wireless communication is carried out with other operators around, there is a risk of accidents while working with the construction machinery.

[0005] In particular, construction machinery such as excavators and forklifts has relatively large windows in the cab and it is easy to observe the front, but it is difficult to observe the left, right and rear due to the machinery mounted on the vehicle body.

[0006] Therefore, usually, the operator operates the construction machinery while monitoring the surroundings of the construction machinery through various mirrors such as a rearview mirror located inside the construction machinery or sideview mirrors located on the left and right. However, there are blind spots within the range that the operator can visually monitor from the driver's seat.

[0007] Such blind spots become a major problem in the safe operation of construction machinery. In fact, most accidents such as fatal accidents and damage to structures that occur during the operation of construction machinery occur in the left, right and rear blind spots that are difficult for the operator to observe. Therefore, at the site, the operator of the construction machinery and the surrounding workers need to be extremely careful.

[0008] Despite such precautions, accidents caused by construction machinery frequently occur due to the carelessness of the operator or surrounding workers during operation. These accidents mainly occur because the operator of the construction machinery fails to recognize the surrounding workers working behind or in the blind spot of the construction machinery during operation. In the case of an excavator, there are many accidents where the boom platform is rotated, hitting the surrounding workers or causing injuries during the reverse movement of the construction machinery.

[0009] To solve this problem, various surrounding recognition systems that utilize sensors, cameras, etc. have been developed. Among them, Korean Registered Patent No. 10-2007535 applies an AVM (Around View Monitoring) system that displays the surroundings of the construction machinery through cameras installed in the front, rear, left, and right directions of the construction machinery, enabling the operator to recognize blind spots. However, this system has a problem in that the AVM screen is displayed on the monitor provided on the construction machinery, and the operator has to shift their line of sight to the monitor during operation, resulting in being away from the work site and unable to respond immediately.

Summary of the Invention

Problems to be Solved by the Invention

[0010] The present invention was created to solve the problems of the prior art as described above. The object of the present invention is to provide information on blind spots to the operator of the construction machinery through smart glasses, minimizing the influence of the external environment and minimizing the movement of the operator's line of sight during operation, thereby improving work efficiency and preventing accidents caused by carelessness, and to provide a display device for the blind spot of the construction machinery.

Means for Solving the Problems

[0011] The present invention is a display device for blind spots of construction machinery, including a detection unit provided on the construction machinery to detect objects around the construction machinery, a display unit provided in front of the eyes of the operator of the construction machinery, a line-of-sight tracking unit that follows the line-of-sight direction of the operator, and a control unit that acquires information from the detection unit and the line-of-sight tracking unit and analyzes information in the direction that coincides with the line-of-sight of the operator. The control unit can display a marker for the object included in the line-of-sight direction of the operator on the display unit.

[0012] Specifically, the control unit can also display a marker for the object on the display unit for an object that is included in the line-of-sight direction but exists in the blind spot of the operator's line of sight, so that the operator can recognize the object existing in the blind spot.

[0013] Specifically, the control unit further includes a pupil sensor unit that recognizes the pupil with the operator's eyeball, and an angle sensor unit that recognizes the angle change of the display unit. The control unit can analyze the information of the pupil sensor unit, the line-of-sight tracking unit, and the angle sensor unit and correct the display position of the marker on the display unit corresponding to the angle change.

[0014] Specifically, it further includes an alarm unit that provides an alarm for the object. When the object is located within the working radius of the construction machinery, the control unit can activate the alarm unit to make the operator recognize the object.

[0015] Specifically, the detection unit includes at least one or more of a camera, a radar, a lidar, and an ultrasonic sensor, and is provided in front of, behind, on the left side, and on the right side of the construction machinery, and can also be provided in front of the configuration of the construction machinery that induces the blind spot.

[0016] Specifically, the display unit can provide an interface for the operator to set and correct the functions of the control unit.

[0017] Specifically, when the construction machine is an excavator, the blind spot is formed by the boom structure of the excavator, and the working radius can be set based on the length of the boom structure.

[0018] Specifically, the marker can include the contour line of the object, a box shape including the object, or an image in which the object is projected onto the blind spot.

[0019] Specifically, when the movement of the eyeball through the pupil sensor unit or the gaze tracking unit is equal to or less than a set value, the control unit can provide an alarm via the alarm unit, and the display unit can be provided on the smart glass.

Advantages of the Invention

[0020] The blind spot display device for a construction machine according to the present invention provides information on the blind spot to the operator of the construction machine through smart glass, is less affected by the external environment, and minimizes the movement of the operator's line of sight during work, thereby improving work efficiency and preventing accidents due to carelessness.

Brief Description of the Drawings

[0021]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Modes for Carrying Out the Invention

[0022] The objects, specific advantages, and novel features of the present invention will become more apparent from the following detailed description and preferred embodiments, which are related to the accompanying drawings. In this specification, when assigning reference numerals to the components of each drawing, it should be noted that as long as they are the same components, the same numbers are assigned as much as possible even if they are shown on other drawings. In addition, when explaining the present invention, if it is determined that the detailed description of the related known technology will unnecessarily obscure the gist of the present invention, the detailed description thereof will be omitted.

[0023] Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings.

[0024] FIG. 1 is a conceptual diagram of a construction machine according to an embodiment of the present invention, FIG. 2 is a perspective view of a detection unit according to a first embodiment of the present invention, and FIG. 3 is a perspective view of a detection unit according to a second embodiment of the present invention. Further, FIG. 4 is a perspective view of a detection unit according to a third embodiment of the present invention.

[0025] Referring to FIG. 1, an excavator is shown as the construction machine 4, but a crane, dump truck, bulldozer, forklift, etc. used at various construction sites may also be included in the construction machine 4.

[0026] The blind spot display device of the construction machine 4 according to the present invention includes a detection unit 11, a display unit 12, a pupil sensor unit 21, a gaze tracking unit 22, an angle sensor unit 23, an alarm unit 24, and a control unit 31 provided on the construction machine 4.

[0027] A plurality of detection units 11 may be provided on the construction machine 4, and may be provided in front of, behind, on the left side, and on the right side of the construction machine 4, respectively.

[0028] Referring to FIG. 1, the detection unit 11 is provided in front of, behind, on the left side, and on the right side of the construction machine 4, and can also be provided in front of the configuration of the construction machine 4 that induces the blind spot of the line of sight of the operator of the construction machine 4.

[0029] When the construction machine 4 is an excavator, the blind spot of the operator's line of sight can be formed by the boom structure of the excavator. When the construction machine 4 is a forklift, the blind spot of the operator's line of sight can be formed by the mast or the fork.

[0030] Referring to FIG. 1, an excavator is shown as the construction machine 4. The blind spot is formed by the boom structure 6, which induces the blind spot of the operator's line of sight, and the operator may not be able to recognize an object 5 (including a person) in the portion hidden by the boom structure 6.

[0031] Therefore, since the objects 5 in front of and on the sides of the boom structure 6 are located in the blind spot of the operator's line of sight and cannot be recognized by the operator with the naked eye, the blind spot display device of the construction machine 4 of the present invention also provides a detection unit 11 in front of the boom structure 6 to detect the objects 5 existing in the blind spot of the operator's line of sight, and accidents caused by carelessness can be prevented.

[0032] The detection unit 11 capable of detecting the objects 5 around the construction machine 4 can include at least one or more of a camera, a radar, a lidar, and an ultrasonic sensor.

[0033] The camera is a device often used for monitoring the surroundings of the construction machine 4, and a plurality of cameras may be provided. Instead of simply taking images and transmitting them to the control unit 31, the camera can also recognize the object 5 from the images using an IMOD, which is a video-based detection system. Also, it is possible to recognize the object from the video through AI.

[0034] Referring to FIGS. 2 and 3, the state of a camera, which is an embodiment of the detection unit 11, can be understood. The camera includes a lens and may have a fixing plate arranged on the construction machine 4 by screws or welding so that it can be arranged on the construction machine 4.

[0035] Referring to FIG. 2, the camera may be provided with an LED together with the lens, and can identify the object 5 even when the surrounding environment is dark. A camera cover can also be provided to prevent light blur from occurring or the situation where the object 5 cannot be recognized when the lens is irradiated with other light such as direct sunlight.

[0036] Also, the side surface of the camera has a pivot structure to adjust the vertical angle of the camera so that the object 5 can be recognized. The fixing plate for fixing the camera is connected to the construction machine 4 by a pivot structure, enabling adjustment of the horizontal angle of the camera, and eliminating the object 5 that is out of the camera's field of view.

[0037] Referring to FIG. 3, the lens of the camera may protrude compared to FIG. 2, and the diameter of the lens may be provided larger. Since the performance of the camera can be improved in proportion to the size of the lens, high-quality video imaging is possible, the resolution is also improved, and the recognition degree of the object 5 can be increased.

[0038] Also, the side surface of the camera and the fixing plate for fixing the camera have a pivot structure, enabling adjustment of the vertical and horizontal angles of the camera, eliminating the object 5 that is out of the camera's field of view, and the cameras may be provided such that the fields of view of multiple cameras overlap each other.

[0039] The multiple cameras provided on the construction machine 4 may have the same performance, or different lenses may be used according to the arranged positions, so cameras with different performances can also be arranged.

[0040] The image quality of the camera may use a VGA-class analog camera, or use a clearer HD-class digital camera to capture images at a high resolution, and the recognition degree of the object 5 from the images can be improved by using IMOD.

[0041] The radar is a device that can detect and measure distances using radio waves. It measures the reflected wave that returns after the irradiated radio wave hits the target to detect the object 5, and can grasp the direction, distance, speed, etc.

[0042] Therefore, when the distance between the construction machine 4 and the object 5 changes due to the movement of the construction machine 4 or the movement of the surrounding object 5, the time for the radio wave irradiated from the radar to return changes. Thus, it is possible to know whether there is a collision with the construction machine 4, and this can be transmitted to the control unit 31.

[0043] A plurality of radars may be provided on the construction machine 4, or they may be used alone. However, since there may be an error in the detection range, they can be used together with a camera to minimize accidents due to carelessness and improve the accuracy of recognizing the object 5.

[0044] Referring to FIG. 4, the state of the radar can be understood. The radar may be provided on the construction machine 4 with a part fixed thereto, or may be intensively provided at the rear of the construction machine 4 where the driver's vision cannot reach.

[0045] The radar may be of a type where the main body is attached to the construction machine 4 or may be provided separately from the main body machine. The connection part with the construction machine 4 may be provided with a pivot structure so that the horizontal angle can be adjusted.

[0046] A lidar is a device different from a radar. It is a sensor that helps the construction machine 4 to determine its own position by irradiating the surroundings with a laser, measuring the time difference after hitting an object and then returning, and creating a surrounding map.

[0047] In the lidar, a laser is provided inside a cylindrical cover, and the laser can be irradiated while rotating 360 degrees to receive the reflected laser and create a surrounding map. This may be a spinning or rotation method.

[0048] However, since this method involves a motor, there may be problems with failures and durability. Therefore, methods such as changing the refractive index by applying heat after fixing the laser to irradiate the radar or changing the phase using a mirror or liquid crystal can also be used.

[0049] The ultrasonic sensor uses ultrasonic waves, which are audio frequencies outside the human hearing range. By measuring the time it takes for the emitted ultrasonic waves to hit an object 5 and be reflected, the distance to the object 5 can be measured. Although the measurement principles of radar and ultrasonic waves are similar, there is a difference in that radar uses electromagnetic waves while ultrasonic waves use sound waves. The ultrasonic sensor has a long lifespan and is inexpensive, and multiple ultrasonic sensors can be provided on the construction machine 4.

[0050] The display unit 12 may be provided in front of the driver's eyes of the construction machine 4. The support base (not shown) that supports the display unit 12 can be provided in a glasses-like shape or attached to a helmet, and various forms are possible as long as it can move together in response to the movement of the driver's head.

[0051] Therefore, while existing monitors and HUDs are fixed at specific locations to display information, the display unit 12 is provided in front of the driver's eyes and can move together in response to the movement of the driver's head, such as in the front, rear, and sides (left and right directions) of the driver. Therefore, the position of the display unit 12 can be changed.

[0052] The display unit 12 can set the functions of the control unit 31 described later or provide an interface for correcting numerical adjustments, etc. Even for the same information, the form displayed on the display unit 12 can be changed by adjusting the interface.

[0053] The display unit 12 not only displays the information of the control unit 31 to the driver but can also be provided with a transparent substance such as glass, and the driver can perform work through the display unit 12. Therefore, if the display unit 12 does not provide information, the real world seen by the driver can be the same regardless of the presence or absence of the display unit 12.

[0054] The marker 7 described below is displayed on the display unit 12 overlapping the real world that the driver views through the display unit 12, and can include the AR (augmented reality - overlay) concept which is augmented reality.

[0055] The pupil sensor unit 21 is configured to recognize the pupils with the driver's eyeballs, and can recognize them by shining infrared rays on the pupils. The pupil sensor unit 21 may be provided around the display unit 12, and a plurality of them may be provided to recognize the left and right pupils respectively.

[0056] The gaze tracking unit 22 is a device that tracks the driver's gaze direction with respect to information such as the marker 7 displayed on the display unit 12, and can obtain information regarding the driver's gaze like the pupil sensor unit 21. Therefore, even if the position of the display unit 12 does not change, different information can be provided for the information displayed on the display unit 12 according to the driver's gaze direction, and the position where the same information is displayed can also change.

[0057] The movement of the driver's eyeballs can be grasped through the pupil sensor unit 21 and the gaze tracking unit 22. When the movement of the eyeballs is below a set value, a signal can be provided to the control unit 31 to provide an alarm to the driver via the control unit 31.

[0058] The case where the movement of the eyeballs is below the set value may include the case where the pupils cannot be recognized. Thus, when the driver cannot concentrate on the work or is sleepy, attention can be given by the alarm, and accidents due to carelessness can be prevented. Since this function can also operate when the driver is on break, it can be equipped with an on - off function.

[0059] The angle sensor unit 23 can recognize the angle change of the display unit 12. Since the display unit 12 is provided in front of the driver's eyeballs, the angle change of the display unit 12 and the angle change of the driver's neck can be the same.

[0060] The angle sensor unit 23 can use a sensor that recognizes the tilt of the display unit 12. Since it must recognize the angles in the vertical, horizontal, up, down, left, and right directions, at least two sensors for recognizing the angles in the vertical and horizontal directions may be provided, or a plurality of sensors may be provided for accuracy.

[0061] Therefore, the angle sensor unit 23 can recognize the case where the operator moves his / her head up, down, left, and right during work. The angle sensor unit 23 can transmit information regarding the angle change to the control unit 31, and the control unit 31 can correct the display position of the information displayed on the display unit 12.

[0062] The angle sensor unit 23 can also recognize the case where the operator moves his / her head up, down, left, and right while looking ahead, and the case where the operator moves his / her head while looking at the side and the rear. Therefore, even without using the side mirror (not shown) or the rearview mirror (not shown by reference numeral) provided on the construction machine 4, the presence of the object 5 located on the side and the rear of the construction machine 4 can be known by the dead angle display device of the construction machine 4 according to the present invention.

[0063] The alarm unit 24 provides an alarm for the object 5 around the construction machine 4, and can provide an alarm when the object 5 is located within the working radius of the construction machine 4, and this can be controlled by the control unit 31.

[0064] The alarm may be provided by vibration or sound, and the magnitude and on / off function of the vibration or sound can be changed by the control unit 31.

[0065] The working radius of the construction machine 4 may vary depending on the construction machine 4. In the case of an excavator, a boom structure 6 is provided. The boom structure 6 consists of a boom and an arm, and the height and length can be changed during work. Therefore, the working radius of the excavator can be set based on the length of the boom structure 6.

[0066] In addition, when the movement of the eyeball is equal to or less than the set value, the alarm unit 24 can receive a signal from the control unit 31 and provide an alarm to the driver. When the movement of the eyeball is equal to or less than the set value, it may be the case where the driver is dozing off or unable to concentrate on the work. Therefore, the driver can be alerted by the alarm.

[0067] The control unit 31 can collect and analyze information related to the blind spot display device of the construction machine 4 which is the present invention.

[0068] The control unit 31 can obtain information from the detection unit 11 that detects the surrounding object 5 of the construction machine 4 and the line-of-sight tracking unit 22 that follows the line-of-sight direction of the driver, and analyze the information in the direction that coincides with the driver's line-of-sight.

[0069] In addition, it can receive and analyze information transmitted from the pupil sensor unit 21 that recognizes the driver's pupil and the angle sensor unit 23, and display the marker 7 for the object 5 included in the driver's line-of-sight direction on the display unit 12.

[0070] The marker 7 displays the surrounding object 5 of the construction machine 4 detected by the detection unit 11, and is displayed on the display unit 12 so that the driver can recognize it during work. The display of the marker 7 can be in various forms, such as the contour line of the object 5, a box shape of various colors including the object 5, and when the object 5 is in the blind spot of the driver's line-of-sight, a projected video or image in the blind spot is possible.

[0071] Since the display of the marker 7 can be corrected by the interface provided by the display unit 12, the display of the marker 7 used by each driver may be different. Since the marker 7 is displayed on the display unit 12 overlapping the real world that the driver sees through the display, it can include the AR function which is augmented reality.

[0072] In addition, when an object 5 is located within the working radius of the construction machine 4, an alarm of the alarm unit 24 is provided. However, the display of the marker 7 can be made different depending on whether the object 5 existing in the blind spot is within the working radius of the construction machine 4. For example, if the object 5 is within the working radius, it can be displayed in the shape of a red box, and if the object 5 is away from the working radius, it can be displayed in the shape of a green box for differentiation.

[0073] The control unit 31 analyzes information included in the driver's line-of-sight direction and displays it on the display unit 12. However, there may be a blind spot in the driver's line of sight in the construction machine 4.

[0074] Construction machines 4 such as excavators and forklifts have relatively wide windows in the driver's cab and it is easy to observe the front, but it is difficult to observe the left, right, and rear due to the machines mounted on the vehicle body.

[0075] In particular, in the case of an excavator, a boom structure 6 is provided in one direction of the construction machine 4, and the driver tends to work while being biased to the opposite side. Therefore, there is a limit to the visual field information that the driver can see with the naked eye, and since the boom structure 6 can be changed at any time during operation, the blind spot can also be changed at any time during operation.

[0076] Therefore, the control unit 31 can display the object 5 that is included in the driver's line-of-sight direction but exists in the blind spot on the display unit 12 with the marker 7, and the driver can also recognize the object 5 existing in the blind spot.

[0077] Devices for recognizing and displaying the surrounding object 5 of the existing construction machine 4 had a separate monitor provided and arranged around the driver. Therefore, there was the annoyance that the driver had to look at the monitor at any time while working, and there was a problem that the driver's line of sight could not immediately respond when it left the work place during operation. However, in the blind spot display device of the construction machine 4 of the present invention, the display unit 12 is provided in front of the driver's eyeball, and the marker 7 for the surrounding object 5 is displayed on the display unit 12. Therefore, the driver can recognize the surrounding object 5 while working without changing the line of sight.

[0078] FIG. 5 is a block diagram showing a blind spot display device for a construction machine according to an embodiment of the present invention.

[0079] The control unit 31 can acquire information from the detection unit 11, the pupil sensor unit 21, the gaze tracking unit 22, and the angle sensor unit 23, analyze the information on the direction of the driver's line of sight, and display the analyzed information on the display unit 12. Further, a signal can be sent to the alarm unit 24 to have the alarm unit 24 provide an alarm to the driver, so as to give a warning when the object 5 is located within the working radius of the construction machine 4 or when the driver is sleepy.

[0080] Since the detection unit 11 is provided on the construction machine 4, it may perform wireless communication with the control unit 31. The pupil sensor unit 21 and the gaze tracking unit 22 are provided around the driver's eyeball, the angle sensor unit 23 is provided on the display unit 12, and the pupil sensor unit 21, the gaze tracking unit 22, and the angle sensor unit 23 can perform wireless or wired communication with the control unit 31.

[0081] Since the control unit 31 can correct the information on the surrounding object 5 of the construction machine 4 by the detection unit 11 so as to correspond to the visual information of the driver and provide it to the display unit 12, it can receive information from the pupil sensor unit 21, the gaze tracking unit 22, and the angle sensor unit 23 in real time.

[0082] An interface for setting and correcting the functions of the control unit 31 is provided on the display unit 12, so that the driver can adjust the functions of the control unit 31 described above, and in particular, the driver can select the display form of the marker 7.

[0083] FIG. 6 is a conceptual diagram of a blind spot display device for a construction machine according to an embodiment of the present invention.

[0084] The display unit 12 is provided in front of the driver's eyeball, and can be in the form of goggles or glasses depending on the form, and may be provided only in front of one eyeball.

[0085] Referring to FIG. 6, the blind spot display device of the construction machine 4 according to an embodiment of the present invention is in the shape of glasses and may be smart glasses. Therefore, the display unit 12 may be provided on the smart glasses. Even if no information is displayed on the display unit 12, the operator can recognize the construction site, which is the real world, through the display unit 12.

[0086] In FIG. 6, the display unit 12 is shown as opaque or colored, but this is only an example, and it may be provided transparently.

[0087] Referring to FIG. 6, five images are provided, and characters are displayed for each image. The center indicates the central image, the top indicates the upper image, the bottom indicates the lower image, the left indicates the left image, and the right indicates the right image.

[0088] FIG. 6 shows the field of view when the operator is sitting in the construction machine 4 and working while looking forward. The central image indicates the case when the operator's field of view is in the center. With the central image as the center, the up, down, left, and right directions are the cases when the operator moves the field of view up, down, left, and right, respectively.

[0089] In the case of the central image, it can be seen that a blind spot is formed by the boom structure 6 in the operator's field of view. Since the boom structure 6 is changed at any time during operation, the blind spot can also be changed at any time. The box on the display unit 12 in the central image shows the surrounding object 5 of the construction machine 4 with the marker 7, and the shape may be changed according to the setting of the marker 7.

[0090] Looking at the central image, two surrounding objects 5 of the construction machine 4 are detected by the detection unit 11. The surrounding object 5 exists in the blind spot formed by the boom structure 6 and is difficult to be recognized by the operator's naked eye. However, since the control unit 31 also provides the marker 7 for the object 5 existing in the blind spot to the display unit 12, the operator can recognize the object 5 existing in the blind spot by the marker 7.

[0091] The top, bottom, left, and right images show the line of sight and neck angle of the operator changed while the construction machine 4 and the object 5 are in a stopped state for convenience of understanding.

[0092] In the top image, the line of sight and neck angle of the operator are in the upper direction, and the position of the marker 7 is located on the lower side on the display unit 12. The control unit 31 can analyze the information of the pupil sensor unit 21, the line-of-sight tracking unit 22, and the angle sensor unit 23 and correct the display position of the marker 7 on the display unit 12 in response to the angle change of the operator.

[0093] Therefore, when the line of sight and neck angle of the operator are in the upper direction, the marker 7 for the object 5 located in the center can be relatively located on the lower side on the display unit 12.

[0094] Looking at the top image, it is possible to compare before and after wearing the blind spot display device of the construction machine 4 according to the present invention. At the construction site before wearing the present invention, since the object 5 is located in the blind spot and is difficult to recognize with the naked eye, the operator of the construction machine 4 can perform the work without recognizing the object 5, and there is a possibility of an accident due to carelessness.

[0095] After wearing the present invention, the object 5 is displayed as the marker 7 on the display unit 12 and the operator can intuitively recognize it. Since the object 5 is recognized through the display unit 12 provided in front of the operator's eyeballs without recognizing the object 5 through other monitors, the change of the line of sight at the work site can be minimized.

[0096] In the bottom image, the line of sight and neck angle of the operator are in the lower direction, and the position of the marker 7 is located on the upper side on the display unit 12. Comparing with the top image, the size of the marker 7 can change because the size of the marker 7 displayed on the display unit 12 along the line of sight direction of the operator can change according to the angle of the operator's neck.

[0097] The left image shows that the driver's line of sight and the angle of the neck are in the left direction, and the position of marker 7 is located on the right side on the display unit 12. Even if the driver changes the line of sight and the neck to the left direction, the marker 7 is displayed in a relatively small shape on the right side portion of the display unit 12, so that the driver can recognize the object 5.

[0098] The right image shows that the driver's line of sight and the angle of the neck are in the right direction, and the position of marker 7 is located relatively on the left side on the display unit 12 compared with the central image, but the object 5 in the blind spot is displayed by the marker 7 and can be recognized by the driver.

[0099] FIG. 6 shows a case where the driver moves the neck up, down, left, and right while looking forward and working inside the construction machine 4, and it can be similarly applied when the driver looks at the side and the rear.

[0100] The control unit 31 can display the marker 7 for the object 5 included in the driver's line of sight direction on the display unit 12. However, the driver's line of sight direction can also be the front, side, and rear. The driver can recognize the object 5 located in the blind spot of the driver's line of sight through the blind spot display device of the construction machine 4 according to the present invention.

[0101] The blind spot of the driver's line of sight can also be formed by the boom structure of the excavator and the cabin (not shown in the figure) where the driver rides inside the construction machine 4. Generally, the driver can recognize the object 5 located on the side or rear of the cabin through the side mirror or the rearview mirror provided on the construction machine 4. However, the driver has to shift the line of sight from the work site, and there may be a case where the driver cannot fully recognize the object 5 during the work, and there may be a drawback that there is a limit to the visual field that can be seen through the side mirror or the rearview mirror.

[0102] The blind spot display device of the construction machine 4 of the present invention can overcome such drawbacks, and can recognize an object 5 in all the visual line directions of the driver including the blind spot of the driver's line of sight and display it with a marker 7. Therefore, the driver can recognize the object 5 located not only in front of the construction machine 4 but also on the side and at the rear.

[0103] Therefore, since the driver does not need to shift the line of sight to a separate monitor or the like to recognize the surrounding object 5, the driver can concentrate on the work, the work efficiency can be improved, and the driver can also immediately respond to the object 5 located at an unexpected position. Therefore, the blind spot display device of the construction machine 4 of the present invention can minimize the movement of the driver's line of sight and prevent accidents due to carelessness.

[0104] The present invention is not limited to the above embodiments, and combinations of the above embodiments or combinations of at least any one of the above embodiments and known technologies can be further included as other embodiments.

[0105] As described above, the present invention has been described in detail through specific embodiments, but this is for specifically explaining the present invention, and the present invention is not limited thereto. It is obvious that those having ordinary knowledge in the field can make modifications and improvements within the technical idea of the present invention.

[0106] Any mere deformation or change of the present invention belongs to the scope of the present invention, and the specific protection scope of the present invention will be clarified by the appended claims.

Claims

1. A detection unit provided on a construction machine for detecting an object around the construction machine; A display unit provided in front of the eyes of the operator of the construction machine; A gaze tracking unit that follows the gaze direction of the operator; A control unit that acquires information from the detection unit and the gaze tracking unit and analyzes information in a direction that coincides with the operator's gaze, comprising: The control unit: A display device for a blind spot of a construction machine that displays a marker for the object included in the gaze direction of the operator on the display unit.

2. The control unit: For an object that is included in the gaze direction but exists in the blind spot of the operator's gaze direction, the marker for the object is also displayed on the display unit to let the operator recognize the object existing in the blind spot. The display device for a blind spot of a construction machine according to claim 1.

3. The control unit: Further includes a pupil sensor unit that recognizes the pupil with the operator's eyeball, and an angle sensor unit that recognizes a change in the angle of the display unit; The control unit: Analyzes information from the pupil sensor unit, the gaze tracking unit, and the angle sensor unit, and corrects the display position of the marker on the display unit corresponding to the change in angle. The display device for a blind spot of a construction machine according to claim 2.

4. Further includes an alarm unit that provides an alarm for the object; The control unit: When the object is located within the working radius of the construction machine, the alarm unit is activated to let the operator recognize the object. The display device for a blind spot of a construction machine according to claim 3.

5. The detection unit: Includes at least one or more of a camera, a radar, a lidar, and an ultrasonic sensor; Is provided in front, rear, left, and right of the construction machine, and is also provided in front of the configuration of the construction machine that induces the blind spot. The display device for a blind spot of a construction machine according to claim 4.

6. The display unit: Provides an interface for setting and correcting the functions of the control unit for the operator. The display device for a blind spot of a construction machine according to claim 5.

7. When the construction machine is an excavator, The blind spot is formed by the boom structure of the excavator, and The working radius is Set based on the length of the boom structure. The display device for a blind spot of a construction machine according to claim 6.

8. The marker is ​ The blind spot display device for a construction machine according to claim 7, including the contour line of the object, a box shape including the object, or an image in which the object is projected onto the blind spot.

9. The control unit The blind spot display device for a construction machine according to claim 8, wherein when the movement of the eyeball through the pupil sensor unit or the gaze tracking unit is equal to or less than a set value, an alarm is provided via the alarm unit.

10. The display unit of the blind spot display device for a construction machine according to claim 1 is provided on a smart glass.

Images