System and method for improving visibility around a compactor

Abstract

A system for improving visibility around a compactor includes imaging devices for generating input images including a surrounding area of the compactor and one or more components of the compactor. The system also includes a controller for receiving one or more input images from the imaging devices, analyzing the input images to determine a location of the components of the compactor within the input images, processing the input images to simulate the components of the compactor as transparent, and generating an output image including the surrounding area of the compactor and the components of the compactor. The components of the compactor are depicted as transparent in the output image. The system includes a display module that receives and displays the output image to indicate to an operator a location of at least one obstacle and / or a previously compacted area.

Description

Technical Field

[0001] This disclosure relates to a compactor, a system for improving visibility around the compactor, and a method for improving visibility around the compactor. Background Technology

[0002] Compactors are typically used to compact materials such as asphalt, soil, and / or other materials. A compactor consists of rollers that come into contact with the material to be compacted. Visibility around the compactor is crucial for efficient operation and understanding the presence of various obstacles around the components. When the operator is seated in the operator's cab of the compactor, the components may obstruct the operator's visibility of the area around the compactor, including obstacles. During operation, the operator may have difficulty understanding the position of the compactor components (such as rollers) relative to obstacles or relative to compacted / uncompacted areas on the site.

[0003] U.S. Patent Application 2023 / 0035181 describes a control system for engineering machinery, comprising: an upper camera mounted in the cab of a rear vehicle for capturing images of the front of the cab; a lower camera mounted in a front body rotatably connected to the rear vehicle for capturing images of the front of the front vehicle; an angle information detection unit configured to detect information about the angle of refraction of the front vehicle relative to the rear vehicle; an image processing device configured to synthesize a first image and a second image captured from the upper and lower cameras, and configured to determine the position of a transparency processing region in the synthesized image based on the angle of refraction information and to perform transparency processing on at least one of the first and second images in the transparency processing region; and a display module configured to display the synthesized image with transparency processing performed by the image processing device. Summary of the Invention

[0004] In one aspect of this disclosure, a system for improving visibility around a compactor is provided. The system includes a plurality of imaging devices coupled to the compactor. Each of the plurality of imaging devices is configured to generate an input image. The input image includes a region surrounding the compactor and one or more components of the compactor. One or more input images generated by one or more of the plurality of imaging devices include at least one obstacle present in the region surrounding the compactor and / or a previously compacted area compacted by the compactor. The system also includes a controller communicatively coupled to the plurality of imaging devices. The controller is configured to receive one or more input images from one or more of the plurality of imaging devices. The controller is further configured to analyze the one or more input images to determine the location of the one or more components of the compactor within the one or more input images. The controller is further configured to process the one or more input images to simulate the one or more components of the compactor as transparent. The controller is configured to generate an output image. The output image includes the region surrounding the compactor and the one or more components of the compactor. The one or more components of the compactor are depicted as transparent in the output image. The output image includes the at least one obstacle and / or the previously compacted area. The system also includes a display module configured to receive the output image from the controller. The display module is configured to display the output image thereon to provide the operator of the compactor with a visual indication of the area surrounding the compactor. The output image at least indicates to the operator the position of the at least one obstacle and / or the previously compacted area relative to the compactor.

[0005] In another aspect of this disclosure, a compaction machine is provided. The compaction machine includes a frame. The compaction machine also includes rollers coupled to the frame. The compaction machine further includes a system for improving visibility around the compaction machine. The system includes a plurality of imaging devices coupled to the compaction machine. Each of the plurality of imaging devices is configured to generate an input image. The input image includes a region surrounding the compaction machine and one or more components of the compaction machine. One or more input images generated by one or more of the plurality of imaging devices include at least one obstacle present in the region surrounding the compaction machine and / or a previously compacted area compacted by the compaction machine. The system also includes a controller communicatively coupled to the plurality of imaging devices. The controller is configured to receive one or more input images from one or more of the plurality of imaging devices. The controller is also configured to analyze the one or more input images to determine the location of the one or more components of the compaction machine within the one or more input images. The controller is also configured to process the one or more input images to simulate the one or more components of the compaction machine as transparent. The controller is configured to generate an output image. The output image includes the area surrounding the compactor and one or more components of the compactor. The one or more components of the compactor are depicted as transparent in the output image. The output image includes the at least one obstacle and / or the previously compacted area. The system also includes a display module configured to receive the output image from the controller. The display module is configured to display the output image thereon to provide the operator of the compactor with a visual indication of the area surrounding the compactor. The output image at least indicates to the operator the position of the at least one obstacle and / or the previously compacted area relative to the compactor.

[0006] In another aspect of this disclosure, a method for improving visibility around a compactor is provided. The method includes generating one or more input images by one or more imaging devices of a plurality of imaging devices coupled to the compactor. Each input image includes a region surrounding the compactor and one or more components of the compactor. The one or more input images generated by the one or more imaging devices of the plurality of imaging devices include at least one obstacle present in the region surrounding the compactor and / or a previously compacted area compacted by the compactor. The method further includes receiving the one or more input images from the one or more imaging devices of the plurality of imaging devices by a controller. The plurality of imaging devices are communicatively coupled to the controller. The method further includes analyzing the one or more input images by the controller to determine the location of one or more components of the compactor within the one or more input images. The method includes processing the one or more input images by the controller to simulate the one or more components of the compactor as transparent. The method further includes generating an output image by the controller. The output image includes the region surrounding the compactor and the one or more components of the compactor. The one or more components of the compactor are depicted as transparent in the output image. The output image includes the at least one obstacle and / or the previously compacted area. The method further includes receiving the output image from the controller by a display module. The display module is communicatively coupled to the controller. The method includes displaying the output image via the display module to provide the operator of the compactor with a visual indication of the area surrounding the compactor. The method further includes indicating to the operator the position of the at least one obstacle and / or the previously compacted area relative to the compactor.

[0007] Other features and aspects of this disclosure will become apparent from the following description and accompanying drawings. Attached Figure Description

[0008] Figure 1 This is a schematic view of an exemplary compactor according to an example of this disclosure;

[0009] Figure 2 It is an embodiment of the present disclosure for improving Figure 1 A block diagram of the system for ensuring visibility around the compactor is shown.

[0010] Figure 3 Based on the examples in this disclosure Figure 2 An exemplary example of the output image generated on the system's display module;

[0011] Figure 4 It is based on another example of this disclosure. Figure 2 An exemplary example of the output image generated on the system's display module; and

[0012] Figure 5 This is a flowchart of a method for improving visibility around a compactor, according to an example of this disclosure. Detailed Implementation

[0013] In all the accompanying drawings, use the same reference numerals to denote the same or similar parts whenever possible.

[0014] Figure 1 This is a schematic side view of an exemplary compactor 100. The compactor 100 may be embodied as a soil compactor, landfill compactor, asphalt compactor, pneumatic roller, double-drum vibratory roller, etc. Furthermore, this disclosure is not limited to the compactor 100 and may include any other machine. The compactor 100 includes a frame 102. The compactor 100 defines a front end 104 and a rear end 106 opposite the front end 104, as well as sides 108 (only one side is illustrated herein). The frame 102 supports various components of the compactor 100 thereon. The frame 102 defines a housing 110 near the rear end 106. The compactor 100 also includes a power source (not shown) disposed within the housing 110. The various components of the compactor 100 are operated by the power source. The power source may be an engine, such as an internal combustion engine, a fuel cell, a battery system, etc., without any limitations.

[0015] The compactor 100 also includes a roller 112 coupled to a frame 102. The roller 112 is positioned near the front end 104 of the compactor 100. The compactor 100 includes a pair of wheels 114 positioned at the rear end 106 of the compactor 100. The roller 112 and wheels 114 support the frame 102 of the compactor 100 and allow the compactor 100 to move on the ground. Furthermore, the roller 112 contacts the work surface to perform a compaction operation, thereby compacting materials such as asphalt, soil, gravel, etc. In some examples, the roller 112 may include a foot-type roller having multiple segmented pads disposed on the roller 112 to allow the compactor 100 to perform the compaction operation. The roller 112 includes a housing 116. During compaction operations or movement of the compactor 100, the housing 116 contacts various surfaces. In another example, the compactor 100 may include two rollers instead of a single roller 112, and the wheels 114 may be omitted. The compactor 100 includes an operator's cab 118. The operator can sit in the operator's cab 118 to perform and / or observe the compaction operation.

[0016] refer to Figure 1 and Figure 2This disclosure relates to a system 200 for improving visibility around a compactor 100. The system 200 includes a plurality of imaging devices 202 coupled to the compactor 100. Each of the plurality of imaging devices 202 generates an input image I1. The input image I1 includes a surrounding area 120 of the compactor 100 and one or more components 112, 102, 118, 114 of the compactor 100. One or more components 112, 102, 118, 114 of the compactor 100 include a roller 112 of the compactor 100, a frame 102 of the compactor 100, a portion of the operator's cab 118 of the compactor 100, and / or one or more wheels 114 of the compactor 100. Furthermore, one or more input images generated by one or more of the plurality of imaging devices 202 in the input image I1 include one or more obstacles 122 present in the surrounding area 120 of the compactor 100. Figure 1 Only one obstacle is shown in the image) and / or the previously compacted area 124 (e.g., compacted by the compactor 100) Figure 4 (As shown). The term "pre-compacted zone" refers to the area previously compacted by the compactor 100.

[0017] Imaging devices 202 may be coupled to the compactor 100 at a front end 104, a rear end 106, and one or more sides 108. Therefore, at least some of the imaging devices 202 generate one or more input images I1 of the surrounding region 120 at the front end 104 of the compactor 100. Furthermore, at least some of the imaging devices 202 generate one or more input images I1 of the surrounding region 120 at the rear end 106 of the compactor 100. Additionally, at least some of the imaging devices 202 generate one or more input images I1 of the surrounding region 120 at one or more sides 108 of the compactor 100.

[0018] Imaging device 202 may include a monochrome digital camera, a high-resolution digital camera, or any suitable digital camera. Furthermore, imaging device 202 may include any of the following, without limitation: a still camera, a video camera, a closed-circuit television (CCTV) camera, etc. Imaging device 202 may include one or more optical flow chips and / or other devices that facilitate image acquisition. In some examples, imaging device 202 may be embodied as a complementary metal-oxide-semiconductor (CMOS) camera. It should be noted that imaging device 202 may include any other type of imaging device known in the art.

[0019] Now for reference Figure 2The system 200 also includes a controller 204 communicatively coupled to a plurality of imaging devices 202. The controller 204 includes one or more memories 206. The memories 206 may include any component for storing information, including hard disks, optical disks, floppy disks, ROMs (read-only memory), RAMs (random access memory), PROMs (programmable ROMs), EEPROMs (electrically erasable PROMs), or other computer-readable storage media known to those skilled in the art.

[0020] The controller 204 also includes one or more processors 208 communicatively coupled to one or more memories 206. It should be noted that the one or more processors 208 may be embodied as a single microprocessor or multiple microprocessors for receiving various input signals and generating output signals. Many commercially available microprocessors can perform the functions of one or more processors 208. Each processor 208 may also include a general-purpose processor, a central processing unit, an application-specific integrated circuit (ASIC), a digital signal processor, a field-programmable gate array (FPGA), digital circuitry, analog circuitry, a microcontroller, any other type of processor, or any combination thereof. Each processor 208 may include one or more devices operable to execute computer-executable instructions or computer code that can be stored in and retrieved from one or more memories 206.

[0021] Controller 204 receives one or more input images I1 from one or more imaging devices 202. Controller 204 analyzes the one or more input images I1 to determine the compactor 100 (see [link to image 100]). Figure 1 One or more components 112, 102, 118, 114 (see Figure 1 The position of one or more components 112, 102, 118, 114 of the compactor 100 within one or more input images I1. In some examples, the controller 204 receives multiple coordinates of one or more components 112, 102, 118, 114 of the compactor 100 to determine the position of one or more components 112, 102, 118, 114 of the compactor 100 within one or more input images I1.

[0022] Controller 204 processes one or more input images I1 to simulate one or more components 112, 102, 118, 114 of compactor 100 as transparent. Controller 204 generates output images O1, O2. Output images O1, O2 include the surrounding area 120 of compactor 100 (see...). Figure 1The compactor 100 and one or more components 112, 102, 118, 114. One or more components 112, 102, 118, 114 of the compactor 100 are depicted as transparent in the output images O1, O2. The output images O1, O2 also include one or more obstacles 122 (see...). Figure 1 ) and / or the previously compacted zone 124 (see Figure 4 ).

[0023] refer to Figure 2 , Figure 3 and Figure 4 The system 200 also includes a display module 210. The display module 210 is located in the compactor 100 (see...). Figure 1 The operator's cab 118 (see) Figure 1 The display module 210 can be any type of device on which information, video, or images can be displayed, and may include, for example, handheld devices, smartphones, tablets, etc. The display module 210 receives output images O1, O2 from the controller 204. The display module 210 displays the output images O1, O2 on it to provide the operator of the compactor 100 with a visual indication of the area 120 surrounding the compactor 100. Furthermore, the output images O1, O2 at least indicate to the operator the position of one or more obstacles 122 and / or the previously compacted area 124 relative to the compactor 100.

[0024] One or more components 112, 102, 118, 114 of the compactor 100 (see Figure 1 The outline of each of the elements in the image is represented as a dashed line on the output images O1 and O2. For example... Figure 3 and Figure 4 As shown, the outline C1 of the roller 112 is represented as a dashed line on the output images O1 and O2. Although in Figure 3 and Figure 4 Only roller 112 is shown in the example, but compactor 100 (see Figure 1 Any other components of the output image can be displayed as transparent on the output images O1 and O2 to improve visibility.

[0025] Now for reference Figure 3 The output image O1 also includes one or more obstacles 122. The output image O1 indicates the obstacle 122 relative to the compactor 100 (see [link]). Figure 1 One or more components 112, 102, 118, 114 (see Figure 1 The position of ). For example, Figure 3 As depicted, obstacle 122 is positioned behind roller 112, and the operator can see the obstacle due to the transparent depiction of compactor 100.

[0026] Now for reference Figure 4Output image O2 also includes the previously compacted zone 124. Output image O2 indicates the previously compacted zone 124 relative to the compactor 100 (see [link]). Figure 1 The position of the roller 112. Furthermore, the output image O2 indicates whether the previously compacted zone 124 was aligned or misaligned with the roller 112. For example... Figure 4 As depicted, roller 112 is misaligned relative to the previously compacted zone 124. Output image O2 depicts the misalignment between roller 112 and the previously compacted zone 124, based on which the operator can adjust the compactor to align roller 112 with the previously compacted zone 124.

[0027] It should be noted that a single feature shown or described for one embodiment may be combined with a single feature shown or described for another embodiment. The embodiments described above do not limit the scope of this disclosure in any way. Therefore, it should be understood that although some features are shown or described to illustrate the use of this disclosure in the context of a functional section, such features may be omitted from the scope of this disclosure as defined in the appended claims.

[0028] Industry Applicability

[0029] This disclosure describes a compactor 100 and a system 200 for improving visibility around the compactor 100. The system 200 utilizes multiple imaging devices 202 and a controller 204 to generate output images O1, O2 from an operator's perspective. These output images characterize one or more components 112, 102, 118, 114 of the compactor 100 (such as roller 112, frame 102, etc.) as transparent. Specifically, the controller 204 simulates components 112, 102, 118, 114 as transparent to improve visibility, thereby revealing the presence of obstacles 122 around the compactor 100 and / or the compacted and uncompacted areas at the work site.

[0030] System 200 is cost-effective and easy to implement. Furthermore, system 200 can be retrofitted onto existing compactors. System 200 improves operator visibility and allows the operator to easily identify the location of obstacles 122 around the compactor 100. Additionally, controller 204 generates an output image O2 that allows the operator to observe uncompacted and compacted areas. Specifically, output image O2 can indicate to the operator any misalignment between roller 112 and previously compacted areas 124, allowing the operator to perform compaction operations efficiently.

[0031] refer to Figure 5 A flowchart of a method 500 for improving visibility around a compactor 100 is shown.

[0032] At step 502, one or more imaging devices among the plurality of imaging devices 202 coupled to the compactor 100 generate one or more input images I1. Each input image I1 includes a surrounding area 120 of the compactor 100 and one or more components 112, 102, 118, 114 of the compactor 100. Furthermore, the one or more input images generated by one or more imaging devices among the plurality of imaging devices 202 in the input image I1 include one or more obstacles 122 present in the surrounding area 120 of the compactor 100 and / or previously compacted areas 124 compacted by the compactor 100. The one or more components 112, 102, 118, 114 of the compactor 100 include a roller 112 of the compactor 100, a frame 102 of the compactor 100, a portion of the operator's cab 118 of the compactor 100, and / or one or more wheels 114 of the compactor 100.

[0033] At step 504, controller 204 receives one or more input images I1 from one or more of the plurality of imaging devices 202. The plurality of imaging devices 202 are communicatively coupled to controller 204.

[0034] At step 506, controller 204 analyzes one or more input images I1 to determine the position of one or more components 112, 102, 118, 114 of compactor 100 within one or more input images I1.

[0035] At step 508, controller 204 processes one or more input images I1 to simulate one or more components 112, 102, 118, 114 of compactor 100 as transparent.

[0036] At step 510, controller 204 generates output images O1 and O2. Output images O1 and O2 include the surrounding area 120 of compactor 100 and one or more components 112, 102, 118, and 114 of compactor 100. One or more components 112, 102, 118, and 114 of compactor 100 are depicted as transparent in output images O1 and O2. Output images O1 and O2 also include one or more obstacles 122 and / or previously compacted areas 124.

[0037] At step 512, the display module 210 receives output images O1 and O2 from the controller 204. The display module 210 and the controller 204 are communicatively coupled.

[0038] At step 514, display module 210 displays output images O1, O2 to provide the operator of compactor 100 with visual indication of the area 120 surrounding compactor 100.

[0039] At step 516, the operator is instructed on the position of one or more obstacles 122 and / or the previously compacted zone 124 relative to the compactor 100.

[0040] In some examples, at step 516, the position of the previously compacted zone 124 relative to the roller 112 of the compactor 100 is indicated, and / or the alignment or misalignment between the previously compacted zone 124 and the roller 112 is indicated based on the output image O2.

[0041] In some examples, at step 516, the position of one or more obstacles 122 relative to one or more components 112, 102, 118, 114 of the compactor 100 is indicated.

[0042] In some examples, method 500 further includes a step (not shown) in which controller 204 receives multiple coordinates of one or more components 112, 102, 118, 114 of compactor 100 to determine the position of one or more components 112, 102, 118, 114 of compactor 100 within one or more input images I1.

[0043] In some examples, method 500 further includes a step (not shown) in which some of the imaging devices 202 generate one or more input images I1 of the surrounding region 120 at the front end 104 of the compactor 100. Method 500 also includes a step (not shown) in which some of the imaging devices 202 generate one or more input images I1 of the surrounding region 120 at the rear end 106 of the compactor 100. Method 500 further includes a step (not shown) in which some of the imaging devices 202 generate one or more input images I1 of the surrounding region 120 at one or more sides 108 of the compactor 100.

[0044] Furthermore, steps 502, 504, 506, 508, 510, 512, 514, and 516 of method 500 can be performed in a manner different from... Figure 5 The steps 502, 504, 506, 508, 510, 512, 514, and 516 of method 500 can be executed together.

[0045] While various aspects of this disclosure have been specifically shown and described with reference to the foregoing embodiments, those skilled in the art will understand that various additional embodiments can be contemplated through modifications to the disclosed machinery, systems, and methods without departing from the spirit and scope of this disclosure. Such embodiments should be understood to fall within the scope of this disclosure as defined by the claims and any equivalents.

Claims

1. A system for improving visibility around a compactor, the system comprising: A plurality of imaging devices coupled to the compactor, wherein each of the plurality of imaging devices is configured to generate an input image, wherein the input image includes a surrounding area of ​​the compactor and one or more components of the compactor, and wherein one or more input images generated by one or more of the plurality of imaging devices include at least one obstacle present in the surrounding area of ​​the compactor and / or a previously compacted area compacted by the compactor; and A controller, communicatively coupled to the plurality of imaging devices, wherein the controller is configured to: Receive one or more input images from one or more of the plurality of imaging devices; Analyze the one or more input images to determine the location of the one or more components of the compactor within the one or more input images; Process the one or more input images to simulate the one or more components of the compactor as transparent; Generate an output image, wherein the output image includes the surrounding area of ​​the compactor and the one or more components of the compactor, wherein the one or more components of the compactor are depicted as transparent in the output image, and wherein the output image also includes the at least one obstacle and / or the previously compacted area; and A display module configured to receive the output image from the controller, wherein the display module is configured to display the output image thereon to provide the operator of the compactor with a visual indication of the area surrounding the compactor, and wherein the output image indicates to the operator at least the position of the at least one obstacle and / or the previously compacted zone relative to the compactor.

2. The system of claim 1, wherein the one or more components of the compactor include the compactor's rollers, the compactor's frame, a portion of the compactor's operator's cab, and / or one or more wheels of the compactor.

3. The system of claim 2, wherein the output image indicates the position of the previously compacted zone relative to the roller of the compactor, and wherein the output image further indicates, based on the output image, alignment or misalignment between the previously compacted zone and the roller.

4. The system of claim 1, wherein the controller is further configured to receive multiple coordinates of the one or more components of the compactor to determine the position of the one or more components of the compactor within the one or more input images.

5. The system of claim 1, wherein the outline of each of the one or more components of the compactor is illustrated as a dashed line on the output image.

6. The system of claim 1, wherein at least some of the plurality of imaging devices are configured to generate one or more input images of the surrounding area at the front end of the compactor, wherein at least some of the plurality of imaging devices are configured to generate one or more input images of the surrounding area at the rear end of the compactor, and wherein at least some of the plurality of imaging devices are configured to generate one or more input images of the surrounding area at one or more sides of the compactor.

7. The system of claim 1, wherein the output image indicates the position of the at least one obstacle relative to the one or more components of the compactor.

Images