Object detection and transmission system and method for work machine
The object detection and transmission system addresses visibility issues in work machines by prioritizing and enhancing the display of critical objects, improving safety by reducing collisions.
Patent Information
- Application Number
- US19/201979
- Authority / Receiving Office
- US · United States
- Patent Type
- Applications(United States)
- Current Assignee / Owner
- Filing Date
- 2025-05-08
- Publication Date
- 2026-11-12
AI Technical Summary
Work machines face visibility challenges at constrained worksites, particularly around intersections, corners, and obstructed areas due to limited camera views and resolution issues, which can lead to collisions with objects.
An object detection and transmission system using cameras to capture real-time video feeds, a controller to highlight and prioritize higher priority objects, and a communication system to transmit and decompress these feeds for improved visibility on the work machine.
Enhances operator visibility by clearly highlighting higher priority objects, reducing the risk of collisions and providing a detailed view of critical objects around intersections and obstructed areas.
Smart Images

Figure US20260357541A1-D00000_ABST
Abstract
Description
TECHNICAL FIELD
[0001] The present disclosure relates to an object detection and transmission system for a work machine and a method of object detection and transmission for the work machine.BACKGROUND
[0002] A work machine often operates at a constrained worksite to perform one or more work operations. The constrained worksite typically has a number of intersections defined by one or more roadways at the worksite. Such intersections may impair visibility of an operator of the work machine that may cause damage to the work machine or the objects, which is not desirable. In some examples, when the work machine approaches an intersection, one or more stationary objects such as a building may hinder the visibility of the operator of the work machine and the operator may not have a clear view of a pedestrian, other work machines, or objects present near the intersection.
[0003] Generally, the work machine includes one or more cameras that improve the visibility of the operator around the work machine. For example, the work machine may include backup cameras to improve rearward visibility, but the operator's view is limited to the point of view of the backup camera and may not improve visibility in other directions or around corners. Further, an output generated by the backup cameras may be distorted due to lower resolution and may completely hide the objects that are small in size and / or are distant from the work machine.
[0004] Another solution would be implementing surround view cameras, giving an operator a bird's-eye view of their surroundings, but they are costly and that still does not solve issues related to corner or farther distance visibility. Further, such backup cameras and / or surround cameras may not provide indication of a vicinity of the intersection. Thus, the main issue to address is a lack of visibility around intersections, corners, narrow roads, and / or in obstructed areas.
[0005] JP4892965B2 describes a moving object discrimination system and moving object discrimination method for discriminating an approaching moving object more easily and reliably than before on a road with low visibility, such as a blind spot at an intersection or a blind curve, and a computer program for executing the moving object discrimination method by a computer. A CPU calculates an average value of a motion vector direction of a pixel in a connection block and specifies the calculated average value as a moving direction of the connection block. The CPU calculates an angle difference between the specified moving direction and a predetermined approaching direction, when the calculated angle difference is equal to a second threshold value or smaller, generates a display image, and combines it into a picked-up image. Thus, when it is decided that there is a moving object which is on the picked-up image and is moving in the approaching direction, display information for highlighting the moving object is added.SUMMARY OF THE DISCLOSURE
[0006] In an aspect of the present disclosure, an object detection and transmission system for a work machine is provided. The object detection and transmission system includes at least one camera disposed at a worksite at which the work machine is operating. The at least one camera is configured to capture a video feed of a portion of the worksite in real-time. The object detection and transmission system also includes a first controller communicably coupled with the at least one camera. The first controller is configured to receive the video feed of the portion of the worksite from the at least one camera. The first controller is also configured to determine a presence of one or more higher priority objects in the video feed. The first controller is further configured to generate a first video feed based on determining the presence of the one or more higher priority objects in the video feed. The one or more higher priority objects are at least one of highlighted in the first video feed and have a higher bitrate. The first controller is configured to compress the first video feed. The first controller is also configured to generate a compressed first video feed. The object detection and transmission system further includes a communication unit communicably coupled with the first controller. The object detection and transmission system includes a second controller associated with the work machine. The second controller is communicably coupled with the first controller via the communication unit. The second controller is configured to receive the compressed first video feed from the first controller via the communication unit. The second controller is also configured to decompress the compressed first video feed. The second controller is further configured to generate a second video feed having the one or more higher priority objects at least one of highlighted therein and having the higher bitrate.
[0007] In another aspect of the present disclosure, a method of object detection and transmission for a work machine is provided. The method includes capturing, by at least one camera, a video feed of a portion of a worksite at which the work machine is operating in real-time. The method also includes receiving, by a first controller, the video feed of the portion of the worksite from the at least one camera. The first controller is communicably coupled with the at least one camera. The method further includes determining, by the first controller, a presence of one or more higher priority objects in the video feed. The method includes generating, by the first controller, a first video feed based on determining the presence of the one or more higher priority objects in the video feed. The one or more higher priority objects are at least one of highlighted in the first video feed and have a higher bitrate. The method also includes compressing, by the first controller, the first video feed. The method further includes generating, by the first controller, a compressed first video feed. The method includes transmitting, by a communication unit, the compressed first video feed from the first controller to a second controller. The second controller is associated with the work machine. The second controller is communicably coupled with the first controller via the communication unit. The method also includes receiving, by the second controller, the compressed first video feed from the first controller via the communication unit. The method further includes decompressing, by the second controller, the compressed first video feed. The method includes generating, by the second controller, a second video feed having the one or more higher priority objects at least one of highlighted therein and having the higher bitrate.
[0008] Other features and aspects of this disclosure will be apparent from the following description and the accompanying drawings.BRIEF DESCRIPTION OF THE DRAWINGS
[0009] FIG. 1 is a schematic view of an object detection and transmission system for a work machine, according to an example of the present disclosure;
[0010] FIG. 2 is a schematic block diagram of the object detection and transmission system of FIG. 1;
[0011] FIG. 3 is an illustration of a second video feed displayed on an output module of the object detection and transmission system of FIG. 1, according to an example of the present disclosure; and
[0012] FIG. 4 is a flowchart of a method of object detection and transmission for the work machine of FIG. 1, according to an example of the present disclosure.DETAILED DESCRIPTION
[0013] Wherever possible, the same reference numbers will be used throughout the drawings to refer to the same or like parts.
[0014] FIG. 1 is a schematic view of an object detection and transmission system 100 for a work machine 102, according to an example of the present disclosure. The work machine 102 may be a manual, an autonomous, or a semi-autonomous work machine. Further, the work machine 102 may embody any type of machine including, but not limited to, a wheel loader, a mining truck, a motor grader, a cold planer, and the like. It should be noted that the object detection and transmission system 100 is not limited to the work machine 102 and may be associated with a vehicle such as a car, a truck, and the like.
[0015] The object detection and transmission system 100 includes one or more cameras 104 disposed at a worksite 106 at which the work machine 102 is operating. It should be noted that the present disclosure is not limited to a type of the worksite 106 and may include a mining site, a road, and the like.
[0016] The one or more cameras 104 may be mounted proximal to an intersection 105 defined by two or more roadways 107 at the worksite 106, and / or one or more roadways 107 at the worksite 106. For example, the cameras 104 may be mounted proximal to a T-junction or around a corner at the worksite 106. In the illustrated example of FIG. 1, the one or more cameras 104 includes a single camera 104 that is mounted proximal to the intersection 105 defined by the two roadways 107 at the worksite 106. In another example, the camera 104 may be mounted along any roadway 107 or a portion of the worksite 106 that may be narrow, may have corners, may have an obstructed path, or may be obstructed from a view of an operator seated within the work machine 102. In some embodiments, an operator could be located external to the work machine 102 and operate the work machine 102 remotely. In some embodiments, the object detection and transmission system 100 could be used with autonomous vehicles. The term “operator” is intended to encompass a remote operator and an autonomous vehicle controller. It should be noted that the object detection and transmission system 100 may include any number of cameras 104 based on application attributes.
[0017] The one or more cameras 104 capture a video feed F1 of a portion of the worksite 106 in real-time. In some examples, the camera 104 may be a stationary camera that captures the video feed F1 of the portion of the worksite 106 in real-time. It should be noted that the present disclosure is not limited to a type of the camera 104. In some examples, the camera 104 may be already present at the worksite 106. A field of view of the camera 104 is depicted by dotted lines 130 in FIG. 1.
[0018] Referring to FIG. 2, a schematic block diagram of the object detection and transmission system 100 is illustrated. With reference to FIGS. 1 and 2, the object detection and transmission system 100 also includes a first controller 108 communicably coupled with the one or more cameras 104. In an example, the camera 104 and the first controller 108 may be mounted within a single housing.
[0019] The first controller 108 receives the video feed F1 of the portion of the worksite 106 from the one or more cameras 104. The first controller 108 determines a presence of one or more higher priority objects 122 in the video feed F1. The one or more higher priority objects 122 may include a person, an animal, a stationary object, and / or a moving object. For example, the person may be an operator of another work machine, a worker working at the worksite 106, and the like. The stationary object may include a stationary machine, signages present at the worksite 106, large rocks or boulders, and the like. The moving object may include one or more work machines, oncoming vehicle traffic, and the like. In the illustrated example of FIGS. 1 and 2, the one or more higher priority objects 122 includes a single higher priority object 122 that is embodied as a pedestrian. Further, the first controller 108 may also determine a presence of one or more lower priority objects 124 in the video feed F1. In some examples, the one or more lower priority objects 124 may include a tree, a building, leaves scattered on the roadways, snow, small pebbles, an area that is densely populated with trees and / or buildings, and the like.
[0020] Further, the first controller 108 includes an object detection unit 114 and an encoding unit 116 communicably coupled with the object detection unit 114. In an example, the camera 104 may be in direct communication with each of the object detection unit 114 and the encoding unit 116. In another example, the camera 104 may be in communication with the encoding unit 116 via the object detection unit 114. The object detection unit 114 determines the presence of the one or more higher priority objects 122 in the video feed F1 received from the one or more cameras 104. In some examples, the object detection unit 114 may also determine the presence of the one or more lower priority objects 124 in the video feed F1.
[0021] The first controller 108 generates a first video feed V1 based on determining the presence of the one or more higher priority objects 122 in the video feed F1. The one or more higher priority objects 122 are highlighted in the first video feed V1 and / or having a higher bitrate (alternatively, “a high bitrate”). The first video feed V1 generated by the first controller 108 is compressed.
[0022] Specifically, the encoding unit 116 generates the compressed first video feed V1. The encoding unit 116 receives an information pertaining to the presence of the one or more higher priority objects 122 in the video feed F1 that is received from the object detection unit 114. In some examples, the object detection unit 114 may transmit information of the higher priority objects 122 as well as the lower priority objects 124 to the encoding unit 116. In other examples, the object detection unit 114 may only transmit information of the higher priority objects 122 and may completely omit the lower priority objects 124.
[0023] The encoding unit 116 allocates the higher bitrate to the one or more higher priority objects 122 in the video feed F1 received from the object detection unit 114 and allocates a lower bitrate (alternatively, “a low bitrate”) to the one or more lower priority objects 124 in the video feed F1 received from the object detection unit 114.
[0024] The term “bitrate” as used herein refers to a number of bits that are conveyed or processed per unit of time. Therefore, the term “higher bitrate” refers to better clarity with more vibrant colors. In other words, the allocation of the higher bitrate to the one or more higher priority objects 122 in the video feed F1 will result in the one or more higher priority objects 122 to be displayed at a higher resolution with higher clarity and detailed view. Further, the allocation of the lower bitrate to the one or more lower priority objects 124 in the video feed F1 will result in the one or more lower priority objects 124 to be displayed at a lower resolution with lower and / or average clarity.
[0025] The encoding unit 116 generates the first video feed V1 based on an allocation of the higher bitrate to the one or more higher priority objects 122 in the video feed F1 and an allocation of the lower bitrate to the one or more lower priority objects 124 in the video feed F1. In some examples, the encoding unit 116 may pre-store a background of the field of view of the camera 104. Further, the encoding unit 116 may periodically update, based on receipt of signals from the camera 104, the relevant information (for e.g. updates in the higher priority objects 122 / lower priority objects 124) to generate the first video feed V1.
[0026] The first controller 108 further compresses the first video feed V1. Specifically, the encoding unit 116 compresses the first video feed V1 after allocating the higher bitrate to the one or more higher priority objects 122 in the video feed F1 and the lower bitrate to the one or more lower priority objects 124 in the video feed F1 so as to reduce a size of the first video feed V1.
[0027] In some examples, the encoding unit 116 may use MPEG, MPEG2, MPEG4, H.264, VP9, AV1, and the like to allocate the higher bitrate to the one or more higher priority objects 122 in the video feed F1, to allocate the lower bitrate to the one or more lower priority objects 124 in the video feed F1, to highlight the one or more higher priority objects 122 in the first video feed V1, and / or to compress the first video feed V1. In other examples, the encoding unit 116 may use a video compression algorithm, a down sampling algorithm, and the like to compress the first video feed V1. The present disclosure is not limited to a technique used by the encoding unit 116 and / or the object detection unit 114 to generate the first video feed V1.
[0028] The object detection and transmission system 100 further includes a communication unit 110 communicably coupled with the first controller 108. Specifically, the communication unit 110 includes a first communication unit 118 communicably coupled with the encoding unit 116. The first communication unit 118 receives the compressed first video feed V1 from the encoding unit 116. The first communication unit 118 is present at the worksite 106, for example, at the intersection 105.
[0029] The communication unit 110 further includes a second communication unit 120 communicably coupled with the first communication unit 118. The second communication unit 120 receives the compressed first video feed V1 from the first communication unit 118. In some examples, each of the first communication unit 118 and the second communication unit 120 includes a radio. In other examples, each of the first communication unit 118 and the second communication unit 120 may include a Cellular Vehicle-to-Everything (C-V2X) component, a dedicated short-range communication (DSRC) component, and / or a wireless mesh network (WiFi Mesh) component. The present disclosure is not limited to a type of the first communication unit 118 and the second communication unit 120.
[0030] The object detection and transmission system 100 further includes a second controller 112 associated with the work machine 102. The second controller 112 is communicably coupled with the first controller 108 via the communication unit 110. In some examples, the second controller 112 may be present onboard the work machine 102 and the second communication unit 120. In an example, the second controller 112 may be a machine control unit (MCU) associated with the work machine 102. In some examples, the second controller 112 may be present at a back-office at the worksite 106.
[0031] It should be noted that each of the first controller 108 and the second controller 112 includes one or more memories and one or more processors. The one or more processors are communicably coupled with the one or more memories.
[0032] The one or more memories may include any means of storing information, including a hard disk, an optical disk, a floppy disk, read only memory (ROM), random access memory (RAM), programmable ROM (PROM), electrically erasable PROM (EEPROM), or other computer-readable memory media.
[0033] It should be noted that the one or more processors may embody a single microprocessor or multiple microprocessors for receiving various input signals and generating output signals. Numerous commercially available microprocessors may perform the functions of the one or more processors. Each processor may further include a general processor, a central processing unit, an application specific integrated circuit (ASIC), a digital signal processor, a field programmable gate array (FPGA), a digital circuit, an analog circuit, a microcontroller, any other type of processor, or any combination thereof. Each processor may include one or more components that may be operable to execute computer executable instructions or computer code that may be stored and retrieved from the one or more memories.
[0034] The second controller 112 receives the compressed first video feed V1 from the first controller 108 via the communication unit 110. Specifically, the second controller 112 receives the compressed first video feed V1 from the first controller 108 via the first and second communication units 118, 120. The second controller 112 decompresses the compressed first video feed V1. The second controller 112 also generates a second video feed V2 having the one or more higher priority objects 122 highlighted therein and / or having the higher bitrate.
[0035] Specifically, the second controller 112 includes a decoding unit 126 communicably coupled with the communication unit 110. The decoding unit 126 receives the compressed first video feed V1 from the communication unit 110. Specifically, the decoding unit 126 is communicably coupled with the second communication unit 120 and receives the compressed first video feed V1 from the second communication unit 120. The decoding unit 126 decompresses the compressed first video feed V1. The decoding unit 126 generates the second video feed V2 having the one or more higher priority objects 122 highlighted therein and / or having the higher bitrate after decompressing the compressed first video feed V1. In some examples, the decoding unit 126 may include a unified video decoding unit (UVD), H.264 / H.265 video decoding unit (VDU), and the like. In other examples, the decoding unit 126 may use an inverse discrete cosine transform (IDCT) algorithm, an inverse quantization algorithm, a motion compensation algorithm, and the like to decompress the compressed first video feed V1, without any limitations.
[0036] In some examples, the object detection and transmission system 100 may generate and transmit the second video feed V2 at predefined time intervals. In another example, the object detection and transmission system 100 may generate and transmit the second video feed V2 upon detection or knowledge of a position of the work machine 102 at the worksite 106. For example, the object detection and transmission system 100 may generate and transmit the second video feed V2 if the work machine 102 is approaching the intersection 105. In yet another example, the object detection and transmission system 100 may generate and transmit the second video feed V2 in a continuous manner.
[0037] FIG. 3 is a snapshot of the second video feed V2 displayed on an output module 128 of the object detection and transmission system 100 of FIG. 1, according to an example of the present disclosure. Referring now to FIGS. 2 and 3, the object detection and transmission system 100 further includes the output module 128 communicably coupled with the second controller 112. Specifically, the output module 128 is communicably coupled with the decoding unit 126. The output module 128 receives the second video feed V2 from the second controller 112. Specifically, the output module 128 receives the second video feed V2 from the decoding unit 126. The output module 128 displays the second video feed V2 thereon. In an example, the output module 128 may be disposed within an operator cabin of the work machine 102. Upon receiving the second video feed V2, the output module 128 displays the second video feed V2 thereon. In some examples, the output module 128 may include a display device such as, a Liquid Crystal Display (LCD) panel or a Light Emitting Diode (LED) display panel, a smart phone, a laptop, a tablet, and the like.
[0038] As shown in FIG. 3, the higher priority object 122 is highlighted in the second video feed V2 with the higher resolution, whereas the lower priority objects 124 are shown having the lower resolution. It should be noted that the higher priority object 122 may have an outline. In some examples, the outline may be a box that highlights the higher priority object 122 in the second video feed V2. Specifically, a single higher priority object 122 that is embodied as a pedestrian is illustrated in FIG. 3. Alternatively, any number of the higher priority object 122 and / or the lower priority objects 124 can be present in the second video feed V2.INDUSTRIAL APPLICABILITY
[0039] The present disclosure relates to the object detection and transmission system 100 that includes the one or more cameras 104 to capture the video feed F1 of the portion of the worksite 106 in real-time. The object detection and transmission system 100 improves operator visibility around the work machine 102. The object detection and transmission system 100 includes an off-work machine detection system, i.e. the camera 104 and the first controller 108, to designate higher or lower relevance of objects present in the video feed F1. Further, the object detection and transmission system 100 also controls video compression to preserve a fidelity of the higher priority objects 122 present in the video feed F1 sent to the work machine 102 at an expense of non-relevant or lower priority objects 124.
[0040] Since the cameras 104 capture the video feed F1 in real-time, the object detection and transmission system 100 may provide real-time information pertaining to the higher and lower priority objects 122, 124 to various work machines that are approaching the intersection 105, that are present around corners, blind spots, narrow passages or alleyways, and / or obstructed areas, where the work machine 102 needs improved visibility. In other words, the object detection and transmission system 100 may provide the information of the higher priority objects 122 at the higher bitrate thus providing a clear and detailed view of the higher priority objects 122 to the work machine 102.
[0041] The object detection and transmission system 100 may provide an information of the higher priority objects 122 as well as the lower priority objects 124 to the operator of the work machine 102 before the work machine 102 approaches a particular location. Thus, the object detection and transmission system 100 may prevent collision of the work machine 102 with various objects present at the worksite 106.
[0042] Further, the encoding unit 116 with the help of the object detection unit 114 may allocate the higher bitrate to the higher priority objects 122 even if they are small in size. Furthermore, the output module 128 receives the second video feed V2 from the second controller 112 and displays the second video feed V2 thereon, thereby allowing the operator of the work machine 102 to view the higher priority objects 122 at the higher bitrate (higher resolution). This may allow the operator to take necessary actions if required, for example, applying brakes in advance or turning / moving with caution.
[0043] Overall, the object detection and transmission system 100 may be simple in construction, may be cost-effective, and may be durable. Further, the object detection and transmission system 100 may be retrofitted on existing work machines and worksites. Moreover, the object detection and transmission system 100 may be used by a variety of vehicles and / or work machines.
[0044] FIG. 4 is a flowchart of a method 400 of object detection and transmission for the work machine 102. With reference to FIGS. 1 to 4, at step 402, the video feed F1 of the portion of the worksite 106 at which the work machine 102 is operating is captured by the one or more cameras 104 in real-time.
[0045] At step 404, the video feed F1 of the portion of the worksite 106 is received by the first controller 108 from the one or more cameras 104. The first controller 108 is communicably coupled with the one or more cameras 104.
[0046] At step 406, the presence of the one or more higher priority objects 122 in the video feed F1 is determined by the first controller 108. The step 406 further includes a step at which the one or more higher priority objects 122 in the video feed F1 are determined by the object detection unit 114 of the first controller 108.
[0047] At step 408, the first video feed V1 is generated by the first controller 108 based on determining the presence of the one or more higher priority objects 122 in the video feed F1. The one or more higher priority objects 122 are highlighted in the first video feed V1 and / or have the higher bitrate. The step 408 further includes a step at which the information pertaining to the presence of the one or more higher priority objects 122 in the video feed F1 that is received from the object detection unit 114 is received by the encoding unit 116 of the first controller 108. The encoding unit 116 is communicably coupled with the object detection unit 114. The step 408 further includes a step at which the higher bitrate is allocated by the encoding unit 116 to the one or more higher priority objects 122 in the video feed F1 received from the object detection unit 114 and the lower bitrate to one or more lower priority objects 124 in the video feed F1 received from the object detection unit 114. The step 408 further includes a step at which the first video feed V1 is generated by the encoding unit 116 based on the allocation of the higher bitrate to the one or more higher priority objects 122 in the video feed F1 and the allocation of the lower bitrate to the one or more lower priority objects 124 in the video feed F1.
[0048] At step 410, the first video feed V1 is compressed by the first controller 108. The step 410 further includes a step at which the first video feed V1 is compressed via the encoding unit 116 after allocating the higher bitrate to the one or more higher priority objects 122 in the video feed F1 and the lower bitrate to the one or more lower priority objects 124 in the video feed F1.
[0049] At step 412, the compressed first video feed V1 is generated by the first controller 108.
[0050] At step 414, the compressed first video feed V1 is transmitted by the communication unit 110 from the first controller 108 to the second controller 112. The second controller 112 is associated with the work machine 102. The second controller 112 is communicably coupled with the first controller 108 via the communication unit 110. The step 414 further includes a step at which the compressed first video feed V1 is received via the first communication unit 118 of the communication unit 110 from the encoding unit 116. The first communication unit 118 is communicably coupled with the first controller 108. The step 414 further includes a step at which the compressed first video feed V1 is received via the second communication unit 120 of the communication unit 110 from the first communication unit 118. The second communication unit 120 is communicably coupled with the first communication unit 118.
[0051] At step 416, the compressed first video feed V1 is received by the second controller 112 from the first controller 108 via the communication unit 110. The step 416 further includes a step at which the compressed first video feed VI is received by the decoding unit 126 of the second controller 112 from the communication unit 110. The decoding unit 126 is communicably coupled with the communication unit 110.
[0052] At step 418, the compressed first video feed V1 is decompressed by the second controller 112. The step 418 further includes a step at which the compressed first video feed VI is decompressed by the decoding unit 126.
[0053] At step 420, the second video feed V2 having the one or more higher priority objects 122 highlighted therein and / or having the higher bitrate is generated by the second controller 112. The step 420 further includes a step at which the second video feed V2 having the one or more higher priority objects 122 highlighted therein and / or having the higher bitrate is generated by the decoding unit 126 after decompressing the compressed first video feed V1.
[0054] The method 400 includes a step (not shown) at which the second video feed V2 from the second controller 112 is received by the output module 128 of the work machine 102. The output module 128 is communicably coupled with the second controller 112. The method 400 further includes a step (not shown) at which the second video feed V2 is displayed by the output module 128 thereon.
[0055] It should be noted that the steps 402, 404, 406, 408, 410, 412, 414, 416, 418, 420 of the method 400 may be performed in a sequence that is different from that explained in relation to FIG. 4. Further, various steps 402, 404, 406, 408, 410, 412, 414, 416, 418, 420 can be performed together.
[0056] It is to be understood that individual features shown or described for one embodiment may be combined with individual features shown or described for another embodiment. The above-described implementation does not in any way limit the scope of the present disclosure. Therefore, it is to be understood although some features are shown or described to illustrate the use of the present disclosure in the context of functional segments, such features may be omitted from the scope of the present disclosure without departing from the spirit of the present disclosure as defined in the appended claims.
[0057] While aspects of the present disclosure have been particularly shown and described with reference to the embodiments above, it will be understood by those skilled in the art that various additional embodiments may be contemplated by the modification of the disclosed work machine, systems and methods without departing from the spirit and scope of the disclosure. Such embodiments should be understood to fall within the scope of the present disclosure as determined based upon the claims and any equivalents thereof.
Claims
1. An object detection and transmission system for a work machine, the object detection and transmission system comprising:at least one camera disposed at a worksite at which the work machine is operating, wherein the at least one camera is configured to capture a video feed of a portion of the worksite in real-time;a first controller communicably coupled with the at least one camera, wherein the first controller is configured to:receive the video feed of the portion of the worksite from the at least one camera;determine a presence of one or more higher priority objects in the video feed;generate a first video feed based on determining the presence of the one or more higher priority objects in the video feed, wherein the one or more higher priority objects are at least one of highlighted in the first video feed and have a higher bitrate;compress the first video feed; andgenerate a compressed first video feed;a communication unit communicably coupled with the first controller; anda second controller associated with the work machine, wherein the second controller is communicably coupled with the first controller via the communication unit, and wherein the second controller is configured to:receive the compressed first video feed from the first controller via the communication unit;decompress the compressed first video feed; andgenerate a second video feed having the one or more higher priority objects at least one of highlighted therein and having the higher bitrate.
2. The object detection and transmission system of claim 1, wherein the first controller includes an object detection unit and an encoding unit communicably coupled with the object detection unit, and wherein the object detection unit is configured to determine the presence of the one or more higher priority objects in the video feed received from the at least one camera.
3. The object detection and transmission system of claim 2, wherein the encoding unit is configured to:receive an information pertaining to the presence of the one or more higher priority objects in the video feed that is received from the object detection unit;allocate the higher bitrate to the one or more higher priority objects in the video feed received from the object detection unit and allocate a lower bitrate to one or more lower priority objects in the video feed received from the object detection unit;generate the first video feed based on an allocation of the higher bitrate to the one or more higher priority objects in the video feed and an allocation of the lower bitrate to the one or more lower priority objects in the video feed; andcompress the first video feed after allocating the higher bitrate to the one or more higher priority objects in the video feed and the lower bitrate to the one or more lower priority objects in the video feed.
4. The object detection and transmission system of claim 2, wherein the communication unit includes a first communication unit communicably coupled with the encoding unit, and wherein the first communication unit is configured to receive the compressed first video feed from the encoding unit.
5. The object detection and transmission system of claim 4, wherein the communication unit further includes a second communication unit communicably coupled with the first communication unit, and wherein the second communication unit is configured to receive the compressed first video feed from the first communication unit.
6. The object detection and transmission system of claim 5, wherein each of the first communication unit and the second communication unit includes a radio.
7. The object detection and transmission system of claim 5, wherein each of the first communication unit and the second communication unit includes at least one of Cellular Vehicle-to-Everything (C-V2X) component, a dedicated short-range communication (DSRC) component, or a wireless mesh network (WiFi Mesh) component.
8. The object detection and transmission system of claim 1, wherein the second controller includes a decoding unit communicably coupled with the communication unit, and wherein the decoding unit is configured to:receive the compressed first video feed from the communication unit;decompress the compressed first video feed; andgenerate the second video feed having the one or more higher priority objects at least one of highlighted therein and having the higher bitrate after decompressing the compressed first video feed.
9. The object detection and transmission system of claim 1 further comprising an output module communicably coupled with the second controller, wherein the output module is configured to receive the second video feed from the second controller, and wherein the output module is configured to display the second video feed thereon.
10. The object detection and transmission system of claim 1, wherein the one or more higher priority objects includes at least one of a person, an animal, a stationary object, and / or a moving object.
11. The object detection and transmission system of claim 1, wherein the at least one camera is mounted proximal to at least one of an intersection defined by two or more roadways at the worksite, and / or one or more roadways at the worksite.
12. A method of object detection and transmission for a work machine, the method comprising:capturing, by at least one camera, a video feed of a portion of a worksite at which the work machine is operating in real-time;receiving, by a first controller, the video feed of the portion of the worksite from the at least one camera, wherein the first controller is communicably coupled with the at least one camera;determining, by the first controller, a presence of one or more higher priority objects in the video feed;generating, by the first controller, a first video feed based on determining the presence of the one or more higher priority objects in the video feed, wherein the one or more higher priority objects are at least one of highlighted in the first video feed and have a higher bitrate;compressing, by the first controller, the first video feed;generating, by the first controller, a compressed first video feed;transmitting, by a communication unit, the compressed first video feed from the first controller to a second controller, wherein the second controller is associated with the work machine, and wherein the second controller is communicably coupled with the first controller via the communication unit;receiving, by the second controller, the compressed first video feed from the first controller via the communication unit;decompressing, by the second controller, the compressed first video feed; andgenerating, by the second controller, a second video feed having the one or more higher priority objects at least one of highlighted therein and having the higher bitrate.
13. The method of claim 12, wherein the step of determining, by the first controller, the presence of the one or more higher priority objects in the video feed further includes determining, by an object detection unit of the first controller, the one or more higher priority objects in the video feed.
14. The method of claim 13, wherein the step of generating, by the first controller, the first video feed based on determining the presence of the one or more higher priority objects in the video feed further includes:receiving, by an encoding unit of the first controller, an information pertaining to the presence of the one or more higher priority objects in the video feed that is received from the object detection unit, wherein the encoding unit is communicably coupled with the object detection unit; andallocating, by the encoding unit, the higher bitrate to the one or more higher priority objects in the video feed received from the object detection unit and a lower bitrate to one or more lower priority objects in the video feed received from the object detection unit; andgenerating, by the encoding unit, the first video feed based on an allocation of the higher bitrate to the one or more higher priority objects in the video feed and an allocation of the lower bitrate to the one or more lower priority objects in the video feed.
15. The method of claim 14, wherein the step of compressing, by the first controller, the first video feed further includes compressing, via the encoding unit, the first video feed after allocating the higher bitrate to the one or more higher priority objects in the video feed and the lower bitrate to the one or more lower priority objects in the video feed.
16. The method of claim 15, wherein the step of transmitting, by the communication unit, the compressed first video feed from the first controller to the second controller further includes:receiving, via a first communication unit of the communication unit, the compressed first video feed from the encoding unit, wherein the first communication unit is communicably coupled with the first controller; andreceiving, via a second communication unit of the communication unit, the compressed first video feed from the first communication unit, wherein the second communication unit is communicably coupled with the first communication unit.
17. The method of claim 12, wherein the step of receiving, by the second controller, the compressed first video feed from the first controller via the communication unit further includes receiving, by a decoding unit of the second controller, the compressed first video feed from the communication unit, and wherein the decoding unit is communicably coupled with the communication unit.
18. The method of claim 17, wherein the step of decompressing, by the second controller, the compressed first video feed further includes decompressing, by the decoding unit, the compressed first video feed.
19. The method of claim 18, wherein the step of generating, by the second controller, the second video feed having the one or more higher priority objects at least one of highlighted therein and having the higher bitrate further includes generating, by the decoding unit, the second video feed having the one or more higher priority objects at least one of highlighted therein and having the higher bitrate after decompressing the compressed first video feed.
20. The method of claim 19 further comprising:receiving, by an output module of the work machine, the second video feed from the second controller, wherein the output module is communicably coupled with the second controller; anddisplaying, by the output module, the second video feed thereon.
