360-degree manhole inspection system and method
Through the automated 360° manhole video data acquisition system, a comprehensive and automated manhole inspection is achieved using a rangefinder and digital processor, solving the problems of inaccurate and non-repeatable inspection results in the prior art, and providing real-time Feedback and accurate data acquisition.
Patent Information
- Application Number
- CN202280086173.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2021-10-26
- Filing Date
- 2022-10-26
- Publication Date
- 2024-12-06
AI Technical Summary
Prior art manhole inspection methods do not provide comprehensive, repetitive and measurable inspection results, lacking automation and real-time feedback.
An automated 360° human-hole video data acquisition system is designed, including a housing, 360° camera, light, digital processor and rangefinder, which determines the position through rangefinder, and provides real-time feedback and automatic control system. descent and extraction process.
A comprehensive, automated manhole inspection is achieved, providing 360° video data, ensuring the accuracy and repetition of inspections, eliminating the dependence on guessing.
Smart Images

Figure CN119096137A_ABST
Abstract
Description
[0001] Citation of Related Applications
[0002] This application is based on U.S. Provisional Application No. 63 / 272,083 filed on October 26, 2021, the entire text of which (including its appendix) is incorporated herein by reference. Technical Field
[0003] The present invention generally relates to apparatus and methods for inspecting access structures, shafts, tunnels and other pipelines, and more specifically to apparatus and methods for inspecting manholes to record their location and general condition, including size, shape, appearance, structural condition (e.g., manhole collar, walls and inner bottom), and the location of lateral connections. Background Art
[0004] Manholes provide access to sewer systems at ground level and extend down to sewer pipes. Manholes and other access structures are essential for the ongoing inspection, maintenance, and renovation of sewer systems. Inspections of manholes provide valuable information for maintenance and repair of sewer systems. However, prior art manhole inspection methods fail to provide comprehensive, repeatable, and measurable inspections.
[0005] Applicants have recognized a need for a simple manhole inspection device that is automated and takes the guesswork out of inspections. The present invention satisfies this need and others. Summary of the invention
[0006] A simplified overview of the present invention is presented below to provide a basic understanding of some aspects of the present invention. This overview is not a comprehensive overview of the present invention. This overview is not intended to identify key / important elements of the present invention or to describe the scope of the present invention. The sole purpose of this overview is to present some concepts of the present invention in a simplified form as a preface to a more detailed description presented later.
[0007] A method for automatically acquiring 360° manhole video data, the method comprising: (a) commencing acquisition of video data once the system has been maintained at a constant vertical position from the bottom of the manhole for a predetermined time; (b) prompting a user to begin lowering the system into the manhole once the system begins acquiring video data; (c) ceasing acquisition of video data once the system is a predetermined distance from the bottom of the manhole; and (d) prompting the user to remove the system from the manhole.
[0008] A method for obtaining 360° manhole video data, the method comprising: (a) maintaining a 360° manhole video data system in a manhole at a constant vertical position from the bottom of the manhole for a predetermined time to start acquisition of video data; (b) once the system starts acquisition of video data, after receiving a prompt from the system to lower the system, lowering the system into the manhole; and (c) once the system reaches a predetermined distance from the bottom of the manhole, after receiving a prompt from the system, removing the system from the manhole.
[0009] A system for automatically obtaining 360° manhole video data, the system comprising: (a) a housing; (b) a power supply, the power supply being in the housing; (c) a 360° camera, the camera being in the housing and being operatively connected to the power supply; (d) one or more lights, the one or more lights being disposed in the housing and being operatively connected to the power supply; (e) a digital processor, the digital processor being disposed in the housing and being operatively connected to the power supply and the camera; (f) a rangefinder, the rangefinder being disposed in the housing and being operatively connected to at least the power supply and the digital processor; and (g) a digital storage device, the digital storage device being disposed in the housing and being operatively connected to at least the power supply and the digital processor. a housing and operatively connected to at least the power source and the digital processor for storing digital data from the 360° camera; wherein the digital processor is configured to automatically obtain manhole video data by: (i) starting acquisition of video data once the housing is maintained at the same vertical position from the bottom of the manhole as determined by the rangefinder for a predetermined time; (ii) prompting a user to start lowering the housing once the digital processor starts acquiring video data; (iii) stopping acquisition of video data once the housing is a predetermined distance from the bottom of the manhole; and (iv) prompting the user to remove the housing from the manhole.
[0010] A system for obtaining a 360° video of a manhole, the system comprising: (a) a housing having at least one planar portion defining a first opposing side and a second opposing side and one or more edges substantially orthogonal to the first opposing side and the second opposing side; (b) a 360° camera in the planar portion, the camera comprising a first lens and a second lens, the first lens protruding from the first opposing side and the second lens protruding from the second opposing side; (c) one or more lights disposed along the at least one edge and operatively connected to the power source; (d) a digital processor disposed in the housing; (e) a rangefinder disposed in the housing; and (f) a digital storage device disposed in the housing for storing digital data from the 360° camera. BRIEF DESCRIPTION OF THE DRAWINGS
[0011] Figure 1 is a perspective view of one embodiment of a camera module of the present invention.
[0012] Figure 2 yes Figure 1 A side view of an embodiment of the invention.
[0013] Figure 3 is a schematic block diagram of one embodiment of the inspection system of the present invention.
[0014] Figure 4 is a perspective view of one embodiment of an upper housing of a camera module of the present invention.
[0015] Figure 5 is a top view of one embodiment of a planar portion of a camera module of the present invention.
[0016] Figure 6 is a schematic diagram of the camera module when it is lowered in the manhole. DETAILED DESCRIPTION
[0017] Throughout the specification, the preferred embodiments and examples shown should be considered as exemplary, rather than limiting, the present invention. As used herein, "the present invention" refers to any one of the embodiments of the present invention described herein and any equivalents. In addition, the reference to various features of the "present invention" throughout the document does not mean that all claimed embodiments or methods must include the features mentioned.
[0018] refer to Figure 1-Figure 2, shows an embodiment of the system 100 of the present invention. The system 100 is configured for obtaining a 360° video of a manhole and includes a camera device 100a having a housing 101. In this specific embodiment, the housing 101 includes a planar portion 101a and an upper housing 101b. The planar portion includes a first opposing side 102 and a second opposing side 103 and one or more edges 110 substantially orthogonal to the first opposing side and the second opposing side. In this embodiment, the upper portion 101b is configured for attachment to a pole (not shown). A 360° camera 104 is disposed in the planar portion and includes a first lens 105a and a second lens 105b, the first lens protruding from the first opposing side and the second lens protruding from the second opposing side. One or more lights 106 are disposed along the edge. A rangefinder 111 is disposed in the housing 101 and is configured to measure the distance from the housing 101 to the bottom of the manhole. A digital processor (not shown) and a digital storage device (not shown) are also disposed in the housing 101 and are configured to operate the camera, light and rangefinder to obtain a 360° video of the manhole.
[0019] Reference Figure 3 , a block diagram 300 of one embodiment of the system 100 is shown. In this embodiment, a camera module 304 having a wireless interface 330 is housed in the camera housing or planar portion 101a described above. In this embodiment, an LED driver 306 for the light 106 is housed in the upper housing 101b described above. Also housed in the upper housing 101b is a rangefinder module 311, a digital processor 310 having a wireless interface 331, and a power module 320 including a power / charging control 322 and a battery 321. In this embodiment, there is also an on / off controller 340 for turning the processor on / off. The switch 121 is conveniently located on the outside of the housing 101, such as Figure 4 This embodiment of the system 100 also includes a remote operator control 350 wirelessly connected to the processor and / or camera via a wireless interface 351 .
[0020] These features are described in more detail below, along with selected alternative embodiments.
[0021] Remote User Interface
[0022] In one embodiment, system 100 includes remote user interface 100b, such as smart phone or tablet computer or other computer equipment, to interact with camera module 100a. In one embodiment, remote user interface uses any known pairing protocol / method wirelessly (e.g., Wi-Fi or Bluetooth) to link to camera module 100a. By linking remote user interface 100b to camera module 100b, users can control the operation of the system (e.g., power on / off, light on / off, mode video / photo), and monitor other parameters such as battery level. In one embodiment, remote user interface also provides instructions for operating system 100 to the user. For example, remote user interface can display instructions to (1) start to lower camera module, (2) lower camera module more slowly, and / or (3) take out camera module because inspection is completed. In addition to the operation of control system 100, remote user interface can also be used to manage data received from system 100, including organizing data into projects and editing data. In one embodiment, remote user interface is promoted using commercially available WinCan application.
[0023] camera
[0024] The camera is used to provide both video and static images of the manhole. Such cameras are well known and commercially available (e.g., THETA SC2 from Ricoh), and therefore will not be discussed in detail here. In one embodiment, as Figure 5 As shown, the camera includes an external on-off switch 126 for powering the camera. In a more specific embodiment, the camera also includes a Wi-Fi button 127 for initiating a Wi-Fi connection between the camera module and a remote user interface, a mode button 128 for selecting between a video mode or a photo mode, and a self-timer button 129. In one embodiment, the camera module has a status indicator 150 to indicate the status of the Wi-Fi connection, camera mode, and battery power.
[0025] Processor / Operation
[0026] One embodiment of the present invention is a simple manhole inspection device that is substantially automated, thereby eliminating the guesswork from manhole inspections. Specifically, in one embodiment, the system 100 includes a digital processor for initiating the acquisition of data, communicating with the user while acquiring data to provide real-time feedback to ensure the correct acquisition of inspection data, automatically stopping the inspection and communicating with the user that the inspection is complete, and finally transmitting the inspection data configured by the user. The processor can be any known digital processor for executing instructions from a configured memory / digital storage device.
[0027] In one embodiment, the digital processor is configured to start the acquisition of video data once the housing is maintained at the same vertical position from the bottom of the manhole for a predetermined time (e.g., about 3 seconds to 10 seconds). Figure 6 Once the user holds the camera module 100a in position at the top of the manhole 600 for a predetermined time, the system begins data acquisition, which in one embodiment involves storing the camera's output in a data repository. The vertical position of the module 100a is determined using a rangefinder (described below).
[0028] In one embodiment, once the digital processor begins acquiring data, the digital processor is configured to prompt the user to begin lowering the housing. There are different ways in which the system can prompt the user to begin lowering the housing. For example, in one embodiment, the digital processor prompts the user by turning on the light 106. Alternatively, an audio signal may be provided, or the user may be prompted via a smart phone or tablet. Other means of prompting the user will be apparent to the skilled person in light of this disclosure.
[0029] In one embodiment, the digital processor is configured to evaluate the distance data received from the rangefinder to determine the descent rate of the module in the manhole, and if the descent rate is too fast, the digital processor is configured to cause a message to be sent to the user to slow down the descent rate. In one embodiment, the digital processor is also configured to cause a message to be sent to the user to increase the descent rate if the descent rate is too slow. There are various methods for delivering this information to the user. In one embodiment, the information is conveyed to the user via remote user control by audio and / or visual signals. Alternatively, the camera module itself can be used to convey this information. For example, in one embodiment, the light can flash quickly or change color to indicate that the user is quickly / slowly lowering the device. According to the present disclosure, other methods for sending messages to the user will be apparent to those skilled in the art.
[0030] In one embodiment, the digital processor is configured to stop acquiring video data once the housing is at a predetermined distance (e.g., 0.2m-0.5m) from the bottom of the manhole. In one embodiment, the system 100 prompts the user that the inspection is complete. Likewise, this can be done in different ways. In one embodiment, this information is communicated to the user via an audio and / or visual signal through a remote user interface. In another embodiment, this information is indicated by the camera module itself. For example, in one embodiment, the digital processor is configured to turn off the light when the acquisition of video data has stopped.
[0031] In one embodiment, the digital processor is configured to automatically wirelessly transmit inspection data once the acquisition of video data has stopped. In one embodiment, once the camera device is taken out of the manhole to be enough to be wirelessly connected to the remote user interface, the wireless transmission is started. In one embodiment, the data is sent to the remote user interface. Alternatively, the data can be sent to a cloud or Internet storage facility. Similarly, other data storage locations will be apparent to those skilled in the art in accordance with this disclosure. Although wireless transmission of data is disclosed herein, those skilled in the art will know other methods in accordance with this disclosure. For example, data can be sent via a cable permanently or temporarily connected to the camera module, rather than wirelessly transmitting data.
[0032] power supply
[0033] The power supply is used to provide power to the camera module, processor and range finder. In one embodiment, Figure 3 As shown, the power module includes a power supply / charger circuit 320 and a battery 321. Such circuits are known and will not be discussed in detail herein. In one embodiment, by Figure 4 The port 121 shown is used to facilitate charging of the battery, and the port is configured to be attached to a known charging cable. For example, the port 121 can be configured to be attached to a USB cable. In one embodiment, the power level of the battery is indicated in a battery status indicator 122 on the housing 101.
[0034] Although the system 100 is depicted herein as having a battery power source, it should be understood that other embodiments are possible. For example, the camera module 100a may be powered by a cable rather than a battery, in which case the battery and power / charger circuit would not be required. In this embodiment, the cable may be used not only to power the camera module, but also to support the camera module as it is lowered into the manhole. Again, those skilled in the art will appreciate obvious modifications to the present disclosure in light of the present disclosure.
[0035] lamp
[0036] The lights 106 of the system 100 are used to provide sufficient illumination to image the interior of the manhole. In one embodiment, the system 100 provides illumination along the edges of the planar portion 101a. In one embodiment, a plurality of lights are disposed along at least one edge. For example, in one embodiment, the planar portion 101a includes two side edges 110a, 110b in the bottom edge 110c, and at least one light is disposed on each of the side edges and the bottom edge. By projecting light not only downward but also radially from the camera, the applicant unexpectedly discovered that the quality of video and photo images is significantly improved. In one embodiment, the lights are LED lights. In such an embodiment, the LED driver is disposed in the upper housing 101b or the camera housing 101a.
[0037] rangefinder
[0038] An important aspect of one embodiment of the present invention is to monitor the distance of the camera module 100a from the bottom of the manhole. Specifically, as described above, the measurement can be used to start the inspection process and can be used to stop the inspection process. The rangefinder is also used to obtain distance data for recording the video to the vertical position in the manhole. Therefore, at least for this embodiment of the present invention, it is important to have a device that accurately measures the distance between the camera module and the bottom of the manhole. In one embodiment, the rangefinder is arranged along the bottom edge so that when the system is positioned in the manhole, the rangefinder points to the bottom of the manhole. In one embodiment, the rangefinder is a laser rangefinder, but it should be understood that other rangefinders are also possible. For example, in one embodiment, a sonar rangefinder can be used instead of a laser rangefinder. In another embodiment, a physical feeler gauge is used to measure the distance between the camera module and the bottom of the manhole. According to the present disclosure, those skilled in the art will know other means of determining the distance between the camera module and the bottom of the manhole.
[0039] case
[0040] The housing is used to provide a water-resistant / waterproof enclosure for the above-mentioned components. Additionally, in one embodiment, the housing provides for attachment to the elongated member / pole. Thus, in one embodiment, the housing 101 includes a planar portion 101a for housing the camera module 304, and a pole adapter portion or upper portion 101b for housing other components including the power supply / charger module 320, LED driver 306, rangefinder module 311, and processor 330 and associated memory / data storage devices.
[0041] In one embodiment, the upper portion 101b is configured for attachment to an elongated member, such as the elongated member disclosed in US8054459B2. Although these configurations may vary, in one embodiment, the upper portion 101b is rounded to be accommodated in a socket of a rod or elongated member. In one embodiment, the system 101 also includes a bracket for supporting the elongated member in the approximate center of the manhole. The bracket is configured to enable a user to lower the housing into the manhole. Such brackets are well known and are generally similar to a tripod, although other configurations will be apparent to those skilled in the art in light of this disclosure.
[0042] Although rigid elongated members are disclosed herein, those skilled in the art will recognize alternatives in light of this disclosure. For example, the camera module may be attached to a cable adapted to lower / raise the camera module in the manhole rather than a rigid pole. In such an embodiment, the cable may be adapted to provide power and / or transmit inspection data from the camera module to a data repository.
[0043] Having thus described several specific embodiments of the present invention, various changes, modifications and improvements will readily occur to those skilled in the art. Although not expressly stated herein, such changes, modifications and improvements apparent from this disclosure are intended to be a part of this specification and are intended to be within the spirit and scope of the present invention. Therefore, the foregoing description is merely exemplary and non-restrictive. The present invention is limited only by the appended claims and their equivalents.
Claims
1. A system for automatically obtaining 360° manhole video data, the system comprising: case; a 360° camera, wherein the camera is in the housing; one or more lamps, the one or more lamps disposed in the housing; a digital processor disposed in the housing; a rangefinder, the rangefinder being arranged in the housing; and a digital storage device, the digital storage device being disposed in the housing and being used to store digital data from the 360° camera; The digital processor is configured to automatically obtain manhole video data by: once the housing is maintained at the same vertical position from the bottom of the manhole for a predetermined time as determined by the range finder, initiating acquisition of video data; Once the digital processor begins acquiring video data, prompting the user to begin lowering the housing; Once the housing is a predetermined distance away from the bottom of the manhole, stopping the acquisition of the video data; as well as The user is prompted to remove the housing from the manhole.
2. The system of claim 1, wherein the predetermined time is approximately 3 seconds to 10 seconds.
3. The system of claim 1, wherein initiating acquisition of the video data comprises the digital processor causing the at least one light to turn on.
4. The system of claim 1 , wherein the digital processor is configured to evaluate distance data received from the rangefinder to determine a rate of descent of the module in the manhole, and if the descent rate is too fast, the digital processor is configured to cause a message to be sent to a user to slow the descent rate. The system according to claim 1 , wherein the predetermined distance is 0.2 m-0.5 m.
6. The system of claim 1, wherein the digital processor is configured to turn off the light when the acquisition of video data stops.
7. The system according to claim 1, further comprising: Wherein the digital processor is configured to automatically wirelessly transmit the video data once the acquisition of video data has ceased.
8. The system of claim 1, wherein a plurality of lights are disposed along the at least one edge.
9. The system of claim 1, wherein the rangefinder is a laser rangefinder.
10. The system of claim 1, wherein the at least one edge comprises two side edges in a bottom edge.
11. The system of claim 10, wherein the rangefinder is disposed along the bottom edge such that when the system is positioned in a manhole, the rangefinder points toward the bottom of the manhole.
12. The system of claim 10, wherein at least one light is disposed on each of the side edges and the bottom edge.
13. The system according to claim 1, further comprising: a power source, the power source comprising a battery; and A port is located on the housing and is used to charge the power source.
14. The system of claim 13, wherein the port is a USB charging cable or a wall outlet charging adapter.
15. The system of claim 1, wherein the housing further comprises an interface for connecting to an elongated member for extending downwardly into the manhole.
16. The system according to claim 15, further comprising: An elongated member is connected to the interface.
17. The system according to claim 16, further comprising: A bracket is provided for supporting the elongated member in a generally central position of the manway, the bracket being configured to enable a user to lower the housing.
18. The system of claim 1, further comprising: An external on-off switch is used to supply power to the digital processor.
19. The system of claim 1, further comprising: An external on-off switch is used to power the camera.
20. A method for obtaining 360° manhole video data, the method comprising: Maintaining the 360° manhole video data system in the manhole at a constant vertical position from the bottom of the manhole for a predetermined time to start acquisition of video data Once the system begins acquisition of video data, upon receiving a prompt from the system to lower the system, lowering the system into the manhole; as well as Once the system reaches a predetermined distance from the bottom of the manhole, upon receiving a prompt from the system, the system is removed from the manhole.
21. A method for automatically obtaining 360° manhole video data, the method comprising: Once the system has been held at a constant vertical position from the bottom of the manhole for a predetermined time, the acquisition of video data is initiated; Once the system begins acquiring video data, prompting the user to begin lowering the system into the manhole; once the system is a predetermined distance away from the bottom of the manhole, stopping acquisition of the video data; as well as The user is prompted to remove the system from the manhole.
22. The method of claim 21, wherein prompting the user to begin lowering the device comprises turning on a light on the system.
23. The method of claim 21, wherein prompting the user to remove the system comprises turning off the light of the system.
24. The method according to claim 21, further comprising: Once the system is removed from the manhole sufficiently to wirelessly connect to a user device, the video data is wirelessly transmitted from the system to the user device.
25. A system for obtaining a 360° video of a manhole, the system comprising: a housing having at least one planar portion defining a first opposing side and a second opposing side and one or more edges substantially orthogonal to the first opposing side and the second opposing side; a 360° camera in the planar portion and operatively connected to the power source, the camera comprising a first lens and a second lens, the first lens protruding from the first opposing side and the second lens protruding from the second opposing side; one or more lights, the one or more lights disposed along the at least one edge; a digital processor disposed in the housing; a rangefinder disposed in the housing and operatively connected to at least the digital processor; and A digital storage device is disposed in the housing and operatively connected to at least the digital processor for storing digital data from the 360° camera.
26. The system of claim 25, wherein the digital processor is configured to automatically obtain manhole video data.
27. The system of claim 26, wherein the digital processor is configured to initiate acquisition of video data once the housing has been maintained at the same vertical position from the bottom of the manhole for a predetermined time as determined by the rangefinder.
28. The system of claim 27, wherein the predetermined time is approximately 3 seconds to 10 seconds.
29. The system of claim 27, wherein once the digital processor begins acquiring video data, the digital processor is configured to prompt a user to begin lowering the housing.
30. The system of claim 27, wherein once the digital processor begins acquiring video data, the digital processor is configured to cause the light to turn on.
31. The system of claim 26, wherein the digital processor is configured to evaluate distance data received from the rangefinder to determine a rate of descent of the module in the manhole, and if the descent rate is too fast, the digital processor is configured to cause a message to be sent to a user to slow down the descent.
32. The system of claim 26, wherein the digital processor is configured to stop acquiring video data once the housing is a predetermined distance from the bottom of the manhole.
33. The system according to claim 32, wherein the predetermined distance is 0.2m-0.5m.
34. The system of claim 32, wherein the digital processor is configured to turn off the light when acquisition of video data ceases.
35. The system of claim 26, wherein the digital processor is configured to automatically transmit the inspection data upon cessation of acquisition of video data.
36. The system of claim 25, wherein a plurality of lights are disposed along the at least one edge.
37. The system of claim 25, wherein the rangefinder is a laser rangefinder.
38. The system of claim 25, wherein the at least one edge comprises two side edges in a bottom edge.
39. The system of claim 38, wherein the rangefinder is disposed along the bottom edge such that when the system is positioned in a manhole, the rangefinder points toward the bottom of the manhole.
40. The system of claim 38, wherein at least one light is disposed on each of the side edges and the bottom edge.
41. The system of claim 25, further comprising a power source in the housing.
42. The system of claim 41, further comprising: A port is located on the housing and is used to charge the power source.
43. The system of claim 42, wherein the port is a USB charging cable or a wall outlet charging adapter.
44. The system of claim 25, wherein the housing further comprises an interface for connecting to an elongated member for extending downwardly into the manhole.
45. The system of claim 44, further comprising: An elongated member is connected to the interface.
46. The system of claim 45, further comprising: A bracket is provided for supporting the elongated member in a generally central position of the manway, the bracket being configured to enable a user to lower the housing.
47. The system of claim 25, further comprising: An external on-off switch is used to supply power to the digital processor.
48. The system of claim 25, further comprising: An external on-off switch is used to power the camera.
49. The system of claim 25, further comprising: A remote user interface is linked to the processor.
50. The system of claim 49, wherein the remote user interface is a smart phone.
Citation Information
Patent Citations
Inspection system and method
US8054459B2
