Roadside detection and warning system and method
The roadside warning system uses LiDAR and alert beacons to activate audio and visual warnings based on vehicle speed and distance, addressing the safety risks near service vehicles by enhancing situational awareness for approaching drivers.
Patent Information
- Application Number
- JP2022570262
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2020-05-19
- Filing Date
- 2021-05-19
- Publication Date
- 2024-11-14
- Estimated Expiration
- 2041-05-19
AI Technical Summary
Conventional cones and alarms do not provide effective advance warning for approaching vehicles near service or emergency vehicles, posing a risk to technicians and responders.
A roadside warning system with LiDAR sensors, processors, and alert beacons that activate audio and visual alerts based on vehicle speed and distance, integrated with GPS and network interfaces for real-time communication and deployment.
Enhances safety by providing timely warnings to approaching vehicles, allowing technicians to take evasive actions and ensuring the safety of service personnel and vehicle occupants.
Smart Images

Figure 0007583833000007 
Figure 0007583833000008 
Figure 0007583833000009
Abstract
Description
[Technical field]
[0001] This application claims priority to U.S. Application Serial No. 16 / 878,272, filed May 19, 2020, the disclosure of which is incorporated herein by reference in its entirety.
[0002] A warning system and method are disclosed that activates a warning when an object (eg, an approaching vehicle) is detected traveling at a predetermined speed and within a predetermined distance of a roadside warning beacon. [Background technology]
[0003] Each year, service technicians and emergency responders are injured while providing or rushing to distressed, stopped, or parked vehicles. For example, accidents may occur when an approaching vehicle is traveling at an undesirable speed or within an undesirable distance from the service or damaged vehicle. To prevent accidents and provide advance warning to approaching vehicles, cones or barrels that include flashing LED lights are sometimes employed to alert approaching vehicles that assistance is being provided. However, traditional cones and barrels do not always provide effective advance warning to approaching vehicles, nor do traditional cones and barrels provide advance warning to service technicians or emergency responders. Summary of the Invention
[0004] A warning system and method for deployment on or along a roadway. The warning system may include at least one warning beacon having one or more sensors (e.g., a LiDAR sensor). The warning beacon further includes a processor operable to poll the LiDAR sensor to read a predetermined number of β values in response to receiving an initial measurement from the LiDAR sensor indicating that a vehicle is within a predetermined distance of the warning beacon. The processor is further operable to calculate an average distance to the vehicle and an average speed of the vehicle in response to receiving the predetermined number of β values if the vehicle is within the predetermined distance of the warning beacon. The processor is also operable to activate an audio alert and a visual alert in response to calculating the average distance and the average speed if the average distance falls below a distance threshold and the average speed exceeds a speed threshold.
[0005] Each warning beacon may include one or more digital cameras operable to capture one or more images of the vehicle in response to receiving the initial measurements from the LiDAR sensor indicating that the vehicle is within the predetermined distance from the warning beacon. The processor may be operable to calculate a second average distance to the vehicle and a second average speed of the vehicle using one or more of the images. The processor may be further operable to activate the audio and visual alerts when the second average distance falls below the distance threshold and the second average speed exceeds the speed threshold. The processor may be further operable to analyze one or more of the digital images to determine whether a service repair protocol is being performed.
[0006] Each alarm beacon may further include a Global Positioning System (GPS) operable to provide location data and a network interface operable to communicate with a remote server. Each processor may be further operable to transmit an ID of the at least one alarm beacon and the location data in response to a request signal received from a remote server. Each processor may be further operable to transmit the location data of the beacon to the remote server in response to receiving the initial measurement from the LiDAR sensor indicating that the vehicle is within the predetermined distance from the alarm beacon. Each processor may be further operable to navigate the at least one alarm beacon to the geographic coordinates based on the location data in response to a request to deploy the at least one alarm beacon to the geographic coordinates.
[0007] It is contemplated that the at least one warning beacon may be an airborne drone operable to hover around the geographic coordinates based on the location data. A mobile software application executing on a mobile device may be operable to communicate with the at least one warning beacon. Each processor may be further operable, in response to receiving the initial measurements from the LiDAR sensor indicating that the vehicle is within the predetermined distance from the at least one warning beacon, to send a signal to the mobile software application to activate visual and audio notifications on the mobile device. Each processor may be further operable, in response to receiving the initial measurements from the LiDAR sensor indicating that the vehicle is within the predetermined distance from the warning beacon, to send an alert that is displayed on an infotainment system in the vehicle. [Brief description of the drawings]
[0008] [Figure 1] An example of a situation where one or more oncoming vehicles are approaching a service vehicle and a damaged vehicle is shown. [Diagram 2] 1 illustrates a roadside warning system according to one embodiment. [Figure 3A] FIG. 3A illustrates one embodiment of an alarm beacon employed by the alarm system. [Figure 3B] FIG. 3B illustrates one embodiment of an alarm beacon employed by the alarm system. [Figure 3C] FIG. 3C illustrates one embodiment of an alarm beacon employed by the alarm system. [Figure 3D] FIG. 3D illustrates one embodiment of an alarm beacon employed by the alarm system. [Figure 4A] FIG. 4A shows a schematic of an example of vehicles approaching a warning beacon, a service vehicle and a damaged vehicle along a predetermined route. [Figure 4B] FIG. 4B illustrates an example of a schematic of vehicles approaching a warning beacon, a service vehicle, and a damaged vehicle along a predetermined route. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0009] Where necessary, detailed embodiments of the present invention are disclosed herein, but it should be understood that the disclosed embodiments are merely exemplary of the present invention, which may be embodied in various alternative forms. The figures are not necessarily to scale, and some features may be exaggerated or minimized to show details of specific components. Therefore, specific structural and functional details disclosed herein should not be construed as limiting, but merely as a representative basis for teaching those skilled in the art to employ the present invention in various ways.
[0010] Each year, people may be injured while attempting to rescue or approach a distressed, stopped, or parked vehicle. For example, FIG. 1 shows a service vehicle 102 parked behind a distressed vehicle 104 that needs service. The damaged vehicle 104 may be parked along one side of a road 106 or on the shoulder 108. A service assistant may then exit the service vehicle 102 and approach the damaged vehicle 104 to provide assistance near the road 106 or along the shoulder 108. If a rescuer needs to tow the damaged vehicle 104, the service assistant may have to connect a tow hitch to the damaged vehicle 104.
[0011] While the service assistant is connecting the two vehicles, changing a tire, or in some way securing the damaged vehicle 104, the service assistant may be unaware of the location or speed of the approaching vehicle 110. Alternatively, an object (e.g., concrete, a rock, or a part from the approaching vehicle 110) may be protruding dangerously close to the service vehicle 102 and the damaged vehicle 104 that the service assistant is attending to. Without awareness of the approaching vehicle 110 or the object, a potentially dangerous situation may arise for the service assistant, the occupants of the damaged vehicle 104, or the occupants of the approaching vehicle 110. It is therefore desirable to provide a system and method that detects and provides advance warning of such potentially dangerous situations as they arise.
[0012] 2 illustrates an alarm system 200 that may be deployed to detect and provide an alarm when an object (e.g., an approaching vehicle, concrete, rocks, or other object) is determined to be approaching at an undesirable speed and / or path. It is contemplated that the alarm system 200 may be deployed to monitor a work site where a service technician is assisting a damaged vehicle 104 and occupants within the damaged vehicle 104.
[0013] The alarm system 200 may include at least one alarm beacon 202. The alarm beacon 202 may include at least one processor 204 operatively connected to a memory unit 208. The processor 204 may be one or more integrated circuits that implement the functions of a CPU 206 (i.e., a central processing unit). The processor 204 may be a microcontroller board (e.g., an Arduino microcontroller). Alternatively, the processor 204 may be a commercially available CPU that implements instructions such as the x86, ARM, Power, or MIPS instruction set families.
[0014] During operation, CPU 206 may execute stored program instructions retrieved from memory unit 208. The stored program instructions may include software that controls operation of CPU 206 to perform the operations described herein. In some examples, processor 204 may be a system on a chip (SoC) that integrates the functionality of CPU 206, memory unit 208, network interface, and input / output interface into a single integrated device. Processor 204 may implement an operating system for managing various aspects of its operation.
[0015] The alarm beacon may include an electrical energy power supply 226 comprised of a DC-battery or a high voltage capacitor. During operation, the power supply 226 may receive recharging energy from an external solar panel 228. Alternatively, a wind generator may provide recharging energy to the power supply 226. It is also contemplated that the power supply may be connected to an AC-energy source (i.e., a 120V AC outlet) which may be used to recharge the power supply 226.
[0016] The memory unit 208 may include volatile and non-volatile memory for storing instructions and data. The non-volatile memory may include solid-state memory such as NAND flash memory, magnetic and optical storage media, or any other suitable data storage device that retains data when the alarm system 200 is deactivated or loses power. The volatile memory may include static and dynamic random access memory (RAM) for storing program instructions and data.
[0017] The warning beacon 202 may include one or more sensors. For example, the warning beacon 202 may include a Light Detection And Ranging (LiDAR) sensor 210 that may use a pulsed laser to measure the distance, speed (using change in distance), acceleration, or speed of an approaching object, and may be operable to use light in the form of such a pulsed laser. As described below, the processor 204 may be operable to use data provided by the LiDAR sensor 210 to algorithmically detect an approaching object and calculate its speed in miles per hour.
[0018] The alarm beacon 202 may include other radar sensors 212, such as ultrasonic radar sensors or short / medium / long range radar sensors, which are also operable to transmit pulse signals that may be used by the alarm beacon 202 to measure range (distance) from an object. The alarm beacon 202 may include a digital camera 214 operable to take images or videos that may be processed by the alarm beacon 202 to detect stationary or approaching objects. The alarm beacon 202 may include a Global Positioning System (GPS) 215 for detecting the location of the alarm beacon 202.
[0019] The warning beacon 202 may further include one or more audio alerts 216. The audio alerts 216 may consist of a speaker that provides an audio warning or siren to people within a predetermined radius of the warning beacon 202. Alternatively, the audio alerts 216 may include multiple unique alerts that provide different notifications to a service technician. For example, one unique alert may be used to alert a service technician that an approaching vehicle 110 is approaching from behind the damaged vehicle 104, and a different alert may be used for approaching vehicles 110 that may be in the forward path of the damaged vehicle 104.
[0020] The alarm beacon 202 may further include one or more visual alerts 218 for people within a predetermined radius of the alarm system 200. For example, the visual alert 218 may include a light system (e.g., one or more light emitting diodes (LEDs)) that glows continuously, flashes brightly, or flashes to provide a visual alert to people. Alternatively, the visual alert 218 may be an electronic message board operable to provide an alert to people that can be read and altered.
[0021] It is contemplated that the audio alert 216 and / or visual alert 218 may be used to alert an occupant of the approaching vehicle 110, a service technician, or an occupant of the damaged vehicle 104. It is also contemplated that the warning beacon may use one or more relays to activate and operate the audio alert 216 and visual alert 218 to alert an occupant of the approaching vehicle 110, a service technician, or an occupant of the damaged vehicle 104. It is also contemplated that the audio alert 216 and / or visual alert 218 may operate to alert an occupant (i.e., a driver) of the approaching vehicle 110 to veer off course and away from the warning beacon 202, the service vehicle 102, and / or the damaged vehicle 104. Alternatively, the audio alert 216 and / or visual alert 218 may operate to alert a service technician or an occupant of the damaged vehicle 104 to move away from the approaching vehicle 110.
[0022] The alarm beacon 202 may include a network interface device 220 configured to provide communication with external systems and devices. For example, the network interface device 220 may include a wired and / or wireless Ethernet interface defined by the Institute of Electrical and Electronics Engineers (IEEE) 802.11 family of standards. The network interface device 220 may include a cellular communication interface for communicating with a cellular network (e.g., 3G, 4G, 5G). The network interface device 220 may be further configured to provide a communication interface to an external network 222 or the cloud.
[0023] The external network 222 may be interconnected to the World Wide Web or the Internet. The external network 222 may establish a standard communication protocol between one or more external computing devices 224. The external network 222 may facilitate the exchange of information and data between the computing devices 224 and the network interface 220. For example, the external devices 224 may be comprised of one or more servers that communicate with the alarm beacon 202 via the external network 222. Alternatively, the external devices 224 may include mobile devices (e.g., smartphones, smart watches) that communicate with the alarm beacon 202 via the external network 222.
[0024] It is further contemplated that the alarm system 200 may be implemented using one or more alarm beacons 202. Although FIG. 2 illustrates only a single alarm beacon 202, it is contemplated that each of the various features and functions described above may be separated and implemented by multiple alarm beacons 202. For example, the alarm system 200 may be comprised of multiple alarm beacons 202, each having separate sensors 210-214, audio alerts 216, and visual alerts 218. Each alarm beacon 202 may also operate independently or the alarm beacons 202 may communicate and operate as a mesh network. The alarm beacons 202 may also communicate with a remote server (e.g., device 224) using an external network 222, which may be used to monitor or deploy the alarm beacons 202.
[0025] When multiple warning beacons 202 are employed, the warning system 200 may communicate between the individual warning beacons 202 using an external network 222. For example, the warning system 200 may be operable to communicate between a first warning beacon 202 located in front of the damaged vehicle 104 and a second warning beacon 202 located behind the service vehicle 102 using the external network 222. By deploying multiple warning beacons 202, the warning system 200 may provide the ability to scan for approaching vehicles or objects from multiple directions (e.g., vehicles approaching from in front of the damaged vehicle 104 or vehicles approaching from behind the service vehicle 102) using the LiDAR 210, radar 212, or camera 214. Furthermore, even if one warning beacon 202 ceases operation, the remaining warning beacons 202 may continue to operate to scan, detect, and issue warnings for approaching vehicles 110 or objects. Thus, implementing multiple warning beacons 202 provides redundancy to the warning system 200.
[0026] The alarm beacon 202 may be designed to operate under extreme weather conditions across different geographic regions. For example, the alarm beacon 202 may be designed to operate when exposed to extremely cold or hot weather, or rain, sleet, or snow. As such, it is contemplated that the alarm beacon may be sealed or placed within an Ingress Protection (IP) enclosure to protect the components (e.g., processor 204, LiDAR 210) from various weather conditions and climate changes.
[0027] 3A-3D show various exemplary warning beacons 202 that may be deployed as part of a warning system 200 to detect approaching objects (e.g., approaching vehicles or debris) and provide a warning. It is contemplated that the warning beacons 202 may be deployed by a service assistant to detect potentially dangerous objects while the damaged vehicle 104 is being serviced. However, the warning beacons 202 may also be deployed by police, fire, or ambulance service personnel providing emergency services. Alternatively, it is contemplated that the warning beacons 202 may be designed as a commercial system available and deployable by motorists.
[0028] Again, the warning beacon 202 may include one or more audio alerts 216 and / or visual alerts 218 operable to indicate the presence of the service vehicle 102 or damaged vehicle 104 to the approaching vehicle 110. Alternatively, the audio alerts 216 and / or visual alerts 218 may be operable to indicate the presence of the approaching vehicle 110 to a service assistant. As shown in FIG. 3A, the visual alerts 218 may include bucket light light emitting displays (LEDs) to indicate the presence of the service vehicle 102 or damaged vehicle 104 to the approaching vehicle 110. As mentioned above, the audio alerts 216 may be designed with a speaker system to provide an audible indication to the service assistant that the approaching vehicle 110 is approaching at a dangerous speed or distance.
[0029] It is also contemplated that the warning system 200 may operate by detecting whether an approaching vehicle 110 is within a predetermined distance using data provided by the LiDAR sensor 210 or radar 212. The processor 204 may include instructions to perform error checking and remove any false positive data received from the LiDAR sensor 210 or radar 212.
[0030] The processor 204 may also operate on beta measurements or samples for the approaching object (i.e., the approaching vehicle 110) before determining the average distance. If the processor 204 determines that the measurement is not within the predetermined range, the processor 204 may not store the measurement in the memory 208 and / or may discard the measurement. The processor 204 may continue to poll the LiDAR sensor 210 or the radar 212 until a predetermined number of measurements (i.e., beta measurements) are within a predetermined range (e.g., [γ, δ] centimeters), as shown in equation (1) below.
[0031] TIFF0007583833000001.tif12168
[0032] In formula (1), x i is the distance (cm) to the approaching object. Once the processor 204 has calculated the average distance, the processor 204 may further calculate the velocity of the approaching object. The velocity of the approaching object may be expressed as the change in position (cm) divided by the change in time (ms), as shown in equation (2) below:
[0033] TIFF0007583833000002.tif12168
[0034] Here, p i is the i-th position, and t iis the i-th time. The processor 204 may be operable to convert the calculated speed to miles per hour (MPH). The processor 204 may convert the calculated speed from centimeters per millisecond to miles per hour using the following equations (3), (4), and (5):
[0035] TIFF0007583833000003.tif11168
[0036] TIFF0007583833000004.tif11168
[0037] TIFF0007583833000005.tif12168
[0038] The processor 204 may determine whether the speed of the object (i.e., the approaching vehicle 110) is moving at or above a predetermined speed (e.g., 25 MPH) and whether the object's speed is less than or equal to a predetermined distance (e.g., 3000 cm), as shown in equation (6) below.
[0039] TIFF0007583833000006.tif13168
[0040] where z may be an output indicating whether an audio alert 216 or visual alert 218 should be activated, x is the speed in miles per hour (MPH), and y is the distance in centimeters (cm). If the processor 204 determines that an object is within the predetermined speed and distance, the processor may activate a visual alert 218 (e.g., an LED light) or an audio alert 216 (e.g., a loud siren).
[0041] 3A exemplarily illustrates that the warning beacon 202 may include multiple LiDAR sensors 210A-210C, multiple radar sensors 212A-212C, and multiple cameras 214A-210C. The LiDAR sensors 210A-210C, radar sensors 212A-212C, and cameras 214A-210C may be disposed at various locations around the warning beacon 202. By including multiple LiDAR sensors 210A-210C, radar sensors 212A-212C, and cameras 214A-210C, the warning beacon 202 may be operable to scan in all directions for approaching objects or vehicles. For example, the warning beacon 202 may use multiple LiDAR sensors 210A-210C, radar sensors 212A-212C, and cameras 214A-210C to scan for all approaching vehicles 110 regardless of the direction they are approaching the service vehicle 102 or damaged vehicle 104. It is also contemplated that only one set of LiDAR, radar, and cameras (e.g., 210A, 212A, 214A) may be included and that the set may be designed to rotate around the warning beacon 202 and scan for approaching objects or vehicles in all directions.
[0042] As shown in FIG. 3A, the warning beacon 202 may be designed or shaped as a triangular cone. However, it is contemplated that the warning beacon 202 may be shaped or deployed in other forms or manners depending on a given application. For example, FIG. 3B shows that the warning beacon 202 is designed as a roadside triangular stop sign. As shown in FIG. 3B, multiple visual alerts 218 (e.g., LED lighting systems) may be included to provide visual warnings to approaching traffic, service assistants, or bystanders. FIG. 3B also shows that multiple audio alerts 216 may be included within the warning beacon 202. Depending on the size or application of the warning beacon 202, additional audio alerts 216 and visual alerts 218 may be desired. FIG. 3C further shows the warning beacon 202 designed as a roadside cylinder.
[0043] FIG. 3D illustrates that the warning beacon 202 may be designed as an aerial drone. As used within this application, the term "drone" may refer to an aerial vehicle that can operate autonomously to perform a given function or may refer to an aerial vehicle controlled by a human operator. The warning beacon 202 may include one or more thrust devices 230A-230D. As shown, the thrust devices 230A-230D may include propeller members arranged on the periphery and rotating to generate thrust. The thrust devices 230A-230D may be configured to provide both lift (vertical thrust) and lateral thrust (horizontal thrust). The vertical and horizontal components of thrust allow the warning beacon 202 to change altitude, lateral movement, and orientation (attitude).
[0044] Finally, it is contemplated that the alarm beacon 202 may be designed as clothing or an IoT device worn by a service technician when rescuing the damaged vehicle 104. The alarm system 200 may still provide wireless connectivity between the alarm beacon 202 (i.e., clothing or an IoT device) worn by the service technician and additional alarm beacons 202 positioned around the service vehicle 102 and the damaged vehicle 104. However, it is contemplated that the clothing or IoT device may be an alternative form of the alarm system 200 independent of the alarm beacon 202 illustrated by FIGS. 4A-4D.
[0045] For example, the garment may be a vest worn by a service technician. The vest may include one or more LiDAR or radar sensors to detect the location and speed of an approaching vehicle 110 or object. The vest may include one or more camera sensors to detect and record video. The vest may be operable to determine if an approaching vehicle is approaching within a predetermined distance or speed of the service vehicle 102 or damaged vehicle 104. The vest may include audio and visual alerts that are activated to notify the service technician of the approaching vehicle 110 or object. When employed as wearable glasses or contact lenses, the alarm system 200 may display a visual alert to the service technician. Alternatively, the garment may be a smart watch (e.g., an Android watch or an Apple watch) on which a mobile software application may be utilized to provide visual or audio alerts to the service technician.
[0046] 4A illustrates an alarm system 200 having multiple warning beacons 202A-202D positioned around the service vehicle 102 and the damaged vehicle 104. It is contemplated that a service technician may deploy and position the warning beacons 202A-202D to surround the vicinity of the service vehicle 102 and the damaged vehicle 104. Alternatively, each warning beacon 202A-202D may include a motor and wheels to enable automatic deployment from the service vehicle 102. Thus, the alarm system 200 may automatically position the warning beacons 202A-202D to surround the vicinity of the damaged vehicle 104 without the assistance of a service technician.
[0047] However, it is contemplated that a service technician may manually control the placement of the alarm beacons 202A-202D using the network interface 220. For example, the service technician may use a mobile device or remote control wirelessly connected to each alarm beacon 202A-202D via the network interface 220. For example, the service technician may use a mobile app that allows the service technician to select each alarm beacon 202A-202D. After the alarm beacon 202A-202D is selected, the mobile app may provide the service technician with the ability to control the placement of the alarm beacon 202A-202D.
[0048] Again, each warning beacon 202A-202D may be an aerial drone operable to hover in the vicinity of the service vehicle 102 and the damaged vehicle 104, as shown in FIG. 3D. When deployed using an aerial drone, the warning beacon 202A-202D may be located above the first lane 406, the second lane 408, or the shoulders 108A, 108B. When the drone is hovering over the approaching vehicle 110, the visual alert 216 (e.g., an LED light) may be visible from a greater distance from the service vehicle 102. When activated, the visual alert 216 may be a flashing light visible from the approaching vehicle 110 at a distance of ¼ mile or more. The increased visibility may be because the drone is not blocked by other vehicles or roadside obstacles.
[0049] It is also contemplated that each warning beacon 202A-202D also includes a motorized assembly (not shown) controlled by the processor 204 to self-level the LiDAR 210, radar 212, and camera 214 regardless of road gradient. For example, the processor 204 may be programmed to: (1) scan downward until the ground is detected, (2) scan upward to detect the horizon, and (3) auto-level the LiDAR 210 in a position to project toward the approaching vehicle 110. Alternatively, the processor may provide a self-leveling function using an accelerometer to determine a particular orientation of the LiDAR 210, radar 212, and camera 214 and measure different values of downward acceleration due to gravity.
[0050] It is further contemplated that each warning beacon 202A-202D may be physically mounted to the service vehicle 102. For example, each warning beacon 202A-202D may be mounted to a light bar on top of the service vehicle 102 or via equipment mounted inside or outside the service vehicle 102. The LiDAR 210, radar 212, and camera 214 may also be positioned around the service vehicle 102 and used by the processor 204 to detect approaching vehicles 110 approaching from various directions. The LiDAR 210, radar 212, and camera 214 may also be controlled by a service technician or may operate automatically in conjunction with traffic flow and road position.
[0051] As shown by FIG. 4A, the warning beacons 202A-202D may be positioned behind the service vehicle 102 near the edge of the road shoulder 108. The approaching vehicle 110 may initially approach in the first lane 406 toward the warning beacon 202. However, once the approaching vehicle 110 is alerted by the warning beacon 202, the approaching vehicle 110 may be directed into the second lane 408 along the first path 402. Once the visual alert 218 (e.g., LED bucket light) is visible to the driver, the oncoming vehicle 110 may be directed into the second lane 308. Alternatively, the oncoming vehicle 110 may send a message to the vehicle, phone, or IOT device to move into the second lane. Alternatively, the oncoming vehicle 110 may be autonomously controlled and directed into the second lane 408 based on sensed or received data transmitted by the warning system 200. Relocation to the second lane 408 may cause the warning system 200 to not activate the audio alert 216 .
[0052] However, as illustrated by FIG. 4B, the approaching vehicle 110 may not leave the first lane 406. Instead, the approaching vehicle 110 may travel along a second path 404 that approaches the vicinity of the warning beacon 202. The approaching vehicle 110 may approach the vicinity of the warning beacon 202 even though the visual alert 218 is activated and operates to alert the occupants of the approaching vehicle 110. When the approaching vehicle 110 reaches a predetermined distance or speed from the warning beacon 202, an audio alert 318 may be activated to alert a service technician. The audio alert 318 may be alerted when the approaching vehicle 110 reaches a predetermined distance or speed so that the service technician has enough time to reposition himself or herself and possibly alert the occupants of the damaged vehicle 104.
[0053] The camera 214 may be operable to provide a video recording of the area surrounding the damaged vehicle 104. The camera 214 may be operable whenever the warning beacon 202 is deployed. Alternatively, the camera 214 may be operable to record video only if the approaching vehicle 110 is determined to be moving at or above a predetermined speed (i.e., velocity) or within a predetermined direction of the damaged vehicle 104, the service vehicle 102, or the warning beacon 202. The predetermined speed and direction values may be stored in the memory 208. The predetermined direction and speed values may be calibratable or may be adjusted by the service technician. The warning beacon 202 may also be operable to record and store digital images, recorded videos, or video segments obtained from the camera 214 in the memory 208 or on the external network 222. Additionally, the camera 214 may be used in combination with machine learning algorithms by the processor 204 to determine whether a predetermined set of safety or operating protocols are being followed by the service technician while rescuing the occupants of the damaged vehicle 104.
[0054] The alarm system 200 may also be operable to transmit the video using the external network 222 to a remote storage (e.g., device 224) that may be located within the service vehicle 102. Alternatively, the alarm beacon 202 may operatively transmit the video using the external network 222 to a remote server (e.g., a corporate server or cloud-based storage such as Amazon Web Services). The transmitted video may then be viewed by a remote worker while the service is being provided or at a later time. The remote worker may view the video to supervise or monitor the work being performed by the service technician. Alternatively, the remote worker may view the video as an added level of safety for the service technician and the occupants of the damaged vehicle 104. The video and GPS location may be live streamed to a central location via the network interface 220 and the external network 224, allowing supervisors and fleet operators the ability to supervise the work in real time.
[0055] The alarm system 200 may also be operable to process real-time traffic analysis stored in memory 208 using video collected from the camera 214. The traffic analysis may be transmitted to a central system or cloud-based storage (e.g., device 224) that may monitor multiple alarm systems 200 (i.e., multiple emergency service vehicles) distributed at various locations, again using an external network 222. The traffic analysis data may be used both internally and externally to provide more accurate information to service technicians and drivers.
[0056] Data from GPS 215 may likewise be transmitted to monitoring or emergency services (via external network 222) when processor 204 determines that an approaching vehicle 110 is approaching at a predetermined speed, distance, or path toward a service vehicle 102, a damaged vehicle 104, or a warning beacon 202. Data provided by GPS 215 may also be processed for internal analysis regarding the location of prevalent damaged vehicles.
[0057] The alarm system 200 may also be operable to transmit an alert to an infotainment system, head-up display, video monitor, or mobile device located in the approaching vehicle 110 using the external network 222. For example, the alarm system 200 may employ the external network 222 to provide geo-fencing capabilities that may provide an alert in an oncoming vehicle. The alarm system 200 may transmit data indicative of the location of the service vehicle 102, the damaged vehicle 104, or the alert beacon 202 to the approaching vehicle 110 via the external network 222. The alarm system 200 may also receive data indicative of the location of the approaching vehicle 110 from the external network 222. The alarm system 200 may determine when to activate an audio alert 216 or a visual alert 218 based on the location and speed of the approaching vehicle 110 relative to the service vehicle 102, the damaged vehicle 104, or the alert beacon 202. Additionally, the warning system may be capable of communicating with a mobile software application that can then provide route information to the driver and give real-time traffic information to advise the occupants of the approaching vehicle 110.
[0058] The alarm system 200 may also transmit instructions from the network interface 220 over the external network 222 to slow the oncoming vehicle 110 to a predetermined speed. For example, the alarm system 200 may transmit data or instructions over the external network 222 to notify local emergency services about the damaged vehicle 104. The local emergency services may be equipped to transmit a notification signal to the oncoming vehicle 110 in the vicinity (e.g., ¼ mile radius) of the damaged vehicle 104. Upon receiving the notification signal, the oncoming vehicle 110 may be programmatically controlled to slow down to a specified speed (e.g., 25 MPH) regardless of whether the driver attempts to press the accelerator pedal. It is contemplated that the notification signal need not be requested as coming from an emergency services location and may be transmitted by the alarm system 200 or a monitoring service in communication with the alarm system 200.
[0059] The warning system 200 may also transmit a notification signal operable to initiate automatic braking or collision avoidance in the approaching vehicle 110. For example, the notification signal may be used to provide automatic braking in an approaching vehicle 110 approaching within a predetermined speed or distance of the warning beacon 202, the service vehicle 102, or the damaged vehicle 104. Alternatively, the notification signal may be used to direct the approaching vehicle 110 away from the warning beacon 202, the service vehicle 102, or the damaged vehicle 104.
[0060] The warning system 200 may further be operable to connect to roadside billboards or municipal notification systems using the external network 222 to provide additional warnings to the approaching vehicles 110. For example, many roadside billboards are now equipped as video electronic displays. The warning system 200 may be operable to connect to such billboards (directly or through a notification service) using the external network 222 so that information may be provided to the approaching vehicles 110. Many cities also feature electronic signs that may be used to alert the approaching vehicles 110 of current traffic conditions. These electronic signs may also be used by the warning system 200 to inform the approaching vehicles 110 of the location of the service vehicles 102, damaged vehicles 104, or warning beacons 202.
[0061] The alarm system 200 may also be operable to connect using an external network with a mobile device worn by a service technician. For example, the alarm system 200 may include a mobile software application that may be downloaded onto the mobile device (e.g., a downloadable app available for Apple or Android smartphones). The mobile software application may use an audible or visual alert feature of the mobile device to alert the service technician when the speed of the approaching vehicle 110 is determined to exceed a predetermined threshold or when the direction of the approaching vehicle 110 is determined to be within a predetermined distance.
[0062] The alarm system 200 may be integrated to operatively use sensors or alarm systems located within the service vehicle 102. Alternatively, the alarm system 200 may integrate or alternatively rely on sensors located within the damaged vehicle 104. For example, the damaged vehicle 104 may be operative to include functionality that allows a service technician to connect the alarm system 200 to sensors (e.g., LiDAR, cameras) located within the damaged vehicle 104. The sensors located within the damaged vehicle 104 may then be implemented by the alarm system 200 to further detect and provide an alarm about an approaching vehicle 110 or object.
[0063] The warning system 200 may also transmit data to the external network 222 indicating traffic patterns surrounding the damaged vehicle 104. Alternatively, the warning system 200 may transmit instructions requesting rerouting of traffic away from the damaged vehicle 104. The data and instructions may be provided to a mapping software provider (e.g., Google or Waze) so that the approaching vehicles 110 may be notified and / or rerouted away from the damaged vehicle 104. For example, the warning system 200 may request that the approaching vehicles 110 be rerouted a predetermined distance (e.g., ½ mile) away from the damaged vehicle 104.
[0064] It is further contemplated that the area surrounding the damaged vehicle 104 may have movable traffic flow devices. For example, certain roads include lane diversion systems that allow additional or alternative traffic lanes. The warning system 200 can activate and use these additional or alternative traffic lanes to reroute approaching vehicles 110 away from the damaged vehicle 104 to provide a safe working environment for the service technicians.
[0065] The warning system 200 may also be designed to receive information regarding where the damaged vehicle 104 is located. For example, the damaged vehicle 104 may be located in a highly traversed area, an area that includes visual obstacles for the approaching vehicle 110 (e.g., bridges, bushes), or a location that does not include suitable space to service the damaged vehicle 104 (e.g., an area with a small shoulder or no shoulder at all). The warning system 200 may be operable to evaluate and determine whether the damaged vehicle 104 is located in an area that is unsafe for a service technician. The warning system 200 may be operable to warn the damaged vehicle 104 to proceed to another location before being serviced.
[0066] It is also contemplated that the alarm system 200 may operatively receive data from a local weather service from the external network 222 about pending weather conditions surrounding the damaged vehicle 104. If the alarm system 200 determines that the received data about weather conditions may increase the likelihood of an accident with the approaching vehicle 110, additional safety measures may be employed. For example, if the alarm system 200 receives data about a heavy snow storm or if icy road conditions exist around the damaged vehicle 104, the alarm system 200 may request increased coverage by the alarm beacons 202 surrounding the damaged vehicle 104. The radius and number of the alarm beacons 202 may also be increased so that the alarm system 200 can provide enhanced warning to the service technician. The alarm system 200 may also operatively employ machine learning algorithms to enable the service vehicle 102 to access telematics data to determine any degradation of the alarm beacons 202 that may lead to a malfunction or equipment failure.
[0067] It is further contemplated that the alarm system 200 may implement facial recognition algorithms, block chain algorithms, optical character recognition (OCR), or image recognition to track and detect potential misplacement or theft of any one of the alarm beacons 202. For example, the alarm beacon 202 may be taken from the roadside or from the rear of the service vehicle 102. Using the network transmitter 220, the processor 204 may transmit a digital image captured by the camera 214. The processor 204 may also employ facial recognition algorithms to identify the individual responsible for photographing the alarm beacon 202. The processor 204 may also employ GPS data from the GPS 215 to determine and transmit the location of the alarm beacon 202 for retrieval by authorities.
[0068] The processor 204 may also employ the camera 214 to capture an image of the license plate from the oncoming vehicle 110. The alarm system 200 may use the external network 222 to communicate with an external server (e.g., a police database) or emergency services if the captured license plate is determined to be that of a stolen or missing vehicle. The alarm system 200 may use the images captured by the camera 214 to detect that a stolen or missing vehicle has occurred. The alarm system 200 may send a notification (using the external network 222) to local authorities (e.g., a police station) indicating the location where the stolen or missing vehicle was confirmed. If the alarm system 200 is unable to capture a license plate, it may still capture an image of the vehicle and use object / color detection to capture the make, model, and color of the stolen or missing vehicle.
[0069] The LiDAR sensor 210, the radar sensor 212, the camera 214, and the GPS 215 may also be used to create a surface or terrain map of where the damaged vehicle 104 is located. The surface / terrain map may be used by the warning system 200 to detect dangerous road conditions or obstacles. The warning system 200 may then provide an alert to the service technician if the road conditions or obstacles may present a dangerous working environment. For example, the road surface map may indicate the presence of a large pothole near the damaged vehicle 104. The warning system 200 may provide an audible or visual alert to the service technician about the pothole. The service technician may then use this alert to add additional warning beacons 202 around the service vehicle 102 or the damaged vehicle 104 to ensure that the approaching vehicle 110 avoids the obstacle (e.g., pothole).
[0070] The warning system 200 may also be operable to store location, terrain data, and weather conditions in the memory 208 when servicing a damaged vehicle 104. The warning system 200 may use this information to generate analytical data regarding general locations where damaged vehicles 104 require service. If a given location routinely contains damaged vehicles 104 requiring service, the warning system 200 may notify local authorities. The warning system 200 may also provide data to local authorities regarding potential reasons for an increased number of damaged vehicles 102 at a given location. For example, the warning system 200 may be operable to evaluate analytical data including terrain, satellite imagery, or surface maps obtained from the LiDAR sensor 210, radar 212, camera 214, or GPS 215, and determine that a given location is likely to contain several large potholes. The warning system 200 may be operable to transmit the analytical data using the network interface 220. The analytical data may be received by local authorities who can use the information to correct or remedy the potholes.
[0071] The alarm system 200 may further use a microphone (e.g., in the camera 214) to record and analyze audio analytics while the service technician is servicing the damaged vehicle 104. The audio analytics may then be further processed to determine a customer's satisfaction while the damaged vehicle is being serviced. If the alarm system 200 determines a positive customer satisfaction, the alarm system 200 may be capable of providing a post on a social networking website (e.g., LinkedIn or Facebook) regarding the service technician and the work performed. The alarm system 200 may also be capable of tracking response times and the time required to service the damaged vehicle 104. Again, the alarm system 200 may then be operable to post updates regarding the response or service times on the social networking website. Alternatively, the time updates may be used to inform other potential customers about the expected wait times.
[0072] It is further contemplated that the occupants of the damaged vehicle 104 may complete an application process accessible by the alarm system 200 using the external network 222. The application process may be part of a registration system with an insurance agency (e.g., AAA in Michigan). The application process may include emergency contact information. The alarm system 200 may be operable to provide an alert to the emergency contacts when the alarm system 200 is deployed for the occupants of the damaged vehicle 104.
[0073] While exemplary embodiments have been described above, it is not intended that these embodiments describe all possible forms of the invention. Rather, the words used herein are words of description rather than limitation, and it is understood that various changes may be made without departing from the spirit and scope of the invention. Moreover, features of various embodiments may be combined to form further embodiments of the invention.
Claims
1. 1. A warning system deployable on or along a roadway, comprising: at least one warning beacon including a distance sensor; A processor operable to: responsive to receiving an initial measurement from the distance sensor indicating the presence of a vehicle within a predetermined distance of the warning beacon, polling the distance sensor to take a predetermined number of measurements; if the vehicle is within the predetermined distance from the warning beacon, calculating an average distance to the vehicle and an average speed of the vehicle in response to receiving the predetermined number of measurements; activating an audio alert and a visual alert in response to calculating the average distance and the average speed when the average distance falls below a distance threshold and the average speed exceeds a speed threshold; and and a processor operable in response to activation of the audio and visual alerts to analyze one or more digital images of at least the service technician and the damaged vehicle to determine whether a predetermined protocol to be followed by the service technician while salvaging the damaged vehicle is being performed.
2. the at least one warning beacon further comprises a digital camera operable to capture the one or more digital images; The processor further comprises: in response to receiving the initial measurement from the distance sensor indicating that the vehicle is within the predetermined distance from the warning beacon; acquiring one or more images of the vehicle; calculating a second average distance to the vehicle and a second average speed of the vehicle using the one or more images; and 2. The warning system of claim 1, operable to activate the audio and visual alerts when the second average distance falls below the distance threshold and the second average speed exceeds the speed threshold.
3. The alarm system of claim 1 , wherein the at least one alarm beacon further comprises a Global Positioning System (GPS) operative to provide location data and a network interface operative to communicate with a remote server.
4. 4. The alarm system of claim 3, wherein said processor is further operable to transmit an identification of said at least one alarm beacon and said location data in response to a request signal received from said remote server.
5. 4. The warning system of claim 3, wherein the processor is further operable to transmit the location data of the warning beacon to the remote server in response to receiving the initial measurement from the distance sensor indicating that the vehicle is within the predetermined distance from the warning beacon.
6. 4. The alarm system of claim 3, wherein the processor is further operable, in response to a request to deploy the at least one alarm beacon to a geographic coordinate, to navigate the at least one alarm beacon to the geographic coordinate based on the location data.
7. The warning system of claim 6 , wherein the at least one warning beacon is an airborne drone operable to hover around the geographic coordinates based on the location data.
8. The alarm system of claim 1 , wherein a mobile software application executing on a mobile device is operable to communicate with the at least one alarm beacon.
9. 10. The warning system of claim 8, wherein the processor is further operable, in response to receiving the initial measurement from the distance sensor indicating that the vehicle is within the predetermined distance from the at least one warning beacon, to send a signal to the mobile software application to activate visual and audio notifications on the mobile device.
10. 2. The warning system of claim 1, wherein the processor is further operable to transmit a warning for display on an infotainment system in the vehicle in response to receiving the initial measurement from the distance sensor indicating that the vehicle is within the predetermined distance from the warning beacon.
11. 1. A method of operation of a warning system deployable on or along a roadway, comprising: responsive to receiving an initial distance measurement from at least one sensor indicating the presence of a vehicle within a predetermined distance from the warning beacon, polling the one or more sensors to read a predetermined number of distance measurements; if the vehicle is within the predetermined distance from the warning beacon, calculating an average distance to the vehicle and an average speed of the vehicle in response to receiving the predetermined number of distance measurements; activating one or more alarms in response to calculations of the average distance and the average speed when the average distance falls below a distance threshold and the average speed exceeds a speed threshold; and analyzing one or more digital images of at least the service technician and the damaged vehicle to determine whether a predetermined protocol to be followed by the service technician while salvaging the damaged vehicle is being performed.
12. acquiring images of the one or more vehicles from a digital camera in response to receiving the initial distance measurements from one or more of the sensors indicating the presence of the vehicle within the predetermined distance from the warning beacon; calculating a second average distance to the vehicle and a second average speed of the vehicle using the one or more images; The method of claim 11 further comprising activating one or more of the alarms when the second average distance falls below the distance threshold and the second average speed exceeds the speed threshold.
13. 13. The method of claim 12, further comprising the step of transmitting the alarm beacon's ID and location data provided by a Global Positioning System (GPS) in response to a request signal received from a remote server.
14. 14. The method of claim 13, further comprising the step of transmitting the location data of the warning beacon to the remote server in response to receiving the initial distance measurements from one or more of the sensors indicating that the vehicle is within the predetermined distance from the warning beacon.
15. The method of claim 13 further comprising the step of, in response to a request to deploy the alarm beacon at a geographic coordinate, navigating the alarm beacon to the geographic coordinate based on the location data.
16. 12. The method of claim 11, further comprising, in response to receiving the initial distance measurements from one or more of the sensors indicating the presence of the vehicle within the predetermined distance from the warning beacon, sending a signal to a mobile application to activate visual and audio notifications on a mobile device.
17. 1. A warning beacon deployable on or along a road, comprising: responsive to determining whether a vehicle is within a predetermined distance, polling one or more sensors to take a predetermined number of distance measurements; if the vehicle is within the predetermined distance, calculating an average distance to the vehicle and an average speed of the vehicle in response to receiving the predetermined number of distance measurements; activating an alarm in response to a calculation of the average distance and the average speed when the average distance falls below a distance threshold and the average speed exceeds a speed threshold; An alarm beacon including a controller operable, in response to activation of the alarm, to analyze one or more digital images of at least the service technician and the damaged vehicle to determine whether a predetermined protocol is being performed that should be followed by the service technician while rescuing the damaged vehicle.
18. further comprising a digital camera operable to capture the one or more digital images; The controller further comprises: responsive to receiving an initial measurement from one or more of the sensors indicating the presence of the vehicle within the predetermined distance, acquiring one or more images of the vehicle; calculating a second average distance to the vehicle and a second average speed of the vehicle using the one or more images; 18. The warning beacon of claim 17, operable to activate one or more of the warnings when the second average distance falls below the distance threshold and the second average speed exceeds the speed threshold.
Citation Information
Patent Citations
Trouble reporting method
JP2002367063A
Vehicle accident analysis device
JP2003040061A
Emergency reporting device
JP2003281652A
Relief service provision system, its method, portable terminal device, server device, program, and recording medium
JP2005056244A
System and method for providing rescue service, on-vehicle terminal device, server device, program, and recording medium
JP2005067499A
