Search support system and search support method for the search support system
Patent Information
- Application Number
- JP2025082829
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2025-05-16
- Publication Date
- 2026-09-08
- Estimated Expiration
- 2045-05-16
AI Technical Summary
【0015】 本発明によれば、紫外線カメラを利用して山岳地域や海上で救助を待つ生存者、負傷者、死亡者を気象条件に左右されずに、かつ、夜間においても撮像することで、捜索精度を格段に向上させて視認性に優れた人命救助活動を機動的に支援できる。
Smart Images

Figure 0007917211000001_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to search support system and search cable support support systems Search and rescue support methods . Background Art
[0002] In recent years, distress accidents in mountainous areas and at sea have shown an increasing trend. Especially at night or under bad weather conditions, visibility decreases significantly, and search and rescue operations continue to require a great deal of time and human resources.
[0003] As a life rescue system that uses drones to transport distressed persons, the following Patent Document 1 discloses: "In order to provide a drone for rescuing people left in dangerous areas that helicopters and the like cannot easily approach and where it is difficult to rescue people, the manned drone comprises at least: a drone main body; a person accommodating portion detachably stored in the drone main body for accommodating a person; a rope connected to the person accommodating portion; and a rope winding means mounted on the drone main body, capable of accommodating the person accommodating portion in the drone main body by winding up the rope, and detaching the person accommodating portion from the drone main body by unwinding the rope."
[0004] Further, as a system for transporting rescue supplies by drones, the following Patent Document 2 discloses: "In order to provide a life rescue device that can easily and quickly transport rescue supplies to persons requiring rescue, the life rescue device 1 comprises: a drone 2 as an unmanned aerial vehicle capable of flying by remote control or automatic piloting; rescue supplies 4 necessary for rescuing the person requiring rescue; and rescue supply locking means 5 for detachably locking the rescue supplies 4. Therefore, the drone 2 can quickly transport the rescue supplies 4 to the person requiring rescue, and the rescue supplies 4 can be easily attached to and detached from the rescue supply locking means 5. Accordingly, the rescue supplies 4 can be easily and quickly transported to the person requiring rescue."
[0005] On the other hand, as a system that uses drones to search for missing persons, Patent Document 3 discloses "a search support system using an aircraft that can quickly find the person to be searched for, comprising a drone 10 equipped with a communication device 50 and cameras 25 and 26, a detection unit 27 that detects the person to be searched for P based on images taken by cameras 25 and 26, and a control unit 33 that controls cameras 25 and 26, the communication device 50, and the drone 10. The control unit 33 flies the drone 10 to the search area of the person to be searched for P and has cameras 25 and 26 take images of the search area. When the detection unit 27 recognizes specific information predetermined from the images taken by cameras 25 and 26, it determines that the person to be searched for P is alive at the location where the specific information was detected. The communication device 50 transmits location information of the place where the person to be searched for P was detected by the detection unit 27 to the search headquarters 100 based on instructions from the control unit 33."
[0006] Furthermore, as a search system that utilizes a transmitter carried by a climber, Patent Document 4 discloses the following: "In order to provide a novel technology for searching for a climber who becomes a lost person when a climber deviates from the regular route while walking, the lost person search system 10 includes a management server 50 that can communicate with a communication terminal 90 having a positioning function which is attached to the climber in advance before the start of walking, a transmitter 32 that emits a unique signal which is attached to the same climber in advance before the start of walking, a receiver 210 that can receive a signal from the transmitter 32 which is used to search for the lost person, a communication terminal-based search unit 50 that searches for the lost person using the positioning function of the communication terminal 90, provided that a connection is established between the communication terminal 90 and the management server 50, and a transmitter-based search unit 202 that searches for the lost person using the signal from the transmitter 32, provided that a connection is established between the transmitter 32 and the receiver 210." [Prior art documents] [Patent Documents]
[0007] [Patent Document 1] Japanese Patent Publication No. 2017-104365 [Patent Document 2] Japanese Patent Publication No. 2017-210078 [Patent Document 3] Japanese Patent Publication No. 2024-090756 [Patent Document 4] Japanese Patent Publication No. 2023-062707 [Overview of the project] [Problems that the invention aims to solve]
[0008] However, conventional search methods have mainly relied on visual searching using visible light and heat source detection using infrared cameras. These methods are susceptible to the influence of natural environmental factors such as changes in ambient light, fog, rainfall, and vegetation, and therefore have certain limitations in terms of detection accuracy and identification.
[0009] Therefore, in areas where an accident is highly likely, it is conceivable that a swift and mobile search could not be conducted due to weather conditions, potentially leading to the loss of precious lives.
[0010] This invention was made to solve the above problems. By having climbers and those enjoying water sports wear LEDs that emit ultraviolet light, it is possible to use an ultraviolet camera to image survivors, injured, and deceased people awaiting rescue in mountainous areas and at sea, regardless of weather conditions and even at night. This dramatically improves search accuracy and enables mobile search support for life-saving operations with superior visibility. system and search cable support Support system Search and rescue support methods The objective is to provide. [Means for solving the problem]
[0013] Furthermore, the search and rescue support system of the present invention, which achieves the above objectives, has the following configuration.
[0014] The search support system according to the present invention houses a light-emitting diode that emits ultraviolet light of a predetermined wavelength. multiple LED devices for people moving on land or at sea The position is such that the radiation direction of the light-emitting diode does not interfere with the walking direction of the person, and the band mechanism is provided to be detachable from the person's clothing, hat, and equipment.A search support system comprising: a mounting portion for enabling wearable mounting; and a camera unit capable of detecting ultraviolet light of a predetermined wavelength emitted from the light emitting diode and capturing an image, wherein the predetermined wavelength is 200 nm to 280 nm in the UV-C band, the camera unit comprises: a first imaging unit that captures visible light from incident light; a second imaging unit that captures ultraviolet light in the UV-C band from the incident light; and an image processing unit that combines a visible image acquired by the first imaging unit and an ultraviolet image acquired by the second imaging unit respectively, and outputs combined image data capable of specifying a position of the mounting portion while visually recognizing a mover Alignment processing is performed so that the registrations match. Previous Furthermore, the LED device automatically lights up when it detects vibration or submersion. characterized by [Effects of the Invention]
[0015] According to the present invention, by using an ultraviolet camera to capture images of survivors, injured persons and deceased persons waiting for rescue in mountainous areas or at sea regardless of weather conditions and even at night, search accuracy can be significantly improved, and life-saving rescue activities with excellent visibility can be flexibly supported. [Brief Description of Drawings]
[0016] The drawings show specific embodiments of the present invention, and include not only indispensable configurations of the invention, but also alternative and preferred embodiments. [Figure 1] A diagram explaining a configuration of a search support device according to the present embodiment. [Figure 2] A diagram showing a mounting example of the LED device shown in FIG. 1. [Figure 3] A system configuration diagram showing an example of a search and rescue support system according to the present embodiment. [Figure 4] A diagram showing an operation state of a UV camera searched by a searcher boarding a helicopter shown in FIG. 3. [Figure 5] A perspective view showing an appearance of a UV camera operated by a searcher boarding a helicopter shown in FIG. 4. [Figure 6] A block diagram explaining a fusion process of a UV camera image and a visible image shown in FIG. 4. [Figure 7] A block diagram showing the configuration of the search and rescue support system according to this embodiment. [Figure 8] A block diagram illustrating the configuration of the management server shown in Figure 7. [Figure 9] Figure 5 shows an example of a fused image of the ground taken from search video acquired from a UV camera. [Figure 10] Figure 5 shows an example of a fused image of the ground taken from search video acquired from a UV camera. [Figure 11] Figure 5 shows an example of a fused image of the ground taken from search video acquired from a UV camera. [Figure 12] Figure 5 shows an example of a fused image of the ground taken from search video acquired from a UV camera. [Figure 13] Figure 5 shows an example of a fused image of the ground taken from search video acquired from a UV camera. [Figure 14] Figure 5 shows an example of a fused image of the ground taken from search video acquired from a UV camera. [Figure 15] Figure 5 shows an example of a fused image taken of the sea surface from search video acquired from a UV camera. [Figure 16] Figure 5 shows an example of a fused image taken of the sea surface from search video acquired from a UV camera. [Figure 17] Figure 5 shows an example of a fused image taken of the sea surface from search video acquired from a UV camera. [Modes for carrying out the invention]
[0017] Next, the best mode for carrying out the present invention will be described with reference to the drawings.
[0018] <System Configuration Description> [First Embodiment] Figure 1 is a diagram illustrating the configuration of the search support device shown in this embodiment.
[0019] In Figure 1, 1 is an LED device housing a light-emitting diode (ultraviolet LED) that emits ultraviolet light of a predetermined wavelength. For example, it is configured to emit UV-C in the 250-270 nm wavelength range and consists of an ultraviolet LED bulb, a battery, a control circuit, a switch, a waterproof housing, and the like.
[0020] Here, the applicant has fabricated a prototype LED device 1 that employs a low-power UV-C LED with a wavelength of 270 nm and an output of 1 mW.
[0021] LED device 1 is designed to be housed in close proximity to the human body, ensuring safety while enabling high-sensitivity detection by a UV camera during search. To measure the radiation intensity, an LS125 ultraviolet irradiance meter is used, and the ultraviolet irradiance at a distance of, for example, 10 cm from the LED surface is 7. μ W / cm 2 We measured values less than [amount missing].
[0022] Similarly, using the LS125 UV irradiance meter, for example, the UV irradiance at 20 cm is 0.1 μ W / cm 2 The measured value was less than [value missing]. This is well below the UV-C exposure limit defined in IEC 62471 and represents a safe output for the human body.
[0023] IEC 62471 is an international standard for evaluating the biological effects of light radiation emitted from light sources and lighting systems on the human eye and skin. This standard applies to a wide range of light sources, including LED and laser light sources, and is used to ensure the safety of products such as household lighting, medical devices, and toys.
[0024] Specifically, the impact on the human body is evaluated through spectral analysis of light emission and measurement of radiation levels, and the products are classified into the following four risk groups. Harmless: No impact on health. Low risk (Risk Group 1): Safe for short-term exposure. Intermediate risk (Risk Group 2): Risk may arise with prolonged exposure. High risk (Risk Group 3): Even short-term exposure may have serious effects.
[0025] Through the evaluation and certification process based on this standard, product safety is ensured, and consumers are provided with reliable products.
[0026] Furthermore, in the above standard, the exposure limit for UV-C is 3 mJ / cm². 2 (8 hours) is approximately 1 μW / cm². 2 This is equivalent to continuous exposure.
[0027] In this embodiment, UV-C is used because UV-C from sunlight is absorbed by the ozone layer and does not reach the Earth's surface, and therefore does not exist in nature. Due to this characteristic, it is possible to clearly distinguish it without background noise and maintain high visibility even during the day or night or in adverse weather conditions.
[0028] Furthermore, considering the intended use of the LED device 1 by the wearer, such as during mountain climbing or marine leisure activities, the LED device 1's body is designed to be waterproof and shock-resistant, making it usable even in harsh environments like mountain climbing and marine accidents.
[0029] Furthermore, the LED device 1 incorporates a waterproof switch (not shown) that can be manually turned ON / OFF by the user during mountain climbing or sea travel. In the future, an automatic activation system using a water-sensing sensor triggered by vibration, shock, rainfall, or submersion may be adopted.
[0030] Furthermore, the power supply for LED device 1 (not shown) uses two CR2032 button batteries in series (6V), and the power consumption is kept low, enabling continuous illumination for more than 30 hours. This power-saving design makes it possible to use the device for extended rescue operations.
[0031] Furthermore, the drive circuit for LED device 1 (not shown) is designed so that the LED remains constantly lit when the switch is turned ON. However, in the future, an astable circuit using a general-purpose timer IC such as NE555 may be adopted. This would enable blinking operation with a 1Hz period, which is expected to improve visibility and further reduce power consumption.
[0032] Furthermore, for those traveling on land or at sea, the housing is equipped with fixing belts that can be attached by sewing or adhesive, making it easy to attach to life jackets, climbing equipment, etc., with the LED device 1.
[0033] Furthermore, for the commercialization of LED device 1, it may be configured to flexibly accommodate housing shape, weather resistance, mass production capabilities, etc.
[0034] Thus, the search and rescue support device may be configured to allow the LED device 1 to be attached to a person moving on land or at sea, with a pocket on the upper shoulder side of the vest that can accommodate the attachment part, making it easy to put on and take off.
[0035] [Example of wearing] Equipment to be worn (life vest, jacket, etc.) The attachment points include a cloth wrap-around component (hold belt) that can be worn as an armband by the person in distress (user), and a pocket component that can be attached to a life vest or jacket, but there is no problem if the person traveling can be accompanied using other attachment components.
[0036] Alternatively, the LED device (UV-C wavelength) 1 may be incorporated into a helmet or ice axe in a detachable manner.
[0037] In addition to being manually activated by the user in the event of an emergency, LED device 1 can also be equipped with a mechanism that automatically activates in the event of submersion or vibration.
[0038] Figure 2 shows an example of how the LED device 1 shown in Figure 1 is installed. In this example, the LED device 1 shown in Figure 1 is housed in a pocket located on the upper shoulder of a vest worn by, for example, a climber P1.
[0039] LED devices 1-1 and 1-2 can be stored on the upper shoulder, the top of the helmet, or the side pocket of the hat when traveling on land, and on the upper shoulder of the life vest, the weight adjustment belt at the waist, or the attachment points of diving equipment when traveling at sea.
[0040] Furthermore, if LED devices 1-1 and 1-2 become smaller, they can be integrated into a single module along with the wristwatch function.
[0041] Furthermore, LED devices 1-1 and 1-2 may also be configured to include an armband that can be worn on the arm, which is attached to a pocket.
[0042] Figure 3 is a system configuration diagram showing an example of a search and rescue support system according to this embodiment, and the same reference numerals are used for components identical to those in Figure 1.
[0043] Figure 4 shows the operation status of the UV camera CA-2 being operated by searcher P2 aboard the helicopter shown in Figure 3. The helicopter H is assumed to be flying at a constant speed over a mountain route, for example at 500m, but this will vary depending on the altitude of the mountain peak along the search route.
[0044] Furthermore, helicopter H is configured to learn the history of frequent mountain accidents in each region, which is stored in the mountain rescue database located in the external memory 15-18 of the system management server 15 (described later), and to formulate its flight route. In addition, after the actual rescue operation is completed, the system is configured to store the route information flown during the rescue process in the mountain rescue database 15-14, incorporating the learned results.
[0045] At that time, the management server 15 stores the extent of the injuries of the person to be rescued, whether they are alive or not, their age, and weather information in the mountain rescue database 15-14, and also executes a process to send a warning message on a web page that can be viewed by the climber P1.
[0046] Furthermore, the management server 15 recommends that climber P1 use LED devices 1-1 and 1-2 that emit UV light, and also offers a service to deliver the actual devices to climber P1 via web order.
[0047] Furthermore, the management server 15 also provides a service that displays the activation status of LED devices 1-1 and 1-2, which are attached to the data terminal carried by climber P1, on a map application.
[0048] This allows for the system to distinguish between climber P1 moving along the climbing route and being stationary, and to control the imaging area (search area) of UV cameras CA-1 and CA-2 accordingly. Here, UV camera CA-1 functions as an unmanned ultraviolet detection camera mounted on the drone body.
[0049] Furthermore, since helicopter H, which performs mountain rescues, is equipped with a transponder, the management server 15 can constantly visually confirm the position of helicopter H on the search map screen, which will be described later. In addition, the position of helicopter H can also be displayed overlaid on the GPS information screen on the screens of the second data terminals 52-1 to 52-N, which are operated by the ground searcher P2, as described later.
[0050] In Figure 3, CA-2 is a UV camera equipped with hardware that performs the software processing described in Japanese Patent Publication No. 7442848. The UV bandpass filter is configured to match the wavelength of ultraviolet light emitted by LED devices 1-1 and 1-2.
[0051] Figure 4 is an enlarged view showing the operating state of the UV camera CA-2, which is operated by searcher P2 aboard helicopter H as shown in Figure 3.
[0052] As shown in Figure 4, searcher P2 holds the UV camera CA-2 in one hand and images the search area on the mountain route from above, capturing ultraviolet light emitted from the LED devices 1-1 and 1-2 worn by climber P1.
[0053] Figure 5 is a perspective view showing the external appearance of the UV camera CA-2 operated by searcher P2 aboard helicopter H, as shown in Figure 4.
[0054] Specifically, this figure shows the configuration of UV camera CA-2 (Japanese Patent Publication No. 7442848) which processes incident light from a subject entering through a single incident lens.
[0055] In the UV camera CA-2 shown in Figure 5, 21-1 is a cover that rotates upwards to protect the liquid crystal display 21-4 (shown by a dashed line in the figure). 31-2 is the control panel, which has buttons for switching the imaging mode and the focus position to wide-angle or telephoto, and is configured to allow adjustment of the display magnification, brightness, color tone, and white balance of the liquid crystal screen. Operation keys 31-3 are located on the control panel 31-2.
[0056] Figure 6 is a block diagram illustrating the fusion process of UV images and visible images from the UV camera CA-2 shown in Figure 4.
[0057] In the UV camera CA-2, which consists of a first imaging unit 25 and a second imaging unit 26 as shown in Figure 6, 11 is a beam splitter that separates the incident light when photographing electrical equipment into visible light 11a and ultraviolet light 11b and directs it to separate optical paths. 12 is a visible light lens that forms an image of the visible light 11a on the first visible light CCD image sensor 13. Note that in the UV camera CA-2, the power supply unit consisting of a rechargeable lithium battery is omitted.
[0058] 16 is an ultraviolet lens that transmits ultraviolet light 11b from around 250nm, and then images the transmitted ultraviolet light 11b onto a second ultraviolet CCD image sensor 18 of the MCP / UV type via a UV bandpass filter (UV filter) 17. Here, the UV bandpass filter 17 has the function of passing through the 240-280nm wavelength band of ultraviolet light 11b, which is the ultraviolet wave band emitted from LED devices 1-1 and 1-2 worn by climber P1.
[0059] Specifically, the system comprises a beam splitter 11 that separates the optical path into a first optical path system that allows visible light 11a to pass through the incident light and a second optical path system that allows ultraviolet light 11b to pass through the incident light; a first image sensor 13 that images the visible light separated by the beam splitter 11 via a visible light lens 12; a second image sensor 18 that images the ultraviolet light separated by the beam splitter 11 via an ultraviolet lens 16 and a UV bandpass filter 17; an image processing unit 19 that performs specific image processing on the ultraviolet image data captured by the second image sensor 18; and an image synthesis unit 14 that generates output image data by combining the visible image data captured by the first image sensor 13 and the ultraviolet image data output from the image processing unit 19, all housed in a portable housing, wherein the specific image processing performed by the image synthesis unit 14 is a predetermined machine learning image registration process applied to the visible image data and the ultraviolet image data.
[0060] This allows for the extraction of ultraviolet images in the 200-400nm wavelength range emitted from LED devices 1-1 and 1-2 worn by climber P1, even when affected by atmospheric ultraviolet radiation. The speckle range of the UV bandpass filter 17 is 240-280nm. Furthermore, the focusing lens employs a dual lens system with both wide-angle and telephoto lenses, enabling rapid switching between wide-area and local imaging.
[0061] Furthermore, the incident lens of the imaging device shown in this embodiment is composed of multiple focal lens groups, and each of these focal lens groups consists of a first lens group that focuses on the wide-angle side and a second lens group that focuses on the telephoto side, and the focal position can be switched to the wide-angle side or the telephoto side by the operation unit 31-2 described above.
[0062] Furthermore, the image synthesis unit 14 combines a first image data 22, which captures the ground scenery by focusing it as visible light 11a as described later, with a second image data 23, which is an ultraviolet image corresponding to the ultraviolet light 11b emitted from LED devices 1-1 and 1-2 moving along the mountain route. This allows for the generation of a third image data 24 by superimposing the first image data 22 showing the scenery with the second image data 23, which identifies the marked locations indicating the position of climber P1 that would otherwise be missed in a normal visual search, and the first image data 22 showing the scenery, through a simple operation of capturing images of the mountain route from the ground or from above.
[0063] The generated third image data 24 can be output to a display device acting as the management server 15, to a data terminal operated by a searcher via the management server 15, or stored in internal memory or external memory (including SD memory and USB memory) as described later.
[0064] This allows UV data captured by climber P1's LED devices 1-1 and 1-2, stored in external memory (described later), to be stored in a mountain database on an annual basis, associated with the date, time, and weather conditions (temperature, humidity, wind speed, and wind direction). This enables the identification of hotspots (places prone to accidents) that should be searched for on each mountain route, and this information can be reflected in the search area determination process formulated by the management server 15.
[0065] 19 is an image processing unit that performs image processing based on either MCP or UV, and then outputs the image data to the management server 15 via the image synthesis unit 14.
[0066] Here, the multiplier microchannel plate (MCP) of the image processing unit 19 performs image processing to convert invisible vacuum ultraviolet light into the emission of visible phosphors that can be easily detected by photodiode arrays (PDAs) or charge-coupled devices (CCDs).
[0067] The image processing unit 19 can capture ultraviolet light 11b emitted by LED devices 1-1 and 1-2 worn by the missing person, which are difficult to recognize in the visible light range, and generate UV image data.
[0068] The image synthesis unit 14 superimposes the first image data 22 output from the first CCD image sensor 13 and the second image data 23 corresponding to the UV image processed by the image processing unit 19 for ultraviolet light 11b, while the images are aligned, to generate a third image data 24 that identifies the positions of the LED devices 1-1 and 1-2 worn by climber P1.
[0069] Specifically, the image synthesis unit 14 performs a first image processing step, which involves performing a predetermined machine learning image registration process on the visible image data and the ultraviolet image data, and a second image processing step, which involves performing a predetermined machine learning image registration process on the visible image data and the ultraviolet image data.
[0070] Furthermore, the image synthesis unit 14 performs specific image processing on the ultraviolet image data, including noise reduction.
[0071] As a result, even when UV cameras CA-1 and CA-2 capture images of a natural environment exposed to natural ultraviolet light during the daytime, such as the area around a mountain trail where climber P1 is moving, the management server 15 or data terminal can confirm images that pinpoint the locations of the LED devices 1-1 and 1-2 worn by climber P1, as shown in Figure 3.
[0072] 15 is a management server, which displays the third image data 24 generated by the image synthesis unit 14 on its display unit. Alternatively, a wireless communication device may be connected between the image synthesis unit 14 and the management server 15, allowing the search image data to be viewed on an external display device installed at a remote management station via Wi-Fi. The display unit is activated by opening a shielding cover on the top of the UV camera CA-2 body and is, for example, composed of a small liquid crystal display.
[0073] Furthermore, the UV camera CA-2 is configured to display images captured manually by ground search and rescue team members in a color that can distinguish ultraviolet light, such as red, on a monitor device, such as a smartphone screen.
[0074] Furthermore, the UV camera CA-2 is configured to display ultraviolet 11b emitted from ultraviolet LEDs (LED devices 1-1, 1-2) worn by climbers, for example, climbers, in a distinguishable color, such as red, when a searcher P2 manually operates the camera from an aircraft such as a helicopter H to take aerial photographs of ridges and valleys along mountain climbing routes from a predetermined altitude above the mountainous area to be searched. The image captured of the search area can be displayed on a monitor device equipped with the camera, or on a smartphone screen, for example.
[0075] Furthermore, by performing resist alignment between the visible image position and the ultraviolet image position, the precise discharge location can be identified. In addition, ultraviolet light is directional, and by attaching multiple miniaturized LED devices 1-1 and 1-2 to the arm, hat, or life vest of the climber (person being rescued) P1, the detectability of ultraviolet light 11b is significantly improved.
[0076] Furthermore, even if the LED device 1 is lying down in a way that blocks the transmitting surface, if ultraviolet light is being emitted from either of the attached LED devices 1-1 or 1-2, the likelihood of detecting the person to be rescued increases.
[0077] The UV camera CA-2, while mounted and fixed to the drone D operated by searcher P2 as shown in Figure 3, receives imaging commands from a manual controller (or remote control commands from the management server 15) as it flies over the search area. It then analyzes the image data transmitted from each designated point over the designated search area to determine the location of the missing person, performing highly accurate search imaging processing in conjunction with the drone D's location information (GPS).
[0078] This system uses two types of UV cameras depending on the search method: a small UV camera CA-2 for imaging by the searcher, and an ultralight UV camera CA1-1 mounted on drone D to image a specific altitude range.
[0079] Specifically, for searches using manned helicopters (H), a portable UV camera (CA-2), such as model MetaUVI-100PHC, will be used, while for searches using unmanned aerial vehicles (drones), a small, lightweight drone-mounted UV camera (CA-1), such as model MetaUVI-100DRM, will be used.
[0080] Both UV cameras, CA-1 and CA-2, have two independent optical paths for visible light and ultraviolet (UV) light. After performing image preprocessing such as noise reduction on the captured images, the two images are spatially aligned using machine learning-based image registration with GoogleNet. Furthermore, it is possible to visually clarify the source of UV radiation through image fusion processing using the inverse wavelet transform.
[0081] Furthermore, the two UV cameras, CA-1 and CA-2, are equipped with a UV bandpass filter 17 that supports the 240-280nm band, enabling clear detection of UV signals day and night. They also have a built-in UV light image intensifier, allowing for high sensitivity even to weak UV-C signals. This enables rapid searching over long distances and wide areas. Table 1 shows a comparison of the functional configurations of the two UV cameras.
[0082] [Table 1]
[0083] Figure 7 is a block diagram showing the configuration of the search and rescue support system according to this embodiment. Components identical to those shown in Figure 6 are denoted by the same reference numerals.
[0084] In Figure 7, the management server 15 is configured to communicate bidirectionally via the network NET with the first data terminals 51-1 to 51-N operated by climber P1, the second data terminals 52-1 to 52-N operated by ground searcher P2, the first UV cameras CA-1-1 to CA-1-N mounted on multiple drones D, and the second UV cameras CA-2-1 to CA-2-N operated by searcher P2 aboard multiple helicopters H, via platform 15A.
[0085] Figure 8 is a block diagram illustrating the configuration of the management server 15 shown in Figure 7, and the same reference numerals are used for components identical to those in Figure 7.
[0086] In Figure 8, 15-11 is the communications unit, which performs communication processing via the network NET between the first data terminals 51-1 to 51-N, the second data terminals 52-1 to 52-N operated by ground searchers P2, the first UV cameras CA-1-1 to CA-1-N mounted on multiple drones D, and the second UV cameras CA-2-1 to CA-2-N operated by searchers P2 aboard multiple helicopters H.
[0087] 15-19 is the AI support unit, which uses image information received from the first UV cameras CA-1-1 to CA-1-N mounted on multiple drones D and the second UV cameras CA-2-1 to CA-2-N operated by search and rescue personnel aboard multiple helicopters H, along with mountain accident information (including location, time, gender, age, and weather information) stored in the mountain rescue database 15-14, to support probability calculation processing to determine whether the person awaiting rescue is still alive.
[0088] 15-13 is the CPU, which loads programs stored in external memory 15-18 into RAM 15-16 and performs data processing.
[0089] In RAM15-16, 15-16-1 is the first processing unit, which extracts location information from received image information, etc., and performs the process of identifying the rescue point to be rescued.
[0090] 15-16-2 is the second processing unit, which performs the process of assigning the deployment of helicopter H and drone D according to the identified rescue point, and instructs the pilot of helicopter H on the flight route, as well as the operator of drone D on the flight route.
[0091] 15-16-3 is the third processing unit, which executes the process of generating a rescue map according to the flight route instructed by the second processing unit 15-16-2.
[0092] 15-16-4 is the fourth processing unit, which updates the mountain rescue information stored in the mountain rescue database 15-14 each time a rescue operation is completed. At that time, 15-16-5 is the AI judgment unit, which calculates the survival rate at the location of the mountain accident based on the survival information of the rescued person. Information is generated on the mountain map site (intended to be published on the web) to warn that the area is a place where accidents such as falls frequently occur.
[0093] Furthermore, the fourth processing unit 15-16-4 supports the service of providing the information generated by the AI judgment unit 15-16-5 to the mountain map site (a site that sponsors this system).
[0094] 15-17 is a display that shows a rescue map generated by the third processing unit 15-16-3 according to the image data transmitted from UV cameras CA-1 and CA-2, with the map being updated as it progresses.
[0095] Furthermore, the management server 15 is equipped with multiple displays 15-17, configured to allow multiple rescue support personnel to quickly take agile responses while viewing the display screen. Specifically, this includes processing the reporting of the current situation via data communication to the mountain rescue team, as well as collecting information such as the rescuer's physical condition and the extent of their injuries.
[0096] [Simulated Mountain Search Test] To verify the effectiveness of the system shown in this embodiment, a simulated experiment simulating a mountain search operation was conducted.
[0097] The experiment used a straight paved road on land, and, simulating observations from above, took images while varying the distance between the prototype ultraviolet LED and the UV camera.
[0098] Figures 9 to 14 show examples of fused images of the ground taken from search video acquired from the UV camera shown in Figure 5. The UV detection results on the ground at the following different straight-line distances will be examined.
[0099] In Figures 9 to 14, the rectangular regions Oj-1 to Oj-6 observed in the center of the image display spots corresponding to the amount of ultraviolet light detected. In the video footage, these UV signals are clearly displayed as flashing red spots, and we consider that they are more visible than in still images.
[0100] Furthermore, the screen may be configured to display the relative value of the ultraviolet intensity detected in real time as a numerical value, and the way in which the intensity decreases according to the distance between the UV camera and the subject was examined from the displayed content.
[0101] In this demonstration test, the location of the light emission was clearly visible even at a maximum observation distance of 2.0 km, demonstrating that this system has high detection performance even in long-range searches (see Figures 9 to 14).
[0102] On the other hand, we considered that at distances of 2.5 km or more, the visibility of ultraviolet signals decreases significantly, making them difficult to distinguish.
[0103] [Simulated Maritime Search and Rescue Test] To verify the effectiveness of the system shown in this embodiment, a simulated experiment simulating a maritime search was conducted.
[0104] The experiment used the sea area around Odaiba in Tokyo, and, simulating observations from above, acquired images while varying the distance between the prototype ultraviolet LED and the UV camera.
[0105] Figures 15-17 show examples of fused images of the sea surface taken from search video acquired from the UV camera shown in Figure 5. The UV detection results at sea surface at the following different straight-line distances will be examined.
[0106] In Figures 15 to 17, the rectangular regions Oj-7 to Oj-9 observed in the center of the image display spots corresponding to the amount of ultraviolet light detected.
[0107] In this test, as with the results from land-based experiments, we concluded that the luminous location was clearly visible at a maximum observation distance of 2.0 km. We also noted that visibility decreased beyond 2.5 km.
[0108] The following describes the advantages (effects) of the search method using a UV camera as shown in this embodiment, in comparison to a conventional search method using a camera.
[0109] The characteristics of UV cameras in natural environments are as follows:
[0110] The LED device 1 shown in Figure 1 emits ultraviolet (UV-C) wavelengths, which do not exist in the natural environment, resulting in very little interference from sunlight or artificial lighting. Therefore, artificial signals using UV-C can be detected selectively and with high accuracy, and the risk of false detection is extremely low.
[0111] A key feature is that it maintains a high level of object identification even during daylight hours and in adverse weather conditions.
[0112] In this example, we show the results of a comparison with conventional methods, confirming that the method using UV-C signals is effective for wide-area and long-distance searches and enables rapid location identification.
[0113] Furthermore, by combining this with AI-powered image recognition capabilities in the future, it is expected that the accuracy of detecting injured people awaiting rescue and recovering bodies will be improved, while simultaneously making search operations more efficient and labor-saving.
[0114] [Effects of this embodiment] According to this embodiment, the next-generation rescue support method, based on remote search technology combining an ultraviolet LED device worn by the person being searched and a UV camera, uses UV-C wavelength signals that do not exist in nature, thereby maintaining high identification accuracy during the day, at night, and even in adverse weather conditions, and supporting wide-area and rapid search and rescue operations with fewer false detections.
[0115] Furthermore, the system's configuration is extremely simple, and its compact size, light weight, and low cost allow for long periods of continuous operation using inexpensive batteries, making it highly portable and practical.
[0116] Furthermore, by backing up the drone's battery set with at least 3 to 5 fully charged sets, sufficient search and imaging time can be ensured even if the drone's flight time is limited.
[0117] [Second Embodiment] The following describes a series of search procedures for rescuing a climber, assuming that the climber actually slips and falls while moving along a climbing route. In this embodiment, when the climber is on a regular route assumed by the mountain rescue team, the climber themselves declares the climbing route upon entering the mountain and the process of confirming their descent is performed.
[0118] The general procedure for reporting a mountain climb is as follows:
[0119] (1) When applying online, you can easily submit your climbing plan from your smartphone or PC by using climbing apps such as "Compass" or "Mountain Map".
[0120] (2) When submitting to a police station or mountain climbing post, submit a paper climbing plan to the police station that has jurisdiction over the mountain you plan to climb or to the mountain climbing post located at the trailhead.
[0121] (3) When submitting by email or fax, some prefectures accept mountain climbing notifications by email or fax.
[0122] (4) If the scheduled time for descending the mountain has passed and a family member has called 110 to report that the climber's identity has not been confirmed, the police will contact the relevant mountain rescue team (which may be established by each prefectural police department or organized as part of a wider search network) and begin the search.
[0123] In both cases, if a search system is constructed using electronic devices (data terminals) that rescue workers can use for investigation, communication will be possible between the rescue team's communication devices and the platform 15A of the prefectural police's management server 15, which oversees the entire system.
[0124] Here, the management server 15 periodically receives the first ultraviolet detection results from the ground search team members traversing the mountain route and flying drone D, and performs the task of marking the traversed mountain route on a digital map.
[0125] The management server 15 receives transponder signals transmitted from helicopter H, which is responsible for a search area different from the marked area, and supports wide-area aerial search operations.
[0126] In this scenario, helicopter H carries a search and rescue team member, who, armed with a UV camera CA-2, captures images of ultraviolet 11b emitted from the search area from above. The system is configured to automatically transfer the images captured by the UV camera CA-2 to a pre-configured URL account (the platform mentioned above) along with GPS information and transponder signals.
[0127] Furthermore, it is possible for search and rescue team members to enter the mountain via mountain routes equipped with a UV camera CA-2.
[0128] By organizing search and rescue teams across such a wide area, it becomes possible to support more mobile and rapid life-saving operations in mountainous regions where the likelihood of accidents is high.
[0129] In particular, even when using binoculars to rescue a person from above, if the person is only recognizable as a dot from an altitude of over 500m, the ultraviolet light 11b emitted from LED devices 1-1 and 1-2 can be displayed as, for example, a red image on the corresponding screen on the subject being imaged. This dramatically improves the probability of finding and rescuing the person in the initial search, and even if the person is unable to move, their current location can be marked, resulting in a much higher survival rate.
[0130] Furthermore, the LED device 1 shown in Figure 1 may be configured to allow a small loudspeaker to be attached as an optional, detachable device.
[0131] This allows survivors, if they can see helicopter H, to emit a directional voice signal upwards, which can then be heard by the searcher P2 on helicopter H or retrieved by the helicopter H's microphone.
[0132] Furthermore, in the event that a climber is injured by falling rocks while bivouacking on a rocky outcrop, the configuration may allow the LED device 1 to be attached to a rod-shaped member extending from the tent.
[0133] This means that the same effect can be expected not only on hiking trails but also when rock climbing.
[0134] Furthermore, the LED device 1 may be equipped with a function to check the remaining battery level, allowing users to anticipate situations where the battery might run out during mountain climbing and to visually confirm this fact. [Industrial applicability]
[0135] This next-generation search and rescue support system, combining ultraviolet LEDs and UV cameras, utilizes highly visible artificial signals to enable faster and more reliable detection with fewer false positives compared to conventional visual or infrared detection methods. This technology is expected to have applications in a variety of situations, including the following:
[0136] First, as a measure against mountain accidents among mountain climbers and trail runners, wearing a portable ultraviolet LED signal transmitter can ensure visibility from above even at night or in bad weather. Furthermore, for maritime workers, fishermen, or those adrift at sea, it is expected that the flashing signal can be reliably detected even on the waves, serving as a means of maritime rescue.
[0137] Furthermore, it is effective in assisting with the location identification of elderly people, especially those with dementia, who wander off, and in the early detection of evacuees and missing persons during large-scale disasters such as earthquakes and floods, and has the potential to be implemented as part of public safety and disaster prevention infrastructure.
[0138] Thus, this solution is expected to develop as a new social implementation technology that realizes highly efficient and labor-saving search support in a variety of application scenarios.
[0139] Similarly, for this reason, it is expected to be applied to a variety of rescue and monitoring scenarios, such as mountain accidents, drifting at sea, support for evacuees during disasters, and monitoring the elderly. In the future, it is expected to be implemented in society as a foundational technology supporting smart rescue.
[0140] In the search example shown in this embodiment, a wide area is searched from above using an unmanned aerial vehicle (drone) or a manned helicopter equipped with an ultraviolet camera, and the ultraviolet light emitted from the LED device is detected with high sensitivity to quickly and reliably determine the location.
[0141] The disclosure relating to the present invention described above can be summarized to at least the following:
[0142] (1 ) place It contains a light-emitting diode that emits ultraviolet light of a constant wavelength. multiple LED devices for people moving on land or at sea The position is such that the radiation direction of the light-emitting diode does not interfere with the walking direction of the person, and the band mechanism is provided to be detachable from the person's clothing, hat, and equipment.A search support system comprising a mounting unit that can be attached to the device for portability, and a camera unit capable of detecting and imaging ultraviolet light of a predetermined wavelength emitted from the light-emitting diode, wherein the predetermined wavelength is 200 nm to 280 nm in the UV-C band, and the camera unit comprises a first imaging unit that images visible light from the incident light, a second imaging unit that images ultraviolet light in the UV-C band from the incident light, and a visible image acquired by the first imaging unit and an ultraviolet image acquired by the second imaging unit. Alignment processing is performed so that the registration matches each image. Synthesize and visually identify the moving person Previous The system includes an image processing unit that outputs composite image data capable of identifying the position of the marking attachment part, and Furthermore, the LED device automatically lights up when it detects vibration or submersion in water. It is characterized by doing so.
[0143] (2) The light-emitting diode is characterized by being powered by a button battery.
[0144] (3) The camera unit is characterized by being mounted on an autonomously flying drone. .
[0145] (4) The camera unit mounted on the drone is characterized by comprising a communication unit that transmits captured composite image data to a management server. .
[0146] (5) Handheld UV detection camera It is characterized by being operated by multiple search and rescue personnel aboard the aircraft.
[0147] (6) The drone body is characterized by starting a search flight from the ground. .
[0148] (7) The drone body is characterized by detaching from an aircraft flying at a predetermined altitude and commencing a search flight. .
[0149] (8) A light-emitting diode that emits ultraviolet light of a predetermined wavelength is housed in multiple LED devices for people moving on land or at sea The position is such that the radiation direction of the light-emitting diode does not interfere with the walking direction of the person, and the band mechanism is provided to be detachable from the person's clothing, hat, and equipment.A search support method for a search support system comprising a mounting part that can be attached so as to be carried along, and a camera unit capable of detecting and imaging ultraviolet light of a predetermined wavelength emitted from the light-emitting diode, wherein the predetermined wavelength is 200 nm to 280 nm in the UV-C band, and the camera unit comprises a first imaging step of imaging visible light from the incident light, a second imaging step of imaging ultraviolet light in the UV-C band from the incident light, a visible image acquired in the first imaging step, and an ultraviolet image acquired in the second imaging step. Alignment processing is performed so that the registration matches each image. Synthesize and visually identify the moving person Tsu The image processing step includes outputting composite image data that can identify the position of the mounting part. Furthermore, the LED device automatically lights up when it detects vibration or submersion in water. It is characterized by doing so. [Explanation of Symbols]
[0151] 1-1 LED Devices 1-2 LED Devices 15 Management Server CA-1 UV Camera CA-2 UV Camera
Claims
1. A mounting unit is provided to attach multiple LED devices, each containing a light-emitting diode that emits ultraviolet light of a predetermined wavelength, to the clothing, hat, or equipment of a person moving on land or at sea, in a position where the direction of radiation from the light-emitting diodes does not interfere with the walking direction of the person, and which is equipped with a band mechanism that allows the device to be attached and carried along by the person. A search support system comprising: a camera unit capable of detecting and imaging ultraviolet light of a predetermined wavelength emitted from the light-emitting diode, The predetermined wavelength is 200 nm to 280 nm in the UV-C band. The camera unit includes a first imaging unit that captures visible light from the incident light, A second imaging unit that images ultraviolet light in the UV-C band from the incident light, The system includes an image processing unit that performs alignment processing on a visible image acquired by the first imaging unit and an ultraviolet image acquired by the second imaging unit so that the registrations of each image match, and then synthesizes them to output synthesized image data that allows the position of the attachment to be identified while visually identifying a moving person. The aforementioned LED device is a search support system characterized by automatically lighting up when it detects vibration or submersion.
2. The search support system according to claim 1, characterized in that the light-emitting diode is a battery-powered LED light source.
3. The search support system according to claim 1 or 2, characterized in that the camera unit is mounted on an autonomously flying drone.
4. The search support system according to claim 3, characterized in that the camera unit mounted on the drone includes a communication unit that transmits captured composite image data to a management server.
5. The search support system according to claim 4, characterized in that the handheld ultraviolet detection camera is operated by multiple searchers aboard the aircraft.
6. The search support system according to claim 4, characterized in that the drone body starts the search flight from the ground.
7. The search support system according to claim 4, characterized in that the drone body detaches from an aircraft flying at a predetermined altitude and begins a search flight.
8. A mounting unit is provided to attach multiple LED devices, each containing a light-emitting diode that emits ultraviolet light of a predetermined wavelength, to the clothing, hat, or equipment of a person moving on land or at sea, in a position where the direction of radiation from the light-emitting diodes does not interfere with the walking direction of the person, and which is equipped with a band mechanism that allows the device to be attached and carried along by the person. A search support method for a search support system comprising a camera unit capable of detecting and imaging ultraviolet light of a predetermined wavelength emitted from the light-emitting diode, The predetermined wavelength is 200 nm to 280 nm in the UV-C band. The camera unit performs a first imaging step of capturing visible light from the incident light, A second imaging step in which ultraviolet light in the UV-C band is imaged from the incident light, The system includes an image processing step which involves performing alignment processing on the visible image acquired in the first imaging step and the ultraviolet image acquired in the second imaging step so that the registrations of each image match, and then synthesizing them to output a synthesized image data that allows the position of the attachment to be identified while visually identifying a moving person. The aforementioned LED device is characterized by automatically lighting up when it detects vibration or submersion in water, and is used as a search support method for a search support system.
Citation Information
Patent Citations
Missile launcher
JP1994018193A
Search and rescue using ultraviolet radiation beam
JP2015007631A
Manned drone
JP2017104365A
Human life rescue device
JP2017210078A
Search system
JP2020037353A