Hardware equipped with multiple multi-complex sensors for human detection

Abstract

The present invention relates to hardware equipped with multiple multi-composite sensors for human detection, and more specifically, to a wearable device equipped with multiple multi-composite sensors for human detection, characterized by comprising a hardware part provided in the form of a wearable part or a movable robot part that can be worn or fixed to a part of a user's body, and a composite sensor module coupled to said hardware part to collect comprehensive information about the user's surrounding environment and provide the collected information to a user wearing said wearable part or to a control center or a manager supervising the user from a distance.

Description

Technology Field

[0001] The present invention relates to hardware equipped with multiple multi-composite sensors for human detection, and more specifically, to a wearable device equipped with multiple multi-composite sensors for human detection, characterized by comprising a hardware part provided in the form of a wearable part or a movable robot part that can be worn or fixed to a part of a user's body, and a composite sensor module coupled to said hardware part to collect comprehensive information about the user's surrounding environment and provide the collected information to a user wearing said wearable part or to a control center or a manager supervising the user from a distance. Background Technology

[0003] The content described in this section merely provides background information regarding the present invention and does not constitute prior art.

[0004] At fire scenes, rescuers generally face difficulties in carrying out rescue operations due to smoke generated by combustion.

[0005] Therefore, ensuring the rescuer's visibility is considered crucial for smooth rescue operations in disaster situations such as fires, and goggles serve as a solution. However, even when wearing goggles, visibility is difficult due to smoke.

[0006] Devices equipped with visual sensors as auxiliary devices to ensure visibility are currently being developed. However, these sensing devices also require light, just like the human eye, and present a problem in that their performance can be significantly degraded by atmospheric conditions such as fog, haze, smoke, heatwaves, and smog.

[0007] Meanwhile, fires often cause significant damage due to hot flames and toxic gases from combustion. In particular, when high-temperature flames occur and there is a risk of explosion, firefighters may not only be unable to effectively suppress the fire even if they are deployed to the scene, but in cases where the flames are severe, they may also be unable to approach the scene.

[0008] In particular, there were problems such as the inability to effectively suppress fires in confined spaces where people or firefighting equipment could not access.

[0009] Although various firefighting robots or devices designed to be deployed to fire scenes in place of humans have been disclosed to address these problems, the firefighting robots invented to date are not effective and are therefore not being properly utilized in actual field situations.

[0010] In order to solve the problems of rescue activities by rescuers in the aforementioned fire and disaster situations, some domestic and overseas companies have conducted research on sensing modules to secure the rescuer's field of vision or accurately identify information such as the surroundings (or objects). However, there have been no cases of full-scale commercialization because the cost required to equip such a structure for actual productization was excessive, or even if not, the sensing effect was not significant compared to the manufacturing cost of the device, resulting in low market competitiveness.

[0011] Therefore, as described above, the development of a device capable of solving the problems of the conventional technology is required. The problem to be solved

[0014] The problem to be solved by the present invention is to compensate for the disadvantages of the aforementioned prior art, and the objective of the present invention is as follows.

[0015] First, we aim to provide hardware equipped with a composite sensor module capable of more accurately identifying information about the surroundings and objects at sites requiring rescue, such as disaster and fire scenes.

[0016] Second, we aim to provide hardware equipped with a composite sensor module that can form a separate space on the front of the sensor module and circulate gas within the separate space so as to acquire accurate information even in a narrow field of view caused by external environments such as smoke and foreign substances.

[0017] Third, we aim to provide hardware equipped with a composite sensor module applicable to various applications, such as a wearable form that can be worn on the body of a user, such as a rescuer, or a robot form that can move without human intervention.

[0018] The problems of the present invention are not limited to those mentioned above, and other problems not mentioned will be clearly understood by those skilled in the art from the description below. means of solving the problem

[0020] According to the present invention, a wearable device equipped with a multi-composite sensor for human detection is provided, characterized by comprising a wearable part that can be worn or fixed to a part of a user's body, and a composite sensor module coupled to the wearable part to collect comprehensive information about the user's surrounding environment and provide the collected information to the user wearing the wearable part or to a control center or a manager supervising the user from a distance.

[0021] At this time, the wearable part may have a certain rigidity to prevent damage caused by external forces applied to the user's body.

[0022] In addition, it may include a display unit capable of outputting images or videos so that the user can visually check the information collected from the composite sensor module.

[0023] Furthermore, the composite sensor module may include a housing containing a hollow receiving space, a first sensor unit embedded in the housing capable of detecting visual information, and a second sensor unit embedded in the housing capable of detecting auditory information.

[0024] Meanwhile, the first sensor unit may include an RGB camera unit capable of acquiring an image of the user's surroundings (or object), a thermal imaging unit capable of acquiring a thermal image of the user's surroundings (or object), and an infrared depth unit capable of acquiring information regarding the distance or direction of the user's surroundings (or object).

[0025] At this time, the second sensor unit may be a pair of stereo microphones positioned on each side of the housing of the composite sensor module to improve the detection accuracy of auditory information that may vary depending on the user's location.

[0026] In addition, it may include an air curtain section capable of removing smoke and foreign substances present on the front of the housing so as to improve the detection accuracy of the first sensor section.

[0027] Furthermore, the air curtain section may include a space-forming section positioned at the front of the housing to form a space separate from the housing's receiving space and having its front surface formed of a transparent material to ensure visibility, an exhaust section located on at least one of the upper, lower, left, or right sides of the space-forming section and formed in the shape of a hole to allow gas inside the receiving space of the space-forming section to pass through, and a circulation section for circulating gas present inside the space-forming section.

[0028] Therefore, the above composite sensor module is not directly exposed to the external environment and can sense the environment that is primarily filtered by the air curtain section.

[0029] Meanwhile, it may include a communication unit capable of transmitting and receiving data to remotely provide information collected from the composite sensor module to an administrator, and a control unit capable of storing information collected from the composite sensor module, fusing data or synchronizing it with the administrator's medium, and performing a calibration operation to remove noise caused by the external environment.

[0030] Additional means of solution of the present invention will be partially described in the following description, which may be partially easily identified from the description, or may be obtained through the practice of the present invention.

[0031] The foregoing general description and the following detailed description are merely illustrative and illustrative and do not limit the invention as described in the claims. Effects of the invention

[0033] The effects of the present invention configured as described above are explained as follows.

[0034] First, by being equipped with a composite sensor module capable of collecting both visual and auditory information, information about the surroundings and objects can be identified more accurately at sites requiring rescue, such as disaster and fire scenes.

[0035] Second, by forming a separate space on the front of the sensor module and circulating gas within the separate space, accurate information can be obtained even in a narrow field of view caused by external environments such as smoke and foreign substances.

[0036] Third, it can be applied to various applications, such as wearable forms that can be worn on the body of users, such as rescuers, or robot forms that can move without human intervention.

[0037] The effects of the present invention are not limited to those mentioned above, and other unmentioned effects will be clearly understood by those skilled in the art from the description in the claims. Brief explanation of the drawing

[0039] FIG. 1 is a detailed diagram of hardware equipped with multiple multi-composite sensors for human detection according to an embodiment of the present invention. FIG. 2 is a detailed view of a composite sensor module according to an embodiment of the present invention. FIG. 3 is a drawing illustrating hardware according to an embodiment of the present invention being implemented as a wearable device. FIG. 4 is a drawing illustrating hardware according to an embodiment of the present invention being implemented as a robot device. FIG. 5 is a detailed view of the air curtain section of a composite sensor module according to one embodiment of the present invention. Specific details for implementing the invention

[0040] Hereinafter, specific embodiments of the present invention will be described in detail with reference to the attached drawings.

[0041] However, in describing a specific embodiment of the present invention, if it is determined that a detailed description of related known functions or configurations could unnecessarily obscure the essence of the present invention, such detailed description is omitted.

[0042] The aforementioned objects, features, and advantages of the present invention will become more apparent from the following detailed description in conjunction with the accompanying drawings. However, as the present invention is subject to various modifications and may include various embodiments, specific embodiments are illustrated in the drawings and described in detail below.

[0043] If it is determined that a detailed description of known functions or configurations related to the present invention could unnecessarily obscure the essence of the invention, such detailed description is omitted. Furthermore, numbers used in the description of this specification are merely identification symbols to distinguish one component from another.

[0044] Furthermore, the suffix "bu" for components used in the following description is used merely to facilitate the drafting of the specification or for interchangeable purposes, and does not inherently possess a distinct meaning or role.

[0046] FIG. 1 is a detailed diagram of hardware equipped with multiple multi-composite sensors for human detection according to an embodiment of the present invention.

[0047] FIG. 2 is a detailed view of a composite sensor module according to an embodiment of the present invention.

[0048] According to the present invention, a wearable device equipped with a multi-composite sensor for human detection can be provided, characterized by including a wearable part that can be worn or fixed to a part of a user's body, and a composite sensor module coupled to the wearable part to collect comprehensive information about the user's surrounding environment and provide the collected information to the user wearing the wearable part or to a control center or a manager supervising the user from a distance.

[0050] FIG. 3 is a drawing illustrating hardware according to an embodiment of the present invention being implemented as a wearable device.

[0051] FIG. 4 is a drawing illustrating hardware according to an embodiment of the present invention being implemented as a robot device.

[0052] The wearable part can be designed to be worn on the user's head, torso, arms, legs, etc.

[0053] Various means of attachment, such as Velcro and zippers, may be adopted for the wearable part. The wearable part may be designed to be detachable from clothing or provided as an embedded fixed part.

[0054] Meanwhile, hardware equipped with multiple multi-composite sensors for human detection according to another embodiment of the present invention may be provided in the form of a robot unit that is movable at the site.

[0055] The robot part can be designed in various forms, such as a mobile type capable of moving on the ground or a flying type.

[0056] Meanwhile, for convenience, specific embodiments of the present invention described below are assumed to be in a wearable form. However, the hardware of the present invention is not limited to a wearable and may also be provided in the form of a robot part as described above.

[0057] The above-mentioned wearable part may have a certain rigidity to prevent damage caused by external forces applied to the user's body.

[0058] In addition, it may include a display unit capable of outputting images or videos so that the user can visually check the information collected from the composite sensor module.

[0059] The form of the display unit may vary depending on the type of wearable unit. For example, if the wearable unit is a helmet type, body type, leg-removable type, etc., the wearable unit and the display unit must be provided separately so that the user can view the screen of the display unit.

[0060] In contrast, in the case of a form that can be worn on the arm, wrist, etc., the wearable part and the display part can be formed as a single unit.

[0061] The above composite sensor module may include a housing that is detachably coupled to a helmet when worn on a user's head, has one side configured to correspond to the shape of the helmet, and includes a hollow receiving space, a first sensor unit embedded in the housing capable of detecting visual information, and a second sensor unit embedded in the housing capable of detecting auditory information.

[0062] Meanwhile, the first sensor unit may include an RGB camera unit capable of acquiring an image of the user's surroundings (or object), a thermal imaging unit capable of acquiring a thermal image of the user's surroundings (or object), and an infrared depth unit capable of acquiring information regarding the distance or direction of the user's surroundings (or object).

[0063] More specifically, the RGB camera sensor is an imager that collects visible light (400–700 nm), converts it into electrical signals, and then configures information to render image and video streams. However, the RGB camera unit requires light like the human eye, and its performance can be significantly degraded by atmospheric conditions such as fog, haze, smoke, heatwaves, and smog. Therefore, to compensate for this, it can be configured to acquire thermal image data through a thermal imaging unit and fuse it with the images acquired by the RGB camera unit to provide corrected information to users, rescuers, and administrators.

[0064] Meanwhile, the infrared depth unit may include at least one of an IR depth camera, an IR camera, and an IR-UWB radar.

[0065] The second sensor unit may be a pair of stereo microphones positioned on each side of the housing of the composite sensor module to improve the detection accuracy of auditory information that may vary depending on the user's location.

[0066] More specifically, a microphone sensor may be provided to effectively secure auditory data at an indoor fire scene, particularly auditory data regarding human lives. Depending on the location of the user or rescuer, the angle and distance of the composite sensor module change, and the accuracy of sensing may vary accordingly. Therefore, to obtain auditory information with improved accuracy, a pair of stereo microphones may be provided on the left and right sides of the housing.

[0067] FIG. 5 is a detailed view of the air curtain section of a composite sensor module according to one embodiment of the present invention.

[0068] It may include an air curtain section capable of removing smoke and foreign substances present on the front of the housing so as to improve the detection accuracy of the first sensor section.

[0069] Furthermore, the air curtain section may include a space-forming section positioned at the front of the housing to form a space separate from the housing's receiving space and having its front surface formed of a transparent material to ensure visibility, an exhaust section located on at least one of the upper, lower, left, or right sides of the space-forming section and formed in the shape of a hole to allow gas inside the receiving space of the space-forming section to pass through, and a circulation section for circulating gas present inside the space-forming section.

[0070] More specifically, at fire and disaster sites, high temperatures and high pressures cause dust, fog or haze, smoke, heatwaves, and smog to adversely affect rescue operations.

[0071] Inevitably, it is difficult to secure the rescuer's field of vision, and although a composite sensor module according to the present invention is provided to assist in this, the sensor module is also adversely affected by dust, fog or haze, smoke, heatwaves, smog, etc., which may reduce the accuracy of sensing.

[0072] To resolve such problems, the hardware equipped with the multi-composite sensor for human detection according to the present invention includes an air curtain unit. The air curtain unit forms a space separate from the housing. Gas circulation is induced within the separate space of the air curtain unit. If the composite sensor module is directly exposed to the external environment without the air curtain unit, smoke or other substances may accumulate on the front of the sensor module, obscuring the view and potentially interfering with sensing. However, since the air curtain unit continuously circulates gas, it prevents smoke or other substances from concentrating in one place, thereby improving the accuracy of sensing.

[0073] Therefore, the above composite sensor module is not directly exposed to the external environment and can sense the environment that is primarily filtered by the air curtain section.

[0074] Meanwhile, it may include a communication unit capable of transmitting and receiving data to remotely provide information collected from the composite sensor module to an administrator, and a control unit capable of storing information collected from the composite sensor module, fusing data or synchronizing it with the administrator's medium, and performing a calibration operation to remove noise caused by the external environment.

[0075] Meanwhile, hardware equipped with multiple multi-composite sensors for human detection according to another embodiment of the present invention may be implemented as a detection robot equipped with multiple multi-composite sensors for human detection, characterized by including a robot part movable at the site and a composite sensor module coupled to said robot part to collect comprehensive information about the user's surrounding environment and provide it to a control center or a manager supervising the user from a distance.

[0076] At this time, the composite sensor module may include a housing containing a hollow receiving space, a first sensor unit embedded in the housing capable of detecting visual information, and a second sensor unit embedded in the housing capable of detecting auditory information.

[0077] In addition, the first sensor unit may include an RGB camera unit capable of acquiring an image of the user's surroundings (or object), a thermal imaging unit capable of acquiring a thermal image of the user's surroundings (or object), and an infrared depth unit capable of acquiring information regarding the distance or direction of the user's surroundings (or object).

[0078] A detection robot equipped with multiple multi-composite sensors for human detection may include a pair of stereo microphones positioned on each side of the housing of the composite sensor module to improve the detection accuracy of auditory information that may vary depending on the user's location.

[0080] At this time, the detection robot may include an air curtain section capable of removing smoke and foreign substances present on the front of the housing so as to improve the detection accuracy of the first sensor section.

[0081] Additionally, the air curtain section may include a space-forming section positioned at the front of the housing to form a space separate from the housing's receiving space and having its front surface formed of a transparent material to ensure visibility, an exhaust section located on at least one of the upper, lower, left, or right sides of the space-forming section and formed in the shape of a hole to allow gas inside the receiving space of the space-forming section to pass through, and a circulation section for circulating gas present inside the space-forming section.

[0082] This embodiment is merely an illustrative explanation of the technical concept of the present invention, and those skilled in the art to which the present invention pertains will be able to make various modifications and variations of this embodiment within the scope of the essential characteristics of the present invention.

[0083] This embodiment is intended to explain, not limit, the technical concept of the present invention, and therefore, the scope of the rights of the present invention is not limited by this embodiment.

[0084] The scope of protection of the present invention shall be interpreted by the claims, and all technical ideas recognized as equivalent or equivalent thereto shall be interpreted as being included in the scope of rights of the present invention.

Claims

Claim 1 A wearable part that can be worn on parts of the user's body including the head, torso, arms, and legs, and is provided to be detachable from clothing; A composite sensor module comprising: a housing that is detachably coupled to a helmet when worn on the user's head, having one side configured to correspond to the shape of the helmet and including a hollow receiving space; a first sensor unit embedded in the housing capable of detecting visual information; and a second sensor unit embedded in the housing capable of detecting auditory information; coupled to the wearable unit to collect comprehensive information about the user's surrounding environment and provide the collected information to a user wearing the wearable unit or to a control center or a manager supervising the user from a distance; a space-forming unit disposed on the front of the housing, forming a space separate from the receiving space of the housing and having its front surface formed of a transparent material to secure a field of view; an exhaust unit located on at least one of the upper, lower, left, or right sides of the space-forming unit and formed in a hole shape to allow gas inside the receiving space of the space-forming unit to pass through; and a circulation unit configured to flow gas existing inside the space-forming unit, thereby removing smoke and foreign substances present on the front of the housing to improve the detection accuracy of the first sensor unit, so that the composite sensor module can directly [prevent] the external environment An air curtain unit capable of sensing an environment that is not exposed and is primarily filtered; a communication unit capable of transmitting and receiving data to remotely provide information collected from the composite sensor module to an administrator; and a control unit capable of storing information collected from the composite sensor module, fusing data or synchronizing it with the administrator's medium, and performing a calibration operation to remove noise caused by the external environment;A wearable device equipped with a multi-composite sensor for human detection, comprising: a second sensor unit comprising a pair of stereo microphones positioned on each side of the housing of the composite sensor module to improve the detection accuracy of auditory data that may vary depending on the user's location, thereby securing the auditory data of a human being at an indoor fire scene. Claim 2 A wearable device equipped with a multi-composite sensor for human detection, wherein the wearable part of claim 1 has a predetermined rigidity to prevent damage caused by external forces applied to the user's body. Claim 3 A wearable device equipped with multiple multi-composite sensors for human detection, characterized in that it includes a display unit capable of outputting images or videos so that the user can visually check the information collected from the composite sensor module according to claim 1. Claim 4 delete Claim 5 A wearable device equipped with a multi-composite sensor for human detection, characterized in that, in claim 1, the first sensor unit comprises: an RGB camera unit capable of acquiring an image of the user's surroundings (or object); a thermal imaging unit capable of acquiring a thermal image of the user's surroundings (or object); and an infrared depth unit capable of acquiring information regarding distance or direction of the user's surroundings (or object). Claim 6 delete Claim 7 delete Claim 8 delete Claim 9 delete Claim 10 delete

Images