DEVICE IN PARTICULAR FOR DETECTING AND, IF NECESSARY, IDENTIFYING AT LEAST ONE TARGET WITHIN A CERTAIN VOLUME AND ARRANGEMENT COMPRISING SUCH A DEVICE

DE602021034582T2Active Publication Date: 2025-07-23INRIA INSTITUT NATIONAL DE RECHERCHE EN INFORMATIQUE ET EN AUTOMATIQUE +1
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
DE602021034582
Authority / Receiving Office
DE · DE
Patent Type
Patents
Current Assignee / Owner
Priority Date
2020-03-03
Filing Date
2021-03-02
Publication Date
2025-07-23
Estimated Expiration
2041-03-02

AI Technical Summary

Technical Problem

Current monitoring and tracking devices require targets to wear identification systems like light-emitting diodes or chips, complicating installation and limiting their use in environments where such equipment is impractical.

Method used

A device comprising an image acquisition system with infrared, thermal, and visible cameras mounted on a common support, allowing detection and identification without requiring target-specific identification systems, with a portable design for easy assembly and maintenance, and protective covers for the cameras.

Benefits of technology

Enables target detection and identification in challenging illumination conditions with simplified installation and maintenance, while ensuring camera protection and optimized data acquisition for real-time audiovisual effects.

✦ Generated by Eureka AI based on patent content.
Patent Text Reader
Need to check novelty before this filing date? Find Prior Art

Description

[0001] The present invention relates to a device in particular for the detection and possibly the identification of at least one target within a determined volume, as well as an assembly comprising such a device.

[0002] It relates in particular to a device in particular for the detection and possibly the identification of at least one target within a determined volume, said device comprising an image acquisition system.

[0003] In many fields, and particularly in the entertainment industry, monitoring and tracking devices have been developed to enable, in particular, the tracking of the movements of people occupying the stage. These monitoring and tracking devices integrate an image acquisition system whose images are processed. These monitoring and tracking devices, operating in real time and continuously, can be coupled with lighting, video and sound control systems to enable audiovisual effects to be produced in real time from the position and movements of people on stage. However, the current design of monitoring and tracking devices requires the people to be tracked to wear a box equipped with an identification system, such as light-emitting diodes or a chip. Furthermore, imaging devices are known, as illustrated in documents US 2014 / 0139643 and US 9185391.However, such devices do not allow tracking of a target.

[0004] An aim of the invention is to propose a device in particular for the detection and possibly the identification of at least one target of the aforementioned type, the design of which makes it possible to dispense with the need to install an identification box on the targets to be tracked without compromising the ease of mounting of the device.

[0005] To this end, the invention relates to a device in particular for the detection and possibly the identification of at least one target within a determined volume, said device comprising an image acquisition system, characterized in that the image acquisition system comprises, at least one infrared camera sensitive to waves whose wavelength is between 780 and 1400 nm, a thermal camera sensitive to waves between 3000 and 14000 nm and a so-called visible camera sensitive to waves between 350 and 780 nm, in that said cameras are mounted on a common support in the form of an elongated beam-type body, in that the cameras are arranged on the common support with the fields of vision of said cameras having an intersection zone corresponding to the volume to be observed, in that the optical axes of said cameras arranged on the common support are distinct and in that the distance between the optical axes of at least two of the cameras is between 10 cm and 2 m.The combination of 3 types of cameras and their positioning on a common support allows on the one hand, a simple and rapid assembly of the device, on the other hand, an acquisition of sufficient raw data to allow, after processing of said data, a detection of at least one moving target, in particular in terms of movement and position and therefore its tracking even in difficult illumination conditions.

[0006] According to one embodiment of the invention, the common support is portable and is provided with at least one attachment member. The production of a common support appearing externally in the form of an elongated beam-type body facilitates the gripping and carrying of the device. The presence of one or more attachment members allows easy mounting of the device above a stage. The elevation of the device above a stage can be carried out easily due to the portable nature of the device.

[0007] According to one embodiment of the invention, the common support comprises a support base for receiving the cameras, a sheath-type envelope inside which the support base is configured to be inserted at least partially, said sheath envelope being provided with openings, at least some of the openings extending to the level of the optics of the cameras arranged on the support base in the inserted state of the support base in said sheath envelope. This design allows easy maintenance of the device while ensuring good protection of the sensitive components of the device, in particular during the phases of transport, storage and installation of the device.

[0008] According to the invention, the device comprises, for at least one of the cameras, at least one protective cover for the optics of said camera mounted to slide along an axis parallel to the longitudinal axis of the elongated common support for movement of the so-called active part of said cover between an active position for protecting the optics of the camera in which the active part of the cover extends at least partially opposite said optics of the camera and an inactive position in which the optics of the camera are not masked. The cover is preferably positioned inside the sheath casing, between the support base and the sheath casing, so that it can be protected as best as possible from damage. The cover can be manually driven in sliding movement. Alternatively, the device can comprise a system for controlling the movement of the or at least one of the covers.

[0009] According to the invention, the active part of the cover is provided internally, on the surface side of the cover facing the optics, in the active position of said active part of the cover, with a cover mounted to move in the direction of moving the active part of the cover closer to or further apart, said cover forming, in the position moved away from the cover and in the active position of the cover, a chamber covering at least the optics of the camera, this chamber interposed between the cover and the optics of the camera isolating the optics of the camera from the cover. The presence of a so-called dust-tight chamber, in particular to dust, makes it possible to protect the optics of the cameras during phases of non-use of the cameras.This results in double protection, namely both protection of the camera optics from contact with external objects that could damage them during installation / uninstallation of the device and during transport, and protection against dust that could settle on the optics.

[0010] According to one embodiment of the invention, the or at least one of the covers has the shape of a U with the core of the U forming the active part of the cover and the cover is, for its movement between a position separated from and a position close to the cover, equipped with guide members respectively engaged one or the other with at least one guide path provided on the cover, the other or the others with at least one guide path provided on the common support. Thus, the sliding movement of the cover from the inactive position to the active position allows in parallel the passage of the cover from the position close to the cover to the position separated from the cover.

[0011] According to one embodiment of the invention, the viewing angle of each camera is less than 90°. This results in an optimization of the spatial precision of each camera.

[0012] According to one embodiment of the invention, the or one of the visible cameras is arranged on the common support at least between a thermal camera and an infrared camera.

[0013] According to one embodiment of the invention, there are at least two infrared cameras, as well as two thermal cameras. This arrangement can allow for optimized perception of the scene. Preferably, the cameras are arranged on the support to form, from one end to the other end of the elongated support, a succession of cameras comprising at least one thermal camera, one infrared camera, one visible camera, one thermal camera and one infrared camera.

[0014] According to one embodiment of the invention, the common support carries, in addition to the cameras, at least one light emitter not visible to the naked eye. This configuration makes it possible to improve the perception of the infrared cameras. In particular, the or each light emitter, such as infrared light-emitting diodes, preferably emits within a wavelength range between 780 and 1400 nm to allow detection of said light by the infrared camera(s).

[0015] According to one embodiment of the invention, the optical axes of the cameras are parallel and / or the viewing angles of the cameras are identical from one camera to another. This results in a simplification of the mathematical processing of the raw data from the cameras to enable in particular a 3D reconstruction of the scene and a possibility of minimizing the number of cameras.

[0016] According to one embodiment of the invention, the device comprises at least one communication system configured to allow communication between the cameras of the image acquisition system and at least one data transmitter and / or receiver system. The communication system is therefore configured to allow addressing to the cameras of control data from said cameras originating from a transmitter system comprising a camera control unit, and to transfer the raw or possibly pre-processed data from the cameras to a receiver system, this receiver system possibly being common or separate from the transmitter system.

[0017] The invention also relates to an assembly comprising at least one data transmitter and / or receiver system and a device in particular for the detection and possibly the identification of at least one target within a determined volume, characterized in that the device is of the aforementioned type and the or at least one of the data transmitter and / or receiver systems and the cameras of the acquisition system are configured to communicate with each other.

[0018] According to one embodiment of said assembly, the or at least one of the data transmitter and / or receiver systems of said assembly comprises a camera control unit configured to control so-called simultaneous capture of images by the cameras with a phase shift or time lag in the acquisition of images between two cameras of at most 5 milliseconds. Brève description des dessins

[0019] The invention will be better understood upon reading the following description of exemplary embodiments, with reference to the appended drawings in which: [ Fig. 1 ] represents a schematic view of an assembly in accordance with the invention; [ Fig. 2 ] represents a schematic view of the arrangement of the cameras on the common support to materialize the intersection zone of the viewing angles of said cameras corresponding to the volume to be observed; [ Fig. 3 ] represents a perspective view of a device according to the invention; [ Fig. 4 ] represents an exploded view of the elements of the device according to the invention; [ Fig. 5 ] represents a top view and a front view of the support base; [ Fig. 6 ] represents a partial perspective view of a part of the support base equipped with a protective cover in the inactive position of said cover; [ Fig. 7 ] represents a perspective view of a cache; [ Fig. 8 ] represents a sectional view of the support base taken at the level of the protective cover; [ Fig. 9 ] represents a partial perspective view of the common support taken at the level of a protective cover, said protective cover being in the inactive position; [ Fig. 10 ] represents a partial sectional view of the support base taken at the level of a protective cover, said protective cover being in the inactive position; [ Fig. 11 ] represents a partial perspective view of the common support taken at the level of a protective cover, said protective cover being in the active position; [ Fig. 12 ] represents a partial sectional view of the support base taken at the level of a protective cover, said protective cover being in the active position; [ Fig. 13 ] represents a partial sectional view of the support base taken at the level of a protective cover in the active position of the protective cover; [ Fig. 14 ] represents a partial sectional view of the support base taken at the level of a protective cover in the inactive position of the protective cover.

[0020] As mentioned above, the invention relates to a device 1 in particular for the detection, possibly the identification of at least one mobile or immobile target within a corresponding determined volume V, in the example shown in figure 1 , to a performance scene. Obviously, this determined volume V can be a volume other than a performance scene, without departing from the scope of the invention.

[0021] The target(s) to be detected may be living beings, such as artists or animals moving within volume V.

[0022] The device 1 which is the subject of the invention therefore comprises an image acquisition system 2 forming a set of raw data which can, in real time, be addressed directly or after pre-processing, to a data receiving system 21, such as a server and / or a dedicated computer which, after processing, can address the result of the data processing to third-party sound and / or light and / or video management systems, in a manner known per se. The details of the data processing will not be described below.

[0023] The device 1 which is the subject of the invention aims to acquire image data in good conditions to enable optimal processing.

[0024] Device 1 must be positioned so as to allow unobstructed vision of the scene. Thus, generally and as illustrated in figure 1 , device 1 is generally arranged along one of the upper edges of the parallelepiped delimiting the scene.

[0025] Thus, the device 1 is arranged high up, at the front of the stage, and is directed towards the stage to have an overall view of the stage. In the example shown, the stage may have a dimension of 10 meters x 10 meters x 10 meters. Obviously, in the case of a very large stage, several devices 1 may be provided.

[0026] The image acquisition system 2 comprises at least three types of cameras, namely at least one infrared camera 3 also called “NIR” or “near infrared” camera, this infrared camera 3 being sensitive to waves whose wavelength is between 780 and 1,400 nanometers, at least one thermal camera 4 sensitive to waves between 3 and 14 micrometers and at least one so-called visible camera 5, sensitive to waves between 350 and 780 nanometers. These different cameras 3, 4, 5 are fixedly mounted on a common support 6, so that the relative position of the different cameras is known.

[0027] This common support 6 is externally presented in the form of an elongated beam-type body. Generally, and as illustrated in the figure 4 , the common support 6 comprises a base 61 supporting the cameras which is in the form of an elongated body. This elongated body here has a U-shaped cross-section. This elongated body can be made in one or more pieces. The common support 6 also comprises a sheath-type casing 62 inside which the base 61 supporting body is configured to be inserted at least partially. This casing 62 is in the form of an elongated hollow body of parallelepiped shape, this hollow body being provided, along one of its faces, with openings 63 offset axially along said body.

[0028] These openings 63 of the envelope 62 extend opposite openings made in one of the faces of the support base 61.

[0029] These openings 63 extend to the level of the optics of the cameras 3, 4 and 5 arranged on the support base 61, in the inserted state of the support base 61 in said sheath 62.

[0030] The envelope 62 has a length, preferably between 1.20 meters and 1.80 meters, a width between 10 and 20 centimeters and a height between 8 and 12 centimeters. The total weight of the common support 6 after receipt of all the elements that it must support is preferably between 10 and 20 kilos. In the example shown, the common support 6 has external dimensions length x width x height of 1,450 mm x 150 mm x 88 mm and the weight is 15 kilos. The common support 6 is therefore a portable support.

[0031] To facilitate its installation, the common support 6 comprises one or more attachment members 10. These attachment members 10 here take the form of hooks arranged on the envelope. Anchoring points to which slings can be attached are also provided on said envelope 62.

[0032] Each camera 3, 4, 5 obviously includes an optic that can also be called a lens. This optic is represented at 31 for an infrared camera 3, at 41 for a thermal camera 4 and at 51 for a visible camera 5.

[0033] Each camera 3, 4, 5 comprises an optical axis represented at 9 in the figures, a field of vision or angle of view represented at 7 in the figures. Each camera 3, 4, 5 also comprises an optical center.

[0034] In a manner characteristic of the invention, the cameras 3, 4, 5 are arranged on the common support 6 with the viewing angles of said cameras having an intersection zone 8 corresponding to the volume V to be observed, as illustrated in figure 2 .

[0035] The optical axes of said cameras 3, 4, 5 arranged on the common support 6 are distinct and the distance D between the optical axes of at least two of the cameras 3, 4, 5 is between 10 centimeters and 2 meters.

[0036] In the examples shown, the viewing angle of each camera 3, 4, 5 is less than 90°, the optical axes of the cameras 3, 4, 5 are parallel and the viewing angles of the cameras 3, 4, 5 are identical from one camera to another.

[0037] There are two infrared cameras 3, as well as two thermal cameras 4. The visible camera 5 is arranged on the common support 6 between a thermal camera 4 and an infrared camera 3. In particular, the cameras are arranged on the common support 6, to form from one end to the other end of the elongated support 6 a succession of cameras comprising at least one thermal camera, one infrared camera, one visible camera, one thermal camera and one infrared camera.

[0038] To enable a power supply to said cameras, a low-voltage power supply unit 19 is mounted on the support base 61.

[0039] The common support 6 carries, in addition to the cameras 3, 4, 5, at least one light emitter 17, not visible to the naked eye.

[0040] In the examples shown, the light emitters 17, which are two in number, are LED-type infrared projectors, which preferably emit within a wavelength range of between 780 and 1400 nm to allow detection of said light by the infrared camera(s) 3. These light emitters 17 are arranged on the support base 61, on either side of the visible camera 5, between the visible camera 5 and one of the infrared cameras for one of the light emitters 17 and between the visible camera 5 and a thermal camera for the other of the light emitters.

[0041] Again, these light emitters 17 are arranged opposite an opening 63 of the casing 62 and an opening of the support base 61 and are oriented to illuminate the volume V to be observed.

[0042] A power supply for these 17 light emitters is planned.

[0043] Each end of the base 61 support is equipped with a fan 20.

[0044] To complete the assembly, the device 1 comprises for at least one of the cameras at least one cover 11 for protecting the optics of said camera, slidably mounted along an axis parallel to the longitudinal axis of the common elongated support 6, for movement of the so-called active part 110 of the cover 11 between an active position for protecting the optics of the camera in which the active part of the cover extends at least partially opposite said optics of the camera and an inactive position in which the optics of the camera are not masked.

[0045] The active part 110 of the cover 11 is provided internally, on the surface side of the cover 11 facing the optics in the active position of said active part 110 of the cover 11, with a cover 12 mounted to move in the direction of moving the active part 110 of the cover 11 closer to or further apart. The cover 12 forms, in the position moved away from the cover 11 and in the active position of the cover 11, in which the active part of the cover extends at least partially facing said optics of the cam, a chamber 13 covering at least the optics of the camera.

[0046] This chamber 13 interposed between the cover and the camera optics isolates the camera optics from the cover 11.

[0047] This chamber 13, said to be closed in a dust-tight manner, prevents dust from being deposited on the optics of the camera(s) opposite said cover 12.

[0048] In the examples shown, the device comprises three covers 11, namely a first cover for the visible camera 5 and two other covers each serving to protect a pair of cameras formed of a thermal camera and an infrared camera.

[0049] Each cover 11 has the shape of a U with the core of the U forming the active part 110 of the cover 11. Each cover 11 is arranged inside the casing 62 of the common support 6, between the casing 62 and the support base 61.

[0050] The part of the support base 61 on which the cover 11 and the cover 12 slide is produced in the form of a block removably mounted on the rest of the support base 61. This assembly allows for easy maintenance of the covers and covers.

[0051] At least one, preferably each of the covers 11, is, for its sliding movement, actuable either manually or using a remotely controllable movement drive device. This movement drive device may be formed by a motorized worm screw or a motorized belt or chain movement transmission device to which the covers are coupled.

[0052] The core of the U is lined internally with a foam frame 120. This frame 120 is pressed against the part of the support base 61 surrounding the optics of the cameras to be protected by a cover 12 in the position spaced from the cover 12 of the cover 11 and in the active position of the cover 11. This foam frame provides dust insulation for the chamber 13 described above.

[0053] The cover 12 has the shape of a U-shaped part in a similar manner to the hood 11. Each branch of the U of the constituent part of the cover 12 is provided with guide members 14 made here in the form of pins. Some of these guide members 14 are arranged inside the U on the branches of the U, to engage with a guide path 16, such as a groove, provided on the common support 6, in particular on a face of the support base 61 adjoining the face of the support base 61 provided with openings for the camera optics.

[0054] Others of these guide members 14 are arranged inside the U on the branches of the U, to engage with a guide path 15 provided in the cover 11.

[0055] The guide paths 15 and 16 are configured, that is to say shaped and dimensioned to allow, in parallel with the passage of the protective cover 11 from the inactive position to the active position, the passage of the cover 12 from the position close to the protective cover 11 to a position distant from the protective cover 11. This movement is illustrated by the figures 10 And 12 .

[0056] To complete the device 1, the device comprises at least one communication system 18, configured to allow communication between the cameras of the image acquisition system 2 with at least one remote data transmitter and / or receiver system 21.

[0057] In the examples shown, this communication system 18 comprises an Ethernet switch also called an Ethernet switch embedded on the support base 61.

[0058] This communication system 18 can in particular transfer the raw or pre-processed data from each camera to a data receiving system, such as a server or a dedicated computer. This receiving system makes it possible to calibrate the network of cameras so that each camera is precisely positioned in the absolute 3D environment and to process the data in order to detect the targets and address the positions of these targets to audiovisual systems.

[0059] This data receiving system is generally also a data transmitting system which includes a control unit for the cameras and all the components equipping the common support 6 such as the light emitters.

[0060] Preferably, the control unit is configured to control so-called simultaneous image capture by the cameras with a phase shift or time lag in the acquisition of images between two cameras of at most 5 milliseconds. This control unit is in the form of an electronic and computer system which comprises, for example, a microprocessor and a working memory. When it is specified that the unit is configured to carry out an operation, this means that the unit comprises computer instructions and the corresponding execution means which make it possible to carry out said operation and / or that the unit comprises corresponding electronic components.

[0061] At least thermal cameras and infrared cameras are configured to operate in stereovision.

[0062] Details of data transmitters and / or receivers will not be provided below, as they are well known to those skilled in the art.

[0063] Due to the design of the device as described above, it is possible, in an easy manner, to install such a device above a scene and to detect the targets on the scene without having to pre-equip said targets with any detection system.

Claims

1. A device (1) for detecting and possibly identifying at least one target inside a determined volume (V), said device (1) comprising an image acquisition system (2), the image acquisition system (2) comprising, - at least one infrared camera (3) sensitive to waves whose wavelength is between 780 and 1400 nm, - a thermal camera (4) sensitive to waves between 3000 and 14000 micrometers and - a camera (5), referred to as a visible camera, sensitive to waves between 350 and 780 nm, in that said cameras (3, 4, 5) are mounted on a common support (6) in the form of an elongated beam-like body, in that the cameras (3, 4, 5) are disposed on the common support (6) with the fields of vision of said cameras (3, 4, 5) having an intersection zone (8) corresponding to the volume (V) to be observed, in that the optical axes of said cameras (3, 4, 5) disposed on the common support (6) are distinct, in that the distance (D) between the optical axes of at least two of the cameras (3, 4, 5) is between 10 cm and 2 m, in that the device (1) comprises, for at least one of the cameras (3, 4, 5), at least one cover (11) for protecting the optic of said camera (3, 4, 5), said cover being mounted so as to slide along an axis parallel to the longitudinal axis of the elongated common support (6) for movement of the part (110), referred to as active part, of said cover (11) between an active position for protecting the optic of the camera (3, 4, 5), in which the active part (110) of the cover (11) extends at least partially facing said optic of the camera (3, 4, 5), and an inactive position, in which the optic of the camera (3, 4, 5) is non-masked, in that the active part (110) of the cover (11) is provided internally, on the surface side of the cover (11) facing the optics in the active position of said active part (110) of the cover (11), with a shield (12) mounted so as to be able to move in the direction closer to or away from the active part (110) of the cover (11), said shield (12) forming, in a position moved away from the cover (11) and in the active position of the cover (11), a chamber (13) capping at least the optic of the camera (3, 4, 5), this chamber (13) interposed between the cover (11) and the optic of the camera (3, 4, 5) isolating the optic of the camera (3, 4, 5) from the cover (11).

2. The device (1) as claimed in claim 1, characterized in that the common support (6) is portable and is provided with at least one attachment member.

3. The device (1) according to either of claims 1 and 2, characterized in that the common support (6) comprises a support base (61) for receiving the cameras (3, 4, 5), a sleeve-type casing (62) inside which the support base (61) is configured to be at least partially inserted, said sleeve casing (62) being provided with openings (63), at least some of the openings (63) extending at the level of the optics of the cameras (3, 4, 5) disposed on the support base (61) in the state in which the support base (61) is inserted in said sleeve casing (62).

4. The device (1) as claimed in one of 1 to 3 claims, characterized in that the or at least one of the covers (11) has the shape of a U with the core of the U forming the active part (110) of the cover (11), and in that, for its movement between a position moved away from the cover (11) and a position close thereto, the shield (12) is equipped with guide members (14), one or some being in engagement with at least one guide path (15) provided on the cover (11), the other or others being in engagement with at least one guide path (16) provided on the common support (6).

5. The device (1) as claimed in one of claims 1 to 4, characterized in that the viewing angle of each camera (3, 4, 5) is less than 90°.

6. The device (1) as claimed in one of claims 1 to 5, characterized in that the or one of the visible cameras (5) is disposed on the common support (6) at least between a thermal camera (4) and an infrared camera (3).

7. The device (1) as claimed in one of claims 1 to 6, characterized in that the infrared cameras (3) are at least two in number, as are the thermal cameras (4).

8. The device (1) as claimed in one of claims 1 to 7, characterized in that, in addition to the cameras (3, 4, 5), the common support (6) bears at least one emitter (17) of light not visible to the naked eye.

9. The device (1) as claimed in one of claims 1 to 8, characterized in that the optical axes of the cameras (3, 4, 5) are parallel and / or the viewing angles of the cameras (3, 4, 5) are identical from one camera to another.

10. The device (1) as claimed in one of claims 1 to 9, characterized in that it comprises at least one communication system (18) configured to allow the cameras (3, 4, 5) of the image acquisition system (2) to communicate with at least one data transmitter and / or receiver system (21).

11. An assembly comprising at least one data transmitter and / or receiver system (21) and a device (1) in accordance with one of claims 1 to 10, the or at least one of the data transmitter and / or receiver systems (21) and the cameras (3, 4, 5) of the acquisition system (2) are configured to communicate.