Device and system for automatic behavioral detection of encoded animals

Abstract

The present invention relates to a device and a system for the automatic behavioral recognition of encoded animals and, in particular, to a software-adaptable device and an associated system for the automatic behavioral recognition of wild animals living in the wild.A device (100) according to the invention for automatically recognizing the behavior of encoded animals comprises a sensor (10) for detecting behavior-specific sensor data of an animal (1) connected to the device (100); a processor (20) for evaluating the behavior-specific sensor data detected by the sensor (10) within the device (100) to derive a behavior of the animal (1) corresponding to the sensor data on the basis of an associated sensor-specific behavior model; and a memory (30) in which the associated sensor-specific behavior model is stored, wherein different sensor-specific behavior models from outside the device can be selectively stored in the memory (30).

Description

[0001] The present invention relates to a device and a system for the automatic behavioral recognition of encoded animals and, in particular, to a software-adaptable device and an associated system for the automatic behavioral recognition of wild animals living in the wild. State of the art

[0002] Species conservation and wildlife management primarily concern the preservation, promotion, or regulation of specific animal species in their natural environment. This requires in-depth knowledge, particularly of their specific habitats, typical animal behavior patterns, population development in a region, and a comprehensive understanding of the influence of a wide variety of factors on these data. Research into the behavior and individual movement patterns of wild animals (particularly of rare or nocturnal species, or species living in hiding in vast or inaccessible terrain) is not always possible through direct observation. Furthermore, this usually only allows the observation of larger groups, not individual animals, and the natural behavior of wild animals is often disturbed by the proximity of humans.

[0003] For several decades, so-called "wildlife telemetry" has been used to monitor and research wildlife. Data loggers, usually equipped with various sensors, are attached to the animals. The devices used for this purpose generally use global navigation satellite systems to determine the animals' current position. The position data can be stored (logged) over a long period of time and transmitted, for example, via a cellular connection or a proprietary radio link, to special receivers.

[0004] Acceleration sensors located in the data loggers measure the activity of the tagged animals. These sensors detect and record acceleration in all three spatial directions, as well as rotational movements (3D / 6D accelerometers). By recording such acceleration data while simultaneously observing behavior, it is possible, particularly using artificial intelligence methods, to subsequently create corresponding models that allow the behavior of the respective animal to be determined from subsequently recorded data, even without further observation.

[0005] Until now, it has been common practice to first download the sensor data from the data logger and then apply the corresponding model to the recorded sensor data at the receiver (e.g., Le Roux, Solomon Petrus, et al. “An overview of automatic behavior classification for animal-borne sensor applications in South Africa.” In: Proceedings of the ACM Multimedia 2017 Workshop on South African Academic Participation (2017)). Therefore, behavior can only be determined from the recorded sensor data after the sensor data has been collected and transmitted. However, this has the disadvantage that a considerable amount of data has to be logged and transmitted, and behavior can only be determined with some delay. In addition, despite possible additional solar cells for support, the data loggers usually only have a limited amount of energy available, which is required, in particular, for data transmission when wireless communication systems are available.Therefore, there is a need for particularly energy-efficient data loggers that can effectively reduce the amount of data to be transmitted and also enable timely behavior detection for the on-demand triggering of further sensor data acquisition, such as behavior-dependent tracking.

[0006] There are already initial approaches that attempt to carry out behavioral recognition for limited areas directly in such a data logger (e.g. le Roux, Solomon Petrus, et al. “Reduced energy and memory requirements by on-board behavior classification for animal-borne sensor applications.” IEEE Sensors Journal 18.10 (2018); Marais, Jacques, et al. “Automatic classification of sheep behavior using 3-axis accelerometer data.” In: Proceedings of the twenty-fifth annual symposium of the Pattern Recognition Association of South Africa (PRASA) (2014)). However, when implemented in practice, these approaches usually require the user to have a deeper understanding of the technical aspects as well as extensive programming knowledge, which means that the circle of potential users is limited. The need for adaptations can be avoided by using systems that are adapted or tailored to individual animal species or groups.While the complexity of trained behavioral models can be kept to a minimum, this limits the general applicability of the data loggers to other animal species or groups. Combining several such specific behavioral models for different animal species or groups increases the required computing and storage effort, which negatively impacts energy efficiency. A disadvantage of previous approaches is a lack of reliability and / or flexibility in application. Furthermore, users are usually required to have extensive programming knowledge, which complicates widespread application, for example, in the field of nature conservation.

[0007] DE 10 2023 121 479 A1 discloses a two-part device for the electronic monitoring of and with free-living wild animals such as pigeons and other bird species, wherein the second part of the device can control the first part of the device on the basis of a detected behavior of the animal. Disclosure of the invention

[0008] It is therefore an object of the present invention to provide an improved device for the automatic behavioral recognition of encoded animals ("data logger"), which avoids or at least significantly reduces the problems occurring in the prior art.

[0009] These objects are achieved according to the invention by the features of the independent patent claims. Advantageous embodiments of the invention are contained in the respective subclaims.

[0010] A first aspect of the present invention relates to a device for automatically recognizing the behavior of encoded animals, comprising a sensor for detecting behavior-specific sensor data of an animal connected to the device; a processor for evaluating the behavior-specific sensor data detected by the sensor within the device to derive a behavior of the animal corresponding to the sensor data based on an associated sensor-specific behavior model;and a memory in which the associated sensor-specific behavior model is stored, wherein different sensor-specific behavior models can be optionally stored in the memory from outside the device, wherein a suitably selected initial model can be learned using training data in an external software program and then transferred to the device, wherein the behavior models that can be optionally stored in the memory from outside the device allow the sensor-specific behavior model to be adapted independently of any operating software or firmware of the device before each use on a different animal or with different sensors.

[0011] Behavior-specific sensor data refers to data provided by the sensor from which specific behaviors of the animal can be derived. The sensor data need not be restricted to a specific behavior to be recognized, but can preferably at least potentially detect a variety of different behaviors. Preferably, the sensor for recording behavior-specific sensor data is a 3D acceleration sensor, even more preferably a 6D acceleration sensor, with which rotational movements around orthogonal axes can also be directly recorded. The corresponding behavior can also be derived from one dimension, but in general, a behavior is better recognized through a combined evaluation of all available sensor data. The sensor can also be a combination of two or more different sensors, including:These could include sensors for detecting rotation rates, magnetic fields, air pressure, temperature, etc. For example, a temperature sensor for measuring body temperature (resting) and / or a heart rate monitor for measuring the animal's pulse (running) can also indicate a specific behavior (i.e., an activity currently being performed). A camera can also be used as a corresponding sensor.

[0012] The processor for evaluating the behavior-specific sensor data acquired by the sensor is located within the device and configured to derive the animal's behavior corresponding to the sensor data based on an associated sensor-specific behavior model. The precise manner in which this derivation occurs is thus determined by the respective sensor-specific behavior model.

[0013] In particular, the sensor-specific behavior model can be a rule-based model for corresponding rule-based evaluation by the processor. Preferably, however, the sensor-specific behavior model is a machine-learned model for evaluation by the processor. The latter has the advantage that, after an appropriate learning process for the initial creation of the sensor-specific behavior model used, the behavior-specific sensor data recorded by the sensor can be evaluated within the device significantly faster, more energy-efficiently, and more reliably than with classic rule-based models. However, a hybrid approach is also possible, in which both rule-based and machine-learned components are advantageously combined in a common sensor-specific behavior model.The creation of a sensor-specific behavior model can thus be achieved by "feeding" or teaching a suitably selected initial model with measurement data (e.g. 3D / 6D acceleration data) and associated observation data, which can then be transferred to a device according to the invention in the simplest and most uncomplicated way possible.

[0014] The sensor-specific behavior model thus represents a more or less abstract description of how certain behaviors, for example in a specific animal species or group (e.g., dogs / canids), can be identified in the respective sensor data via a sensor providing the behavior-specific sensor data (the behavior model is specific to the type of behavior-specific sensor data provided by the sensor and does not have to be created specifically for a single, concrete sensor). However, the model can also be provided specifically for a single animal. Therefore, an adaptation of the sensor-specific behavior model may be necessary before each use on a different animal or with different sensors. The modular storage approach of the present invention, however, enables particularly fast and flexible adaptation.

[0015] The sensor-specific behavior model itself is stored in a memory of the device according to the invention and is intended to be selectively stored in the memory from outside the device. This represents a key idea of ​​the present invention. The device can thus be flexibly and easily adapted to the respective task with regard to the sensor-specific behavior models used. Using already known or real observation data obtained for this purpose, a corresponding sensor-specific behavior model is first created or trained (using training data), checked, and validated, and then stored in the memory of the device according to the invention for internal reuse with additional sensor data.

[0016] As a result, the actual operating software or firmware of the device does not need to be adapted each time, as was previously the case; instead, only the respective sensor-specific behavior model needs to be saved. This makes it possible, in particular, for even less technically proficient users to operate such devices. Since the sensor-specific behavior model in the present invention is separate from the actual operating software or firmware of the device, only the respective sensor-specific behavior model needs to be adapted by the user. For this purpose, a correspondingly simplified software program for model creation can be provided to the user. The sensor-specific behavior models are then preferably transferred to the device's memory wirelessly via a suitably provided and user-friendly simplified communication module.

[0017] The device preferably further comprises a means for determining positions, configured to record position data based on behavior derived from sensor data; and / or a camera configured to record image and / or video data based on behavior derived from sensor data. The means for determining positions can be used to record the GPS position of the animal in a behavior-dependent manner, for example in order to identify certain feeding or resting places. The camera can in particular be a particularly compact, lightweight and unobtrusive microcamera. The camera can in particular be an electronic video and / or image camera. This can in particular be designed for recordings in the visible and / or infrared spectral range. The camera is preferably a multi-spectral or hyperspectral camera.The term "camera" generally refers to optical sensor systems for capturing spatial information from the sensor system's environment. It can therefore also be a LiDAR system or similar system for 3D scanning of the environment. Because the camera can only be activated in response to a specific behavior derived from sensor data, for example, targeted images can be captured of food being fed or prey being hunted. The camera can therefore be operated with particularly low energy consumption.

[0018] The device preferably further comprises a power supply and a wireless communication means. A power supply may, in particular, be a battery or a rechargeable energy storage device (accumulator) with or without an associated battery management system (BMS). In particular, the power supply may comprise a module for energy generation and / or storage. The power supply may preferably comprise a rechargeable energy storage device and / or a solar cell. The solar cell may be connected to a rechargeable battery as the energy storage device.

[0019] A wireless communication means can be used, for example, to remotely control and / or monitor the device. A wireless communication means can be, for example, a mobile data modem or a module for establishing a cellular connection, such as GSM, UMTS, HSDPA, or LTE or "2G", "3G", "4G", "5G", or "6G". Both IP-based and text message-based protocol methods can be used for transmission. Although bidirectional communication is preferred here, communication can also be unidirectional, e.g., towards a base station. Unidirectional transmission can be used for particularly energy-efficient operation, for example for the time- or event-based transmission of individual camera images or location data.Especially for field use, a simple communication system based on sending and receiving short SMS messages or data packets (for example via Iridium or any other satellite communication system as LPWAN / IoT packets) is particularly advantageous.

[0020] Monitoring data acquired with a device according to the invention is preferably transmitted wirelessly to a receiver. This is particularly advantageous when reading the device is not immediately possible and recapturing the monitored animal would otherwise be necessary. Wireless transmission can be achieved via a short-range radio connection and / or a long-range radio connection.

[0021] In particular, the current status of the device can also be communicated to a base station via the means of communication. This can include the charge level of a rechargeable energy storage device, the amount of data stored so far or the remaining storage space available for additional data, the result of a functional test, or information required for remote monitoring.

[0022] The means for wireless communication preferably comprises an antenna. An antenna serves for the directed transmission of electromagnetic waves for data transmission. The antenna is preferably arranged in such a way that optimal reception can always be guaranteed, depending on the selected type of attachment to the animal.

[0023] A second aspect of the present invention relates to a system for automatically recognizing the behavior of encoded animals, comprising an inventive device for animal monitoring, a communication module for transferring the sensor-specific behavior models into the memory of the device, and the external software program for execution on a second processor (ie not the processor of the device, but for example on the processor of an external computer), configured to create the different sensor-specific behavior models for the device by a user of the device.

[0024] A user then preferably only needs to check, optimize, and / or validate the model and does not need to perform any direct programming work. This can, in particular, involve selecting a specific algorithm, optimizing individual parameters of the sensor-specific behavior model to be created, and / or cleaning up faulty training data. The completed sensor-specific behavior model can then be transferred to the communication module or, via it, to the device according to the invention. The entire system is designed so that various types of models can be processed.

[0025] The evaluation of the data directly in the device according to the invention using interchangeable sensor-specific behavior models results in several advantages: - Reducing the amount of data that needs to be stored and transferred, - universal application of the device, since the sensor-specific behavior models can be improved, adapted and / or modified in a simple and flexible manner without the need to simultaneously adapt the operating software or firmware of the device, - Possibility of targeted control of data recording based on specific behaviors when activating a positioning device (e.g. GPS) and / or a camera, which are typically the largest energy consumers in such devices, and - extended applications through the ability to react in real time to detected behavior and also to initiate corresponding (external) actions.

[0026] Further preferred embodiments of the invention result from the features mentioned in the subclaims.

[0027] The various embodiments of the invention mentioned in this application can be advantageously combined with one another, unless otherwise stated in the individual case. Brief description of the drawings

[0028] The invention is explained below in exemplary embodiments with reference to the accompanying drawings. It shows: Fig. 1 a schematic sketch of the application of a device according to the invention for monitoring animals, Fig. 2 a schematic representation of a block diagram of an embodiment of a device according to the invention, and Fig. 3 a schematic representation for creating a sensor-specific behavior model for a device according to the invention using the example of a 3D acceleration sensor. Detailed description of the drawings

[0029] Fig. 1 shows a schematic diagram of the application of a device 100 according to the invention for monitoring animals 1. The animal 1 shown is, by way of example, a bird, in particular a pigeon. However, the device 100 according to the invention can, in principle, be used with any animal 1 (including aquatic animals or land animals that spend at least some time in water). The device 100 shown comprises a sensor 10 for recording behavior-specific sensor data of an animal 1 connected to the device 100; a processor 20 (not shown, see Fig. 2) for evaluating the behavior-specific sensor data acquired by the sensor 10 within the device 100 to derive a behavior of the animal 1 corresponding to the sensor data on the basis of an associated sensor-specific behavior model; and a memory 30 (not shown, see Fig. 2) in which the associated sensor-specific behavior model is stored, whereby different sensor-specific behavior models from outside the device can optionally be stored in memory 30. The sensor 10 for acquiring behavior-specific sensor data can, in particular, be a 3D / 6D acceleration sensor.

[0030] The device shown preferably further comprises a means for determining position 12, configured to record position data based on behavior derived from sensor data; and / or a camera 40, configured to record image and / or video data based on behavior derived from sensor data. The triggering sensor data need not originate from the sensor 10 used to detect behavior. The device 100 according to the invention shown can further comprise a means for supplying energy 50 and a means for wireless communication 60, wherein the means for supplying energy 50 can comprise a rechargeable energy storage device and a solar cell 52. This ensures continuous operation of the device even during long monitoring periods by temporarily recharging the power supply 50.The wireless communication means 60 can be used to transmit monitoring data acquired by the device 100 to a receiver, even over long distances. This allows, for example, the behavior of birds or other animals in the wild to be monitored and observed via a mobile radio connection. The wireless communication means 60 preferably comprises an antenna. The sensor-specific behavior models can be transmitted to the device 100, in particular, wirelessly via a communication module 200.

[0031] Fig. 2 shows a schematic representation of a block diagram of an embodiment of a device 100 according to the invention. The basic structure of the device 100 shown corresponds essentially to that in Fig. 1, therefore the reference numerals and their respective assignment to the individual features of the present invention apply accordingly. The sensor 10 shown for recording behavior-specific sensor data can in particular be a 3D / 6D acceleration sensor (for example in the form of a so-called inertial measurement unit, IMU). The means for determining position 12 shown can be a GPS or GNSS module. The sensor data provided by these sensors and by the camera 40 can be sent via one or more data lines to the processor 20 for appropriate processing. These sensors can preferably also be controlled via the processor 20, so that, for example, a position determination by the means for determining position 12 only takes place under certain conditions and does not have to take place continuously.Accordingly, the means for wireless communication 60 can also be connected to the processor 20 via such a bidirectional data connection. Also shown is the memory 30, in which the sensor-specific behavior model can be stored, which is used by the processor 20 to evaluate the behavior-specific sensor data acquired by the sensor 10 within the device 100. However, the memory 30 can also be used to store the behavior of the animal 1 derived therefrom (e.g. which specific activity of the animal was identified in the sensor data) for later retrieval. In this respect, the data connection shown is also bidirectional by way of example. The power supply 50 can, in addition to the. Fig. 1 include an optional battery management system (BMS).

[0032] Fig.Figure 3 shows a schematic representation for creating a sensor-specific behavior model for a device 100 according to the invention, using the example of a 3D acceleration sensor. The animal 1 wearing the device 100 according to the invention is assumed to be a fox. The 3D acceleration sensor could, in particular, be attached to the fox's collar. The curves in the left half represent, by way of example, the temporal progression of the individual acceleration values ​​in the three spatial axes. When the fox is resting, the associated acceleration values ​​are also largely at rest and exhibit at most minor fluctuations (e.g., due to breathing movements). When the fox is moving (“locomotion”), a clear oscillation can be seen in all three axes. The oscillations represent the movement of the body when walking or running.As can be clearly seen in the third diagram, feeding also shows a relatively clear acceleration pattern across all three axes. In this example, the fox may have held its head at a largely constant height, while the chewing movements resulted in widely varying acceleration values ​​in the vertical plane. Finally, grooming also shows a relatively distinctive acceleration profile, clearly distinguishable from the other profiles, with oscillating movements across all three axes.

[0033] The recognition and assignment of sensor data (in this example, acceleration data) to specific behaviors is possible using both traditional means of machine pattern recognition and newer methods of machine learning. Accordingly, a derived sensor-specific behavior model can be a rule-based model for corresponding rule-based evaluation or a machine-learned model for evaluation by the processor, whereby the creation of a sensor-specific behavior model with the help of machine learning is usually preferable. However, a hybrid approach is also possible, in which both rule-based and machine-learned components are advantageously combined in a common sensor-specific behavior model. The sensor-specific behavior model derived from the training data for the respective animal or animal species or-group can then be transmitted to the communication module 200, so that it can then be stored in the memory of a device according to the invention.

[0034] The sensor-specific behavior model can, in particular, be a trained neural network, where, in particular, an acceleration sensor signal (3D / 6D) can provide information about the direction and / or intensity of a movement as the input data for the neural network. For example, the structure of the neural network can include an analytical algorithm. Training can preferably be carried out using a supervised learning algorithm with previously collected training data. Quantization of the trained weights during detection is preferred. List of reference symbols 1 animal (e.g. fox, wolf, pigeon) 10 Sensor (e.g. 3D / 6D accelerometer) 12 means of positioning 20 Processor (e.g. FPGA, microprocessor, AI chip) 30 memory (e.g. flash memory) 40 Camera 50 Energy supply 52 solar cells 60 means of wireless communication 100 Device for automatic behavioral recognition of encoded animals 200 communication module

Claims

[1] Device (100) for automatically detecting the behavior of energized animals, comprising: a sensor (10) for detecting behavior-specific sensor data of an animal (1) connected to the device (100); a processor (20) for evaluating the behavior-specific sensor data acquired by the sensor (10) within the device (100) to derive a behavior of the animal (1) corresponding to the sensor data on the basis of an associated sensor-specific behavior model; and a memory (30) in which the associated sensor-specific behavior model is stored, characterized by , that different sensor-specific behavioral models can be optionally stored in the memory (30) from outside the device (100), wherein a suitably selected initial model can be learned using training data in an external software program and then transferred to the device (100), wherein the behavioral models that can be optionally stored in the memory (30) from outside the device (100) can be adapted to the sensor-specific behavioral model independently of any operating software or firmware of the device (100) before each use on a different animal (1) or with different sensors (10). [2] Device (100) according to claim 1, wherein the sensor (10) for detecting behavior-specific sensor data is an acceleration sensor. [3] The device (100) of claim 1 or 2, wherein the device further comprises: a means for determining position (12) arranged to record position data based on a behavior derived from sensor data; and / or a camera (40) configured to record image and / or video data based on a behavior derived from sensor data. [4] Device (100) according to one of the preceding claims, further comprising: a means of energy supply (50); and a means of wireless communication (60). [5] Device (100) according to claim 4, wherein the means for supplying energy (50) comprises a rechargeable energy store and / or a solar cell (52). [6] The device (100) of claim 4 or 5, wherein the wireless communication means (60) comprises an antenna. [7] Device (100) according to one of the preceding claims, wherein the sensor-specific behavior model is a rule-based model for rule-based evaluation by means of the processor (20). [8] Device (100) according to one of the preceding claims, wherein the sensor-specific behavior model is a machine-learned model for evaluation by means of the processor (20) based on methods of artificial intelligence, AI. [9] Device (100) according to one of the preceding claims, wherein a transmission of the sensor-specific behavior models into the memory (30) of the device (100) takes place wirelessly via a communication module (200). [10] System for automatic behavioral recognition of encoded animals, comprising: a device (100) according to any one of the preceding claims; a communication module (200) for transferring the sensor-specific behavior models into the memory (30) of the device (100); and the external software program for execution on a second processor, configured to create the different sensor-specific behavior models for the device (100) by a user of the device (100).

Images