Systems and methods for situation recognition regarding mobile objects located in a monitoring room

Abstract

System (1) for situation detection regarding mobile objects (O) located in a monitoring room (S), comprising: a host system (10) with a data interface (11) for receiving location data, which includes as location data content at least: a spatial position of the objects (O) within the monitoring area (S) and at least one identifying characteristic of the respective object (O); a sonification module (20) connected to the host system (10) with an output interface (22), wherein the sonification module (20) is configured to determine acoustic parameters according to a predetermined assignment of acoustic parameters to the positional data contents, to generate an audio signal representing the determined acoustic parameters and to output the audio signal at the output interface (22); and an acoustic transducer (30) connected to the output interface (22) of the sonification module (20), which is configured to convert the audio signal of the sonification module (20) into an acoustic output perceptible to a human user (U); wherein the host system (10) has a first operating device (14) connected to the data interface (11) with an output device (14A) for generating a visual representation based on the position data; wherein the first operating device (14) has an input device (14B) for inputting control commands by the user (U), wherein the sonification module (20) is configured to adjust the generation of the audio signal according to the input control commands; and where the control command is the identification feature of one or contains control data for several objects (O), and wherein the sonification module (20) is configured to select positional data of objects (O) that have the corresponding identification feature, and generates the audio signal only from the positional data of these objects (O).

Description

[0001] The present invention relates to systems and a method for situation detection with regard to mobile objects located in a monitoring space, as well as to a monitoring system.

[0002] For both military and civilian purposes, areas on (and under) sea or on land, often including the associated airspace, are monitored using sensor systems such as radar sensors, satellites, or the like in order to detect mobile objects within the monitored area. This typically involves identifying the objects, e.g., as a ship, aircraft, helicopter, truck, or the like, and determining their position, speed, direction of movement, and similar characteristics based on the recorded sensor data. This information, obtained from the sensor data, can be transmitted to a monitoring station as position data. In the military sector, the monitoring station could, for example, be a command center from which a military operation is coordinated.

[0003] In a monitoring station, situation data is typically visualized on screens or similar graphical display devices, e.g., as an interactive map on which objects are displayed as different graphical objects depending on their identification. The on-duty personnel can use the visual representation of the objects to gain an overview of the situation in the monitored area. This is often referred to as situation awareness.

[0004] US 2007 / 0070069 A1 describes how, in addition to pure position data of objects, images of the objects and audio recordings from the surroundings of the objects can be captured and a visual representation of the monitored area can be enriched by playing back the recorded image and audio data.

[0005] Since area monitoring often requires a large number of objects to be monitored simultaneously and, in addition, the information on the individual objects must be kept in view by the users or operating personnel, the visual representation of the situation in the monitored area typically ties up a very large part of the personnel's attention.

[0006] US 2011 / 0 164 768 A1 describes an acoustic user interface system and method for tracking spatial location data.

[0007] DE 10 2005 019 733 A1 describes a method for detecting a potential threat emanating from an object moving in a surveillance area.

[0008] US 6 097 315 ​​A describes a collision warning system that uses combined binaural acoustic effects in conjunction with optical indicators to direct a person's attention in a desired direction.

[0009] The paper “Sonifying the periphery: supporting the formation of gestalt in air traffic control” by RÖNNBERG, Niklas ; LUNDBERG, Jonas ; LÖWGREN, Jonas, published in “ISon 2016 : Interactive Sonification Workshop, December 15-16th 2016, CITEC, Bielefeld; Proceedings”, describes a design-led exploration of sonification to create peripheral perception in air traffic control centers.

[0010] The object of the present invention is to find solutions that simplify situation recognition with regard to mobile objects located in a surveillance space.

[0011] This problem is solved by the subject matter of the independent claims.

[0012] According to a first aspect of the invention, a system for situation detection regarding mobile objects located in a surveillance area is provided. The system comprises a host system with a data interface for receiving location data, which, as location data content, contains at least: a spatial position of the objects within the surveillance area and at least one identifying feature of the respective object.The system further comprises a sonification module connected to the host system and having an output interface. The sonification module is configured to determine acoustic parameters according to a predetermined assignment of acoustic parameters to the position data contents, generate an audio signal representing the determined acoustic parameters, and output the audio signal at the output interface. An acoustic transducer connected to the output interface of the sonification module is configured to convert the audio signal of the sonification module into an acoustic output perceivable by a human user, i.e., sound. Furthermore, the host system has a first operating device connected to the data interface and having an output device for generating a visual representation based on the position data.The first operating device has an input device for the input of control commands by the user, wherein the sonification module is configured to adapt the generation of the audio signal according to the input control commands. Furthermore, the control command contains the identification feature of one or more objects as control data, and the sonification module is configured to select position data of objects that have the corresponding identification feature and generate the audio signal only from the position data of these objects.

[0013] According to a second aspect of the invention, a system for situation detection regarding mobile objects located in a surveillance area is provided. The system comprises a host system with a data interface for receiving location data, which, as location data content, contains at least: a spatial position of the objects within the surveillance area and at least one identifying feature of the respective object.The system further comprises a sonification module connected to the host system and having an output interface, wherein the sonification module is configured to determine acoustic parameters according to a predetermined assignment of acoustic parameters to the position data contents, to generate an audio signal representing the determined acoustic parameters and to output the audio signal at the output interface, and an acoustic transducer connected to the output interface of the sonification module, which is configured to convert the audio signal of the sonification module into an acoustic output perceivable by a human user, i.e. sound.The system further comprises a second, interactive operating device connected to the host system or a control interface of the sonification module, which second interactive operating device has a sensor device for detecting a movement of the user and / or a spoken utterance of the user and is configured to generate a control command based on the detected movement and / or the detected utterance. The sonification module is configured to adapt the generation of the audio signal according to the input control commands. Furthermore, the control command contains the identification feature of one or more objects as control data, and the sonification module is configured to select location data of objects that have the corresponding identification feature and generate the audio signal only from the location data of these objects. According to a third aspect of the invention, a monitoring system for monitoring a monitoring space is provided. The monitoring system comprises a sensor system with a plurality of monitoring sensors for acquiring position data of objects located in the monitoring space, wherein the position data includes, as position data content, at least: a spatial position of the objects within the monitoring space and an identifying feature of the respective object. The monitoring system further comprises a system according to the first aspect or the second aspect of the invention, wherein the sensor system is connected to the data interface of the host system.

[0014] According to a fourth aspect of the invention, a method for monitoring a surveillance space is provided. The method comprises: - Recording location data of objects located in the surveillance area by means of surveillance sensors, wherein the location data contains at least the following location data contents: a spatial position of the objects within the surveillance area and an identification feature of the respective object; - Determining acoustic parameters according to a predetermined assignment of acoustic parameters to the position data contents; - Generating an audio signal representing the acoustic parameters; - converting the audio signal into an acoustic output perceivable by a human user by means of an acoustic transducer; - Input of control commands by the user via an input device of a first operating device, which is connected to a data interface and has an output device for generating a visual representation based on the position data and / or detecting a movement of the user and / or a verbal utterance of the user via a sensor device of a second, interactive operating device, and generating a control command based on the detected movement and / or on the detected utterance by the second, interactive operating device; and - Adapting the generation of the audio signal according to the input and / or generated control commands by a sonification module; wherein the control command contains the identification feature of one or more objects as control data, and wherein the sonification module is configured to select position data of objects having the corresponding identification feature and generates the audio signal only from the position data of these objects.

[0015] The method according to this aspect can be carried out in particular using a monitoring system according to the third aspect of the invention or a system according to the first aspect or the second aspect of the invention. The features and advantages disclosed for one aspect of the invention therefore also apply to the other aspects of the invention, and vice versa.

[0016] One idea underlying the invention is to sonify location data that represents the position, direction of movement, speed, type, or similar information about objects located in a monitored space. This involves converting the information or data relationships into perceptible relationships in an acoustic signal. A sonification module, which can be implemented, for example, as a computer executing a corresponding software program, transforms the location data into an audio signal, which is then converted into sound waves by an electroacoustic transducer, such as a loudspeaker or headphones. Based on the content of the location data, for example, the position and identifying feature of the object, the sonification module determines a set of acoustic parameters, such as the frequency, according to a predetermined algorithm or a predetermined assignment.Pitch, timbre, rhythm, volume, chords. For example, the timbre can be determined based on the object's identifying feature, and the volume can be determined based on its distance from a predetermined location. For example, a helicopter can be represented by the sound of a guitar string. Closer objects, for example, can be assigned a higher volume than more distant objects.

[0017] One of the advantages of the invention is that the capabilities of human hearing are integrated into situation recognition. By sonifying the situation data, the user or operating personnel is able to perceive changes, e.g. the appearance of new objects in the monitored space, without having to rely exclusively on a visual representation. Furthermore, the ability of human hearing to perceive even minimal changes or differences in sounds is advantageously utilized. This makes it easier for the operating personnel to easily maintain an overview, even when dealing with a very large number of objects. It is also easier to combine monitoring with other tasks. Since hearing is practically a "side effect" for a human user, it is much easier for the user to assess a situation. This can significantly reduce the burden on the operating personnel of a surveillance system.

[0018] Advantageous embodiments and further developments arise from the subclaims which refer back to the independent claims in conjunction with the description.

[0019] According to one embodiment, the acoustic parameters may include one or more of the following parameters: pitch, timbre, rhythm, volume, chords.

[0020] According to a further embodiment, the mobile objects may comprise aircraft, and the location data may contain a recognized air picture. A recognized air picture, or RAP, is a list of all objects in the surveillance space, e.g., an airspace, where each object, in particular each aircraft, is identified as friendly or hostile. Optionally, additional information such as the exact object type, etc., is included. The information may originate from various sources, e.g., from various surveillance sensors or from a database.

[0021] According to the first aspect of the invention, the host system comprises a first operating device connected to the data interface and having an output device for generating a visual representation based on the situation data. The operating device can be implemented, for example, as a computer with a monitor as the output device. The output device can display a graphical representation or a visualization of the monitored space and the objects located therein, e.g., as a virtual overview map. By combining the visual representation with the sound representation generated by sonification of the situation data, situation recognition is further simplified for the user.

[0022] The first operating device has an input device for the input of control commands by the user, e.g., in the form of a keyboard or corresponding buttons on a touch-sensitive display, wherein the sonification module is configured to adapt the generation of the audio signal according to the input control commands. The first operating device can thus be used to modify settings of the sonification module. Generally, a control command contains control data on the basis of which the sonification module adapts the generation of the audio signal. In particular, it is conceivable that the predetermined assignment of acoustic parameters to the position data contents can be specified based on the control commands. For example, it can be provided that the user can change the assignment of a specific sound to a specific object type. Thus, the sonification can be individually adapted to the user's wishes.

[0023] It is also optionally conceivable for the control command to contain control data that spatially defines a sub-area of ​​the surveillance space, and wherein the sonification module is configured to select, based on the control data, location data of objects located in the defined sub-area of ​​the surveillance space and to generate the audio signal only from the location data of these objects. For example, the user can select a specific sector within the surveillance area, e.g., an angular sector relative to a predetermined location within the surveillance area. The associated control data triggers a corresponding setting of the sonification module, which subsequently only sonifies the location data of objects located in the selected sector.

[0024] According to the invention, the control command contains the identification feature of one or more objects as control data, and the sonification module is configured to select location data from objects that have the corresponding identification feature and to generate the audio signal only from the location data of these objects. Similar to the selection of the sub-area described above, the user can, for example, select a specific object type, and the sonification module will sonify only the location data of objects of this type. Thus, a user can only sonify and output location data for objects of the type "ground vehicle," "aircraft," or "helicopter," etc.

[0025] According to the second aspect of the invention, the system comprises a second, interactive operating device connected to the host system or a control interface of the sonification module, which second, interactive operating device comprises a sensor device for detecting a movement of the user and / or a spoken utterance of the user. The second operating device is configured to generate a control command based on the detected movement and / or the detected utterance, wherein the sonification module is configured to adapt the generation of the audio signal according to the input control commands. The second operating device is thus, like the first operating device, generally configured to generate control commands. However, the second operating device comprises a sensor as an input device, with which gestures, movements, spoken utterances, or the like, to which a control command is assigned, can be detected.The sensor can be implemented, for example, as an optical sensor such as a camera, an eye tracker, a data glove, a microphone for speech recognition, or something similar. The second operating device facilitates intuitive operation of the system for the user.

[0026] The second operating device can generate different or the same control commands as the first operating device. In particular, the control command can contain control data that spatially define a sub-area of ​​the monitoring space, and the sonification module is configured to select, based on the control data, position data of objects located in the defined sub-area of ​​the monitoring space and to generate the audio signal only from the position data of these objects.

[0027] According to the invention, the control command contains the identification feature of one or more objects as control data, wherein the sonification module is configured to select position data of objects having the corresponding identification feature and to generate the audio signal only from the position data of these objects.

[0028] According to a further embodiment, it can be provided that the sonification module is configured to generate a directional signal based on the position of the objects contained in the position data, which represents an orientation of the objects with respect to an origin of a reference coordinate system of the monitoring space. The acoustic transducer has at least two sound sources and is configured to convert the audio signal, using the at least two sound sources, into an acoustic output representing the orientation based on the directional signal. The directional signal indicates where the respective object is located with respect to a reference point, e.g., the location of the system user or a center of the monitoring space.The sonification module generates the acoustic signal as a stereo or surround signal so that the transducer can generate the acoustic output in such a way that the user can perceive the sound from the direction in which the object is located.

[0029] Optionally, an orientation sensor connected to the sonification module can be provided, which is designed to detect an orientation of the user's head relative to the origin of the reference coordinate system and to generate an orientation signal representing the orientation of the user's head relative to the origin of the reference coordinate system, wherein the sonification module is designed to modify the direction signal based on the orientation signal such that it represents an orientation of the objects relative to an origin of a user coordinate system that is stationary with respect to the user's head, which orientation corresponds to their orientation in the reference coordinate system when the transducer is not stationary with respect to the user orthe user coordinate system is arranged, and to modify the directional signal based on the orientation signal such that it represents an orientation of the objects relative to the origin of a user coordinate system when the transducer is arranged stationary with respect to the user or the user coordinate system. This means that, depending on whether the transducer is arranged stationary or not, the direction from which the user perceives the sound can be rotated or fixed relative to the user. If the transducer is designed, for example, as headphones that are stationary relative to the user, the spatial distribution of the sounds is rotated against the movement of the head or remains the same with respect to the reference coordinate system. This means that the spatial sound impression that the user perceives changes when the head is rotated.If the transducer is formed by speakers that are not fixed relative to the user, the directional information will rotate with the movement of the user's head. This means that even if the user rotates within the room, the spatial sound impression remains unchanged.

[0030] According to a further embodiment, the host system can have a data storage device connected to the data interface, which stores the position data, wherein the sonification module is connected to the data storage device. Optionally, the first operating device can be connected to the first data interface via the data storage device.

[0031] In general, the "identifying feature" represents a classification property of an object, in particular a classification as a mobile platform or troop. Optionally, a further, more detailed classification can be represented by the identifying feature, e.g., as a land, air, or water vehicle, and optionally, an even more detailed classification as a truck, tank, aircraft, helicopter, missile, drone, submarine, merchant ship, etc. The "unknown" classification can also be represented by the identifying feature. This means that even an unidentifiable object can be sonified with a predetermined sound that represents the "unknown" property.

[0032] A "surveillance space" is generally understood herein to mean a geographical area, e.g., on land and / or at sea and / or underwater, and optionally the associated airspace and / or a three-dimensional spatial area in space. Situational awareness in the surveillance space can, in particular, relate to a military or civilian situation.

[0033] The invention is explained below with reference to the figures of the drawings. The figures show: Fig. 1 schematic view of a monitoring system according to an embodiment of the invention; Fig. 2 shows a simplified schematic functional view of a situation recognition system according to an embodiment of the invention; Fig. 3 is a schematic block diagram of a situation recognition system according to an embodiment of the invention; Fig. 4 is a schematic block diagram of a situation detection system according to another embodiment of the invention; Fig. 5 is a schematic representation of the operation of a sonification module of a situation recognition system according to an embodiment of the invention; Fig. 6 shows a symbolic representation of the perception of a spatial distribution of sound that can be generated by a transducer based on an audio signal generated by a sonification module of a system for situation recognition according to an embodiment of the invention; Fig. 7 the representation according to Fig. 6, where the head of a user is compared to Fig. 6 is rotated, and wherein the perception of the spatial distribution of the sound is the same with respect to a reference coordinate system and is rotated with respect to a user-fixed coordinate system compared to Fig. 6; Fig. 8 the representation according to Fig. 6, where the head of a user is compared to Fig. 6 is rotated, and wherein the perception of the spatial distribution of the sound is the same with respect to a reference coordinate system and is also the same with respect to a user-fixed coordinate system compared to Fig. 6; Fig. 9 shows a symbolic representation of the perception of a spatial distribution of sound that can be generated by means of a transducer based on an audio signal generated by a sonification module of a system for situation recognition according to an embodiment of the invention, wherein only objects in a predetermined sub-area of ​​a monitoring space are perceptible as sound sources for the user; Fig. 10 is a symbolic representation of the perception of a spatial distribution of sound that can be generated by a transducer based on an audio signal generated by a sonification module of a system for situation recognition according to an embodiment of the invention, wherein only objects in a predetermined sub-area of ​​a monitoring space are perceivable as sound sources for the user; and Fig. 11 a symbolic representation of the perception of a spatial distribution of sound by a user, which can be generated by means of a transducer based on an audio signal which is generated by a sonification module of a system for situation recognition according to an embodiment of the invention, wherein only objects in a predetermined sub-area of ​​a monitoring space are perceptible as sound sources for the user.

[0034] In the figures, the same reference symbols denote identical or functionally identical components, unless otherwise stated.

[0035] Fig. 1 shows in a highly simplified manner a surveillance system 100 for monitoring a surveillance room S. As in Fig. 1 symbolically shown, the monitoring system 100 comprises a system 1 for situation recognition and a sensor system 110.

[0036] The sensor system 110 has at least one monitoring sensor 111, with which mobile objects O located in a monitoring area S can be detected and position data of the objects O can be recorded. The monitoring area S is generally a predetermined geographical area, optionally including the associated airspace, or it is merely the airspace belonging to the geographical area. Fig. 1 symbolically shows that three aircraft and a tank are located as objects O in the surveillance space S. The surveillance sensors 111 can be implemented, for example, as optical sensors, radar sensors, lidar sensors, or in a similar manner. In Fig. 1, the sensor system 110 is shown purely as an example as a satellite.

[0037] The monitoring sensors 111 are used to acquire position data of the objects. The position data contains, as position data content, at least a spatial position of the objects O within the surveillance space S and an identification feature of the respective object O, based on which the type of the respective object O, e.g., "aircraft," "tank," "helicopter," "ship," "unknown / unidentifiable object," etc., can be determined. The spatial position can be contained in the position data, e.g., in the form of GPS coordinates. Optionally, additional characteristic features of the object, such as direction of movement, speed, "friend" or "foe" status, etc., can be included as position data content and thus as information in the position data. If the airspace is monitored as the surveillance space S, the position data can, for example, contain a recognized air picture.

[0038] The sensor system 110 is connected to the situation recognition system 1, e.g., via a wireless data connection. The situation recognition system 1 receives the position data acquired by the sensor system 110 and serves to convert the acquired position data into an output perceivable by a human user U, which the user U can use to obtain an overview of the position or situation in the monitoring space S. For example, the system 1 can be integrated into a stationary command center 150, as described in Fig. 1 is symbolically represented. Of course, system 1 can also be used on a mobile platform, such as a vehicle, an aircraft, or a ship.

[0039] Fig. Figure 2 shows, in a highly simplified and symbolic manner, the functional principle of the system 1 for situation recognition and its possible use by a human user U. The system 1 comprises a data interface 11, an optional first operating device 14, a sonification module 20, and an electroacoustic sound transducer 30, e.g., in the form of headphones. The data interface 11 and the first operating device 14 can be part of a Fig. 2 not shown host system 10.

[0040] As in Fig. 2, the operating device 14 has an output device 14A, e.g., in the form of a display. The operating device 14 is connected to the data interface 11, e.g., via a wireless or wired data connection. Using the output device 14A, a visual representation, e.g., in the form of a virtual map M, can be generated from the position data. This visual representation can, for example, contain a symbolic representation O' of the objects O located in the monitoring space S.

[0041] As in Fig. 2, the sonification module 20 is connected to the data interface 11, e.g., via a wireless or wired data connection. The sonification module 20 is configured to convert the position data into an audio signal or to encode the position data as an audio signal according to predetermined rules. This will be explained in more detail below. The audio signal thus contains an acoustic representation of the objects O in the monitoring space S. The electroacoustic transducer 30, which is connected to the sonification module 20 via a wireless or wired data connection, is configured to convert the audio signal of the sonification module 20 into an acoustic output. The user U thus receives a type of acoustic map A, which contains an acoustic representation O" of the objects O located in the monitoring space S, as shown in Fig. 2 is shown symbolically.

[0042] A key advantage of sonification of situation data is that it incorporates the capabilities of human hearing into situation recognition. This relieves the user U, for example, of having to obtain all information from a visual representation. Due to the ability of human hearing to perceive even the smallest changes in acoustic parameters, sonification of situation data also makes it easier for the user U to perceive changes in the situation in the surveillance space, such as the appearance of a new object O or a reduction in the distance between a hostile object O and a friendly object O. In particular, this also makes it easier for the user U to maintain an overview of a large number of objects O. Furthermore, the parallelization of tasks is facilitated.Furthermore, the acoustic representation is less location-dependent than a visual representation, since the user U can carry the transducer 30 with him, e.g. in the form of headphones, and simultaneously perform other tasks.

[0043] In Fig. Figure 3 shows an exemplary block diagram of the system 1 for situation recognition and the monitoring system 100. As already explained, the system 1 comprises a host system 10 with a data interface 11, an optional data memory 12, and an optional first operating device 14, a sonification module 20, an electroacoustic transducer 30, an optional second operating device 40, and an optional orientation sensor 50.

[0044] The host system 10 can, in particular, comprise a server. The data interface 11 is connected to the monitoring sensors 111 of the sensor system 110 of the monitoring system 100 and receives the position data acquired by the monitoring sensors 111 and optionally already processed by an external computing device (not shown). These data can be stored, for example, in the optional data memory 12, which can, in particular, be implemented as a non-volatile data memory such as an EEPROM or a hard disk.

[0045] The optional first operating unit 14 can be implemented, in particular, as a computer with a processor (not shown) and a data memory (not shown). The processor can be, for example, an ASIC, an FPGA, a PLD, a digital signal processor, a microcontroller, or another suitable computing device capable of processing incoming signals containing the position data and converting processed signals into output values. The first operating unit 14 further comprises an output device 14A, which can be implemented, for example, as a display and, as already explained above, is configured to generate a visual representation based on the position data. The first operating unit 14 can also have an input device 14B, which can be implemented, for example, as a keyboard or generally as an input interface, via which the user U can enter control commands.Based on the control commands, the first control unit 14 can generate control data or control signals, which can be used to trigger other components of the system 1, in particular the sonification module 20, to execute predetermined steps. This will be explained in more detail below.

[0046] The sonification module 20 can, as in Fig. 3, it can be implemented as a separate unit from the first operating unit 14 or as a separate unit from the host system 10. In this case, the sonification module 20 can be implemented as a computer with a processor (not shown) and a data memory (not shown). The processor can be, for example, an ASIC, an FPGA, a PLD, a digital signal processor, a microcontroller or another suitable computing device that is capable of processing incoming signals containing the position data and converting processed position data into audio signals. The data memory can in particular be a non-volatile data memory, such as an EEPROM or a hard disk, which stores a software program that is designed to cause the processor to carry out steps for sonifying the position data. The sonification module 20 can also be implemented purely as a software module orA software program may be implemented which is designed to cause a processor to execute steps for sonification of the position data.

[0047] As in Fig. 3, the sonification module 20 has an input interface 21, an output interface 22, and a control interface 23. The input interface 21 can be connected to the data storage 12 of the host system 10 or directly to the data interface 11 of the host system 10. The output interface 22 is connected to the acoustic transducer 30, e.g., via a wired or wireless data connection such as Bluetooth, WiFi, or the like.

[0048] The sonification module 20 receives the position data via the input interface 21, converts it into an audio signal based on predetermined rules, and provides the audio signal at the output interface 22. In Fig. 5 the sonification of position data by the sonification module 20 is symbolically represented.

[0049] Sonification module 20 can, for example, receive the position data for a specific object O located in the monitoring space S as input data set x.

[0050] The input data set x contains various position data contents x1, x2...xN. For example, the position data content x1, as value v1, can be the position of the object O in the form of GPS coordinates, the position data content x2, as value v2, can be the object's identifying feature, etc. In general, each position data content xN has a value vN. The sonification module 20 determines acoustic parameters P1, P2...PN for each position data content x1...xN. The acoustic parameters P1, P2...PN can be, for example, a pitch, a timbre, a rhythm, a volume, a chord, or similar parameters.

[0051] For each attitude data content x1...xN, for example, there may be a look-up table in which specific acoustic parameters P1, P2...PN are stored for each value v1. For example, for the attitude data content x2, which in the present example contains the identifying feature of the object O, for a value v2 that identifies the object as an aircraft, a specific pitch and a specific timbre can be stored in the look-up table as parameters P1, P2. The sonification module 20 determines the acoustic parameters according to this predetermined, systematic assignment of acoustic parameters to the attitude data content.

[0052] Furthermore, the sonification module 20 generates an audio signal y representing the determined acoustic parameters and outputs the audio signal y at the output interface 22, as shown in Fig. 5 is symbolically represented. Thus, the position data is encoded as an audio signal by the sonification module 20 according to a predetermined rule depending on the position data contents.

[0053] The electroacoustic transducer 30 has at least one sound source, optionally at least two or more sound sources, which are configured to generate sound based on the audio signal. The electroacoustic transducer 30 can, for example, be configured to be stationary with respect to the user U, e.g., by being implemented as a headset wearable by the user U, as described in the Fig. 3 and Fig. 4 is shown by way of example. Of course, the transducer 30 can also be implemented as a set of loudspeakers relative to which the user U can move freely, e.g., as wall-mounted loudspeakers in a room of a command center.

[0054] The sonification module 20 can be configured to generate a direction signal based on the position of the objects O contained in the position data, which represents an orientation of the objects O with respect to an origin of a reference coordinate system K1 of the monitoring space S. In Fig. 6 symbolically shows a top view of the monitoring space S with the reference coordinate system K1, wherein the user U is located at the origin of the reference coordinate system K1. Furthermore, three objects O are symbolically represented as rectangles, as well as their acoustic representation O''. Based on the position of the objects O, which is contained in the position data as position information, the sonification module 20 generates a directional signal that describes the direction, e.g., as a vector, in which the object O is located from the origin of the reference coordinate system K1. The sonification module 20 provides this reference signal at the output interface 22, and the acoustic transducer 30, which in this case has at least two sound sources, converts the audio signal, using the at least two sound sources, into an acoustic output representing the orientation based on the directional signal.This means that the sound sources of the transducer 30 are spatially distributed around the user U, e.g., in that several differently oriented sound sources are provided in each earpiece of the headphones, and are controlled by the audio signal in such a way that the user U has the approximate impression that the acoustic representation O'' belonging to the respective object O comes from the direction defined by the directional signal.

[0055] As in Fig. 3, the system 1 can have an orientation sensor 50, which is configured to detect an orientation of the head of the user U relative to the origin of the reference coordinate system and to generate an orientation signal representing the orientation of the head of the user U relative to the origin of the reference coordinate system K1. The orientation sensor 50 can be implemented, for example, by an acceleration sensor or a gyroscope, which is fixedly connected to the transducer 30 implemented as headphones or can be fixedly attached to the head of the user U in another way. It is also conceivable to use an optical sensor, e.g. a camera, as the orientation sensor 50, which detects the movement of the head of the user U. In this way, it can be detected how the head of the user U and thus his ears ora user coordinate system K2, which is stationary with respect to the user, in particular with respect to the head of the user U, is oriented relative to the reference coordinate system K1. As in . Fig. As shown in Figure 7, the user coordinate system K2 is compared to Fig. 6 is rotated by an angle α. This angle α can be detected, for example, by the orientation sensor 50, which generates an orientation signal representing the angle.

[0056] The optional orientation sensor 50 is connected to the sonification module 20, e.g., via wireless or wired data communication. In particular, the orientation sensor 50 can be connected to the control input 23 of the sonification module 20. The sonification module 20 is configured to modify the direction signal based on the orientation signal such that the direction signal represents an orientation of the objects O relative to an origin of the user coordinate system K2, which corresponds to their orientation in the reference coordinate system K1 when the transducer 30 is not stationary relative to the user U.If the transducer 30 is designed as a loudspeaker that is stationary with respect to the reference coordinate system K1, the sound sources of the transducer 30 are controlled by the directional signal, which is modified by the orientation signal, such that the acoustic representation O'' of the objects O always comes from the same direction with respect to the user coordinate system K2. The acoustic representation O'' thus has the same coordinates or the same direction in the user coordinate system K2 as in the reference coordinate system K1. The sound, to put it figuratively, rotates with the user. This is illustrated by way of example in . Fig. 8. Furthermore, sonification module 20 is configured to modify the direction signal based on the orientation signal such that it represents an orientation of the objects O relative to the origin of a user coordinate system K2 when the transducer 30 is arranged stationary with respect to the user U. If the transducer 30 is thus designed as a loudspeaker or headphones that are stationary with respect to the user coordinate system K2, the sound sources of the transducer 30 are controlled by the direction signal, which is modified by the orientation signal, such that the direction from which the acoustic representation O'' of the objects O comes with respect to the user coordinate system K2 changes with the rotation of the user coordinate system K2. The sound is, vividly speaking, rotated against the rotation of the head of the user U and thus fixed with respect to the reference coordinate system K1. This is shown in Fig. 7 is shown as an example.

[0057] As in Fig. 3, the optional first operating device 14 is connected to the sonification module 20. In particular, the first operating device 14 can be connected to the control interface 23 of the sonification module 20. Furthermore, the first operating device 14 is connected either directly to the data interface 11 of the host system 10 or to the optional memory 12 and thus via the latter to the data interface 11 of the host system 10, as shown in Fig. 3 is shown by way of example. As already explained, the input device 14B of the first operating device 14 is configured for the input of control commands by the user U. Based on the control commands, the input device 14B generates control signals which represent or contain control data. The sonification module 20 receives this control data at the control interface 23 and is configured to adapt the generation of the audio signal in accordance with the input control commands. For example, the user U can change the assignment of the acoustic parameters to the position data contents. For example, it is conceivable that the user can enter a control command into the input device 14B, based on which the sonification module 20 is prompted to change the tone or timbre used for a specific object type, e.g. by changing the respective look-up table.Further or other control commands, which will be explained below, can also be input via the input device 14B.

[0058] The second operating device 40 is designed as an interactive operating device, through which the user U can generate control commands via gestures, verbal utterances, or other physical expressions of will. For this purpose, the second operating device 40 has a sensor device 41 for detecting a movement of the user U and / or a verbal utterance of the user U. For example, the sensor device 41 can be implemented as a microphone, as an optical sensor, as capacitive sensors integrated into a so-called data glove, or in a similar manner. Optionally, the second operating device 40 can have a processor or, more generally, a signal converter 42, which is configured to convert the data detected by the sensor device 41 into control commands. In general, the second operating device 40 is configured to generate a control command based on the detected movement and / or on the detected utterance. As in Fig. 3, the second operating device 40 can be connected directly to the control interface 23 of the sonification module 20, e.g., via wireless or wired data communication. An advantage of this solution is that a user interface independent of the host system 10 is provided, thus facilitating the coordination of the user interface and the sonification module 20. Alternatively, the second operating device 40 can also be connected to the host system 10, e.g., to the first operating device 14, which in turn is connected to the control interface, as shown by way of example in Fig. 4. This offers the advantage that the second operating device 40 can also be used for other functions of the host system 10. The sonification module 20 is configured to adapt the generation of the audio signal according to the input control commands. This functions analogously to the control commands generated with the first operating device 14. In principle, it can be provided that both the first and the second operating device 14, 40 can each generate the same control commands and that these are also processed in the same way by the sonification module 20. To avoid repetition, no distinction is made below as to whether the control commands are generated by the first or the second operating device 14, 40.

[0059] For example, it can be provided that the control command contains control data that spatially define a sub-area S1 of the monitoring space S, and that the sonification module 20 is configured to select, based on the control data, position data of objects O that are located in the defined sub-area S1 of the monitoring space S, and to generate the audio signal only from the position data of these objects O. This is exemplified in the Fig. 9 to 11.

[0060] In Fig. 9, the sub-area S1 is shown as a circular sector. The objects O are symbolically represented as rectangles, and the acoustic representations O'' of the respective objects O are symbolically represented by wave symbols. The sonification module 20 is configured to filter the position data 20 received at the input interface 21, e.g., based on the position information "position of the object," and to sonify only the position data that belong to objects O located in the sub-area S1. In Fig. 9 this means that the converter 30 generates an acoustic representation O'' from the audio signal for the two objects O located in the sub-area S1, but not for the object O located outside the sub-area S1.

[0061] In the Fig. 10 and Fig. 11, the subarea S1 is shown in the views (B) as an example as a circular ring around the user U. In Fig. 10, the subarea S1 has a greater distance to the user U than in Fig. 11. In Fig. 10, the converter 30 therefore generates an acoustic representation O'' from the audio signal only for the object O located in the sub-area S1 and far away from the user U, but not for the objects O located outside the sub-area S1, which are shown closer to the user U. This also applies to objects O that are at a greater distance from the user U than the object O located in the sub-area S1, i.e. generally for objects located outside the sub-area S1. In Fig. 11, however, the converter 30 generates an acoustic representation O'' from the audio signal only for the two nearby objects O located in the sub-area S1, but not for the distant object O located outside the sub-area S1. This also applies to objects O that are at a smaller distance from the user U than the objects O located in the sub-area S1, i.e. generally for objects located outside the sub-area S1.

[0062] In the views (A) of the Fig. 10 and Fig. Figure 11 again illustrates the principle of the input of control commands by the user U via the second input device 40. In this case, the sensor device 41 can be implemented, for example, as an optical sensor configured as an eye tracker. This means that the sensor 41 detects a viewing direction of the eyes of the user U, and, based on the viewing direction, determines an area 40b on a reference surface 40a at which the user U is looking. A predetermined sub-area S1 of the monitored space S can be assigned to this area 40b, for example, and the second input device 40 can retrieve the control data representing the sub-area S1 and generate a corresponding control signal.

[0063] In addition to or alternatively to a subarea S1, the control command can contain the identification feature of one or more objects O as control data. Accordingly, the user U can specify the types of objects O for which the attitude data should be sonified. For example, a user U can specify that only attitude data of aircraft should be sonified. The sonification module 20 is accordingly configured to select attitude data of objects O that have the corresponding identification feature and to generate the audio signal only from the attitude data of these objects O.

[0064] A method for monitoring a surveillance space S can be carried out in particular by means of the monitoring system 100 described above. In a first step, the position data of objects O located in the surveillance space S are recorded by means of the monitoring sensors 111. In a further step, the acoustic parameters are determined according to a predetermined assignment of acoustic parameters to the position data contents, e.g., by means of the sonification module 20 as described with reference to the Fig. 5 was explained by way of example. Furthermore, the audio signal representing the acoustic parameters is generated, e.g., by means of the sonification module 20. This audio signal is then converted by means of the converter 30 into an acoustic output perceivable by a human user U.

[0065] Although the present invention has been explained above using exemplary embodiments, it is not limited thereto but can be modified in a variety of ways. In particular, combinations of the above embodiments are also conceivable. LIST OF REFERENCE SYMBOLS 1 system 10 Host system 11 first data interface 12 data storage 14 first operating device 14A Output device 14B Input device 20 Sonification module 21 Input interface 22 Output interface 23 Control interface 30 acoustic transducers 40 interactive, second control device 41 Sensor device of the second operating device 42 signal converters 50 Orientation sensor 100 surveillance system 110 Sensor system 111 monitoring sensors 150 Command Center A Acoustic map K1 reference coordinate system K2 user coordinate system M virtual card O Object O' graphic representation of the object O'' acoustic representation of the object S Monitoring room S1 sub-area U User α angle

Claims

[1] System (1) for situation detection with regard to mobile objects (O) located in a surveillance space (S), comprising: a host system (10) with a data interface (11) for receiving location data, which at least contain as location data contents: a spatial position of the objects (O) within the surveillance space (S) and at least one identification feature of the respective object (O); a sonification module (20) connected to the host system (10) and having an output interface (22), wherein the sonification module (20) is configured to determine acoustic parameters according to a predetermined assignment of acoustic parameters to the position data contents, to generate an audio signal representing the determined acoustic parameters and to output the audio signal at the output interface (22); and an acoustic transducer (30) connected to the output interface (22) of the sonification module (20) and configured to convert the audio signal of the sonification module (20) into an acoustic output perceivable by a human user (U); wherein the host system (10) has a first operating device (14) connected to the data interface (11) with an output device (14A) for generating a visual representation based on the position data; wherein the first operating device (14) has an input device (14B) for the input of control commands by the user (U), wherein the sonification module (20) is configured to adapt the generation of the audio signal according to the input control commands; and wherein the control command is the identification feature of one or several objects (O) as control data, and wherein the sonification module (20) is configured to select position data of objects (O) which have the corresponding identification feature, and generates the audio signal only from the position data of these objects (O). [2] System (1) according to claim 1, additionally comprising: a second, interactive operating device (40) connected to the host system (10) or a control interface (23) of the sonification module (20), which has a sensor device (41) for detecting a movement of the user (U) and / or a verbal utterance of the user (U) and is configured to generate a control command based on the detected movement and / or on the detected utterance; wherein the sonification module (20) is configured to adapt the generation of the audio signal according to the input control commands [3] System (1) for situation detection with regard to mobile objects (O) located in a surveillance space (S), comprising: a host system (10) with a data interface (11) for receiving location data, which at least contain as location data contents: a spatial position of the objects (O) within the surveillance space (S) and at least one identification feature of the respective object (O); a sonification module (20) connected to the host system (10) and having an output interface (22), wherein the sonification module (20) is configured to determine acoustic parameters according to a predetermined assignment of acoustic parameters to the position data contents, to generate an audio signal representing the determined acoustic parameters, and to output the audio signal at the output interface (22); an acoustic transducer (30) connected to the output interface (22) of the sonification module (20) and configured to convert the audio signal of the sonification module (20) into an acoustic output perceivable by a human user (U); and a second, interactive operating device (40) connected to the host system (10) or a control interface (23) of the sonification module (20), which has a sensor device (41) for detecting a movement of the user (U) and / or a verbal utterance of the user (U) and is configured to generate a control command based on the detected movement and / or on the detected utterance; wherein the sonification module (20) is configured to adapt the generation of the audio signal according to the input control commands; and wherein the control command is the identification feature of one or several objects (O) as control data, and wherein the sonification module (20) is configured to select position data of objects (O) which have the corresponding identification feature, and generates the audio signal only from the position data of these objects (O). [4] System (1) according to claim 3, wherein the host system (10) has a first operating device (14) connected to the data interface (11) with an output device (14A) for generating a visual representation based on the position data. [5] System (1) according to claim 4, wherein the first operating device (14) comprises an input device (14B) for input of control commands by the user (U), wherein the sonification module (20) is configured to adapt the generation of the audio signal according to the input control commands. [6] System (1) according to one of the preceding claims, wherein the acoustic parameters comprise one or more of the following parameters: Pitch, timbre, rhythm, volume, chords. [7] System (1) according to one of the preceding claims, wherein the mobile objects (O) comprise aircraft and the attitude data contain a recognized air picture. [8] System (1) according to one of the preceding claims, wherein the control command contains control data which spatially define a partial area (S1) of the monitoring space (S), and wherein the sonification module (20) is configured to select, based on the control data, position data of objects (O) which are located in the defined partial area (S1) of the monitoring space (S), and to generate the audio signal only from the position data of these objects (O). [9] System (1) according to one of the preceding claims, wherein the sonification module (20) is configured to generate a directional signal based on the position of the objects (O) contained in the position data, which directional signal represents an orientation of the objects (O) with respect to an origin of a reference coordinate system of the monitoring space (S), and wherein the acoustic transducer (30) has at least two sound sources and is configured to convert the audio signal, by means of the at least two sound sources, into an acoustic output representing the orientation based on the directional signal. [10] System (1) according to claim 9, additionally comprising: an orientation sensor (50) connected to the sonification module (20) and configured to detect an orientation of the head of the user (U) relative to the origin of the reference coordinate system (K1) and to generate an orientation signal representing the orientation of the head of the user (U) relative to the origin of the reference coordinate system (K1); wherein the sonification module (20) is adapted to - modifying the direction signal based on the orientation signal such that it represents an orientation of the objects (O) relative to an origin of a user coordinate system (K2) that is stationary with respect to the head of the user (U), which corresponds to their orientation in the reference coordinate system (K1) when the transducer (30) is not stationary with respect to the user (U), and - to modify the direction signal based on the orientation signal such that it represents an orientation of the objects (O) relative to the origin of a user coordinate system (K2) when the transducer (30) is arranged stationary with respect to the user (U). [11] System (1) according to one of the preceding claims, wherein the host system (10) has a data memory (12) connected to the data interface (11) which stores the position data, wherein the sonification module (20) is connected to the data memory (12). [12] Monitoring system (100) for monitoring a monitoring room (S), comprising: a sensor system (110) with a plurality of monitoring sensors (111) for detecting position data of objects (O) located in the monitoring space (S), wherein the position data contains at least the following position data contents: a spatial position of the objects within the monitoring space (S) and an identification feature of the respective object (O); and a system (1) according to one of the preceding claims; wherein the sensor system (110) is connected to the data interface (11) of the host system (10). [13] Method for monitoring a surveillance space (S), comprising: Detecting location data of objects (O) located in the monitoring space (S) by means of monitoring sensors (111), wherein the location data contains at least the following location data contents: a spatial position of the objects within the monitoring space (S) and an identification feature of the respective object (O); Determining acoustic parameters according to a predetermined assignment of acoustic parameters to the position data contents; Generating an audio signal representing the acoustic parameters; Converting the audio signal into an acoustic output perceivable by a human user (U) by means of an acoustic transducer (30); Input of control commands by the user (U) via an input device (14B) of a first operating device (14; 40) which is connected to a data interface (11) and has an output device (14A) for generating a visual representation based on the position data and / or detecting a movement of the user (U) and / or a verbal utterance of the user (U) via a sensor device (41) of a second, interactive operating device (40), and generating a control command based on the detected movement and / or on the detected utterance by the second interactive operating device; and Adjusting the generation of the audio signal according to the input and / or generated control commands by a sonification module (20); wherein the control command is the identification feature of one or several objects (O) as control data, and wherein the sonification module (20) is configured to select position data of objects (O) which have the corresponding identification feature, and generates the audio signal only from the position data of these objects (O).

Images