Display apparatus for a video monitoring system, video monitoring system and method

The display apparatus for video monitoring systems addresses the challenge of navigating multiple camera views by creating a coherent model of the monitored area and maintaining a consistent perspective, allowing monitoring personnel to intuitively select and track cameras, thereby improving situational awareness and operational efficiency.

GB2601612BActive Publication Date: 2024-12-04ROBERT BOSCH GMBH
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
GB2021014620
Authority / Receiving Office
GB · GB
Patent Type
Patents
Current Assignee / Owner
Priority Date
2020-10-21
Filing Date
2021-10-13
Publication Date
2024-12-04
Estimated Expiration
2041-10-13

AI Technical Summary

Technical Problem

Existing video monitoring systems face challenges in providing a clear and intuitive display of camera scenes to monitoring personnel, particularly in dynamically changing environments with multiple cameras, where the orientation and perspective of the camera views can be confusing and difficult to navigate.

Method used

A display apparatus for a video monitoring system that includes a model module to create a coherent 2D or 3D model of the monitored area with virtual cameras, a display module to orient the model perspective based on the viewing direction of the selected camera, and a processing module to simplify the display by maintaining a uniform orientation and perspective, allowing easy selection and tracking of cameras and their fields of view.

Benefits of technology

This solution enables monitoring personnel to quickly and intuitively orient themselves within the model, simplifying the navigation and selection of cameras, even when the viewing direction changes, by maintaining a consistent model perspective and displaying adjacent cameras' images in relation to the selected camera, thus enhancing situational awareness and operational efficiency.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 00000001_0000
    Figure 00000001_0000
  • Figure 00000002_0000
    Figure 00000002_0000
  • Figure 00000003_0000
    Figure 00000003_0000
Patent Text Reader

Abstract

The invention relates to a display apparatus, 1, for a video monitoring system, wherein the video monitoring system is configured to monitor a monitored area, 9, with a plurality of monitoring cameras, 3. The system comprises a model module which provides a model (Figure 2, 8) of the monitored area with the monitoring cameras, and a display module for a display device. The display module is configured to display the model on the display device. A processing module selects at least one of the monitoring cameras as a selected monitoring camera, wherein the selected monitoring camera defines a viewing direction, S. The display module is configured to display the model on the display device such that the model is oriented as a function of the viewing direction, S, of the selected monitoring camera in accordance with a model perspective. The model may be a two-dimensional model (such a plan view of the monitored area, Figure 2, 8) or a three-dimensional model.
Need to check novelty before this filing date? Find Prior Art

Description

Title Display apparatus for a video monitoring system, video monitoring system and method State of the art The invention relates to a display apparatus for a video monitoring system having the features of the preamble of Claim 1. The invention also relates to a video monitoring system comprising the display apparatus and a method. Camera-based monitoring apparatuses record scenes from a monitored area with cameras in order to either analyse said scenes automatically or to, for example, present them to monitoring personnel at a monitoring centre. At the interface between the monitoring apparatus and the monitoring personnel, in particular, it is important that the scenes of the cameras are displayed in a clear manner to allow the monitoring personnel easy access to the content of the scenes. Document DE 10 2012 211 298 Al, which arguably relates to the closest prior art, relates to a display apparatus for a video monitoring system, wherein a freely selectable location in a monitored area can be interactively selected and wherein the display apparatus shows a scene from a camera observing said location. Disclosure of the Invention The subject matter of the invention is a display apparatus having the features of Claim 1, a video monitoring system having the features of Claim 13, and a method having the features of Claim 15. Advantageous or preferred design examples of the invention will emerge from the subclaims, the following description and the accompanying figures. The subject matter of the invention is a display apparatus which is suitable and / or configured for a video monitoring system. The video monitoring system is configured to monitor a monitored area and comprises a plurality of monitoring cameras. The monitored area can be a public space, a building, a factory floor, a school, a university, a plurality of contiguous rooms or areas, etc. The monitored area can be a contiguous monitored area or can also be fragmented or divided. The video monitoring system comprises a plurality of monitoring cameras which are distributed within the monitored area. The monitoring cameras can be stationary monitoring cameras that can either be rigidly positioned or configured as movable monitoring cameras, e.g. PTZ cameras (pan-tilt-zoom). It is also possible for the monitoring cameras or a portion thereof to be mobile, so that they can automatically change their positions in the monitored area. The stationary, movable, and / or mobile monitoring cameras, also referred to collectively as active monitoring cameras, can orient their field of view within the scope of their degrees of freedom. It is preferred that the video monitoring system comprises at least five, preferably at least ten, and in particular at least 30 monitoring cameras. The display apparatus comprises a model module, wherein the model module provides a model of the monitored area with the monitoring cameras. The monitoring cameras are in particular shown in the model as virtual monitoring cameras. It is possible that the monitored area and the monitoring cameras are integrated in a common, coherent model, or that the monitored area and the monitoring cameras are displayed in two submodels which together form the model. The model of the monitored area particularly preferably includes floors, walls, windows, door openings and optionally additionally fixed objects, such as furniture, production equipment, fixtures, etc. The model can be a 2D model or a 3D model. It can also be provided that the model is a plan or an image. The model of the monitoring cameras particularly preferably includes the position, orientation and magnification or viewing angle of the monitoring cameras. For example, for each monitoring camera, the model can include a position, an orientation, an up-direction, and a viewing angle. If the monitoring camera is an active camera with degrees of freedom, e.g. with respect to the pivot angle, the tilt angle, the zoom factor or the viewing angle and / or the position, ranges defining the degrees of freedom can be stored for the mentioned parameters. The model module can also be configured as an interface that loads the model from an external data source and thus makes it available to the display apparatus. The display apparatus further includes a display module for a display device, wherein the display module is configured to display the model on the display device. The display device can, for example, be configured as one or more monitors. The display device is optionally a component of the display apparatus and / or the monitoring system. The display module takes the provided model and forwards it to the display device for display. The display apparatus comprises a processing module that selects at least one of the monitoring cameras as a selected monitoring camera. The selected monitoring camera is preferably oriented or can be oriented to a selected location and / or a selected position in the monitored area. The monitoring camera, in particular the selected monitoring camera, has a viewing direction. The viewing direction is in particular defined by a centre or a primary axis of the field of view of the monitoring camera. The display apparatus can be configured as a centralised system, but it is also possible for the display apparatus to have a decentralised or partially decentralised structure. For example, the display apparatus, in particular the modules and / or the devices, can be configured as a server-client system, a cloud service, and / or as one or more digital data processing devices. In the context of the invention, it is proposed that the display module be configured in terms of software and / or programming to display the model on the display device such that the model is oriented as a function of the viewing direction of the selected monitoring camera in accordance with a model perspective. The model perspective changes in particular when the viewing direction changes. More specifically, the model perspective is configured to be dependent on the viewing direction. The underlying thought of the invention is that the model is always oriented in a predefined and uniform state by means of a model perspective that is configured as a function of the viewing direction of the selected monitoring camera. This simplifies and / or standardises the display of the model. In operation, this results in the advantage that the model is always oriented with reference to the viewing direction of the selected monitoring camera, so that, thanks to the simplified and / or standardised display, monitoring personnel can orient in the model themselves very quickly and intuitively. In a preferred further development of the invention, when the selected monitoring camera changes from a current selected monitoring camera to a new selected monitoring camera, the display module is configured to orient the model of the model perspective with reference to the viewing direction of the new selected monitoring camera. The model is consequently always displayed in the same model perspective with reference to the viewing direction of the current selected monitoring camera. In a preferred embodiment of the invention, the model is configured as a 2-D model, in particular as a map. Alternatively or additionally, it is provided that the model is displayed in a bird's eye view as the model perspective. In an advantageous further development of the invention, the viewing direction of the selected monitoring camera or the viewing direction of the selected monitoring camera projected onto the base of the model, in particular the map, is oriented to align with an upper side of the display device. The display device is configured as a screen, for example, whereby the viewing direction and / or the projected viewing direction faces toward the upper side parallel to the sides of the screen. This model perspective is particularly easy to implement and is spontaneously and intuitively comprehensible for the monitoring personnel. In particular, a first person view (FPV) is implemented. When the selected monitoring camera is changed, the model is preferably rotated until the model perspective is set for the new selected monitoring camera. The rotation is preferably displayed in the display device, so that the transition from the old model perspective to the new model perspective is guided. In an alternative embodiment of the invention, the model is configured as a 3-D model, whereby the model is displayed in the model perspective from a first-person perspective of the selected camera. In this alternative embodiment, the viewing direction of the selected camera corresponds to the displayed model perspective. Considering the wide variety of computer games, many people, and therefore also the monitoring personnel, find it particularly easy to find their way around this display. In another alternative, the model is displayed in a third-person perspective as the model perspective, whereby the virtual viewer would appear to be standing behind the monitoring camera in an extension of the viewing direction of the selected monitoring camera. Considering the wide variety of computer games, many people, and therefore also the monitoring personnel, find it particularly easy to find their way around this display. In a possible further development, the selected monitoring camera has an adjustable field of view. The selected monitoring camera is implemented as a PTZ camera, for example. The display module is configured to track the model in the viewing direction of the selected monitoring camera when the field of view of the selected monitoring camera changes. As a result, the model is oriented as a function of the current viewing direction of the selected monitoring camera in accordance with the model perspective. It is particularly preferred that the selected monitoring camera is always disposed in the same position in the model perspective with reference to the display device, in order to simplify the display and to improve the identification of the selected monitoring camera. The selected monitoring camera is preferably positioned in the centre of the display device. It is preferred that in particular adjacent monitoring cameras are shown in the model. These monitoring cameras can in particular be selected to be new selected monitoring cameras. This addition makes it possible to easily locate another monitoring camera that continues to display the monitoring object in the event that said monitoring object leaves the viewing area of the selected monitoring camera. In a preferred further development, the display module is configured to display a monitoring image of the selected monitoring camera and of at least or exactly one, some or all of the adjacent monitoring cameras on the display device. It can also be provided that images from multiple adjacent monitoring cameras are displayed. The images are in particular displayed in the form of a cameo and / or matrix. The monitoring images of the adjacent monitoring cameras are preferably arranged in the correct position relative to the monitoring image of the selected monitoring camera in the model perspective, as in the model. Therefore, if an adjacent monitoring camera is located top-left relative to the selected monitoring camera in the model, the monitoring image of that adjacent monitoring camera is likewise located top-left relative to the monitoring image of the selected monitoring camera. It is further preferred that the display apparatus is configured to control at least one of the adjacent monitoring cameras. The control is carried out in such a way that the field of view of the controlled monitoring camera is directed in the direction of the field of view of the selected monitoring camera. The change of the monitoring cameras as the selected monitoring cameras can thus be prepared, whereby the field of view of the adjacent monitoring camera is already preadjusted. The display apparatus preferably comprises a human-machine interface, whereby the processing module is data-technologically connected to the human-machine interface in order to use the human-machine interface to select the respective monitoring camera as the selected monitoring camera. It can also be provided that the processing module is configured to select the monitoring camera which is defined via an interactively determined position in the model and / or via a monitoring object as the selected monitoring camera. For example, a position in the model is interactively selected, in particular via the or another human-machine interface, whereby the processing module identifies a monitoring camera that is directed toward that position. In the event that multiple monitoring cameras are able to acquire the position, one of the monitoring cameras is determined to be the selected monitoring camera according to a control set of rules. A further subject matter of the invention relates to a video monitoring system, wherein the video monitoring system is configured to monitorthe monitored area with a plurality of monitoring cameras and is characterised by a display apparatus described in the claims, and / or according to the foregoing description. A further subject matter of the invention relates to a method for displaying a model of a monitored area, wherein a monitoring camera is selected from a plurality of monitoring cameras as a selected monitoring camera. The model is subsequently displayed, whereby the model is oriented as a function of the viewing direction of the selected monitoring camera in accordance with a model perspective. Further features, advantages and effects of the invention will emerge from the following description of a preferred design example of the invention and the accompanying figures. The figures show: Figure 1 a schematic block diagram of a display apparatus as a design example of the invention; Figures 2, 3, 4 schematic views onto a display device of the display apparatus in Figure 1. In a schematic block diagram, Figure 1 shows a display apparatus 1 as a design example of the invention. The display apparatus 1 is coupled to a monitoring system 2 or forms part of the monitoring system 2. The monitoring system 2 comprises a plurality of monitoring cameras 3, which are spatially distributed in a monitored area 9, such as in a building or in a public or open area or the like. The monitoring cameras 3 can be rigid monitoring cameras, movable monitoring cameras, such as PTZ cameras, or mobile monitoring cameras that can independently change their position in the monitored area. Optionally, the mobile monitoring cameras also have PTZ functionality. The monitoring cameras 3 each have a viewing direction S. The viewing direction corresponds in particular to the optical axis of the monitoring cameras 3. The monitoring system 2 and / or the display apparatus 1 comprises a display device 4, on which a model 8 of the monitored area 9 and optionally additional monitoring images 5 of the monitoring cameras 3 can be displayed. The display device 4 can be configured as a screen, for example. The model 8 is provided by a model module 12. The display of the model 8 on the display device 4 is controlled by a display module 10. The display apparatus 1 further comprises a processing module 11, wherein the processing module 11 is configured to select at least one of the monitoring cameras 3 as a selected monitoring camera. The processing module 11 is data-technologically connected to a human-machine interface 6, so that the selection of the monitoring camera 3 as the selected monitoring camera can be carried out via the human-machine interface 6. The display module 10 is configured to display the model 8 on the display device 4 as a function of the viewing direction S of the selected monitoring camera 3 in accordance with a model perspective. From a functional perspective, monitoring personnel 7 can select a monitoring camera 3 as the selected monitoring camera via the human machine interface 6 through the processing module 11. The display module 10 is configured to display the model 8 on the display device 4 as a function of the viewing direction S of the selected monitoring camera in accordance with a model perspective. The definition of the model perspective can also be provided by the model module 12. The display device 4 displays the model 8 in accordance with the model perspective. Monitoring images 13 of the selected monitoring camera can optionally additionally be displayed side-by-side, for example, as a function of the mode of operation of further monitoring cameras 3. When changing from the selected monitoring camera to a new monitoring camera 3, for example via the human-machine interface 6, the display module 10 is controlled via the processing module 11, whereby said display module displays the model 8 as a function of the viewing direction S in accordance with the same model perspective as before. The model 8 is thus always displayed to the monitoring personnel 7 in the same model perspective with reference to the viewing direction S of the selected monitoring camera. From a technical perspective, this simplifies the display process; from an application perspective, this display simplifies the intuitive incorporation of the model 8 by the monitoring personnel 7. Figures 2, 3 and 4 respectively show the display device 4. Each figure shows the model 8 of the monitored area 9 in different model perspectives as well as monitoring images 13 of the monitoring cameras 3. In the present illustration, the model 8 is depicted as a 2-D model, a map, and in particular as a satellite image of the monitored area 9. The monitoring cameras 3 are depicted in the model 8 as examples, and in particular with their orientation and thus their viewing direction for the monitoring personnel 7. The monitoring images 13 are arranged on the right side of the display device 4, whereby the monitoring image 13 of the selected monitoring camera from the monitoring cameras 3 is displayed in the middle and also enlarged relative to the monitoring images 13 of the other monitoring cameras 3. In Figure 2, none of the monitoring cameras 3 is selected. The model 8 is oriented as desired. The model 8 can be "oriented north", for example; i.e. oriented such that the cardinal direction north points upward in the display in the classical convention. Placeholders for the monitoring images 13 are provided in addition to the model 8. These can be filled by monitoring images 13 from any of the monitoring cameras 3. The monitoring personnel 7 can select one of the monitoring cameras 3 as the selected monitoring camera via the human machine interface 6, for example. The human-machine interface 6 is configured as a computer mouse, for example, and one of the monitoring cameras 3 is clicked on. Selecting the monitoring camera 3 as the selected monitoring camera rotates the model 8 on the display device 4 into a model perspective, whereby, in the model perspective in Figure 3, the model 8 is still displayed in bird's eye view but has been rotated such that the viewing direction of the selected monitoring camera faces upward. The model 8 is optionally additionally centred on the selected monitoring camera in the model perspective. The monitoring image 13 of the selected monitoring camera is also displayed on the large placeholder. In particular the adjacent or other monitoring cameras 3 are displayed on the smaller placeholders. Due to the oriented display of the model 8 and the simultaneous display of the monitoring image 13 of the selected monitoring camera, the monitoring personnel 7 can orient themselves in the model 8 particularly quickly and intuitively. The display apparatus 1 now allows another monitoring camera 3 to be defined as the selected monitoring camera, for example again through the human-machine interface 6. In this design example, the monitoring camera 3 marked with an arrow is selected as the new selected monitoring camera. On the display device 4, the model 8 is brought into the model perspective with reference to the new selected monitoring camera, in particular with reference to the viewing direction of the new selected monitoring camera. This is done by rotating the model 8 so that the viewing direction of the new selected monitoring camera now faces upward. The model 8 is furthermore centred with reference to the new selected monitoring camera. It does not matter whether the model 8 is oriented first and then centred or centred first and then oriented. The monitoring image 13 of the new selected monitoring camera is displayed in the large placeholder as well. Also when selecting the new selected monitoring camera, the monitoring personnel can orient themselves in the Model 8 intuitively and quickly. In the event that the selected monitoring camera is configured as a movable, in particular a PTZ, monitoring camera, the model 8 is tracked in the same manner in accordance with the model perspective as a function of the current viewing direction of the selected monitoring camera. Thus, if the selected monitoring camera is pivoted horizontally, the model 8 is rotated in the same manner. Since the monitoring personnel 7 intuitively understands the display device 4 and its contents, they need less detailed knowledge with respect to the position, orientation and name of the camera. An application scenario can proceed as follows: monitoring personnel 7 view monitoring images 13 of the monitoring cameras 3 live or in playback. They are interested in an object, for example, that is in the viewing area of a monitoring camera 3. They open the model 8, whereby the corresponding monitoring camera 3 is located in the model 8, is thereby identified as the selected monitoring camera and whereby the selected monitoring camera is entered in the model 8 in the correct position as an icon. The model 8 is then centred on the new selected monitoring camera. The magnification of the model 8 is set such that adjacent monitoring cameras 3 are also displayed at a specified distance. The orientation of the model 8 is set in accordance with the model perspective such that the model 8 is displayed in a first person view with reference to the selected monitoring camera. The monitoring images 13 of the adjacent monitoring cameras 3 to the selected monitoring camera are automatically displayed adjacent to the monitoring images 13 of the selected monitoring camera and arranged in the model 8 in accordance with their relative positioning. For example, if the monitoring image 13 of an adjacent monitoring camera 3 is located top-left relative to the selected monitoring camera in the model 8, the monitoring image of that monitoring camera 3 is likewise located top-left relative to the monitoring image 13 of the selected monitoring camera. It can optionally be provided that all movable monitoring cameras 3, in particular PTZ monitoring cameras, are automatically set such that their fields of view are directed in the direction toward the selected monitoring camera. If, for example, the monitoring personnel 7 see the object disappearfrom the field of view of the current selected monitoring camera, for example toward the upper left of the model 8, they can select the camera, the field of view of which the object has already entered or will at least probably enter soon, as the new selected monitoring camera. The new selected monitoring camera is used again to determine the model perspective of the model 8 and to centre the model 8. The monitoring personnel 7 can alternatively also select any position in the model 8, for example by clicking with the mouse, whereby a monitoring camera 3, the field of view of which overlaps this position, is determined as the selected monitoring camera.

Claims

1. Display apparatus (1) for a video monitoring system, wherein the video monitoring system is configured to monitor a monitored area (9) with a plurality5 of monitoring cameras (3),comprising:a model module (12), wherein the model module (12) provides a model (8) of the monitored area (9) with the monitoring cameras (3),a display module (10) for a display device (4), wherein the display module (10) is 10 configured to display the model (8) on the display device (4),a processing module (11), wherein the processing module (11) is configured to select at least one of the monitoring cameras (3) as a selected monitoring camera, wherein the selected monitoring camera defines a viewing direction (S),wherein the display module (10) is configured to display the model (8) on the15 display device (4) such that the model (8) is oriented as a function of the viewing direction (S) of the selected monitoring camera in accordance with a model perspective,wherein the selected monitoring camera has an adjustable field of view and the display module (10) is configured to track the model (8) in the viewing direction 20        (S) of the selected monitoring camera when the field of view changes, andwherein the display apparatus (1) is configured to control at least one, some or all of the adjacent monitoring cameras (3), so that the field of view of the at least one adjacent monitoring camera is oriented in the direction of the field of view of the selected monitoring camera.25        2. Display apparatus (1) according to Claim 1, characterised in that, whenthe selected monitoring camera changes, the display module (10) is configured to orient the model (8) in the model perspective with reference to the viewing30 08 24direction (S) of the new selected monitoring camera.

3. Display apparatus (1) according to Claim 1, characterised in that the model (8) is configured as a 2D model and / or that the model (8) is displayed in a bird's eye view.5        4. Display apparatus (1) according to Claim 1, characterised in that themodel (8) is displayed as a 3D model, wherein the model (8) is displayed from a first-person perspective of the selected camera.

5. Display apparatus (1) according to Claim 1, characterised in that the model (8) is displayed from a third-person perspective relative to the selected10 monitoring camera.

6. Display apparatus (1) according to any one of the preceding claims, characterised in that the model (8) is displayed with a centred selected camera.

7. Display apparatus (1) according to any one of the preceding claims,characterised in that adjacent monitoring cameras (3) are shown in the model15          (8).

8. Display apparatus (1) according to any one of the preceding claims, characterised in that the display module (10) is configured to display monitoring images (13) of the selected monitoring camera (3) and the adjacent monitoring cameras on the display device (4), wherein the monitoring images (13) of the20 adjacent monitoring cameras are arranged in the model perspective in the correct position in relation to the monitoring image (13) of the selected monitoring camera as in the model (8).

9. Display apparatus (1) according to any one of the preceding claims, characterised in that the processing module (11) is configured to select another 25 of the monitoring cameras (3) as a new selected monitoring camera, wherein the display module (10) is configured to display the model (8) on the display device(4) such that the model (8) is oriented as a function of the viewing direction (S) of the new selected monitoring camera in accordance with the model perspective.30 08 2410. Display apparatus (1) according to Claim 9, characterised in that said device comprises an MMI (6), wherein the processing module (11) is data-technologically connected to the MMI (6) for determining the new selected monitoring camera.5        11. Display apparatus (1) according to any one of the preceding claims,characterised in that the processing module (11) is configured to select the monitoring camera (3) which is defined via a position and / or an object as the selected monitoring camera.

12. Video monitoring system comprising a plurality of monitoring cameras 10        (3), characterised in that the monitoring system (2) comprises a displayapparatus (1) according to any one of Claims 1 to 11.

13. Method for displaying a model (8) on a display apparatus (1) of a monitored area (9) having a plurality of monitoring cameras (3), wherein one of the monitoring cameras (3) is selected as the selected monitoring camera,15 wherein the model (8) is displayed on the display apparatus (1), and wherein the model (8) is oriented as a function of the viewing direction (S) of the selected monitoring camera in accordance with a model perspective,wherein the selected monitoring camera has an adjustable field of view, and the method comprises tracking the model (8) in the viewing direction (S) of the20 selected monitoring camera when the field of view changes, andwherein at least one, some or all of the adjacent monitoring cameras (3) are controlled so that the field of view of the at least one adjacent monitoring camera is oriented in the direction of the field of view of the selected monitoring camera.

Citation Information

Patent Citations

  • Method and apparatus for providing immersive surveillance

    US20030085992A1

  • Interface for browsing and viewing video from multiple cameras simultaneously that conveys spatial and temporal proximity

    US20080088706A1