Monitoring system

Abstract

A method and system for optimizing data retention time periods in a video surveillance system. Based on geofencing data from a user (1) of a monitored area (17), the data processing proposes a change in the length of the data retention time period in dependence on a detected unoccupied duration of the monitored area (17).

Description

Technical Field

[0002] This invention relates to a monitoring system, and more particularly, but not exclusively, to the storage and retention of image data recorded in the monitoring system. Background Technology

[0004] Video surveillance is combined with intrusion detection, for example, in specific areas such as restricted areas and private locations, such as residences or businesses. Recorded images from video surveillance can then be retained for an appropriate period to aid in the subsequent identification of intruders, such as in cases where the intrusion involves criminal activity. Images from video surveillance cannot and should not be retained indefinitely for various reasons, one being the limited storage capacity of the necessary media for storing the images. However, even with a limited retention period, the required storage capacity for image data can be substantial if there is frequent, long-duration recording, high resolution, and high frame rates for some reason. Ultimately, only the user pays for this storage capacity, whether the user provides storage locally or, as the starting point of this invention, pays a service provider for remote storage during the retention period, such as on a subscription basis. The retention requirement, i.e., the length of the data retention period, can vary depending on the nature of the area and may even change over time for a given area. Consider a residential area, such as an apartment or house with a garden. In a residential area, recording images is generally unnecessary or undesirable when the normal occupants (hereinafter referred to as users) are present. Detecting the presence of users and adjusting actions within the area accordingly (i.e., geofencing) is a well-established technology. For smartphones that typically implement one or more Global Navigation Satellite Systems (GNSS), geofencing features implemented on the smartphone can be used. That is, a geofencing perimeter distance is defined around the smartphone so that when a user carrying the phone approaches a known location of the home, the home area can be detected when it enters the perimeter. Conversely, a geofencing perimeter distance can be defined around a known location of the home to define the home area, thereby allowing the detection of a phone within the home's perimeter. Presence detection in a given area is disclosed in particular in US2020 / 0304971. Examples of actions may include: turning on lights when the first user enters an empty area, or turning off lights once the last user leaves the area and the area is empty again, or conversely, turning on alarms and video surveillance once the last user leaves and turning them off again when the first user arrives. Depending on the home's situation, a home area may be empty for only a few hours on a normal workday, while on weekends it may be empty for several days, or at least one user may be present continuously. During holidays, there may be long periods of time when no user is present in the area. In this context, one object of the present invention is to facilitate data storage needs to adapt to actual conditions.

[0005] US2019 / 0141362A1 discloses a surveillance camera and a surveillance data management system, which includes a video management system having a data retention module for determining when to delete surveillance data. Blocks of surveillance data are deleted based on their age, which is calculated based on the difference between the recording start date of each block and the current time, and adjusted by subtracting the duration of system downtime since the start date. The age is also calculated using a counter, which is initialized to a predetermined value for each block and increments or decrements only during system operation. Summary of the Invention

[0007] One object of the present invention is to overcome this problem and to provide a monitoring system that allows the storage capacity of recorded images to be adapted to current needs.

[0008] According to a first aspect of the invention, this and other objectives are achieved by a monitoring system comprising: at least one surveillance camera having a field of view covering an area within the field of view; a detector adapted to detect the presence of a user within the area; a communication connection adapted to transmit images from the at least one surveillance camera to a data storage device, the data storage device including a digital storage medium adapted to store images for a predetermined data retention period according to a data retention scheme defining the predetermined data retention period; a communication connection adapted to transmit data regarding the detected presence of one or more users within the area to a control center; and a data processing device associated with the control center, adapted to: determine an undetected period in the area where no user is present based on the data regarding the detected presence of one or more users within the area; and, based on the undetected period, propose a change to the data retention scheme to at least one of the one or more users via a user interface.

[0009] According to a second aspect of the invention, this and other objectives are achieved by a monitoring method comprising: providing at least one surveillance camera having a field of view covering an area within the field of view; providing a detector adapted to detect the presence of a user within the area; providing a communication connection; transmitting images from the at least one surveillance camera via the communication connection to a data storage device including a digital storage medium, and storing the images in the data storage device for a predetermined data retention period according to a data retention scheme defining the predetermined data retention period; providing a communication connection adapted to transmit data regarding the detected presence of one or more users within the area to a data processing device associated with a control center, and determining an undetected period in the area where no user is present based on the data regarding the detected presence of one or more users within the area; providing a user interface; and, based on the undetected period, proposing a change to the data retention scheme to at least one of the one or more users via the user interface.

[0010] According to a third aspect of the invention, this and other objectives are achieved by a computer program product for a computing device, the computer program product comprising computer program code adapted to perform the following steps when the computer program product is run on a processing unit of the computing device: detecting the presence of one or more users in an area; controlling the storage of images from at least one surveillance camera on a data storage device, the data storage device comprising a digital storage medium adapted to store images for a predetermined data retention period according to a data retention scheme, the data retention scheme defining the predetermined data retention period; determining an undetected period in which no users are present in the area based on the detected presence of one or more users in the area; and, based on the undetected period, proposing a change to the data retention scheme to at least one of the one or more users via a user interface.

[0011] These aspects of the invention allow the storage capacity of the recorded images to be adapted to the user's current needs.

[0012] According to an embodiment of the first aspect of the invention, the monitoring system includes a user-specific tracking device for each of the one or more users, and a detector is adapted to detect the presence of a user within an area based on the tracking device. Using a tracking device (such as a smartphone) to detect presence within an area is efficient.

[0013] According to an embodiment of the first aspect of the invention, the tracking device is further adapted to transmit location information to a control center, and the data processing device is adapted to propose changes to the data retention scheme to at least one or more users based on the location information. Using the location information from the tracking device allows the system to consider the possibility that a user is so far from the area that there is reason in itself to suggest, for example, an extension of the data retention scheme.

[0014] According to an embodiment of the first aspect of the invention, the data processing device is adapted to propose increasing the length of a predetermined data retention period as a change to the data retention scheme. It makes sense to propose an extension to the user when the user has been away for so long that image data may be deleted before the user returns. This would be undesirable because if the user returns to the area (e.g., their home area) and discovers an intrusion such as a burglary, the perpetrator's image may have already been deleted according to the current data retention scheme. As mentioned above, not only the duration of absence but also the distance from the area may be relevant.

[0015] According to an embodiment of the first aspect of the present invention, if the duration of the undetected time period exceeds a predetermined proportion of the length of a predetermined data retention time period, the data processing device is adapted to propose a change to the data retention scheme to at least one of the one or more users. This allows for timely proposals to change the data retention scheme.

[0016] According to an embodiment of the first aspect of the invention, the data processing device is adapted to modify a predetermined ratio based on location information from each of one or more users. This allows the system to also consider the distance of the user from the area; for example, if the user receiving the proposal is far from the area, the predetermined ratio is shortened and the change proposal is made earlier.

[0017] According to an embodiment of the first aspect of the invention, the length of the predetermined data retention period is zero. This allows the system to propose a data retention scheme to users who do not yet have one, once it detects that a region has been unoccupied for an extended period and / or if it detects that users are too far away to return quickly.

[0018] According to an embodiment of the second aspect of the present invention, the monitoring method further includes: providing each of the one or more users with a user-specific tracking device, and using a detector to detect the presence of the user within an area based on the tracking device. Using a tracking device (such as a smartphone) to detect the presence within an area is efficient and thus facilitates the implementation of the method.

[0019] According to an embodiment of the second aspect of the invention, the monitoring method further includes: transmitting location information from the tracking device to a control center, and having a data processing device propose changes to a data retention scheme to at least one or more users based on the location information. Using the location information from the tracking device allows the system to consider the possibility that a user is so far from the area that there is reason in itself to suggest, for example, extending the data retention time of the data retention scheme.

[0020] According to an embodiment of the second aspect of the invention, the monitoring method further includes: the data processing device proposing an increase in the length of a predetermined data retention period as a change to the data retention scheme. It makes sense to propose an extension to the user when the user has been away for so long that image data may be deleted before the user returns. This would be undesirable because if the user returns to the area (e.g., their home area) and discovers an intrusion such as a burglary, the perpetrator's image may have already been deleted according to the current data retention scheme. As mentioned above, not only the duration of absence but also the distance from the area may be relevant.

[0021] According to an embodiment of the second aspect of the invention, the monitoring method further includes: if the duration of the undetected time period exceeds a predetermined proportion of the length of a predetermined data retention time period, then the data processing device proposes a change to the data retention scheme to at least one of the one or more users. This allows the system to also consider the user's distance from the area; for example, if the user is far from the area, the predetermined proportion is shortened and the change proposal is made earlier.

[0022] According to an embodiment of a second aspect of the invention, the monitoring method further includes: modifying a predetermined ratio by a data processing device based on location information from each of one or more users. This allows the system to also consider the distance of the user from the area; for example, if the user receiving the proposal is far from the area, the predetermined ratio is shortened and the change proposal is made earlier.

[0023] According to an embodiment of the second aspect of the invention, the monitoring method further includes: a data processing device proposing a shortening of the predetermined data retention period as a change to the data retention scheme. This allows the data retention period of the data retention scheme to be changed to a more data-saving scheme if users may no longer need the current data retention scheme, for example, once one or more users change their daily habits, or if the previous change is no longer relevant (e.g., after a long period of unusual absence).

[0024] It should be noted that the present invention relates to all possible combinations of the features described in the claims. Attached Figure Description

[0026] These and other aspects of the invention will now be described in more detail with reference to the accompanying drawings, which illustrate various embodiments of the invention. In the drawings: Figure 1 This illustration schematically depicts a user in a home area equipped with a camera surveillance system that communicates with a remote data center. Figure 2 This schematically illustrates users geographically distant from their homes and data centers, and Figure 3 A flowchart illustrating an embodiment of the method according to the present invention is shown. (Schematic illustration) As shown in the figures, the dimensions of the layers and regions have been enlarged for illustrative purposes and are therefore provided to illustrate the general structure of embodiments of the invention. Throughout the figures, similar reference numerals denote similar elements. Detailed Implementation

[0028] The invention will now be described more fully with reference to the accompanying drawings, which illustrate presently preferred embodiments of the invention. However, the invention may be embodied in many different forms and should not be construed as limited to the embodiments set forth herein; rather, these embodiments are provided so as to provide thoroughness and completeness and to fully convey the scope of the invention to those skilled in the art.

[0029] First see Figure 1 The image illustrates a camera surveillance system covering a monitored area. The area can be any relevant area, such as restricted areas and private spaces, like residences or businesses. It can be entirely indoors (such as in an apartment or house), or outdoors (such as in a garden), or a combination thereof. In the example shown, it is assumed that the area is the home area 17 of at least one user 1. More specifically, Figure 1The illustration shows a user 1 on a garden path 2, which extends from a public sidewalk 3 along a street 4 in front of a house 5, which is led by the garden path 2. The house 4 is surrounded by a garden 6, which also houses a parking area 7 for vehicles (not shown). The garden 6 is defined on one side by the public sidewalk 3 and on the other side by a hedge 8. The camera monitoring system includes not only one, but for example, two outdoor surveillance cameras 9, one with a field of view overlooking the parking area and the other with a field of view overlooking the garden path. Additional surveillance cameras 9 with different fields of view may be present inside the house 5. The surveillance cameras 9 are designed to transmit images from the surveillance cameras 9 to a data storage device in a control center 10, for example, via a router and the Internet 13. This communication may be conducted via a local device (such as a Zigbee bridge 11), which is used for home automation to control other facilities such as heating, lighting, doorbells, remote controls, surveillance cameras 9, etc. The Zigbee bridge 11 is typically coupled to a router. Some of these facilities (such as heating, lighting, and surveillance camera 9) can be controlled based on user presence. User 1's presence in home area 17 can be detected using a tracking device (such as smartphone 12) and a detector (such as Zigbee bridge 11), which detects when the user's smartphone 12 logs into the home's WiFi router, which ZigBee bridge 11 is typically also connected to. Alternatively, the aforementioned geofencing feature implemented on the user's smartphone 12 can be used. That is, the phone uses GNSS data to see whether it is within or outside the defined perimeter distance of the defined home area, and vice versa. The phone will not send its actual location, but only whether it is within or outside the defined area. For privacy reasons, surveillance camera 9 will typically be disabled when user 1 is present; that is, surveillance camera 9 will only begin recording when user 1 is not present at all.

[0030] The control center 10 will include or have one or more associated data storage devices 14, which have digital storage media suitable for storing images for a predetermined data retention period in accordance with a data retention scheme, such as a subscription agreement between user 1 and the provider operating the control center.

[0031] Typically, more users 1 will have a regular presence in the monitored home area 17, such as husbands, wives, children, boyfriends, girlfriends, parents, etc. Regular presence largely ensures that unwanted events such as burglaries or other intrusions will be well detected before the scheduled data retention period expires (i.e., before old images are deleted according to plan). This, in turn, means that the scheduled data retention period can be kept relatively short, and therefore the required storage capacity on digital storage media remains low. This will be reflected in the user's costs, as the provider's storage services are typically subscription-based, with users paying a fixed monthly subscription fee for the scheduled retention period (e.g., 14 days or 30 days).

[0032] In certain situations, such as during holidays or business trips, a single user 1 or a group of users 1 (such as a family) may leave home area 17 vacant for an extended period. If this period (whether due to negligence or simply a lack of awareness) exceeds the intended retention period, there is a risk that a user returning to the burglarized home area 17 will find that the perpetrator's image has been deleted according to the retention plan.

[0033] To avoid this, the communication connection is adapted to transmit data regarding the detected presence of one or more users in home area 17 to a control center. In or associated with control center 10, a data processing device 15 (such as a computer running suitable software) is adapted to determine undetected periods of time in home area 17 where no user is present, based on the received data regarding the detected presence of one or more users in area 17. Based on suitable criteria, the software can then propose changes to the data retention scheme to at least one of the one or more users 1 according to the undetected periods. This can be done via a suitable user interface (such as, for example, the screen of a smartphone 12), in the form of a notification from an app, via RSC messages, SMS messages, received emails, etc. In this regard, it should be noted that if email is used, the interface may be a laptop, desktop computer, tablet, etc.

[0034] Since frequent or regular occupancy of home area 17 is the norm in most cases, and prolonged periods of inactivity are rare, the typical first proposal for changing the data retention scheme would be to increase the length of the predetermined data retention period. The increased length of the predetermined retention period does not necessarily need to be a fixed value. It can be a dynamic value, such as the sum of user 1's longest absence time in home area 17 and a fixed-length additional period. However, when reverting to the normal situation of frequent or regular occupancy, it would obviously be proposed again to shorten the data retention period to reduce the storage capacity required by digital storage medium 14. The situation could also obviously be reversed, for example, if a longer retention period is the default, this might be the case when area 17 is a summer villa, etc.

[0035] Preferably, the software should consider user 1's rejection of the change and not send any new proposals for a certain period of time.

[0036] To allow user 1 to consider whether the current data retention period is sufficient, the data processing device 15 is adapted to promptly propose changes to the data retention scheme. That is, if the duration of the undetected period exceeds a predetermined proportion of the length of the predetermined data retention period. For example, if the data retention period is 30 days, this could be after 23 days; or if the data retention period is 14 days, this could be after 10 days. These proportions are, of course, merely a matter of choice for those skilled in the art, and other proportions besides 23 / 30 or 10 / 14 can be chosen.

[0037] However, it's conceivable that these proportions might be too large, for example, if user 1 or all users are too far apart, increasing the likelihood that they might not return before the scheduled data retention period ends. Figure 2 As shown, if the user is at a remote location 18 on the other side of Earth 19, the journey to home area 17 will inevitably take some time. Therefore, if the tracking device has the ability to detect and transmit location data (as is typically the case with smartphone 12), this information can be sent to control center 10 either via direct communication 16 or via a device in home area 17. Thus, if the data processing device assesses that user 1 is too far from home area 17 to return before the retention period expires, it will set a smaller percentage and prompt the user at an earlier stage with a proposal to change the retention period and subscription, giving the user more time to consider.

[0038] Another reason to suggest changes to the data retention scheme to User 1 might be the detection of a security incident, such as through automatic analysis of recorded images from surveillance camera 9, and the impending expiration of the retention period. In this case, it could also be suggested to extend the retention period.

[0039] It's also conceivable that the subscription is part of a broader, more general subscription for the home automation system, covering far more services than just the retention of image data from surveillance camera 9. Retention will be relevant before user 1 actually installs the surveillance camera, and the scheduled retention period is set to zero. Then, during installation and setup, the user can be prompted to select a retention period, such as 14 or 30 days. Alternatively, if home area 17 is regularly occupied, the user might simply find the subscription price too high. Then, if user 1 is far away or not subscribed for an extended period, a subscription could be offered via the user interface. This is likely more effective and less disruptive than offering numerous subscriptions without a clear target, and could be perceived as caring and attentive, similar to a reminder from the dentist.

[0040] One way to execute this method on the data processing equipment in control center 10 is... Figure 3 The flowchart shown illustrates the software program to be run in or on the data processing device 15 associated with the control center 10. Of course, there are many other ways to ensure the needs of user 1 are met, depending on the user's needs and changes in user behavior.

[0041] The program initializes in box 100, and in box 110, sets the retention period (such as 14 days or 30 days) according to, for example, subscription terms. In box 120, the program checks for the occupant in home area 17, i.e., user 1. If an occupant is detected, the program checks in box 130 the elapsed time since home area 17 was last occupied, and if the elapsed time is less than a certain threshold TH1 (e.g., one day), regular use exists, and in box 140, a pattern counter indicating daily use is incremented. Then, in box 150, it checks whether the pattern counter exceeds a certain threshold TH4 indicating long-term daily occupancy. If this is not the case, the program returns to box 120 to check for occupancy. On the other hand, if this is the case, in box 160, it checks whether a notification rejection flag _2 is set, meaning that user 1 will not receive notifications about changes to the retention plan, at least for the given period. If it is set, the program returns to box 120 to check for occupant. If the rejection flag _2 is not set, in box 170, a proposal to shorten the retention period is sent to user 1 via the user interface.

[0042] If user 1 accepts the shortening in box 180, the rejection flag _2 is cleared in box 190, and a new shortening retention time is set in box 110. On the other hand, if user 1 rejects, the rejection flag _2 is set in box 200, and the program returns to box 120 to check the occupant.

[0043] If the program determines in box 120 that there is no occupancy, then in box 210 it determines whether the duration of the unoccupancy exceeds a threshold T2, such as a proportion of the length of the aforementioned predetermined data retention period. If it exceeds the threshold T2, then in box 220 it checks whether the notification rejection flag _1 is set, meaning that at least for a given period of time, user 1 will not receive notifications about changes to the retention plan. If the rejection flag _1 is set, the program returns to box 120 to check the occupant. If the notification rejection flag _1 is not set, then in box 230 a proposed increase is sent to user 1 via the user interface. If user 1 accepts the increase in box 240, then in box 250 the notification rejection flag _1 is cleared, and a new shortened retention period is set in box 110. Otherwise, in box 260 the notification rejection flag _1 is set, and the program returns to box 120 to check the occupant.

[0044] Conversely, if it is determined that the elapsed time since the last occupancy is less than threshold TH2, then in box 270, the distance of user 1 from home area 17 is checked and taken into account to generate a new threshold TH3. If in box 280 the program determines that threshold TH3 is exceeded and the rejection flag _1 is not set in box 220, then the proposal is increased in box 230.

[0045] If user 1 accepts the shortening in box 180, the rejection flag _2 is cleared in box 190, and a new shortening retention time is set in box 110. On the other hand, if user 1 rejects, the rejection flag _2 is set in box 260, and the program returns to box 120 to check the occupant.

[0046] It should be understood that the term "pattern counter" should not be interpreted as a simple counter, such as simply counting the number of consecutive days during which household area 17 is occupied. Instead, it should be understood as the result of the function `retention_time(p1,p2,…)`, where parameters p1, p2, etc., can be part of a large geofence dataset showing occupancy, its duration, unoccupied duration, distance of the user from the household area, the user's other regular destinations (such as workplace), and other data (such as time of year, user-specific inputs, etc.). This allows the data processor to derive patterns, which in turn allows data retention schemes and associated subscriptions to be customized for a specific household area 17 and updated when patterns change (e.g., when a child moves out to live independently). Similarly, the use of remote location information can be used to customize data retention schemes and subscriptions for household area 17. It should be noted that although there may be multiple users 1 associated with household area 17, typically only one user is associated with and responsible for a subscription. Proposals can be made to this single user. However, proposals can also be made to more or even all users 1 of household area 17.

[0047] Those skilled in the art will recognize that the present invention is by no means limited to the preferred embodiments described above. Rather, many modifications and variations can be made within the scope of the appended claims.

[0048] Furthermore, those skilled in the art, when practicing the claimed invention, can understand and implement variations of the disclosed embodiments by studying the drawings, the disclosure, and the appended claims. In the claims, the word "comprising" does not exclude other elements or steps, and the indefinite articles "a" or "an" do not exclude multiple. The mere fact that certain measures are recited in mutually different dependent claims does not imply that combinations of these measures cannot be advantageously used.

Claims

1. A monitoring system, the monitoring system comprising: At least one surveillance camera, the at least one surveillance camera having a field of view covering an area within that field of view. Detector, the detector being adapted to detect the presence of a user within the area, A communication connection is provided for transmitting images from at least one surveillance camera to a data storage device, the data storage device including a digital storage medium adapted to store the images for a predetermined data retention period according to a data retention scheme, the predetermined data retention period being defined. A communication connection suitable for transmitting data about the presence of one or more detected users in the area to a control center. A data processing device, associated with the control center, and adapted to: determine undetected time periods in the area where no users are present, based on data regarding the presence of one or more detected users in the area; Based on the undetected time period, a proposal to change the data retention scheme is made to at least one of the one or more users via the user interface.

2. The monitoring system of claim 1, comprising a user-specific tracking device for each of the one or more users, wherein the detector is adapted to detect the presence of a user in the area based on the tracking device.

3. The monitoring system according to claim 2, wherein the tracking device is further adapted to transmit location information to the control center, and the data processing device is adapted to propose changes to the data retention scheme to the at least one or more users based on the location information.

4. The monitoring system according to any one of the preceding claims, wherein the data processing device is adapted to propose increasing the length of the predetermined data retention period as a change to the data retention scheme.

5. The monitoring system according to any one of the preceding claims, wherein if the duration of the undetected time period exceeds a predetermined proportion of the length of the predetermined data retention time period, the data processing device is adapted to propose a change to the data retention scheme to at least one of the one or more users.

6. The monitoring system of claim 5, wherein the data processing device is adapted to modify the predetermined ratio based on location information from each of the one or more users.

7. The monitoring system according to claim 4, wherein the length of the predetermined data retention period is zero.

8. A monitoring method, the monitoring method comprising: Provide at least one surveillance camera, the at least one surveillance camera having a field of view that covers an area within the field of view. Provide a detector suitable for detecting the presence of a user in the area. Provides communication connectivity. Images from the at least one surveillance camera are transmitted via the communication connection to a data storage device including a digital storage medium, and the images are stored in the data storage device for a predetermined data retention period according to a data retention scheme, wherein the predetermined data retention period is defined. Provide a communication connection adapted to transmit data regarding the presence of one or more detected users in the area to The data processing equipment associated with the control center, based on data regarding the presence of one or more detected users in the area, determines undetected time periods in the area where no users are present. Provide a user interface, and Based on the undetected time period, a change to the data retention scheme is proposed to at least one of the one or more users via the user interface.

9. The monitoring method according to claim 8, wherein the monitoring method further comprises: Each of the one or more users is provided with a user-specific tracking device, and the detector is used to detect the presence of the user in the area based on the tracking device.

10. The monitoring method according to claim 9, wherein the monitoring method further comprises: The tracking device transmits location information to the control center, and the data processing device proposes changes to the data retention scheme to the at least one or more users based on the location information.

11. The monitoring method according to any one of claims 8 to 10, wherein the monitoring method further comprises: The data processing device proposes to increase the length of the predetermined data retention period as a change to the data retention scheme.

12. The monitoring method according to any one of claims 8 to 11, wherein the monitoring method further comprises: If the duration of the undetected period exceeds a predetermined proportion of the length of the predetermined data retention period, the data processing device proposes a change to the data retention scheme to at least one of the one or more users.

13. The monitoring method according to claim 12, wherein the monitoring method further comprises: The predetermined ratio is modified by the data processing device based on location information from each of the one or more users.

14. The monitoring method according to any one of claims 8 to 10, wherein the monitoring method further comprises: The data processing device proposes to shorten the length of the predetermined data retention period as a change to the data retention scheme.

Images