Monitoring system, control method, and program

The monitoring system addresses the issue of confidential information leakage in coworking spaces by detecting when users leave their belongings and notifying them if someone else approaches, effectively preventing unauthorized access.

JP2025012310APending Publication Date: 2025-01-24KONICA MINOLTA INC
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
JP2023115053
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-07-13
Publication Date
2025-01-24

AI Technical Summary

Technical Problem

Existing monitoring systems fail to prevent the leakage of confidential information in coworking spaces where users leave their belongings, as they do not account for the risk of unauthorized access by others.

Method used

A monitoring system that captures images of users and their belongings, detects when a user leaves their property and when another person approaches it, and notifies the user via a mobile terminal to prevent potential information leaks.

Benefits of technology

Reduces the likelihood of confidential information being exposed by promptly alerting users when they leave their belongings unattended and someone else approaches them.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2025012310000001_ABST
    Figure 2025012310000001_ABST
Patent Text Reader

Abstract

To reduce a possibility that confidential information leaks from user's possessions in the case where the user leaves behind his / her own possessions.SOLUTION: A monitoring system 1 includes an imaging unit 6 for imaging a user existing within a prescribed photographic range and the user's possessions, a first detection unit 31 for detecting that the user leaves behind the user's possessions on the basis of an image picked up by the imaging unit 6, a second detection unit 32 for detecting that another person different from the above-mentioned user approaches the user's possessions, and a notification unit 33 for notifying the user when the first detection unit 31 detects that the user leaves behind the possessions and the second detection unit 32 detects that another person approaches the possessions.SELECTED DRAWING: Figure 2
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to a monitoring system, a control method, and a program. [Background technology]

[0002] In recent years, the number of users who use coworking spaces to do telework has been increasing. However, coworking spaces are not necessarily filled with people from the same company as the user, and there is a possibility that people from other companies are also present. In such a situation, for example, if a user leaves their belongings on their desk while teleworking, the user's belongings may be viewed by other people, and confidential information may be leaked.

[0003] Conventionally, a device has been proposed that links luggage to its owner and notifies the owner when the owner forgets the luggage (for example, Patent Document 1). This conventional technology uses a sensor to detect when the owner places the luggage inside the vehicle, and determines that the luggage has been placed on a luggage rack based on image data captured by an omnidirectional camera and sensor data. The conventional technology then links the luggage to the owner, and based on the relative positional relationship between the luggage and the owner, determines that the luggage has been left behind if the distance between the luggage and the owner is equal to or greater than a predetermined threshold while the position of the luggage does not change, and notifies the user that the luggage has been left behind. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2006-166058 A Summary of the Invention [Problem to be solved by the invention]

[0005] The conventional technology of Patent Document 1 can prevent items from being left behind. However, even if the conventional technology of Patent Document 1 is applied, it is not possible to reduce the possibility of confidential information being leaked when a user leaves their belongings on their desk while teleworking in a coworking space or the like and leaves their desk.

[0006] Therefore, in order to solve the above-mentioned conventional problems, the present invention aims to provide a monitoring system, a control method, and a program that can reduce the possibility of confidential information being leaked when a user leaves his / her possessions. [Means for solving the problem]

[0007] In order to achieve the above-mentioned object, the invention of claim 1 is a surveillance system comprising an imaging unit that captures an image of a user and the user's belongings present within a predetermined shooting range, a first detection unit that detects that the user has left the belongings based on the image captured by the imaging unit, a second detection unit that detects that a person other than the user has approached the belongings, and a notification unit that notifies the user when the first detection unit detects that the user has left the belongings and the second detection unit detects that another person has approached the belongings.

[0008] The invention of claim 2 is a surveillance system comprising an imaging unit that captures images of a user and the user's belongings present within a specified shooting range, a first detection unit that detects that the user has moved away from the belongings based on the image captured by the imaging unit, a second detection unit that detects that the belongings have moved within the shooting range based on the image captured by the imaging unit, and a notification unit that notifies the user when the first detection unit detects that the user has moved away from the belongings and the second detection unit detects that the belongings have moved.

[0009] The invention of claim 3 is a configuration in which, in the monitoring system of claim 1 or 2, the monitoring system further includes an acquisition unit that acquires terminal information regarding a mobile terminal carried by the user, and the notification unit sends a notification to the mobile terminal based on the terminal information.

[0010] The invention of claim 4 is characterized in that, in the surveillance system of claim 3, the notification unit transmits an image captured by the imaging unit to the mobile terminal when sending a notification to the mobile terminal.

[0011] The invention of claim 5 is characterized in that, in the monitoring system of claim 4, the notification unit transmits an image taken immediately before detection by the second detection unit to the mobile terminal.

[0012] The invention of claim 6 is a configuration characterized in that, in the surveillance system of claim 1 or 2, it further comprises a registration unit that registers the user, and a possessions management unit that manages the user registered by the registration unit and the user's possessions in association with each other based on an image captured by the imaging unit.

[0013] The invention according to claim 7 is the surveillance system according to claim 6, characterized in that the registration unit registers at least a facial image of the user when registering the user.

[0014] The invention of claim 8 is characterized in that, in the surveillance system of claim 1, the second detection unit detects that a person other than the user has approached the property based on an image captured by the imaging unit.

[0015] The invention of claim 9 is characterized in that, in the surveillance system of claim 2, the second detection unit detects that the belongings have been moved when the belongings disappear from an image captured by the imaging unit.

[0016] The invention of claim 10 is a surveillance system according to claim 1 or 2, further comprising an identification unit which identifies the type of the possession present within the shooting range, and a judgment unit which judges whether the possession is an item containing confidential information based on the type of the possession, and the notification unit is configured to notify the user on the condition that the judgment unit judges that the possession is an item containing confidential information.

[0017] The invention of claim 11 is characterized in that, in the surveillance system of claim 10, the identification unit identifies the type of the possession by analyzing the image captured by the imaging unit.

[0018] The invention of claim 12 is a monitoring system of claim 1, further comprising a registration unit which registers information regarding a group to which the user belongs, and the notification unit is configured such that when the second detection unit detects that another person has approached the property, if the other person belongs to the same group as the user, the notification unit does not notify the user.

[0019] The invention of claim 13 is a control method for a surveillance system equipped with an imaging unit that captures images of a user and the user's belongings present within a predetermined shooting range, characterized in having a first detection step of detecting that the user has left the belongings based on an image captured by the imaging unit, a second detection step of detecting that a person other than the user has approached the belongings, and a notification step of notifying the user when the first detection step detects that the user has left the belongings and the second detection step detects that another person has approached the belongings.

[0020] The invention of claim 14 is a control method for a surveillance system equipped with an imaging unit that captures images of a user and the user's belongings present within a specified shooting range, comprising a first detection step of detecting that the user has moved away from the belongings based on an image captured by the imaging unit, a second detection step of detecting that the belongings have moved within the shooting range based on the image captured by the imaging unit, and a notification step of notifying the user when the first detection step detects that the user has moved away from the belongings and the second detection step detects that the belongings have moved.

[0021] The invention of claim 15 is a program executed in a surveillance system having an imaging unit that captures images of a user and the user's belongings within a predetermined shooting range, characterized in that the surveillance system is configured to execute a first detection step of detecting that the user has left the belongings based on an image captured by the imaging unit, a second detection step of detecting that a person other than the user has approached the belongings, and a notification step of notifying the user when the first detection step detects that the user has left the belongings and the second detection step detects that another person has approached the belongings.

[0022] The invention of claim 16 is a program executed in a surveillance system having an imaging unit that captures images of a user and the user's belongings present within a specified shooting range, characterized in that the program executes a first detection step of detecting that the user has moved away from the belongings based on an image captured by the imaging unit, a second detection step of detecting that the belongings have moved within the shooting range based on the image captured by the imaging unit, and a notification step of notifying the user when the first detection step detects that the user has moved away from the belongings and the second detection step detects that the belongings have moved. Effect of the Invention

[0023] According to the present invention, even if the user leaves his / her property, the possibility of confidential information being leaked from the user's property can be reduced. [Brief description of the drawings]

[0024] [Figure 1] FIG. 1 illustrates an example of the configuration of a monitoring system. [Diagram 2] FIG. 2 is a block diagram showing a functional configuration of the monitoring system. [Diagram 3] 10 is a flowchart showing a processing procedure performed by the mobile terminal and the monitoring device. [Figure 4] 13 is a flowchart showing an example of a detailed procedure of a possession registration process. [Diagram 5] FIG. 13 is a diagram illustrating an example in which a monitoring device detects a user's belongings. [Figure 6] FIG. [Figure 7] 13 is a flowchart showing an example of a detailed processing procedure of a possession monitoring process. [Figure 8] FIG. 13 is a diagram illustrating a concept of processing by a notification processing unit. [Figure 9] 8 is a flowchart showing an example of a detailed processing procedure of a possession monitoring process different from that shown in FIG. 7. [Figure 10] 13 is a flowchart showing an example of a detailed processing procedure of a possession monitoring process in the second embodiment. [Figure 11] FIG. 13 is a diagram illustrating a concept of processing by a notification processing unit. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0025] Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the drawings. In the following embodiments, elements common to each other are designated by the same reference numerals, and redundant description thereof will be omitted.

[0026] (First embodiment) Fig. 1 is a diagram showing an example of the configuration of a monitoring system 1 according to an embodiment of the present invention. The monitoring system 1 is installed in a coworking space 7 used by a variety of people, and is a system that monitors security risks when a particular user leaves their work location. For example, when a user enters the coworking space 7, the user uses an unused desk or the like as a work space 9 to perform teleworking.

[0027] The surveillance system 1 includes a surveillance camera 2, a surveillance device 3, and a mobile terminal 4. The surveillance camera 2, the surveillance device 3, and the mobile terminal 4 can communicate with each other via a network 5. The network 5 includes both wired and wireless networks. The surveillance camera 2 is installed, for example, on a ceiling 8 of a coworking space 7, and captures images within a predetermined shooting range. The surveillance device 3 is configured, for example, by a computer, and executes main processing for monitoring security risks. The mobile terminal 4 is a terminal carried by a user who performs teleworking in the coworking space 7, and is configured, for example, by a tablet terminal or a smartphone.

[0028] 1 illustrates an example in which the surveillance camera 2 and the surveillance device 3 are configured as separate entities. However, the surveillance camera 2 and the surveillance device 3 may be incorporated into a single device. For example, the surveillance camera 2 may have the functions of the surveillance device 3, which will be described later.

[0029] When a user starts teleworking in the workspace 9, the monitoring system 1 detects the user's belongings that the user places in the workspace 9 and manages them as monitoring targets. After that, the monitoring system 1 determines whether the user has left the belongings placed in the workspace 9 based on an image captured by the monitoring camera 2. If the monitoring system 1 determines that the user has left the belongings, it further determines whether a person other than the user is approaching the user's belongings placed in the workspace 9. As a result, if the monitoring system 1 determines that the user has left his / her own belongings and that another person is approaching the user's belongings, it determines that there is a possibility that confidential information may be leaked, and notifies the user who is away from the workspace 9. This allows the user to immediately realize that a security risk has occurred, and to return to the workspace 9, thereby preventing the leakage of confidential information. Hereinafter, such a monitoring system 1 will be described in detail.

[0030] 2 is a block diagram showing the functional configuration of the surveillance system 1. The surveillance camera 2 includes an imaging unit 6. The imaging unit 6 captures an image of a user and his / her belongings present within a predetermined shooting range, and outputs the captured image. The image captured by the imaging unit 6 may be a still image or a moving image. However, in order to enable the surveillance system 1 to detect security risks in real time, it is preferable that the imaging unit 6 captures an image within the shooting range as a moving image. The imaging unit 6 outputs the image captured within the predetermined shooting range to the surveillance device 3.

[0031] The monitoring device 3 includes a CPU 10, a storage unit 11, and a communication interface 12. The CPU 10 is a hardware processor that reads and executes a program 13 stored in the storage unit 11. The storage unit 11 is a non-volatile storage device constituted by, for example, a hard disk drive (HDD) or a solid state drive (SSD). The communication interface 12 is an interface that connects the monitoring device 3 to a network 5 and communicates with the monitoring camera 2 and the mobile terminal 4.

[0032] The CPU 10 executes the program 13 to function as a monitoring target setting unit 20 and a notification processing unit 30. The monitoring target setting unit 20 is a processing unit that links the user and the user's belongings when the user enters the coworking space 7, and sets the user's belongings as monitoring targets. For example, the monitoring target setting unit 20 communicates with a mobile terminal 4 carried by the user, and sets a monitoring target based on information acquired from the mobile terminal 4. The notification processing unit 30 is a processing unit that notifies the user when it detects the occurrence of a security risk after the setting by the monitoring target setting unit 20 is completed.

[0033] The monitoring target setting unit 20 includes a registration unit 21 , a possessions management unit 23 , an identification unit 24 , and a determination unit 25 .

[0034] The registration unit 21 registers a user working in the coworking space 7 in the monitoring device 3. For example, the registration unit 21 acquires information about the user from the mobile terminal 4 carried by the user, and generates user information 14. The information about the user includes a user name, a facial image of the user, information about a group (such as a company or department) to which the user belongs, and the like. The registration unit 21 registers the user in the monitoring device 3 by storing the user information 14 including such information in the storage unit 11. The registration unit 21 also includes an acquisition unit 22. The acquisition unit 22 acquires terminal information 15 from the user's mobile terminal 4. The terminal information 15 is information including a notification method and an address when notifying the mobile terminal 4. When the acquisition unit 22 acquires the terminal information 15, the registration unit 21 registers the terminal information 15 in the user information 14.

[0035] The belongings management unit 23 detects belongings that the user places on the workspace 9 based on the image obtained from the imaging unit 6. For example, the belongings management unit 23 compares an image of the workspace 9 captured by the imaging unit 6 when the user is not using the workspace 9 with an image captured by the imaging unit 6 after the user starts using the workspace 9. The user's belongings are not present in the workspace 9 when the user is not using the workspace 9. In contrast, the user's belongings may be present in the workspace 9 after the user starts using the workspace 9. Therefore, the belongings management unit 23 can detect the user's belongings by extracting the difference between the image when the user is not using the workspace 9 and the image when the user is using the workspace 9. When the belongings management unit 23 detects the user's belongings, it manages the belongings as a monitoring target. That is, the belongings management unit 23 cuts out an image of the user's belongings as a monitoring target from the image captured by the imaging unit 6, and manages the monitoring target image as a monitoring target by recording the monitoring target image in the monitoring target information 16.

[0036] The identification unit 24 identifies the type of the user's belongings detected by the belongings management unit 23. For example, the identification unit 24 analyzes the monitoring target image cut out by the belongings management unit 23, and identifies whether the user's belongings correspond to an information processing terminal such as a PC, a printed matter, a notepad, a plastic bottle, or a snack.

[0037] The determination unit 25 determines whether or not the possession is an item containing confidential information, based on the type of possession identified by the identification unit 24. If the possession is an item containing confidential information, the determination unit 25 maintains the state in which the user's possession is registered as a monitoring target in the monitoring target information 16. On the other hand, if the possession is an item not containing confidential information, the determination unit 25 deletes the possession from the monitoring target information 16 and excludes it from the monitoring targets by the monitoring device 3.

[0038] The notification processing unit 30 includes a first detection unit 31, a second detection unit 32, and a notification unit 33.

[0039] The first detection unit 31 detects that the user has left his / her belongings placed in the workspace 9 based on an image captured by the imaging unit 6. The first detection unit 31 performs face authentication based on an image acquired from the imaging unit 6, and constantly grasps the current location of the user. For example, the first detection unit 31 constantly measures the distance between the user and the user's belongings based on an image acquired from the imaging unit 6, and detects that the user has left his / her belongings when the distance becomes equal to or exceeds a predetermined value. The first detection unit 31 may also detect that the user has left his / her belongings when the user disappears from the imaging range while the user's belongings remain in the workspace 9.

[0040] When the first detection unit 31 detects that the user has left the belongings, the notification processing unit 30 activates the second detection unit 32. The second detection unit 32 detects that a person other than the user who is the owner of the belongings has approached the belongings left in the work space 9. When a person is captured in the image acquired from the imaging unit 6, the second detection unit 32 performs face recognition and determines whether the person approaching the belongings left in the work space 9 is the user who is the owner. Then, the second detection unit 32 detects that a person other than the user has approached the belongings left in the work space 9. For example, when a person captured in the image acquired from the imaging unit 6 is a person other than the user, the second detection unit 32 constantly measures the distance between the person other than the user and the belongings of the user, and detects that a person other than the user has approached the belongings of the user when the distance becomes equal to or less than a predetermined value. Furthermore, the second detection unit 32 may detect that a person other than the user has approached the user's belongings when a person shown in an image acquired from the imaging unit 6 is a person other than the user. Furthermore, in a case where a human body detection sensor is installed near the workspace 9 used by the user, the second detection unit 32 may detect that a person other than the user has approached the user's belongings when the human body detection sensor detects a person.

[0041] If a person other than the user approaches the user's belongings while the user is away from the workspace 9, the user's belongings may be viewed by the other person, and confidential information may be leaked. Therefore, based on the detection results of the first detection unit 31 and the second detection unit 32, the notification processing unit 30 causes the notification unit 33 to function when it is detected that a person other than the user has approached the user's belongings while the user is away from the workspace 9.

[0042] The notification unit 33 notifies the user who is away from the work space 9 that a security risk has occurred. That is, when the notification unit 33 detects that a person other than the user approaches the user's property while the user is away from the work space 9, the notification unit 33 reads the terminal information 15 included in the user information 14 and notifies the mobile terminal 4 carried by the user that confidential information may be leaked. The notification method by the notification unit 33 includes, for example, a method of sending an e-mail or a method of sending a message. The notification unit 33 notifies the mobile terminal 4 by a notification method defined in the terminal information 15. The mobile terminal 4 is always carried by the user. Therefore, even when the user is away from the work space 9, the user can recognize that another person is approaching his / her property by the notification to the mobile terminal 4. As a result, the user can prevent confidential information from being leaked by returning to the work space 9 immediately.

[0043] In addition to notifying the user via the mobile terminal 4, the notification unit 33 may also notify the user by outputting a sound from a speaker provided in the coworking space 7, for example.

[0044] In addition, when the notification unit 33 detects that a person other than the user is approaching the user's belongings while the user is away from the workspace 9, it is preferable that the notification unit 33 refers to the monitored information 16 and notifies the user on the condition that the user's belongings left in the workspace 9 are determined to be items containing confidential information. For example, if the user's belongings left in the workspace 9 are a plastic bottle containing a beverage, there is no possibility of confidential information being leaked even if another user approaches the plastic bottle. Therefore, if the user's belongings left in the workspace 9 are items such as a plastic bottle that do not contain confidential information, the notification unit 33 does not notify the user. This makes it possible to prevent frequent notifications from being sent to users who have left the workspace 9.

[0045] 3 is a flowchart showing the processing procedure performed by the mobile terminal 4 and the monitoring device 3. When a user enters the coworking space 7, the user starts an application that cooperates with the monitoring device 3 on the mobile terminal 4 (step S10). When the mobile terminal 4 starts the application, it transmits a connection request to the monitoring device 3. When the monitoring device 3 receives the connection request from the application of the mobile terminal 4, it detects the connection with the mobile terminal 4 and starts communication with the mobile terminal 4 (step S20).

[0046] When the application of the mobile terminal 4 starts communication with the monitoring device 3, it accepts input of information about the user (step S11). The information about the user includes information about the user's name and the group (company, department, etc.) to which the user belongs. When the information about the user is input, the mobile terminal 4 transmits the information about the user to the monitoring device 3. When the monitoring device 3 obtains the information about the user from the mobile terminal 4, it generates user information 14 and stores it in the memory unit 11 (step S21).

[0047] Next, the application of the portable terminal 4 activates the camera function of the portable terminal 4 and captures a facial image of the user (step S13). The facial image of the user is used for face authentication to identify the same person. The portable terminal 4 transmits the facial image of the user captured by the application to the monitoring device 3 (step S14). When the monitoring device 3 acquires the facial image of the user from the portable terminal 4, it registers the facial image in the user information 14 (step S22).

[0048] Next, the application of the mobile terminal 4 accepts the input of terminal information 15 by the user (step S15). The terminal information 15 is information describing a notification method, address, etc., used when the monitoring device 3 notifies the mobile terminal 4. When the user inputs the terminal information 15, the mobile terminal 4 transmits the terminal information 15 to the monitoring device 3 (step S16). The mobile terminal 4 may automatically generate the terminal information 15 and transmit it to the monitoring device 3. When the monitoring device 3 acquires the terminal information 15 from the mobile terminal 4, it registers the terminal information 15 in the user information 14 (step S23).

[0049] Through the above process, the monitoring device 3 completes the registration of information about the user who uses the coworking space 7 and information about the mobile terminal 4 used by that user.

[0050] Next, the monitoring device 3 performs a property registration process to register the user's property (step S24). This property registration process is a process for registering the user's property that the user places on a table or the like in the work space 9 by linking it to the user. In the property registration process, the above-mentioned property management unit 23, identification unit 24, and determination unit 25 function. For example, when the user takes out an information processing terminal such as a PC from his / her bag and places it on a table in the work space 9, the monitoring device 3 detects the information processing terminal based on an image obtained from the imaging unit 6. The monitoring device 3 links the detected information processing terminal to the user and registers it as the user's property. In addition, when the user takes out a plastic bottle containing a drink from his / her bag and places it on the table in the work space 9, the monitoring device 3 detects the plastic bottle based on an image obtained from the imaging unit 6. The monitoring device 3 links the detected plastic bottle to the user and registers it as the user's property.

[0051] 4 is a flowchart showing an example of a detailed processing procedure of the belongings registration process (step S24). The monitoring device 3 acquires an image captured by the imaging unit 6 (step S30). Upon acquiring the image, the monitoring device 3 performs face authentication and checks whether or not a user registered in the user information 14 is present in the work space 9 (step S31). If the user is present in the work space 9 (YES in step S31), the monitoring device 3 detects the user's belongings placed in the work space 9 by the user (step S32).

[0052] FIG. 5 is a diagram showing an example in which the monitoring device 3 detects the user's belongings. For example, as shown in FIG. 5(a), the monitoring device 3 stores an image G1 captured by the imaging unit 6 when the workspace 9 is not being used by the user. Thereafter, when the user starts using the workspace 9, the monitoring device 3 acquires an image G2 as shown in FIG. 5(b) from the imaging unit 6. The monitoring device 3 extracts the difference between the image G1 and the image G2, and detects the user's belongings. In the example of FIG. 5(b), the monitoring device 3 detects an information processing terminal 41 and a printed matter 42 as the user's belongings.

[0053] When the monitoring device 3 detects the user's belongings, it saves an image of the belongings (step S33) and records the user's belongings in the monitoring target information 16 (step S34). As a result, the user's belongings contained in the image obtained from the imaging unit 6 are registered as monitoring targets. At this time, the monitoring device 3 registers the user's belongings in the monitoring target information 16 in a state linked to the user.

[0054] Next, the monitoring device 3 identifies the type of the user's belongings (step S35). Here, as described above, the identification unit 24 functions in the monitoring device 3. Then, the identification unit 24 identifies whether the user's belongings corresponds to an item such as an information processing terminal, a printed matter, a notepad, a plastic bottle, or a snack.

[0055] Next, the determination unit 25 functions in the monitoring device 3. The determination unit 25 determines whether the belongings identified by the identification unit 24 are items containing confidential information (step S36). At this time, the determination unit 25 refers to the reference information shown in FIG. 6. The reference information shown in FIG. 6 is information in which the type of belongings and the presence or absence of confidential information are previously associated with each other. For example, the reference information in FIG. 6 defines that if the belongings of the user are an information processing terminal, a printed matter, and a notepad, they are items containing confidential information. Also, the reference information in FIG. 6 defines that if the belongings of the user are a writing implement, a plastic bottle, and sweets, they are items not containing confidential information. The determination unit 25 refers to such reference information to determine whether the belongings of the user are items containing confidential information.

[0056] In addition, for example, the determination unit 25 may determine whether or not confidential information is included in the user's belongings by analyzing an image captured by the imaging unit 6. For example, the determination unit 25 may determine whether or not confidential information is included in the user's belongings by analyzing whether or not a character string such as "secret" or "Confidential" is included in the user's belongings.

[0057] If the user's belongings are items containing confidential information (YES in step S36), the monitoring device 3 ends the process with the user's belongings registered as monitored items. On the other hand, if the user's belongings are items not containing confidential information (NO in step S36), the monitoring device 3 excludes the user's belongings from the monitored items (step S37). In other words, the monitoring device 3 deletes the user's belongings registered in the monitored items information 16 from the monitored items information 16. This ends the owned item registration process (step S24).

[0058] Returning to FIG. 4, the monitoring device 3 then performs a possession monitoring process to monitor whether or not a security risk has occurred with respect to the user's possessions (step S25). This possession monitoring process is a process that determines whether or not a person other than the user is approaching the user's possessions left in the workspace 9 when the user has left the workspace 9, and notifies the user if the security risk is increasing. In the possession monitoring process, the notification processing unit 30 described above functions. For example, the notification processing unit 30 analyzes images successively obtained from the imaging unit 6, and notifies the user if there is an increased possibility of confidential information being leaked.

[0059] FIG. 7 is a flowchart showing an example of a detailed processing procedure of the belongings monitoring process (step S25). The notification processing unit 30 first activates the first detection unit 31. The first detection unit 31 acquires an image captured by the imaging unit 6 (step S40) and determines whether or not the user, who is the owner, is present near the user's belongings placed in the work space 9 (step S41). For example, if the distance between the user and the user's belongings measured based on the image obtained from the imaging unit 6 is less than a predetermined value, the first detection unit 31 determines that the user, who is the owner, is present near the user's belongings. On the other hand, if the distance between the user and the user's belongings measured based on the image obtained from the imaging unit 6 is equal to or greater than a predetermined value, the first detection unit 31 determines that the user, who is the owner, is not present near the user's belongings.

[0060] If the owner user is present near the user's property (YES in step S41), the process by the notification processor 30 returns to step S40 and repeats the above-mentioned process. On the other hand, if the owner user is not present near the user's property (NO in step S41), the notification processor 30 activates the second detector 32. The second detector 32 analyzes, for example, an image acquired from the imaging unit 6, and determines whether or not a person other than the user is present near the user's property (step S42).

[0061] If there is no other person different from the user near the user's property (NO in step S42), the process by the notification processing unit 30 returns to step S40 and repeats the above-mentioned process. On the other hand, if there is another person different from the user near the user's property (YES in step S42), the second detection unit 32 determines that there is a possibility of confidential information being leaked. In this case, the notification processing unit 30 activates the notification unit 33. When the user is away from the workspace 9 and another person is approaching the user's property left in the workspace 9, the notification unit 33 notifies the user (step S43). For example, the notification unit 33 transmits a message to the mobile terminal 4 indicating that a security risk is increasing.

[0062] 8 is a diagram showing the concept of processing by the notification processing unit 30. When a user who has been working in the work space 9 leaves the work space 9 as indicated by an arrow F1, the first detection unit 31 detects that the user has left his / her belongings. Thereafter, when another person approaches the user's belongings left in the work space 9 as indicated by an arrow F2 while the user is away from the work space 9, the second detection unit 32 detects that a risk of confidential information leaking has occurred. Then, the notification unit 33 notifies the mobile terminal 4 of the user who is away from the work space 9. This allows the user to immediately return to the work space 9, thereby preventing confidential information from leaking.

[0063] Incidentally, in the processing procedure shown in FIG. 7, even if the belongings left by the user in the workspace 9 are items that do not contain confidential information, when another person approaches the belongings, a notification is sent to the user's mobile terminal 4. Also, even if the person approaching the user's belongings belongs to the same group as the user, a notification is sent to the user's mobile terminal 4 when the person approaches the user's belongings. In all of these cases, there is no possibility of confidential information being leaked. Therefore, in these cases, it is not preferable for the monitoring device 3 to send a notification to the user's mobile terminal 4. Therefore, instead of the processing procedure shown in FIG. 7, the processing procedure shown in FIG. 9 may be adopted.

[0064] Fig. 9 is a flowchart showing an example of a detailed processing procedure of the possession monitoring process (step S25) different from that in Fig. 7. Note that steps S40 to S42 in Fig. 9 are the same processes as steps S40 to S42 shown in Fig. 7.

[0065] When detecting that a person other than the user is near the user's belongings while the user has left the belongings (YES in step S42), the notification processing unit 30 activates the notification unit 33. The notification unit 33 determines whether the user's belongings left in the workspace 9 contain confidential information (step S44). For example, the notification unit 33 refers to the monitored information 16 and determines whether the user's belongings include confidential information depending on whether the belongings left in the workspace 9 by the user are registered in the monitored information 16.

[0066] If the belongings left behind by the user in the workspace 9 are items that do not contain confidential information (NO in step S44), the notification unit 33 does not notify the user's mobile terminal 4. In this case, the process by the monitoring device 3 returns to step S40.

[0067] On the other hand, if the belongings left by the user in the workspace 9 contain confidential information (YES in step S44), the notification unit 33 performs face authentication on the other person approaching the user's belongings, and determines whether the other person belongs to the same group as the user (step S45). At this time, the notification unit 33 reads out the user information 14 of the other person approaching the user's belongings from the storage unit 11, and identifies the group to which the other person belongs. The notification unit 33 then compares the group to which the user belongs with the group to which the other person belongs to determine whether they are in the same group.

[0068] If another person approaching the user's property belongs to the same group as the user (YES in step S45), there is no possibility that confidential information will leak to the outside. Therefore, the notification unit 33 does not notify the user's mobile terminal 4. In this case, the process by the monitoring device 3 returns to step S40.

[0069] On the other hand, if the person approaching the user's property does not belong to the same group as the user (NO in step S45), the notification unit 33 notifies the user's mobile terminal 4 (step S43). This allows the user to immediately return to the workspace 9, thereby preventing confidential information from being leaked.

[0070] In this way, the monitoring device 3 determines whether or not the belongings left by the user in the workspace 9 contain confidential information, and also determines whether or not a person approaching the user's belongings belongs to the same group as the user, thereby making it possible to avoid frequent notifications being sent to the user's mobile terminal 4. Furthermore, the monitoring device 3 can send a notification to the mobile terminal 4 only when there is a possibility that confidential information may be leaked to the outside. Therefore, the monitoring system 1 is realized as a more convenient system.

[0071] Furthermore, when sending a notification to the mobile terminal 4, the notification unit 33 may send an image captured by the imaging unit 6 to the mobile terminal 4. By sending an image to the mobile terminal 4, the user can immediately grasp the surrounding situation of the workspace 9. Therefore, if a person unknown to the user is near the workspace 9, the user will notice it and immediately return to the workspace 9. Furthermore, when sending an image to the mobile terminal 4, the notification unit 33 preferably sends an image taken immediately before detection by the second detection unit 32.

[0072] Second embodiment Next, a second embodiment of the present invention will be described. In the above first embodiment, the first detection unit 31 detects that the user has left the user's property based on an image captured by the imaging unit 6, the second detection unit 32 detects that another person other than the user has approached the user's property, and the notification unit 33 notifies the user when the first detection unit 31 detects that the user has left the user's property and the second detection unit 32 detects that another person has approached the user's property. In contrast, in the second embodiment, the second detection unit 32 detects that the user's property has moved within the shooting range based on an image captured by the imaging unit 6, and the notification unit 33 notifies the user when the first detection unit 31 detects that the user has left the user's property and the second detection unit 32 detects that the user's property has moved. The configuration of the monitoring system 1 of this embodiment is the same as that described in the first embodiment.

[0073] The second detection unit 32 of this embodiment detects that the user's belongings have moved based on the image captured by the imaging unit 6. For example, the second detection unit 32 holds the images captured by the imaging unit 6 for a predetermined time, and determines whether the position of the user's belongings shown in the images has changed by comparing the images before and after the predetermined time has elapsed. If the position in which the user's belongings are shown has changed, the second detection unit 32 detects that the user's belongings have moved. The second detection unit 32 may also detect that the user's belongings have moved when the user's belongings have disappeared from the image captured by the imaging unit 6.

[0074] FIG. 10 is a flowchart showing an example of a detailed processing procedure of the belongings monitoring process (step S25) in the second embodiment. The notification processing unit 30 first activates the first detection unit 31. As in the first embodiment, the first detection unit 31 acquires an image captured by the imaging unit 6 (step S50) and determines whether or not the user who is the owner is present near the user's belongings placed in the work space 9 (step S51). If the user who is the owner is present near the user's belongings (YES in step S51), the processing by the notification processing unit 30 returns to step S40 and repeats the above-mentioned processing. On the other hand, if the user who is the owner is not present near the user's belongings (NO in step S51), the notification processing unit 30 activates the second detection unit 32.

[0075] The second detection unit 32, for example, analyzes the image acquired from the imaging unit 6, and determines whether the user's belongings have been moved (step S52). If the user's belongings have not been moved (NO in step S52), the process by the notification processing unit 30 returns to step S50, and the above-mentioned process is repeated. On the other hand, if the user's belongings have been moved (YES in step S52), the second detection unit 32 determines that there is a possibility that confidential information may be leaked. In this case, the notification processing unit 30 causes the notification unit 33 to function.

[0076] When the user's belongings left in the work space 9 are moved while the user is away from the work space 9, the notification unit 33 notifies the user (step S53).

[0077] FIG. 11 is a diagram showing the concept of processing by the notification processing unit 30. For example, as shown in FIG. 11(a), when a user who has been working in the work space 9 leaves the work space 9 as indicated by an arrow F1, the first detection unit 31 detects that the user has left his / her belongings. Thereafter, while the user is away from the work space 9, the printed matter 42 placed on the work space 9 may move and disappear from the work space 9 as shown in FIG. 11(b). This phenomenon may occur, for example, when the printed matter 42 is blown away by the wind of an air conditioner. If the printed matter 42 is blown away, another person may obtain the printed matter, and confidential information may be leaked. Therefore, the notification unit 33 transmits a message indicating that security risks are increasing to the mobile terminal 4 of the user who is away from the work space 9.

[0078] In this way, even if no other person approaches the workspace 9 where the user is not present, the monitoring system 1 of this embodiment detects the movement of the user's belongings and notifies the user's mobile terminal 4. This notification allows the user to immediately return to the workspace 9 and retrieve the moved belongings by himself, thereby preventing the leakage of confidential information.

[0079] Furthermore, when sending a notification to the mobile terminal 4, the notification unit 33 may send an image captured by the imaging unit 6 to the mobile terminal 4. By sending an image to the mobile terminal 4, the user can immediately know that his / her belongings left behind in the workspace 9 have been moved. Therefore, the user will immediately return to the workspace 9. Furthermore, when sending an image to the mobile terminal 4, the notification unit 33 preferably sends an image taken immediately before detection by the second detection unit 32. By checking the image taken immediately before detection by the second detection unit 32, the user can know whether or not there is a possibility that another person has taken away his / her belongings.

[0080] Other points are the same as those described in the first embodiment. For example, the monitoring device 3 may notify the user's mobile terminal 4 only when the belongings removed from the work space 9 include confidential information.

[0081] (Modification) Although the preferred embodiments of the present invention have been described above, the present invention is not limited to the above-described embodiments, and various modifications are possible.

[0082] For example, in the above embodiment, it has been described that the identification unit 24 identifies the type of the user's belongings by analyzing the monitored image cut out by the belongings management unit 23. However, the identification unit 24 does not necessarily need to perform image analysis when identifying the type of the user's belongings. For example, when the user places the belongings in the work space 9, a sound corresponding to the characteristics of the belongings is generated. The monitoring device 3 may acquire the sound emitted by the belongings with a microphone (not shown) and analyze the sound to identify the type of the belongings. Furthermore, the identification unit 24 may identify the type of the user's belongings based on information other than images and sounds.

[0083] Furthermore, the program 13 described in the above embodiment is not limited to being stored in advance in the storage unit 11 of the monitoring device 3. For example, the program 13 may be a transaction target by itself. In this case, the program 13 may be provided in a downloadable form via a network such as the Internet, or may be provided in a state recorded on a computer-readable recording medium such as a CD-ROM. [Explanation of symbols]

[0084] 1. Surveillance System 2. Surveillance cameras 3 Monitoring device 4. Mobile devices 6. Imaging unit 13 Programs 20 Monitoring target setting section 21 Registration Department 22 Acquisition Department 23 Property Management Department 24 Specific part 25 Judgment Department 30 Notification Processing Unit 31 First detection section 32 Second detection section 33 Notification Department

Claims

1. An imaging unit that captures an image of a user and belongings of the user present within a predetermined imaging range; A first detection unit that detects that the user has left the belongings based on an image captured by the imaging unit; A second detection unit that detects that a person other than the user approaches the property; a notification unit that notifies the user when the first detection unit detects that the user has left the property and when the second detection unit detects that another person has approached the property; and A monitoring system comprising:

2. An imaging unit that captures an image of a user and belongings of the user present within a predetermined imaging range; A first detection unit that detects that the user has left the belongings based on an image captured by the imaging unit; a second detection unit that detects that the belonging has been moved within the photographing range based on an image captured by the imaging unit; a notification unit that notifies the user when the first detection unit detects that the user has left the belongings and when the second detection unit detects that the belongings have been moved; A monitoring system comprising:

3. an acquisition unit that acquires terminal information related to a mobile terminal possessed by the user; Further comprising:

3. The monitoring system according to claim 1, wherein the notification unit transmits a notification to the mobile terminal based on the terminal information.

4. 4. The monitoring system according to claim 3, wherein the notification section transmits an image captured by the imaging section to the mobile terminal when transmitting the notification to the mobile terminal.

5. The monitoring system according to claim 4 , wherein the notification unit transmits to the mobile terminal an image taken immediately before the second detection unit performs detection.

6. A registration unit for registering the user; a possession management unit that manages the user registered by the registration unit and the possessions of the user in association with each other based on an image captured by the imaging unit; 3. The monitoring system according to claim 1, further comprising:

7. 7. The surveillance system according to claim 6, wherein the registration unit registers at least a facial image of the user when registering the user.

8. The surveillance system according to claim 1 , wherein the second detection unit detects that a person other than the user has approached the property based on the image captured by the imaging unit.

9. 3. The surveillance system according to claim 2, wherein the second detection unit detects that the property has been moved when the property has disappeared from an image captured by the imaging unit.

10. an identification unit that identifies the type of the possession present within the photographing range; a determination unit that determines whether the property is an item including confidential information based on the type of the property; Equipped with 3. The surveillance system according to claim 1, wherein the notification unit issues a notification to the user on condition that the determination unit determines that the property is an article containing confidential information.

11. 11. The surveillance system according to claim 10, wherein the identification unit identifies the type of the possession by analyzing an image captured by the imaging unit.

12. a registration unit that registers information regarding a group to which the user belongs; Further comprising: The surveillance system described in claim 1, characterized in that when the second detection unit detects that another person has approached the property, the notification unit does not notify the user if the other person belongs to the same group as the user.

13. A method for controlling a surveillance system having an imaging unit that captures an image of a user and belongings of the user within a predetermined imaging range, comprising: a first detection step of detecting that the user has left the belongings based on an image captured by the imaging unit; A second detection step of detecting that a person other than the user approaches the property; a notification step of notifying the user when it is detected in the first detection step that the user has left the property and when it is detected in the second detection step that another person has approached the property; A control method comprising the steps of:

14. A method for controlling a surveillance system having an imaging unit that captures an image of a user and belongings of the user within a predetermined imaging range, comprising: a first detection step of detecting that the user has left the belongings based on an image captured by the imaging unit; a second detection step of detecting that the belonging has been moved within the photographing range based on an image captured by the imaging unit; a notification step of notifying the user when the first detection step detects that the user has left the property and the second detection step detects that the property has been moved; A control method comprising the steps of:

15. A program executed in a surveillance system having an imaging unit that captures an image of a user and belongings of the user present within a predetermined shooting range, the surveillance system comprising: a first detection step of detecting that the user has left the belongings based on an image captured by the imaging unit; A second detection step of detecting that a person other than the user approaches the property; a notification step of notifying the user when it is detected in the first detection step that the user has left the property and when it is detected in the second detection step that another person has approached the property; A program characterized by executing the above.

16. A program executed in a surveillance system having an imaging unit that captures an image of a user and belongings of the user within a predetermined shooting range, a first detection step of detecting that the user has left the belongings based on an image captured by the imaging unit; a second detection step of detecting that the belonging has been moved within the photographing range based on an image captured by the imaging unit; a notification step of notifying the user when the first detection step detects that the user has left the property and the second detection step detects that the property has been moved; A program characterized by executing the above.

Citation Information

Patent Citations

  • Printing result trouble notification system, client / printing result trouble notification program

    JP2006166058A