Intrusion detection device, intrusion detection method, and intrusion detection program

Abstract

To provide a technology to assist a user in setting an area in a video image.SOLUTION: An intrusion detection program causes an information processor to implement functions of: receiving a video image from a camera; displaying the video image on a touch screen display of the information processor; accepting an operation for setting an area for detecting intrusion of an object by dragging from a first position to a second position of the video image displayed on the touch screen display; setting the area including at least the first position based on the operation; and displaying a message on the touch screen display in response to detection of intrusion of the object into the area.SELECTED DRAWING: Figure 9

Description

[Technical field]

[0001] The present invention relates to video surveillance technology, and more particularly to intrusion detection technology. [Background technology]

[0002] To realize a safe and secure society, surveillance cameras are being proactively installed in cities and buildings. While the number of surveillance locations is increasing, there are limitations to manual surveillance, and there is a demand for a method of efficiently checking the images captured by surveillance cameras. One method for achieving efficient surveillance is a video surveillance technology that detects and recognizes objects captured by a surveillance camera and issues an alarm if the object is a surveillance target. Patent documents 1 to 3 describe examples of such technology.

[0003] Examples of this video surveillance technology include cordon technology, which detects objects that pass through a line on the video, and alert area technology, which detects objects that invade a specific area on the video. Figure 5 is an example of cordon technology. In this example, an object passing through a line connecting two walls on the video is detected, and a warning is issued if the object is a target for surveillance. This line is sometimes called a cordon. Figure 6 is an example of alert area technology. In this example, an object invading a specific area on the video is detected, and a warning is issued if the object is a target for surveillance. This specific area is sometimes called a alert area.

[0004] However, even if the passage of a monitored object is detected by these cordon or area technologies, there are cases where a response to the monitored object is delayed. In response to this, in order to detect the monitored object early, an auxiliary area (auxiliary area) is often set in addition, which detects a monitored object approaching the cordon or area before the passage of the monitored object is detected. This auxiliary area is set over a wide area including the cordon or area. After an object that has entered the auxiliary area is detected as a monitored object, a warning is issued if the monitored object remains within the auxiliary area for a predetermined period of time or longer. This predetermined period of time is sometimes called the intrusion duration time. The auxiliary area is limited within the shooting area. For this reason, the auxiliary area often has a complex shape according to the shooting range and the shape of the site. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] JP 2008-225803 A [Patent Document 2] JP 2012-058880 A [Patent Document 3] JP 2010-102511 A Summary of the Invention [Problem to be solved by the invention]

[0006] In the above-mentioned video surveillance technology, only one intrusion duration could be set for the auxiliary security area. Moreover, this intrusion duration did not depend on the intrusion position of the object. Therefore, the intrusion duration set for the intrusion position of the object into the auxiliary security area was sometimes too long. In other words, the object could enter the security area before a warning was issued because the elapsed time from the detection of the intrusion into the auxiliary security area exceeded the intrusion duration. Figure 7 is an example of an auxiliary security area. In this example, an object that intrudes into a specific area on the video is detected, and a warning is issued if the object is a surveillance target. This specific area is sometimes called an auxiliary security area. In Figure 7, routes i and ii connecting the security line and the auxiliary security area have different actual distances. For example, if an intrusion duration is set for the auxiliary security area assuming route ii, an object that intrudes via route i, which has a shorter actual distance than route ii, may enter the security area before the set intrusion duration has elapsed.

[0007] An object of the present invention is to provide an intrusion detection device, a setting assistance device, an intrusion detection method, a setting assistance method, and a program recording medium that can perform video surveillance according to the intrusion position of an object into a specific area on an image. [Means for solving the problem]

[0008] The intrusion detection program of the present invention enables the information processing device to realize the following functions: receiving an image from a camera; displaying the image on a touch screen display of the information processing device; receiving an operation to set an area in which the intrusion of an object is detected by dragging from a first position to a second position on the image displayed on the touch screen display; setting the area including at least the first position based on the operation; and displaying a message on the touch screen display in response to detection of the intrusion of the object into the area.

[0009] The intrusion detection device of the present invention comprises an image receiving means for receiving an image from a camera, an image display means for displaying the image on a touch screen display provided with the device, an operation receiving means for receiving an operation to set an area in which intrusion of an object is to be detected by dragging from a first position to a second position on the image displayed on the touch screen display, a setting means for setting the area including at least the first position based on the operation, and a message display means for displaying a message on the touch screen display in response to detection of intrusion of the object into the area.

[0010] An intrusion detection method of the present invention includes an information processing device that receives an image from a camera, displays the image on a touch screen display of the information processing device, receives an operation to set an area in which to detect intrusion of an object by dragging from a first position to a second position on the image displayed on the touch screen display, sets the area including at least the first position based on the operation, and displays a message on the touch screen display in response to detection of intrusion of the object into the area. Effect of the Invention

[0011] According to the intrusion detection device, setting assistance device, intrusion detection method, setting assistance method, and program recording medium of the present invention, it is possible to perform video surveillance according to the position of an object intruding into a specific area on the video. [Brief description of the drawings]

[0012] [Figure 1] FIG. 1 is a block diagram showing an example of a means for setting an auxiliary security area according to the first embodiment of the present invention. [Diagram 2] FIG. 2 is a block diagram showing an example of a means for setting an auxiliary security region according to the second embodiment of the present invention. [Diagram 3] FIG. 3 is a block diagram showing an example of a means for setting an auxiliary security region according to the third embodiment of the present invention. [Figure 4] FIG. 4 is a block diagram showing an example of a means for setting an auxiliary security region according to the fourth embodiment of the present invention. [Diagram 5] Figure 5 is an example of the cordon technique. [Figure 6] Figure 6 is an example of the alert area technology. [Figure 7] FIG. 7 is an example of an auxiliary security area. [Figure 8] FIG. 8 is a block diagram showing an example of a hardware configuration of a computer that realizes the intrusion detection device according to the first embodiment of the present invention. [Figure 9] FIG. 9 is a block diagram showing an example of the configuration of a setting support device according to the fifth embodiment of the present invention. [Figure 10A] FIG. 10A is a first schematic diagram for explaining coordinates calculated by a calculation unit. [Figure 10B] FIG. 10B is a second schematic diagram for explaining the coordinates calculated by the calculation unit. [Figure 10C] FIG. 10C is a third schematic diagram for explaining the coordinates calculated by the calculation unit. [Figure 11] FIG. 11 is a flowchart illustrating an example of a process executed by the setting assistance device. [Figure 12] FIG. 12 is a block diagram showing an example of the configuration of an intrusion detection system according to the sixth embodiment. [Figure 13] FIG. 13 is a block diagram illustrating an example of a hardware configuration of an information processing device. [Figure 14] FIG. 14 is a flowchart illustrating an example of processing executed by the information processing device. [Figure 15] FIG. 15 is a flowchart showing an example of the setting process. [Figure 16A] FIG. 16A is a diagram illustrating an example of screen transition of the setting screen. [Figure 16B] FIG. 16B is another diagram illustrating an example of a screen transition of the setting screen. [Figure 17A] FIG. 17A is a first diagram illustrating a coordinate calculation method. [Figure 17B] FIG. 17B is a second diagram illustrating a method for calculating coordinates. [Figure 17C] FIG. 17C is a third diagram illustrating a coordinate calculation method. [Figure 18A] FIG. 18A is a diagram illustrating the first auxiliary security region. [Figure 18B] FIG. 18B is a diagram illustrating the second auxiliary security region. [Figure 19] FIG. 19 is a diagram illustrating the third auxiliary security region. [Figure 20] FIG. 20 is a diagram illustrating the fourth auxiliary security region. [Figure 21] FIG. 21 is a flowchart showing an example of the detection process and the notification process. [Figure 22] FIG. 22 is a diagram illustrating the fifth and sixth auxiliary security areas. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0013] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, an embodiment of the present invention will be described in detail with reference to the drawings. In the following description, components having the same functions are designated by the same reference numerals, and the description thereof may be omitted.

[0014] (First embodiment) (composition) 1 is a block diagram showing an example of a means for setting an auxiliary security area according to a first embodiment of the present invention. In this embodiment, an intrusion detection device 1 includes a detection means 2 and a control means 3.

[0015] (action) The detection means 2 detects the intrusion position of an object that has intruded into a specific area (auxiliary security area) on the image. The control means 3 associates the position on the image with a predetermined time (intrusion duration). Furthermore, the detection means 2 warns the operator when an object remains in the specific area (auxiliary security area) on the image for a predetermined time (intrusion duration) or longer that is associated with a position that matches the detected intrusion position. The predetermined time here is a time determined for each position on the image, and is defined by the operator, for example.

[0016] More specifically, the detection means 2 detects an object that has invaded the auxiliary security area, and if the object is a monitoring target, identifies the intrusion position of the monitoring target in the auxiliary security area. Furthermore, the detection means 2 warns the operator when the monitoring target stays in the auxiliary security area for a predetermined time (intrusion duration) or more associated with the identified intrusion position. The control means 3 associates a position on the image with a predetermined time (intrusion duration) and transmits a pair of the associated position and the predetermined time (intrusion duration) to the detection means 2. The detection means 2 warns the operator based on the intrusion duration of a pair of positions that match the intrusion position identified by the detection means 2 and the position associated by the control means 3 among the transmitted pairs. Alternatively, the detection means 2 may issue a warning to an object that has invaded the auxiliary security area. For example, the control means 3 may associate at regular intervals. Alternatively, the control means 3 may associate when requested by the detection means 2. Furthermore, the control means 3 may have a pair of associated positions and predetermined times (intrusion duration).

[0017] (effect) According to this embodiment, it is possible to carry out video monitoring according to the position of an object entering a specific area on the video.

[0018] Second embodiment (composition) 2 is a block diagram showing an example of a means for setting an auxiliary security area according to a second embodiment of the present invention. In addition to a detection means 2 and a control means 3, the intrusion detection device 1 further includes an input means 4 for receiving an input of an intrusion position into the auxiliary security area and an input of a predetermined time.

[0019] The input means 4 is a means for receiving input of an intrusion position into the auxiliary security area and input of a predetermined time. The intrusion position is, for example, a coordinate on an image. The intrusion position is input, for example, by the input means 4 displaying an image on a display, receiving drawing of points or lines on the displayed image, and calculating coordinates on the image from the drawn points or lines. The input of the predetermined time is, for example, a numerical input. The numerical input may be input using a numeric keypad or other input method. The unit may be seconds or minutes.

[0020] The control means 3 is a means for associating an intrusion position with a predetermined time based on the received intrusion position input and the input of the predetermined time. For example, the control means 3 may be realized by a CPU (Central Processing Unit) executing a predetermined program. For example, when the input means 4 receives an intrusion position input and a predetermined time input as a set, the control means 3 may associate the intrusion position input and the predetermined time input received as a set. Alternatively, when the input means 4 receives an input of a predetermined time, the control means 3 may select an intrusion position input to be associated with the input of the predetermined time among the inputs, thereby associating the intrusion position input and the predetermined time input. Alternatively, the control means 3 may associate the input of the intrusion position with the input of the predetermined time based on the order of each of the inputs of the multiple intrusion positions and the multiple inputs of the predetermined time. For example, the control means 3 may associate the first intrusion position input with the first predetermined time input, and further associate the second intrusion position input with the second predetermined time input.

[0021] Then, the control means 3 transmits a pair of the associated intrusion position and the input at the predetermined time to the detection means 2. When the control means 3 has associated a plurality of pairs of the intrusion position and the input at the predetermined time, the control means 3 may transmit each of the plurality of pairs to the detection means 2.

[0022] The detection means 2 is a means for identifying an intrusion position of the monitored object into the auxiliary security area, referring to an input of a predetermined time associated with an input of an intrusion position indicating the position as an intrusion duration, and warning an operator when the monitored object stays in the auxiliary security area for the intrusion duration or longer. The detection means 2 is notified from the control means 3 of one or more pairs of an input of an intrusion position and an input of a predetermined time associated with the input of the intrusion position in the control means 3. The detection means 2 may store the one or more transmitted pairs in a storage means (not shown). The detection means 2 can identify an intrusion position of the monitored object into the auxiliary security area. For example, the detection means 2 may use a cordon technique to identify a position where the monitored object crosses the boundary line of the auxiliary security area as an intrusion position. The detection means 2 searches for an input of an intrusion position indicating the identified intrusion position from one or more pairs transmitted from the control means 3. The detection means 2 then refers to a predetermined time associated with the searched input of the intrusion position as an intrusion duration. The detection means 2 compares the time that the monitored object stays in the auxiliary security area with the intrusion duration time, and issues a warning to the operator if the monitored object stays in the auxiliary security area for the intrusion duration time or longer.

[0023] (operation) Next, an example of the operation of the intrusion detection device 1 according to the second embodiment of the present invention will be described.

[0024] The input means 4 receives an input of an intrusion position into the auxiliary security area and an input of a predetermined time. The input means 4 transmits the received input of the intrusion position and the predetermined time to the control means 3.

[0025] Thereafter, the control means 3 associates the intrusion location with the predetermined time based on the received input of the intrusion location and the input of the predetermined time. The method of association is as described above. The control means 3 associates the intrusion location with the predetermined time based on the received input of the intrusion location and the input of the predetermined time, and transmits the associated pair of the intrusion location and the predetermined time to the detection means 2.

[0026] The detection means 2 identifies the intrusion position into the auxiliary security area of ​​the monitored object asynchronously with the transmission of the intrusion position and the predetermined time by the control means 3. This identification may be performed every predetermined time, such as every 30 seconds or every minute.

[0027] When the detection means 2 detects an intrusion of the monitored object into the auxiliary security area, or when it identifies the intrusion location, it searches for an input of the intrusion location indicating the identified intrusion location from one or more sets transmitted from the control means 3. The detection means 2 then refers to a predetermined time associated with the input of the searched intrusion location as an intrusion duration. The detection means 2 then compares the time that the monitored object remains in the auxiliary security area with the intrusion duration, and warns the operator if the object remains in the auxiliary security area for longer than the intrusion duration.

[0028] In the above description of the operation, the identification of the intrusion position by the detection means 2 and the transmission from the control means 3 to the detection means 2 are performed asynchronously, but the order of the two is not limited to this. For example, when the control means 3 transmits the intrusion position and the predetermined time to the detection means 2, the detection means 2 may operate to start identifying the intrusion position. Furthermore, when the detection means 2 can identify the intrusion position, it may operate to have the control means 3 transmit the intrusion position and the predetermined time.

[0029] (effect) According to this embodiment, it is possible to carry out video monitoring according to the position of an object entering a specific area on the video.

[0030] (Third embodiment) (composition) 3 is a block diagram showing an example of a means for setting an auxiliary security area according to a third embodiment of the present invention. In addition to the detection means 2 and the control means 3, the intrusion detection device 1 further includes an input means 5 for receiving input of an intrusion position into the auxiliary security area.

[0031] (action) The input means 5 receives an input of an intrusion position into the auxiliary security area. The input means 5 further transmits the received input of the intrusion position to the control means 3. The control means 3 sets a predetermined time based on the input of the intrusion position.

[0032] The control means 3 can set the predetermined time, for example, in the following manner. For example, the control means 3 acquires a security line and calculates the shortest distance between the acquired security line and the input intrusion position. Next, the control means 3 acquires the moving speed of the object. After that, the control means 3 calculates the predetermined time from the acquired moving speed of the object and the calculated shortest distance.

[0033] The control means 3 can acquire the moving speed of the object by, for example, the following method. For example, the control means 3 accepts it as a numerical input. Alternatively, the control means 3 calculates the moving speed of the object from an image.

[0034] The control means 3 can calculate the predetermined time by, for example, the following method. For example, the control means 3 calculates a value by dividing the shortest distance calculated by the above method by the moving speed calculated by the above method. The control means 3 may also calculate the predetermined time by adding a further predetermined time to the calculated value. This allows the setting to be made in consideration of the operation in actual monitoring.

[0035] (effect) According to this embodiment, it is possible to carry out video monitoring according to the position of an object entering a specific area on the video.

[0036] (Fourth embodiment) (composition) 4 is a block diagram showing an example of a means for setting an auxiliary security area according to the fourth embodiment of the present invention. In addition to the detection means 2 and the control means 3, the intrusion detection device 1 further comprises an input means 6 for receiving an input for a predetermined period of time.

[0037] (action) The input means 6 accepts an input for a predetermined time. Furthermore, the input means 6 transmits the accepted input for the predetermined time to the control means 3. The control means 3 sets a specific area (auxiliary security area) based on the accepted input for the predetermined time. The setting of the auxiliary security area by the control means 3 can be performed, for example, by the following method. For example, the control means 3 acquires the moving speed of the object, and calculates the moving distance of the object in the predetermined time from the acquired moving speed of the object and the input for the predetermined time. Furthermore, for example, the control means 3 accepts an input of a security line, calculates the coordinates at the calculated moving distance of the object from the accepted security line as the intrusion position of the object, and sets the calculated intrusion position of the object. At this time, there may be a plurality of intrusion positions of the object. The set of the intrusion positions of the plurality of objects forms a line segment. This line segment is the auxiliary security line. The area surrounded by the auxiliary security line is the auxiliary security area.

[0038] (effect) According to this embodiment, it is possible to carry out video monitoring according to the position of an object entering a specific area on the video.

[0039] Furthermore, according to this embodiment, an auxiliary cordon can be generated by inputting a predetermined time.

[0040] 8 is a block diagram showing an example of a hardware configuration of a computer that realizes the intrusion detection device according to the first embodiment of the present invention. The computer 600 includes a processor 610, a memory 620, a storage 630, and an interface 640.

[0041] The processor 610 is, for example, a CPU (Central Processing Unit). The memory 620 corresponds to a main storage device. The storage 630 corresponds to an auxiliary storage device. The storage 630 is, for example, configured with a hard disk or a flash memory. The storage 630 may also be configured to include a reader / writer for a removable recording medium such as an optical disk or a USB (Universal Serial Bus) flash drive. The interface 640 transmits and receives data to and from an external device.

[0042] The processor 610 can function as the detection means 2 and the control means 3 of the intrusion detection device 1 by executing a program stored in the memory 620 or the storage 630 .

[0043] The present invention can provide an intrusion detection method in addition to an intrusion detection device. The present invention can also be provided in the form of a program for causing a computer to function as an intrusion detection device, or a computer-readable recording medium (optical disk, magnetic disk, semiconductor memory, etc.) on which the program is recorded. The program according to the present invention may also be downloaded to a certain device via a network and cause the device to function as an intrusion detection device.

[0044] Fifth embodiment 9 is a block diagram showing a configuration of a setting support device 100 according to a fifth embodiment of the present invention. The setting support device 100 is an information processing device for supporting (facilitating) a user to set an area based on a video. The setting support device 100 includes at least an acquisition unit 110, a calculation unit 120, and a determination unit 130. The hardware configuration of the setting support device 100 may be the same as that of the computer 600 exemplified in FIG. 8.

[0045] The acquisition unit 110 acquires coordinates in an image. The coordinates represent a line (straight line, curved line, broken line, etc.) or an area designated by a user for an image of a three-dimensional space (i.e., an actual space) captured by an image capture device such as a security camera. The coordinates acquired by the acquisition unit 110 are represented, for example, in a two-dimensional coordinate system with a predetermined position (end point, center, etc.) of the image as the origin. In this embodiment, the image captured by the image capture device can be said to be an image with depth.

[0046] The number of coordinates acquired by the acquisition unit 110 is not limited to a specific number as long as the line can be defined. For example, when the line specified by the user is a line segment, the acquisition unit 110 may acquire the coordinates of the end points (start point and end point) of the line segment. Alternatively, when the line specified by the user is a broken line, the acquisition unit 110 may acquire the coordinates of the end points of a plurality of line segments constituting the broken line. The coordinates are specified via an input device such as a mouse or a touch screen display. When the user draws a line by hand using an input device such as a touch screen display, the acquisition unit 110 acquires each coordinate on the hand-drawn line.

[0047] The calculation unit 120 calculates the coordinates of a position at a predetermined distance from the position in three-dimensional space corresponding to the coordinates acquired by the acquisition unit 110. The position here is different from the coordinates in a (two-dimensional) image in that it is a position on a plane in an actual three-dimensional space. More specifically, the calculation unit 120 calculates the coordinates in the image of a position at a predetermined distance from the position in three-dimensional space of the line specified by the user.

[0048] Fig. 10A, Fig. 10B, and Fig. 10C are schematic diagrams for explaining coordinates calculated by the calculation unit 120. Fig. 10A is a diagram illustrating a line L1 specified on an image. Fig. 10B is a diagram illustrating a line L1a in a three-dimensional space corresponding to the line L1, and a line L2a connecting positions equidistant from the line L1a. Fig. 10C is a diagram illustrating the line L1 and a line L2 on the image corresponding to the line L2a.

[0049] It should be noted that the images illustrated in Fig. 10A and Fig. 10C have different perspectives in the y1 axis direction in the figures. That is, the images illustrated in Fig. 10A and Fig. 10C represent positions that are farther away as the y1 axis component increases. Also, the object in the image appears smaller the farther it is from the camera. This is because the magnification of the object in the image is inversely proportional to the distance between the object and the camera. Therefore, in the images illustrated in Fig. 10A and Fig. 10C, even if the object is the same size, it appears smaller at the coordinate where the y1 axis component is larger.

[0050] The x1y1 coordinate system in Figures 10A and 10C is a coordinate system (screen coordinate system) defined for the image. Coordinates in this coordinate system, i.e., coordinates on the image, are numerical values ​​indicating the position of each pixel with a pixel at a specific position on the image as the reference (origin). On the other hand, the x2y2 coordinate system in Figure 10B is a coordinate system (world coordinate system) corresponding to an actual three-dimensional space, and is different from the coordinate systems in Figures 10A and 10C. For example, the x2 axis component and the y2 axis component in Figure 10B correspond to latitude and longitude.

[0051] Line L2 in Fig. 10C does not have the same shape as line L2a in Fig. 10B. This is because the images shown in Fig. 10A and Fig. 10C are apparently distorted (deformed) due to perspective differences. Therefore, even if line L2 in the image is equidistant from line L1a in the real three-dimensional space, it is not equidistant from line L1 in the image. More specifically, the larger the y1-axis component of line L2 is, the closer the distance in the image to line L1 is.

[0052] The calculation unit 120 calculates the coordinates of each point on the line L2 in Fig. 10C using a predetermined function. This function can be defined based on a calibration that is performed in advance, for example. The calibration here is performed, for example, by placing reference objects (sticks of a predetermined length, marks of a predetermined size, etc.) with known sizes at multiple positions in the space to be photographed, and associating the sizes (e.g., the number of pixels) of the reference objects in the image with the actual sizes.

[0053] The determining unit 130 determines an area to be set for the coordinates acquired by the acquiring unit 110, based on the coordinates calculated by the calculating unit 120. For example, the determining unit 130 determines an area surrounded by a closed curve represented by the coordinates calculated by the calculating unit 120 (for example, an area inside the line L2 in FIG. 10C) as an area corresponding to the line L1. Hereinafter, the area determined by the determining unit 130 is also referred to as a "set area."

[0054] The determination unit 130 may set a region that is partially different from the region surrounded by the closed curve represented by the coordinates calculated by the calculation unit 120 as the set region. For example, the determination unit 130 may set a part of the region surrounded by the closed curve represented by the coordinates calculated by the calculation unit 120 as the set region. In other words, the determination unit 130 may set a region excluding a part of the region surrounded by the closed curve represented by the coordinates calculated by the calculation unit 120 as the set region. At this time, the determination unit 130 may determine the region excluded from the set region based on other information. The other information here is, for example, the coordinates acquired by the acquisition unit 110, features extracted from the video, a predetermined rule, and the like. The determination unit 130 may also determine the region excluded from the set region based on a user operation.

[0055] Fig. 11 is a flowchart showing the process executed by the setting assistance device 100. In step S11, the acquisition unit 110 acquires coordinates specified by the user using a line on an image captured in a three-dimensional space. At this time, the image is captured by a capture device and displayed on a display device. The user specifies coordinates on the image displayed on the display device using an input device such as a mouse. Taking Fig. 10A as an example, the acquisition unit 110 acquires coordinates that define a line L1 (for example, the start point and end point of the line L1).

[0056] In step S12, the calculation unit 120 calculates the coordinates of a position at a predetermined distance from the position in the three-dimensional space corresponding to the line represented by the coordinates acquired in step S11. Taking Fig. 10C as an example, the calculation unit 120 calculates each coordinate on the line L2 based on the coordinates that define the line L1.

[0057] In step S13, the determination unit 130 determines the set region based on the coordinates calculated in step S12. The determination unit 130 determines the set region to include at least a part of the region surrounded by the line L2. Taking FIG. 10C as an example, the determination unit 130 may set a part or the whole of the region surrounded by the line L2 as the set region. The determination unit 130 may determine the set region to include not only the region surrounded by the line L2 but also other regions using other information described above.

[0058] As described above, the setting support device 100 of this embodiment has a configuration for determining a setting area based on a line specified by a user. With this configuration, the user only needs to specify a line when setting a setting area, and does not need to input the setting area itself by himself / herself. Therefore, the setting support device 100 of this embodiment makes it easy for the user to accurately set a setting area for an image with depth. In other words, the setting support device 100 can support the setting work by the user.

[0059] Sixth embodiment 12 is a block diagram showing a configuration of an intrusion detection system 200 according to a sixth embodiment. The intrusion detection system 200 is an information processing system for detecting the intrusion of an object. In some aspects, the object referred to here is a human being such as a suspicious person. However, the object referred to here may be an animal other than a human being, or a mobile machine such as an automobile or a robot. In the following, the object detected by the intrusion detection system 200 is assumed to be a human being.

[0060] The intrusion here refers to an intrusion of an object into a specific area that may be fraudulent. However, in each embodiment of the present invention, it does not matter whether an object that has intruded into a specific area actually has a fraudulent purpose. For example, whether an object that has intruded into a specific area has a fraudulent purpose may be determined using a system other than the intrusion detection system 200, or may be determined by a human being. In other words, the intrusion detection system 200 can be said to be a system for detecting signs or possibilities of intrusion, or a system for detecting the intrusion of an object (whether fraudulent or not).

[0061] The intrusion detection system 200 includes at least an information processing device 210, an image capturing device 220, an input device 230, and a display device 240. A plurality of the information processing devices 210, the image capturing devices 220, the input devices 230, and the display devices 240 may be included in the intrusion detection system 200. Furthermore, some or all of the information processing devices 210, the image capturing devices 220, the input devices 230, and the display devices 240 may be configured as a single device.

[0062] The intrusion detection system 200 may include other components in addition to the information processing device 210, the photographing device 220, the input device 230, and the display device 240. For example, the intrusion detection system 200 may include a device or equipment (such as a speaker, a siren, or a warning light) for notifying the detection of an intrusion.

[0063] The information processing device 210 detects a person using a video. In addition, the information processing device 210 supports settings performed by a user (operator) to detect a person. The information processing device 210 is, for example, a computer device such as a personal computer. The information processing device 210 is communicably connected to an imaging device 220, an input device 230, and a display device 240. The communication by the information processing device 210 may be either wired or wireless, and may be performed via another device (i.e., indirectly).

[0064] The image capturing device 220 captures video. The image capturing device 220 is, for example, a surveillance camera that is installed in a certain location and continuously captures a specific area. The image capturing device 220 captures the area to be monitored and generates video data representing the video of the area. The image capturing device 220 supplies the video data to the information processing device 210.

[0065] The input device 230 accepts a user's operation. The input device 230 is, for example, a mouse or a keyboard. The input device 230 may also be a touch screen display integrated with the display device 240. The input device 230 supplies the information processing device 210 with input data representing the user's operation.

[0066] The display device 240 displays an image. The display device 240 is, for example, a liquid crystal display. The display device 240 displays an image corresponding to image data supplied from the information processing device 210. The display device 240 may display, for example, an image captured by the image capturing device 220. Alternatively, the display device 240 may display a screen (hereinafter also referred to as a "setting screen") for a user to execute various settings related to surveillance. Note that the intrusion detection system 200 may be configured to include a display device that displays an image captured by the image capturing device 220 and another display device that displays the setting screen.

[0067] 13 is a block diagram showing a hardware configuration of the information processing device 210. The information processing device 210 includes a control unit 211, a storage unit 212, and an interface unit 213. The information processing device 210 corresponds to an example of the setting support device 100 described in the fifth embodiment. More specifically, the information processing device 210 can realize a function equivalent to the setting support device 100 by the control unit 211 executing a predetermined program.

[0068] The control unit 211 includes a processor (arithmetic processing device) such as a CPU (Central Processing Unit) and a main memory (main storage device). The control unit 211 may be configured to include multiple processors, such as having a GPU (Graphics Processing Unit) for image processing in addition to the CPU. The control unit 211 executes programs to realize several functions related to person detection.

[0069] The storage unit 212 stores data used by the control unit 211. For example, the storage unit 212 may store a program executed by the control unit 211. The storage unit 212 includes a storage device such as a hard disk drive. The storage unit 212 may also include a reader / writer for a storage medium (such as a memory card) that is detachable from the information processing device 210. Data exchange in the information processing device 210 may be performed via this detachable storage medium.

[0070] The interface unit 213 transmits and receives data to and from the imaging device 220, the input device 230, and the display device 240. The interface unit 213 can transmit and receive data in accordance with a predetermined standard such as USB (Universal Serial Bus) or HDMI (High-Definition Multimedia Interface) (registered trademark). The interface unit 213 may include an interface for connecting to a network such as the Internet.

[0071] The above is the configuration of the intrusion detection system 200. With this configuration, the intrusion detection system 200 detects a person based on the video captured by the imaging device 220. The information processing device 210 executes the following processes as processes related to the detection of a person.

[0072] 14 is a flowchart showing an outline of the processing executed by the information processing device 210. The processing executed by the information processing device 210 is roughly divided into a setting process (step S21), a detection process (step S22), and a notification process (step S23). The detection process does not necessarily have to be executed following the setting process. It is sufficient for the setting process to be executed at least once in advance, and therefore it is not necessary to execute the setting process every time the detection process is executed.

[0073] The setting process is a process for setting a security line and an auxiliary security area. The security line in this embodiment is a straight line set by a user's operation. The auxiliary security area in this embodiment is an area set based on the security line, and corresponds to an example of a set area in the fifth embodiment. The setting process in this embodiment includes a process for assisting the user in setting the auxiliary security area.

[0074] The detection process is a process for detecting a person's entry into the auxiliary security area. The detection process may further include a process for detecting a person's passage through the security line. The detection process may also include a process for detecting a person's presence in the auxiliary security area, i.e., a person remaining in the auxiliary security area for a predetermined period of time or longer. Hereinafter, a person detected by the detection process is also referred to as a "suspect person."

[0075] The notification process is a process for notifying the detection result of the detection process. In the notification process, for example, the entry or stay of a suspicious person in the auxiliary security area or the passage of a security line is notified. The notification by the notification process may be performed by the display device 240, or may be performed by a siren or a warning light.

[0076] 15 is a flowchart showing details of the setting process. In step S211, the control unit 211 causes the display device 240 to display a setting screen. More specifically, the control unit 211 supplies image data for displaying the setting screen to the display device 240. The control unit 211 supplies the image data to the display device 240 via the interface unit 213.

[0077] 16A and 16B are diagrams illustrating screen transitions of the setting screen displayed in step S211. FIG. 16A is a diagram illustrating an example of the setting screen. The setting screen SC1 includes at least an image captured by the photographing device 220. The setting screen may also include a message for prompting the user to input, such as "Please input the security line." The user inputs the security line using the input device 230. Note that the images illustrated in this embodiment include descriptions that are emphasized, exaggerated, or simplified to facilitate understanding.

[0078] In step S212, the control unit 211 acquires coordinates. More specifically, the control unit 211 acquires the coordinates by acquiring input data from the input device 230 via the interface unit 213. In the example of Fig. 16B, the coordinates that define the security line are the two end points of the line segment that is the security line.

[0079] Fig. 16B is a diagram illustrating a cordon L21 designated for the image illustrated in Fig. 16A. In this example, the cordon L21 is a line segment connecting coordinates P21 and P22. For example, the user can set the cordon L21 by designating coordinates P21 and P22 using the input device 230.

[0080] In step S213, the control unit 211 calculates the coordinates of a position that is a predetermined distance (e.g., 100 m) from the security line. In other words, the control unit 211 calculates the coordinates of a position in an actual space that is a constant distance from the security line. The control unit 211 calculates the coordinates, for example, using the following formula (1).

[0081] R dist =f(P a ,P b ) …(1) In equation (1), f(P a ,P b ) is the coordinate P on the image a and coordinate P bThis function returns the real distance (i.e., the actual distance in three-dimensional space) between dist represents a constant corresponding to a predetermined distance. Note that the function f(P a ,P b The function f(P a ,P b ) is the coordinate P in the screen coordinate system. a , P b is a function that converts the above into two coordinates in the world coordinate system and calculates the distance between the two coordinates, and can be calculated using well-known techniques.

[0082] For example, when determining a coordinate whose actual distance from the coordinate P21 is 100 m, the control unit 211 calculates P a Substitute the coordinate P21 into R dist =100 P b Calculate the following: R dist =100 P b (That is, there are a plurality of coordinates whose actual distance from the coordinate P21 is 100 m.) The control unit 211 executes such a calculation for all of the coordinates on the image included in the guard line L21. For example, the control unit 211 calculates the coordinates as follows.

[0083] 17A is a diagram illustrating a curve C1 that is a set of coordinates that are equidistant in real distance from the coordinate P21. In this example, the curve C1 is a closed curve that approximates a circle centered on the coordinate P21, but is not a perfect circle strictly speaking. The curve C1 has a smaller apparent distance from the coordinate P21 as the actual distance from the image capture device 220 increases.

[0084] 17B is a diagram illustrating curve C2, which is a set of coordinates that are equidistant in real distance from coordinate P22, in addition to curve C1. Curve C2 is a circular figure similar to curve C1, but its apparent size is smaller than curve C1. This is because coordinate P22 is farther away from image capture device 220 than coordinate P21. Note that control unit 211 calculates similar curves not only for coordinates P21 and P22, but also for all coordinates included in security line L21.

[0085] FIG. 17C is a diagram illustrating an example of an area A1 that is the basis for determining the auxiliary surveillance area. b If we set the coordinates on the cordon L21, then R dist ≧f(P a ,P b ) a The boundary line of area A1 is a set of coordinates that are equidistant in actual distance from the warning line L21.

[0086] After the coordinates are calculated in step S213, the control unit 211 executes the process of step S214. In step S214, the control unit 211 determines the auxiliary security area based on the coordinates calculated in step S213. For example, the control unit 211 can determine the auxiliary security area by any of the following methods.

[0087] The control unit 211 may directly use the area A1 in the example of Fig. 17C as the auxiliary security area. This method requires the least amount of calculations compared to other methods described later.

[0088] Furthermore, the control unit 211 may determine the auxiliary security area based on the direction (orientation) in which the person crosses the security line. This method can also be said to be a method of determining an auxiliary security area based on the direction of movement of the person. In some embodiments, the direction of movement of the person is predetermined with respect to the security line. The direction of movement of the person may be set by the user via a setting screen. Alternatively, the direction of movement of the person may be determined based on the actual movement of the person detected from the video. The direction of movement of the person may be patterned into several representative directions (e.g., two directions).

[0089] 18A and 18B are diagrams illustrating auxiliary security areas determined based on the direction of movement of a person. Both auxiliary security areas A2 and A3 are determined based on area A1 in FIG. 17C. Auxiliary security area A2 is an auxiliary security area when the direction of movement of a person is the direction of arrow D1. On the other hand, auxiliary security area A3 is an auxiliary security area when the direction of movement of a person is the direction of arrow D2.

[0090] In this case, the control unit 211 determines the remaining area of ​​area A1, excluding the area beyond the security line L21 as viewed from the near side in the direction of the person's movement, as the auxiliary security area. More specifically, the control unit 211 identifies the intersection of a straight line including the security line L21 and the boundary line of area A1, and determines any area of ​​area A1 enclosed by the straight line based on the direction of the person's movement as the auxiliary security area.

[0091] In this way, the control unit 211 may determine an auxiliary security area according to the moving direction of a person. For example, when a security line is set in a place where the moving direction is restricted to one direction, the control unit 211 may determine an auxiliary security area as shown in Figs. 18A and 18B. The auxiliary security area determined in this way makes it possible to reduce false detection of intrusion (i.e., unintended detection) by excluding areas of the area A1 that are unnecessary for detection. In this way, the user can use a more appropriate auxiliary security area for intrusion detection that differs depending on the moving direction of a person.

[0092] The control unit 211 may also determine the auxiliary security area based on a user's operation. For example, the control unit 211 may determine the auxiliary security area based on the coordinates acquired in step S212, i.e., the coordinates specified by the user as the end points of the security line. Alternatively, the control unit 211 may determine the auxiliary security area based on another operation (such as a person's moving direction or coordinates) that serves as a criterion for determining the auxiliary security area.

[0093] Fig. 19 is a diagram showing another example of the auxiliary security area. The auxiliary security area A4 is determined based on the area A1 in Fig. 17C. In this example, the control unit 211 identifies the intersection point between a perpendicular line to the security line L21 that intersects with the end point of the security line L21 and the boundary line of the area A1, and determines the area surrounded by this boundary line, the perpendicular line, and the security line L21 as the auxiliary security area. The auxiliary security area determined in this way can also reduce false detection of intrusion, as in the examples of Figs. 18A and 18B.

[0094] Furthermore, the control unit 211 may determine the auxiliary security region using features extracted from the video captured by the image capturing device 220. The features referred to here are, for example, edges and HOG (Histograms of Oriented Gradients) features. The control unit 211 can extract such features from the video captured by the image capturing device 220 and determine the auxiliary security region based on the extracted features.

[0095] FIG. 20 is a diagram showing yet another example of the auxiliary security area. The auxiliary security area A5 is determined based on the area A1 in FIG. 17C. In this example, the control unit 211 detects edges E1 and E2 in the vicinity of the security line L21. The edges E1 and E2 are, for example, pixel groups in which the change in brightness in a specific direction in the image is greater than a predetermined threshold. In this case, the control unit 211 determines the area surrounded by the security line L21, the edges E1 and E2, and the boundary line of the area A1 as the auxiliary security area. The auxiliary security area determined in this way can also reduce false detection of intrusion, similar to the examples of FIG. 18A, FIG. 18B, and FIG. 19.

[0096] The control unit 211 may be configured to select one of a plurality of candidates for auxiliary security areas. In this case, the control unit 211 may cause the display device 240 to display the plurality of candidates for auxiliary security areas together with the image captured by the image capturing device 220, and select one of them in response to a user operation. For example, the user checks the candidates for auxiliary security areas displayed superimposed on the image, and selects the desired one. At this time, the control unit 211 may select the candidate for auxiliary security areas by pressing the R dist Alternatively, multiple candidates with different values ​​may be displayed on the display device 240 to allow the user to select one.

[0097] Once the auxiliary security area is determined, the control unit 211 executes the process of step S215. In step S215, the control unit 211 records the setting information in the storage unit 212. The setting information includes information indicating the security line and information indicating the auxiliary security area. The setting information stored in the storage unit 212 is used in the detection process. The setting information is, for example, coordinates indicating the boundary between the security line and the auxiliary security area.

[0098] Fig. 21 is a flowchart showing the details of the detection process (steps S221 to S224) and the notification process (steps S231 to S232). The control unit 211 starts executing the series of processes shown in Fig. 21 at the timing when monitoring using video starts. The start timing of the process by the control unit 211 is, for example, the timing when the imaging device 220 starts imaging or the timing instructed by the user. The control unit 211 executes the following process for each frame of the video. For ease of explanation, it is assumed below that one or less people are detected in each frame.

[0099] In step S221, the control unit 211 determines whether a person has been recognized from the video. The control unit 211 can recognize the person by a well-known object recognition technology. The recognition by the control unit 211 may be either general object recognition or specific object recognition. That is, the control unit 211 may recognize an object having characteristics that are like a person, or may recognize a person having specific characteristics that are recorded in advance in a database (a so-called blacklist). If a person is not recognized from the video (S221: NO), the control unit 211 ends the process without executing the notification process.

[0100] If a person is recognized from the video (S221: YES), the control unit 211 further executes the determination of step S222. In step S222, the control unit 211 determines whether the person recognized in step S221 has entered the auxiliary security area. At this time, the control unit 211 specifies the coordinates of the auxiliary security area based on the setting information recorded in the setting process. The control unit 211 may determine that the person recognized in step S221 has entered the auxiliary security area when at least a part of the person is included in the area, or may determine that the person has entered the area when the entire person is included in the area. If the person recognized in step S221 has not entered the auxiliary security area (S222: NO), the control unit 211 ends the process without executing the notification process.

[0101] If the person recognized in step S221 has entered the auxiliary security area (S222: YES), the control unit 211 further executes a measurement process in step S223. The measurement process is a process for measuring the length of time during which a person is detected in the auxiliary security area (hereinafter also referred to as "detection time"). In step S223, if the person recognized in step S221 was not detected in the auxiliary security area in the immediately preceding frame, the control unit 211 starts measuring the detection time. On the other hand, if the person recognized in step S221 was also detected in the auxiliary security area in the immediately preceding frame, the control unit 211 adds one frame to the detection time that has already been measured. Note that, if the person is not detected in the frame following the frame in which the person was detected in the auxiliary security area, the control unit 211 resets the detection time.

[0102] In step S224, the control unit 211 determines whether the person recognized in step S221 has passed the security line. If the person recognized in step S221 has passed the security line (S224: YES), the control unit 211 executes a first notification process (step S231).

[0103] If the person recognized in step S221 has not passed the security line (S224: NO), the control unit 211 further executes the determination of step S225. In step S225, the control unit 211 determines whether the detection time measured by the measurement process is equal to or greater than a predetermined threshold. If the detection time is less than the predetermined threshold (S225: NO), the control unit 211 ends the process without executing the notification process. On the other hand, if the detection time is equal to or greater than the predetermined threshold (S225: YES), the control unit 211 executes a second notification process (step S232).

[0104] The first notification process is, for example, a process for displaying a message such as "A person of interest has passed the security line" on the display device 240. In contrast, the second notification process is, for example, a process for displaying a message such as "A person of interest has entered the auxiliary security area" on the display device 240. In the second notification process, the control unit 211 may also notify the measured detection time. Note that the first notification process and the second notification process may be the same process.

[0105] As described above, the intrusion detection system 200 of this embodiment can execute operations from setting the security line and auxiliary security area to detecting and notifying a person. When setting the security line and auxiliary security area, the information processing device 210 can facilitate the user to set the auxiliary security area (i.e., the setting area) in the same manner as the setting support device 100 of the fifth embodiment.

[0106] Generally, an image captured in a three-dimensional space includes positions that are different in distance (i.e., depth) from the image capture device 220. This allows the image captured by the image capture device 220 to create a sense of perspective for the viewer (i.e., the user). Therefore, when an object is included in such an image, the appearance of the object in the image changes depending on the object's position (in other words, the distance from the image capture device 220).

[0107] However, there are cases where a user wants to set the auxiliary security area to a range that is equidistant from the security line. For example, the auxiliary security area is often set to a range of 100 m from the security line. In particular, when an object can enter from any position on the boundary of the auxiliary security area, setting the range at such an equidistant distance can be said to be reasonable.

[0108] However, as mentioned above, images have depth. Therefore, the apparent distance in an image does not necessarily match the actual distance (real distance) in three-dimensional space. Therefore, it is generally difficult for a user to manually and accurately input a line such as the boundary of an auxiliary security area.

[0109] On the other hand, a cordon is set at a place where people enter and exit, such as the entrance of a facility (a building, a park, etc.) to be monitored. Such a place usually has an appearance that can be distinguished from other places. For example, the entrance of the facility may have a gate or no objects (fences, walls, etc.) that would prevent people from passing through. Therefore, it can be said that the task of a user manually setting a cordon is relatively easy compared to the task of manually setting an area such as an auxiliary security area.

[0110] In this embodiment, the user can set an auxiliary security area, which is relatively difficult to set manually, by simply specifying the security line, which is relatively easy to set manually. The auxiliary security area determined by the intrusion detection system 200 has an equal actual distance from the security line, so that the actual distance from the security line will not become shorter against the user's will. With such an auxiliary security area, it is possible to appropriately determine whether a person has entered or remained in the auxiliary security area, regardless of the position from which the person has entered.

[0111] In addition, in this embodiment, the user can easily modify (edit) the auxiliary security area into a more preferable shape as necessary. This allows the intrusion detection system 200 to suppress detection against the user's will. For example, the intrusion detection system 200 can reduce the possibility of detecting a person who does not need to be detected.

[0112] (Modification of the sixth embodiment) The sixth embodiment can be modified as follows.

[0113] The guard line does not have to be a straight line. For example, the guard line may be a broken line or a curved line, or may be a combination of a straight line and a curved line. The coordinates acquired by the information processing device 210 via the input device 230 are not limited to the examples in this embodiment, and may be the same as the coordinates acquired by the acquisition unit 110 in the fifth embodiment. The information processing device 210 sets the guard line based on the coordinates of the broken line or the curved line acquired via the input device 230.

[0114] 22 is a diagram illustrating an auxiliary security area when the security line is a curve. In this example, the curve C3 represents a set of coordinates that are equidistant in actual distance from the security line L31. The control unit 211 calculates tangents T1 and T2 at the end points P31 and P32 of the security line L31, and among the areas surrounded by the curve C3, the area A6 or A7 surrounded by the security line L31, the tangents T1 and T2, and the curve C3 is set as the auxiliary security area. In other words, the tangents T1 and T2 here are straight lines whose slopes are the right differential coefficient or the left differential coefficient at the end points P31 and P32.

[0115] Furthermore, the setting process may be executed by a device different from the detection process and the notification process. That is, the intrusion detection system 200 may be configured to include an information processing device that executes the setting process and another information processing device that executes the detection process and the notification process. However, the configuration of either information processing device may be similar to that of the information processing device 210 in FIG. 13.

[0116] The information processing device 210 may detect multiple types of objects. For example, the information processing device 210 may simultaneously detect humans and automobiles. However, humans and automobiles have different average moving speeds. Therefore, when detecting multiple types of objects, the information processing device 210 adjusts R in formula (1) according to the type of each object. dist For example, the information processing device 210 may differentiate between the object type and R dist A table associating the above with the type of object may be stored in the storage unit 212, and an auxiliary security area may be determined according to the type of object.

[0117] In addition, R distmay be specified by the user. Alternatively, the user may specify R dist Instead of R, the moving speed of the object and the desired time may be specified. In this case, the control unit 211 multiplies the moving speed and the time to obtain R dist can be calculated.

[0118] The intrusion detection system 200 does not need to detect an object from a video in real time. That is, the video referred to here may be recorded in advance and stored in a storage device or the like. Also, the information processing device 210 may be located in a remote location separated from other devices. For example, the information processing device 210 may be realized using so-called cloud computing technology.

[0119] The present invention is not limited to the above-described embodiment, and various modifications are possible within the scope of the invention described in the claims, and it goes without saying that these modifications are also included in the scope of the present invention.

[0120] (Additional Note) Some or all of the embodiments of the present invention may be described as follows, but are not limited to the following. (Appendix 1) a detection means for detecting an intrusion position of an object that has intruded into a specific area on an image; A control means for associating a position on the image with a predetermined time. With The detection means issues an alarm when the object remains in the specific area on the image for the predetermined time or longer, the time corresponding to a position that coincides with the detected intrusion position. Intrusion detection devices. (Appendix 2) further comprising an input means for receiving an input of an entry position and an input of a predetermined time; the control means associates the entry position with the predetermined time based on the received input of the entry position and the input of the predetermined time. 2. An intrusion detection device as described in appended claim 1. (Appendix 3) Further comprising an input means for receiving an input of an entry position, The control means sets the predetermined time based on the received input of the entry position. 2. An intrusion detection device as described in appended claim 1. (Appendix 4) Further comprising an input unit for receiving an input of a predetermined time, The control means sets the specific area based on the received input of the predetermined time. 2. An intrusion detection device as described in appended claim 1. (Appendix 5) Detecting an intrusion position of an object that has intruded into a specific area on the image, Correlating the intrusion position with a predetermined time, When the object remains in the specific area on the image for more than the predetermined time, a warning is issued. Intrusion detection methods. (Appendix 6) Computer, a detection means for detecting an intrusion position of an object that has intruded into a specific area on an image; A control means for associating the entry position with a predetermined time; A means for issuing a warning when the object remains in the specific area on the image for the predetermined period of time or longer, A computer-readable program recording medium having a program recorded thereon for causing the device to function as a (Appendix 7) An acquisition means for acquiring coordinates designated by a user for an image captured in a three-dimensional space; a calculation means for calculating coordinates in the image of a position at a predetermined distance from a position in the three-dimensional space corresponding to the acquired coordinates; a determining means for determining an area to be set for the specified line based on the calculated coordinates; A setting support device comprising: (Appendix 8) The determining means is The region is determined based on a direction in which an object crosses a position in the three-dimensional space corresponding to the acquired coordinates. 8. The setting support device according to claim 7. (Appendix 9) The determining means is determining the region that differs depending on the direction 9. A configuration support device as described in appendix 8. (Appendix 10) The determining means is The region is determined using the acquired coordinates. A setting support device according to any one of appendix 7 to appendix 9. (Appendix 11) The determining means is The region is determined using features extracted from the image. A setting support device according to any one of appendix 7 to appendix 10. (Appendix 12) The determining means is The apparatus further includes a selection unit for selecting one of a plurality of candidates for the region. A setting support device according to any one of appendix 7 to appendix 11. (Appendix 13) A display means for displaying the plurality of candidates together with the image, The selection means is Selecting one of the plurality of candidates displayed by the display means in response to a user operation. 13. A setting support device as described in appendix 12. (Appendix 14) The apparatus further includes a detection unit for detecting an entry of an object into the determined region in the three-dimensional space. A setting support device according to any one of appendix 7 to appendix 13. (Appendix 15) Acquire coordinates specified by a user for the captured image of the three-dimensional space; Calculating coordinates in the image of a position at a predetermined distance from the position in the three-dimensional space corresponding to the acquired coordinates; A region to be set for the specified line is determined based on the calculated coordinates. Setting support method. (Appendix 16) On the computer, A process of acquiring coordinates designated by a user for a captured image of a three-dimensional space; calculating coordinates in the image of a position at a predetermined distance from a position in the three-dimensional space corresponding to the acquired coordinates; determining an area to be set for the specified line based on the calculated coordinates; A computer-readable program recording medium having a program recorded thereon for executing the above.

[0121] This application claims priority based on Japanese Patent Application No. 2015-245497, filed December 16, 2015, the disclosure of which is incorporated herein in its entirety. [Explanation of symbols]

[0122] 1. Intrusion detection device 2. Detection Methods 3. Control Measures 4,5,6 Input methods

Claims

1. The function of receiving images from the camera, A function of displaying the image on a touch screen display of an information processing device; a function of accepting an operation to set an area including at least a part of an area inside a line connecting a position in three-dimensional space that is a predetermined distance from a position of a line designated by a user by dragging the image displayed on the touch screen display from a first position to a second position, as an area for detecting an intrusion of an object; a function of setting the area including at least the first position based on the operation; a function of displaying a message on the touch screen display in response to detecting an intrusion of the object into the area; An intrusion detection program that causes the information processing device to realize the above.

2. the region includes the second location, 2. The intrusion detection program according to claim 1.

3. The object includes a person.

3. The intrusion detection program according to claim 1.

4. The shape of the region is determined based on the first position and the second position.

4. The intrusion detection program according to claim 1.

5. The information processing device further realizes a function of displaying at least one of the first position and the second position on the touch screen display.

5. The intrusion detection program according to claim 1.

6. A video receiving means for receiving a video from a camera; an image display means for displaying the image on a touch screen display; an operation receiving means for receiving an operation to set an area including at least a part of an area inside a line connecting a position in three-dimensional space that is a predetermined distance from a position of a line designated by a user by dragging from a first position to a second position of the image displayed on the touch screen display as an area for detecting an intrusion of an object; a setting means for setting the area including at least the first position based on the operation; a message display means for displaying a message on the touch screen display in response to detection of an intrusion of the object into the area; An intrusion detection device comprising:

7. By the information processing device, Receives images from the camera, Displaying the image on a touch screen display of the information processing device; accepting an operation to set, as an area for detecting intrusion of an object, an area including at least a part of an area inside a line connecting a position in three-dimensional space that is a predetermined distance from a position of a line designated by a user by dragging from a first position to a second position of the image displayed on the touch screen display; setting the area including at least the first position based on the operation; displaying a message on the touch screen display in response to detecting an intrusion of the object into the area. Intrusion detection methods.

Images