Intrusion detecting method, intrusion detecting program and intrusion detecting device

Abstract

To provide a technology allowing a user to support work for setting an area in a video.SOLUTION: An intrusion detecting program causes an information processing device to realize the functions to: receive a video from a camera; display the video on a touch screen display of the information processing device; accept an operation for setting an area for detecting intrusion of an object by dragging a first position to a second position in the video displayed on the touch screen display; set the area including at least the first position on the basis of the operation; and display a message on the touch screen display according to detection of the object intruding into the area.SELECTED DRAWING: Figure 9

Description

Technical Field

[0001] The present invention relates to video surveillance technology, and more particularly to intrusion detection technology.

Background Art

[0002] Surveillance cameras are actively installed in the streets and buildings to realize a safe and secure society. While the number of surveillance locations is increasing in this way, manual surveillance has limitations, and a method for efficiently checking the images captured by surveillance cameras is required. As one method for realizing efficient surveillance, there is a video surveillance technology that detects and recognizes an object shown in a surveillance camera and gives a warning when the object is a surveillance target. Examples of such technologies are described in Patent Documents 1 to 3.

[0003] This video surveillance technology includes, for example, a warning line technology for detecting an object that has passed through a line on the video, and a warning area technology for detecting an object that has entered a specific area on the video. FIG. 5 is an example of the warning line technology. In this example, an object that passes through a line segment connecting walls on the video is detected, and a warning is given when the object is a surveillance target. This line segment may be called a warning line. FIG. 6 is an example of the warning area technology. In this example, an object that enters a specific area on the video is detected, and a warning is given when the object is a surveillance target. This specific area may be called a warning area.

[0004] By the way, even if the passage of the object to be monitored is detected by these warning line technologies or warning area technologies, the response to the object to be monitored may be delayed. In contrast, in order to detect the object to be monitored earlier, an auxiliary warning area (auxiliary warning area) that detects the object to be monitored that attempts to approach the warning line or warning area before detecting the passage of the object to be monitored is often set together. This auxiliary warning area is set in a wide range including the warning line or warning area. After detecting an object that has entered the auxiliary warning area as the object to be monitored, a warning is issued when the object to be monitored has been within the auxiliary warning area for a predetermined time or more. This predetermined time is sometimes called the intrusion duration. The auxiliary warning area is restricted within the shooting area. For this reason, the auxiliary warning area often has a complex shape according to the shooting range and the shape of the site.

Prior Art Documents

Patent Documents

[0005]

Patent Document 1

Patent Document 2

Patent Document 3

Summary of the Invention

Problems to be Solved by the Invention

[0006] In the above-described video surveillance technology, it was only possible to set one intrusion duration for the auxiliary warning area. Also, this intrusion duration did not depend on the intrusion position of the object. For this reason, the set intrusion duration may have been too long for the intrusion position of the object into the auxiliary warning area. That is, there was a case where the object entered the warning area before a warning was issued due to the elapsed time since the intrusion into the auxiliary warning area becoming equal to or longer than the intrusion duration. FIG. 7 shows an example of the auxiliary warning area. This example detects an object that enters a specific area on the video, and issues a warning when the object is the target to be monitored. This specific area may be called the auxiliary warning area. In FIG. 7, the routes i and ii connecting the warning line and the auxiliary warning area have different actual distances. For example, if the intrusion duration is set for the auxiliary warning area assuming route ii, an object that intrudes via route i, which has a shorter actual distance than route ii, may enter the warning area before the set intrusion duration elapses.

[0007] An object detection device, a setting support device, an object detection method, a setting support method, and a program recording medium capable of performing video surveillance according to the intrusion position of an object into a specific area on the video are provided.

Means for Solving the Problems

[0008] The intrusion detection program of the present invention causes the information processing device to realize a function of receiving video from a camera, a function of displaying the video on a touch screen display of the information processing device, a function of receiving an operation of setting an area for detecting an intrusion of an object by dragging from a first position to a second position of the video displayed on the touch screen display, a function of setting the area including at least the first position based on the operation, and a function of displaying a message on the touch screen display in response to detecting an intrusion of the object into the area.

[0009] The intrusion detection device of the present invention comprises an image receiving means for receiving an image from a camera, an image display means for displaying the image on a touch screen display provided with the device, an operation receiving means for receiving an operation to set an area in which intrusion of an object is to be detected by dragging from a first position to a second position on the image displayed on the touch screen display, a setting means for setting the area including at least the first position based on the operation, and a message display means for displaying a message on the touch screen display in response to detection of intrusion of the object into the area.

[0010] An intrusion detection method of the present invention includes an information processing device that receives an image from a camera, displays the image on a touch screen display of the information processing device, receives an operation to set an area in which to detect intrusion of an object by dragging from a first position to a second position on the image displayed on the touch screen display, sets the area including at least the first position based on the operation, and displays a message on the touch screen display in response to detection of intrusion of the object into the area. Effect of the Invention

[0011] According to the intrusion detection device, setting assistance device, intrusion detection method, setting assistance method, and program recording medium of the present invention, it is possible to perform video surveillance according to the position of an object intruding into a specific area on the video. [Brief description of the drawings]

[0012]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10A

Figure 10B

Figure 10C

Figure 11

Figure 12

Figure 13

Figure 14

Figure 15

Figure 16A

Figure 16B

Figure 17A

Figure 17B

Figure 17C

Figure 18A

Figure 18B

Figure 19

Figure 20

Figure 21

Figure 22

[0013] Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. In the following description, components having the same function may be denoted by the same reference numerals, and the description thereof may be omitted.

[0014] (First Embodiment) (Configuration) Figure 1 is a block diagram showing an example of means for setting an auxiliary warning area according to a first embodiment of the present invention. In the present embodiment, the intrusion detection device 1 includes a detection means 2 and a control means 3.

[0015] (Operation) The detection means 2 detects the intrusion position of an object that has intruded into a specific area (auxiliary warning area) on the video into the specific area (auxiliary warning area). The control means 3 associates the position on the video with a predetermined time (intrusion duration). Further, when the object stays within the specific area (auxiliary warning area) on the video for a predetermined time (intrusion duration) or more corresponding to the detected intrusion position, the detection means 2 warns the operator. The predetermined time mentioned here is a time determined for each position on the video and is defined, for example, by the operator.

[0016] More specifically, the detection means 2 detects an object that has intruded into the auxiliary warning area, and when the object is a monitoring target, specifies the intrusion position of the monitoring target into the auxiliary warning area. Further, when the monitoring target stays within the auxiliary warning area for a predetermined time (intrusion duration) or more corresponding to the specified intrusion position, the detection means 2 warns the operator. The control means 3 associates the position on the video with a predetermined time (intrusion duration), and transmits the set of the associated position and the predetermined time (intrusion duration) to the detection means 2. The detection means 2 warns the operator based on the intrusion duration of the set in which the intrusion position specified by the detection means 2 matches the position associated by the control means 3 among the transmitted sets. Alternatively, the detection means 2 may warn the object that has intruded into the auxiliary warning area. For example, the control means 3 may associate at regular intervals. Alternatively, the control means 3 may associate when requested by the detection means 2. Also, the control means 3 may have a set of the associated position and a predetermined time (intrusion duration).

[0017] (Effect) According to the present embodiment, video monitoring can be performed according to the intrusion position of an object into a specific area on the video.

[0018] (Second Embodiment) (Configuration) FIG. 2 is a block diagram showing an example of means for setting an auxiliary warning area according to the second embodiment of the present invention. The intrusion detection device 1 further includes an input means 4 that receives an input of the intrusion position into the auxiliary warning area and an input of a predetermined time in addition to the detection means 2 and the control means 3.

[0019] The input means 4 is a means for receiving the input of the intrusion position into the auxiliary warning area and the input of a predetermined time. The intrusion position is, for example, the coordinates on an image. The input of the intrusion position is performed, for example, by the input means 4 displaying an image on a display, receiving the writing of points or lines on the displayed image, and calculating the coordinates on the image from the written points or lines. The input of the predetermined time is, for example, the input of a numerical value. The input of the numerical value may be by a numeric keypad or by other input methods. The unit may be seconds or minutes.

[0020] The control means 3 is a means for associating the intrusion position with the predetermined time based on the received input of the intrusion position and the input of the predetermined time. For example, the control means 3 may be realized by a CPU (Central Processing Unit) executing a predetermined program. For example, when the input means 4 receives the input of the intrusion position and the input of the predetermined time as a set, the control means 3 may associate the received input of the intrusion position and the input of the predetermined time as a set. Alternatively, when the input means 4 receives the input of the predetermined time, the control means 3 may associate the input of the intrusion position to be the object of association with the input of the predetermined time being input by causing the input means 4 to select the input of the intrusion position. Or, the control means 3 may associate based on the respective orders of the input of a plurality of inputted intrusion positions and the input of a plurality of predetermined times. For example, the control means 3 associates the input of the first intrusion position with the input of the first predetermined time, and further associates the input of the second intrusion position with the input of the second predetermined time.

[0021] Then, the control means 3 transmits the set of the associated intrusion position and the input of the predetermined time to the detection means 2. When the control means 3 associates a plurality of sets of the intrusion position and the input of the predetermined time, each of these plurality of sets may be transmitted to the detection means 2.

[0022] The detection means 2 identifies the intrusion position into the auxiliary warning area of the monitoring target, refers to the input for a predetermined time associated with the input of the intrusion position indicating the position as the intrusion continuation time, and warns the operator when the monitoring target stays within the auxiliary warning area for longer than the intrusion continuation time. The detection means 2 receives one or more sets of the input of the intrusion position and the input of the predetermined time associated in the control means 3 from the control means 3. The detection means 2 may store these one or more transmitted sets in a storage means (not shown). The detection means 2 can identify the intrusion position into the auxiliary warning area of the monitoring target. For example, the detection means 2 may use the warning line technology to identify the position where the monitored object crosses the boundary line of the auxiliary warning area as the intrusion position. The detection means 2 searches for the input of the intrusion position indicating the identified intrusion position from among one or more sets transmitted from the control means 3. Thereafter, the detection means 2 refers to the predetermined time associated with the input of the searched intrusion position as the intrusion continuation time. The detection means 2 compares the time the monitoring target stays within the auxiliary warning area with the intrusion continuation time, and warns the operator when the stay is longer than the intrusion continuation time.

[0023] (Operation) Next, an example of the operation of the intrusion detection device 1 according to the second embodiment of the present invention will be described.

[0024] The input means 4 receives the input of the intrusion position into the auxiliary warning area and the input of the predetermined time. The input means 4 transmits the received input of the intrusion position and the input of the predetermined time to the control means 3.

[0025] Thereafter, the control means 3 associates the intrusion position with the predetermined time based on the received input of the intrusion position and the input of the predetermined time. The association method is as described above. The control means 3 performs the association between the intrusion position and the predetermined time from the received input of the intrusion position and the input of the predetermined time, and transmits the set of the associated intrusion position and the predetermined time to the detection means 2.

[0026] The detection means 2 identifies the intrusion position into the auxiliary warning area of the monitoring target asynchronously with the transmission of the intrusion position and the predetermined time by the control means 3. This identification may be performed, for example, every time a predetermined time such as every 30 seconds or every minute elapses.

[0027] When the detection means 2 detects an intrusion into the auxiliary warning area of the monitoring target, or when it identifies the intrusion position, it searches for the input of the intrusion position indicating the identified intrusion position from among one or more sets transmitted from the control means 3. Thereafter, the detection means 2 refers to the predetermined time associated with the searched input of the intrusion position as the intrusion duration. Then, the detection means 2 compares the time the monitoring target stays within the auxiliary warning area with the intrusion duration, and warns the operator when the stay time is longer than the intrusion duration.

[0028] In the above description of the operation, the mode in which the identification of the intrusion position by the detection means 2 and the transmission from the control means 3 to the detection means 2 are performed asynchronously has been described, but the order of the two is not limited to this. For example, when the intrusion position and the predetermined time are transmitted from the control means 3 to the detection means 2, the detection means 2 may operate to start identifying the intrusion position. Furthermore, when the detection means 2 can identify the intrusion position, it may operate to cause the control means 3 to transmit the intrusion position and the predetermined time.

[0029] (Effect) According to the present embodiment, video monitoring can be performed according to the intrusion position into a specific area on the video of the object.

[0030] (Third Embodiment) (Configuration) FIG. 3 is a block diagram showing an example of means for setting an auxiliary warning area according to the third embodiment of the present invention. In addition to the detection means 2 and the control means 3, the intrusion detection device 1 further includes an input means 5 for receiving an input of the intrusion position into the auxiliary warning area.

[0031] (Operation) The input means 5 receives the input of the intrusion position into the auxiliary warning area. Further, the input means 5 transmits the received input of the intrusion position to the control means 3. The control means 3 sets a predetermined time based on the input of the intrusion position.

[0032] The setting of the predetermined time by the control means 3 can be performed, for example, by the following method. For example, the control means 3 acquires the warning line and calculates the shortest distance between the acquired warning line and the input intrusion position. Next, the control means 3 acquires the moving speed of the object. Thereafter, the control means 3 calculates a predetermined time from the moving speed of the object acquired and the calculated shortest distance.

[0033] The acquisition of the moving speed of the object by the control means 3 can be performed, for example, by the following method. For example, the control means 3 receives it as an input of a numerical value. Alternatively, the control means 3 calculates the moving speed of the object from the image.

[0034] The calculation of the predetermined time by the control means 3 can be performed, for example, by the following method. For example, the control means 3 obtains a value obtained by dividing the shortest distance calculated by the above method by the moving speed calculated by the above method. Also, the calculation of the predetermined time by the control means 3 may be a value obtained by adding a predetermined time to the obtained value. Thereby, a setting considering the operation in actual monitoring is performed.

[0035] (Effect) According to the present embodiment, video monitoring can be performed according to the intrusion position into a specific area on the video of the object.

[0036] (Fourth Embodiment) (Configuration) FIG. 4 is a block diagram showing an example of means for setting an auxiliary warning area according to the fourth embodiment of the present invention. The intrusion detection device 1 further includes an input means 6 that receives an input of a predetermined time in addition to the detection means 2 and the control means 3.

[0037] (Operation) The input means 6 receives an input for a predetermined time. Further, the input means 6 transmits the received input for the predetermined time to the control means 3. The control means 3 sets a specific area (auxiliary warning area) based on the received input for the predetermined time. The setting of the auxiliary warning area by the control means 3 can be performed, for example, by the following method. For example, the control means 3 acquires the moving speed of an object and calculates the moving distance of the object in the predetermined time from the acquired moving speed of the object and the input for the predetermined time. Further, for example, the control means 3 receives an input of a warning line, calculates the coordinates at the moving distance of the object calculated from the received warning line as the intrusion position of the object, and sets the calculated intrusion position of the object. There may be a plurality of intrusion positions of the object at this time. The set of the intrusion positions of the plurality of objects forms a line segment. This line segment is an auxiliary warning line. And the area surrounded by the auxiliary warning line is the auxiliary warning area.

[0038] (Effect) According to the present embodiment, video monitoring can be performed according to the intrusion position into a specific area on the video of an object.

[0039] Furthermore, according to the present embodiment, an auxiliary warning line can be generated by an input for a predetermined time.

[0040] FIG. 8 is a block diagram showing an example of the hardware configuration of a computer that realizes the intrusion detection device according to the first embodiment of the present invention. The computer 600 includes a processor 610, a memory 620, a storage 630, and an interface 640.

[0041] The processor 610 is, for example, a CPU (Central Processing Unit). The memory 620 corresponds to a main storage device. The storage 630 corresponds to an auxiliary storage device. The storage 630 is constituted by, for example, a hard disk or a flash memory. Further, the storage 630 may be configured to include a reader / writer for a removable recording medium such as an optical disk or a USB (Universal Serial Bus) flash drive. The interface 640 transmits and receives data to and from an external device.

[0042] By executing a program stored in the memory 620 or the storage 630, the processor 610 can function as the detection means 2 and the control means 3 of the intrusion detection device 1.

[0043] In addition to the intrusion detection device, the present invention can provide an intrusion detection method. Further, the present invention can also be provided in the form of a program for causing a computer to function as an intrusion detection device and a computer-readable recording medium (such as an optical disk, a magnetic disk, a semiconductor memory, etc.) recording the program. Also, the program according to the present invention may be downloaded to a certain device via a network to cause the device to function as an intrusion detection device.

[0044] (Fifth Embodiment) FIG. 9 is a block diagram showing the configuration of a setting support device 100 according to the fifth embodiment of the present invention. The setting support device 100 is an information processing device for supporting (facilitating) the setting of an area performed by a user based on an image. The setting support device 100 includes at least an acquisition unit 110, a calculation unit 120, and a determination unit 130. Note that the hardware configuration of the setting support device 100 may be the same as that of the computer 600 illustrated in FIG. 8.

[0045] The acquisition unit 110 acquires coordinates in the image. These coordinates represent a line (such as a straight line, a curve, a broken line, etc.) or an area specified by the user with respect to an image of a three-dimensional space (that is, an actual space) captured by an imaging device such as a surveillance camera. The coordinates acquired by the acquisition unit 110 are represented, for example, in a two-dimensional coordinate system with a predetermined position (such as an end point, a center, etc.) of the image as the origin. The image captured by the imaging device in the present embodiment can also be said to be an image with depth.

[0046] The number of coordinates acquired by the acquisition unit 110 is not limited to a specific number as long as a line can be defined. For example, when the line specified by the user is a line segment, the acquisition unit 110 may acquire the coordinates of the endpoints (starting point and ending point) of the line segment. Alternatively, when the line specified by the user is a polyline, the acquisition unit 110 may acquire the coordinates of the endpoints of the plurality of line segments that make up the polyline. The specification of coordinates is performed, for example, via an input device such as a mouse or a touch screen display. When the user draws a line by hand using an input device such as a touch screen display, the acquisition unit 110 acquires each coordinate on the hand-drawn line.

[0047] The calculation unit 120 calculates the coordinates of a position at a predetermined distance from the position in the three-dimensional space corresponding to the coordinates acquired by the acquisition unit 110. The position referred to here is a position on a plane in the actual three-dimensional space, which is different from the coordinates in the (two-dimensional) video at a certain point. More specifically, the calculation unit 120 calculates the coordinates in the video of a position at a predetermined distance from the position of the line specified by the user in the three-dimensional space.

[0048] FIG. 10A, FIG. 10B, and FIG. 10C are schematic diagrams for explaining the coordinates calculated by the calculation unit 120. FIG. 10A is a diagram illustrating a line L1 specified for the video. FIG. 10B is a diagram illustrating a line L1a in the three-dimensional space corresponding to the line L1 and a line L2a connecting positions equidistant from the line L1a. FIG. 10C is a diagram illustrating the line L1 and a line L2 on the video corresponding to the line L2a.

[0049] Note that the images illustrated in FIGS. 10A and 10C are assumed to have a difference in perspective in the y1-axis direction in the figures. That is, the images illustrated in FIGS. 10A and 10C represent positions farther away as the coordinates with larger components of the y1-axis. Also, an object in the image is photographed smaller in the image as the distance from the photographing device is farther. This is because the magnification of the object in the image is inversely proportional to the distance between the object and the photographing device. Therefore, in the images illustrated in FIGS. 10A and 10C, even for objects of the same size, the object at the coordinate with a larger component of the y1-axis is photographed smaller.

[0050] The x1y1 coordinate system in FIGS. 10A and 10C is a coordinate system (screen coordinate system) defined for the image. The coordinates according to this coordinate system, that is, the coordinates on the image, are numerical values indicating the positions of the respective pixels based on the pixel at a predetermined position of the image (origin). On the other hand, the x2y2 coordinate system in FIG. 10B is a coordinate system (world coordinate system) corresponding to the actual three-dimensional space and is different from the coordinate systems in FIGS. 10A and 10C. For example, the x2-axis component and the y2-axis component in FIG. 10B correspond to latitude and longitude.

[0051] The line L2 in FIG. 10C does not have the same shape as the line L2a in FIG. 10B. This is because apparent distortion (deformation) due to perspective difference occurs in the images represented by FIGS. 10A and 10C. Therefore, even if the line L2 in the image is equidistant from the line L1a in the actual three-dimensional space, it is not equidistant from the line L1 in the image. More specifically, the line L2 is closer to the line L1 on the image as the component of the y1-axis increases.

[0052] The calculation unit 120 calculates the coordinates of each point on the line L2 in FIG. 10C using a predetermined function. This function can be defined based on, for example, calibration executed in advance. The calibration mentioned here is performed, for example, by installing reference objects (rods of a predetermined length, marks of a predetermined size, etc.) of known size at a plurality of positions in the space to be photographed and associating the size (e.g., number of pixels) of the reference object in the image with the actual size.

[0053] Based on the coordinates calculated by the calculation unit 120, the determination unit 130 determines an area set for the coordinates acquired by the acquisition unit 110. For example, the determination unit 130 determines, as the area corresponding to line L1, the area surrounded by the closed curve represented by the coordinates calculated by the calculation unit 120 (for example, the area inside line L2 in FIG. 10C). In the following, the area determined by the determination unit 130 is also referred to as the "set area".

[0054] The determination unit 130 may use, as the set area, an area that is partially different from the area surrounded by the closed curve represented by the coordinates calculated by the calculation unit 120. For example, the determination unit 130 may use, as the set area, a part of the area surrounded by the closed curve represented by the coordinates calculated by the calculation unit 120. In other words, the determination unit 130 may use, as the set area, an area obtained by excluding a part of the area surrounded by the closed curve represented by the coordinates calculated by the calculation unit 120. At this time, the determination unit 130 may determine the area to be excluded from the set area based on other information. The other information referred to here is, for example, the coordinates acquired by the acquisition unit 110, features extracted from the video, predetermined rules, etc. Also, the determination unit 130 may determine the area to be excluded from the set area based on the user's operation.

[0055] FIG. 11 is a flowchart showing the process executed by the setting support device 100. In step S11, the acquisition unit 110 acquires the coordinates specified by the user using a line for the video obtained by photographing the three-dimensional space. At this time, the video is photographed by the photographing device and displayed by the display device. The user specifies the coordinates using an input device such as a mouse for the video displayed by the display device. Taking FIG. 10A as an example, the acquisition unit 110 acquires the coordinates defining line L1 (for example, the start point and the end point of line L1).

[0056] In step S12, the calculation unit 120 calculates the coordinates of a position at a predetermined distance from the position in the three-dimensional space corresponding to the line represented by the coordinates acquired in step S11. Taking FIG. 10C as an example, the calculation unit 120 calculates each coordinate on line L2 based on the coordinates defining line L1.

[0057] In step S13, the determination unit 130 determines a setting area based on the coordinates calculated in step S12. The determination unit 130 determines the setting area so as to include at least a part of the area surrounded by line L2. Taking FIG. 10C as an example, the determination unit 130 may set a part or all of the area surrounded by line L2 as the setting area. The determination unit 130 may use the other information described above to determine the setting area so as to include not only the area surrounded by line L2 but also other areas.

[0058] As described above, the setting support device 100 of the present embodiment has a configuration for determining a setting area based on a line specified by the user. With this configuration, the user only needs to specify a line when setting the setting area, and there is no need to input the setting area itself. Therefore, according to the setting support device 100 of the present embodiment, it becomes easy for the user to accurately set the setting area for a three-dimensional video. That is, the setting support device 100 can support the setting operation by the user.

[0059] (Sixth Embodiment) FIG. 12 is a block diagram showing the configuration of an intrusion detection system 200 according to the sixth embodiment. The intrusion detection system 200 is an information processing system for detecting the intrusion of an object. In some aspects, the object referred to here is a human such as a suspicious person. However, the object referred to here may be an animal other than a human, or a movable machine such as an automobile or a robot. In the following, it is assumed that the object detected by the intrusion detection system 200 is a human.

[0060] As used herein, "intrusion" refers to the entry of an object into a specific area that may be illegal. However, in each embodiment of the present invention, whether the object that has entered the specific area actually has an illegal purpose does not need to be a problem. For example, whether the object that has entered the specific area has an illegal purpose may be determined using a system other than the intrusion detection system 200, or may be determined by a person. That is, it can be said that the intrusion detection system 200 is a system for detecting signs or possibilities of intrusion, or (regardless of whether it is illegal) a system for detecting the entry of an object.

[0061] The intrusion detection system 200 includes at least an information processing device 210, a photographing device 220, an input device 230, and a display device 240. The information processing device 210, the photographing device 220, the input device 230, and the display device 240 may be included in the intrusion detection system 200 in plural. Further, the information processing device 210, the photographing device 220, the input device 230, and the display device 240 may be configured as a single device, either partially or entirely.

[0062] In addition to the information processing device 210, the photographing device 220, the input device 230, and the display device 240, the intrusion detection system 200 may include other configurations. For example, the intrusion detection system 200 may include a device or equipment (such as a speaker, a siren, a warning light, etc.) for notifying the detection of intrusion.

[0063] The information processing device 210 detects a person using video. In addition, the information processing device 210 supports settings executed by a user (operator) for detecting a person. The information processing device 210 is, for example, a computer device such as a personal computer. The information processing device 210 is communicably connected to the photographing device 220, the input device 230, and the display device 240. Communication by the information processing device 210 may be either wired or wireless, and may be performed indirectly via another device.

[0064] The imaging device 220 captures images. The imaging device 220 is, for example, a surveillance camera installed at a certain location and continuously capturing a specific area. The imaging device 220 captures the area to be monitored and generates video data representing the video of the area. The imaging device 220 supplies this video data to the information processing device 210.

[0065] The input device 230 receives user operations. The input device 230 is, for example, a mouse or a keyboard. Also, the input device 230 may be a touch screen display integrated with the display device 240. The input device 230 supplies input data representing the user operation to the information processing device 210.

[0066] The display device 240 displays images. The display device 240 is, for example, a liquid crystal display. The display device 240 displays an image corresponding to the image data supplied from the information processing device 210. The display device 240 may, for example, display the video captured by the imaging device 220. Alternatively, the display device 240 may display a screen (hereinafter also referred to as a "setting screen") for the user to execute various settings related to the monitoring. Note that the intrusion detection system 200 may be configured to include a display device that displays the video captured by the imaging device 220 and another display device that displays the setting screen.

[0067] FIG. 13 is a block diagram showing the hardware configuration of the information processing device 210. The information processing device 210 includes a control unit 211, a storage unit 212, and an interface unit 213. The information processing device 210 corresponds to an example of the setting support device 100 described in the fifth embodiment. More specifically, the information processing device 210 can realize functions corresponding to the setting support device 100 when the control unit 211 executes a predetermined program.

[0068] The control unit 211 includes a processor (arithmetic processing unit) such as a CPU (Central Processing Unit) and a main memory (main storage device). The control unit 211 may be configured to include a plurality of processors, for example, in addition to a CPU, it may have a GPU (Graphics Processing Unit) for video processing. The control unit 211 realizes several functions related to the detection of a person by executing a program.

[0069] The storage unit 212 stores data used by the control unit 211. For example, the storage unit 212 may store a program executed by the control unit 211. The storage unit 212 includes a storage device such as a hard disk drive. Further, the storage unit 212 may include a reader / writer for a removable storage medium (such as a memory card) for the information processing device 210. The transfer of data in the information processing device 210 may be performed via this removable storage medium.

[0070] The interface unit 213 exchanges data with the imaging device 220, the input device 230, and the display device 240. The interface unit 213 can transmit and receive data according to a predetermined standard such as USB (Universal Serial Bus), HDMI (High-Definition Multimedia Interface) (registered trademark). The interface unit 213 may include an interface for connecting to a network such as the Internet.

[0071] The configuration of the intrusion detection system 200 is as described above. Based on this configuration, the intrusion detection system 200 detects a person based on the video captured by the imaging device 220. The information processing device 210 executes the following processes as processes related to the detection of a person.

[0072] FIG. 14 is a flowchart showing an outline of the processing executed by the information processing apparatus 210. The processing executed by the information processing apparatus 210 is roughly classified into setting processing (step S21), detection processing (step S22), and notification processing (step S23). Note that the detection processing does not necessarily have to be executed following the setting processing. Since the setting processing only needs to be executed at least once in advance, it is not a necessary process every time the detection processing is executed.

[0073] The setting processing is a process of setting a warning line and an auxiliary warning area. The warning line in the present embodiment is a straight line set by a user operation. Also, the auxiliary warning area in the present embodiment is an area set based on the warning line and corresponds to an example of the set area in the fifth embodiment. The setting processing in the present embodiment includes a process of assisting the user in setting the auxiliary warning area.

[0074] The detection processing is a process for detecting a person's entry into the auxiliary warning area. The detection processing may further include a process for detecting a person's passage through the warning line. Also, the detection processing may include a process for detecting a person's stay in the auxiliary warning area, that is, a process for detecting that a person continues to stay in the auxiliary warning area for a predetermined time or more. Hereinafter, a person detected by the detection processing is also referred to as a "person requiring attention".

[0075] The notification processing is a process for notifying the detection result by the detection processing. In the notification processing, for example, entry or stay of a person requiring attention into the auxiliary warning area or passage through the warning line is notified. The notification by the notification processing may be executed by the display device 240 or may be executed by a siren or a warning light.

[0076] FIG. 15 is a flowchart showing the details of the setting processing. In step S211, the control unit 211 causes the display device 240 to display a setting screen. More specifically, the control unit 211 supplies image data for displaying the setting screen to the display device 240. The control unit 211 supplies the image data to the display device 240 via the interface unit 213.

[0077] FIGS. 16A and 16B are diagrams illustrating the screen transition of the setting screen displayed in step S211. FIG. 16A is a diagram showing an example of the setting screen. The setting screen SC1 includes at least the video captured by the imaging device 220. The setting screen may also include a message for prompting the user to input, such as "Please enter the warning line." The user inputs the warning line using the input device 230. Note that the video illustrated in this embodiment includes descriptions that are emphasized, exaggerated, or simplified for ease of understanding.

[0078] In step S212, the control unit 211 acquires coordinates. More specifically, the control unit 211 acquires the coordinates by acquiring the input data from the input device 230 via the interface unit 213. In the example of FIG. 16B, the coordinates defining the warning line are the two end points of the line segment that is the warning line.

[0079] FIG. 16B is a diagram illustrating the warning line L21 specified for the video illustrated in FIG. 16A. In this example, the warning line L21 is a line segment connecting the coordinate P21 and the coordinate P22. For example, the user can set the warning line L21 by specifying the coordinates P21 and P22 using the input device 230.

[0080] In step S213, the control unit 211 calculates the coordinates of the positions at a predetermined distance (for example, 100 m) from the warning line. In other words, the control unit 211 calculates the coordinates of the positions where the distance from the warning line in the actual space is constant. The control unit 211 calculates the coordinates, for example, by the following formula (1).

[0081] R dist =f(P a ,P b ) …(1) In formula (1), f(P a ,P b ) represents the coordinate P a on the video and the coordinate P bA function that returns the actual distance (i.e., the actual distance in three-dimensional space) from. Also, R dist represents a constant corresponding to a predetermined distance. Note that the function f(P a ,P b ) can be defined in advance by calibration using the video captured by the imaging device 220. The function f(P a ,P b ) is a function that converts the coordinates P a , P b in the screen coordinate system to two coordinates in the world coordinate system and calculates the distance between the two coordinates, and can be calculated by well-known techniques.

[0082] For example, when obtaining the coordinates whose actual distance from the coordinate P21 is 100 m, the control unit 211 substitutes the coordinate P21 into P a in the formula (1) and calculates P dist that satisfies R b = 100. Note that there are multiple P dist that satisfy R b (i.e., the coordinates whose actual distance from the coordinate P21 is 100 m). The control unit 211 executes such calculations for all the coordinates on the video included in the warning line L21. For example, the control unit 211 calculates the coordinates as follows.

[0083] FIG. 17A is a diagram illustrating a curve C1 that is a set of coordinates having an equal actual distance from the coordinate P21. In this example, the curve C1 is a closed curve approximated by a circle centered on the coordinate P21, but is not exactly a perfect circle. The curve C1 has a smaller apparent distance from the coordinate P21 as the coordinates are farther from the imaging device 220.

[0084] 17B is a diagram illustrating curve C2, which is a set of coordinates that are equidistant in real distance from coordinate P22, in addition to curve C1. Curve C2 is a circular figure similar to curve C1, but its apparent size is smaller than curve C1. This is because coordinate P22 is farther away from image capture device 220 than coordinate P21. Note that control unit 211 calculates similar curves not only for coordinates P21 and P22, but also for all coordinates included in security line L21.

[0085] FIG. 17C is a diagram illustrating an example of an area A1 that is the basis for determining the auxiliary surveillance area. b If we set the coordinates on the cordon L21, then R dist ≧f(P a ,P b ) a The boundary line of area A1 is a set of coordinates that are equidistant in actual distance from the warning line L21.

[0086] After the coordinates are calculated in step S213, the control unit 211 executes the process of step S214. In step S214, the control unit 211 determines the auxiliary security area based on the coordinates calculated in step S213. For example, the control unit 211 can determine the auxiliary security area by any of the following methods.

[0087] The control unit 211 may directly use the area A1 in the example of Fig. 17C as the auxiliary security area. This method requires the least amount of calculations compared to other methods described later.

[0088] Further, the control unit 211 may determine the auxiliary warning area based on the direction (orientation) in which a person crosses the warning line. This method can also be said to be a method of determining the auxiliary warning area based on the moving direction of the person. In some embodiments, the moving direction of the person is predetermined with respect to the warning line. The moving direction of the person may be set by the user via the setting screen. Alternatively, the moving direction of the person may be determined based on the actual movement of the person detected from the video. The moving direction of the person may be patterned into several representative directions (e.g., two directions).

[0089] FIGS. 18A and 18B are diagrams illustrating auxiliary warning areas determined based on the moving direction of a person. The auxiliary warning areas A2 and A3 are both determined based on the area A1 in FIG. 17C. The auxiliary warning area A2 is the auxiliary warning area when the moving direction of the person is in the direction of arrow D1. On the other hand, the auxiliary warning area A3 is the auxiliary warning area when the moving direction of the person is in the direction of arrow D2.

[0090] In this case, the control unit 211 sets, as the auxiliary warning area, the remaining area of the area A1 excluding the area that is in front of the moving direction of the person and is ahead of the warning line L21 as viewed from the front side of the moving direction of the person. More specifically, the control unit 211 identifies the intersection of the straight line including the warning line L21 and the boundary line of the area A1, and sets, as the auxiliary warning area based on the moving direction of the person, any of the areas of the area A1 surrounded by the straight line.

[0091] In this way, the control unit 211 may determine an auxiliary warning area according to the moving direction of the person. For example, when a warning line is set at a location where the moving direction is restricted to one direction, the control unit 211 may determine an auxiliary warning area as shown in FIGS. 18A and 18B. The auxiliary warning area determined in this way can reduce false detection of intrusion (i.e., unintended detection) by excluding the unnecessary areas for detection in the area A1. By doing so, the user can use different and more appropriate auxiliary warning areas for intrusion detection according to the moving direction of the person.

[0092] Further, the control unit 211 may determine the auxiliary warning area based on the user's operation. For example, the control unit 211 may determine the auxiliary warning area based on the coordinates acquired in step S212, that is, the coordinates designated by the user as the endpoints of the warning line. Alternatively, the control unit 211 may determine the auxiliary warning area based on another operation (such as the moving direction of a person, coordinates, etc.) serving as the determination criterion for the auxiliary warning area.

[0093] FIG. 19 is a diagram showing another example of the auxiliary warning area. The auxiliary warning area A4 is determined based on the area A1 in FIG. 17C. In this example, the control unit 211 identifies the intersection point of the perpendicular line to the warning line L21 that intersects the endpoints of the warning line L21 and the boundary line of the area A1, and sets the area surrounded by this boundary line, the perpendicular line, and the warning line L21 as the auxiliary warning area. Similar to the examples in FIGS. 18A and 18B, the auxiliary warning area determined in this way can also reduce false detection of intrusion.

[0094] Further, the control unit 211 may determine the auxiliary warning area using features extracted from the video captured by the imaging device 220. The features referred to here are, for example, edges or HOG (Histograms of Oriented Gradients) feature amounts. The control unit 211 can extract such features from the video captured by the imaging device 220 and determine the auxiliary warning area based on the extracted features.

[0095] FIG. 20 is a diagram showing yet another example of the auxiliary warning area. The auxiliary warning area A5 is determined based on the area A1 in FIG. 17C. In this example, it is assumed that the control unit 211 has detected edges E1 and E2 in the vicinity of the warning line L21. The edges E1 and E2 are, for example, groups of pixels where the change in brightness in a specific direction in the video is greater than a predetermined threshold. In this case, the control unit 211 sets the area surrounded by the warning line L21, the edges E1 and E2, and the boundary line of the area A1 as the auxiliary warning area. Similar to the examples in FIGS. 18A, 18B, and 19, the auxiliary warning area determined in this way can also reduce false detection of intrusion.

[0096] Note that the control unit 211 may be configured to select any one from among a plurality of candidate auxiliary warning areas. In this case, the control unit 211 may cause the display device 240 to display the plurality of candidate auxiliary warning areas together with the video captured by the imaging device 220, and select any one according to the user's operation. For example, the user checks the candidate auxiliary warning areas displayed superimposed on the video and selects any one desired. At this time, the control unit 211 may cause the display device 240 to display a plurality of candidates with different R dist and have the user select them.

[0097] Once the auxiliary warning area is determined, the control unit 211 executes the process of step S215. In step S215, the control unit 211 records the setting information in the storage unit 212. The setting information includes information indicating the warning line and information indicating the auxiliary warning area. The setting information stored in the storage unit 212 is used in the detection process. The setting information is, for example, the coordinates indicating the boundary between the warning line and the auxiliary warning area.

[0098] FIG. 21 is a flowchart showing details of the detection process (steps S221 to S224) and the notification process (steps S231 to S232). The control unit 211 starts executing a series of processes shown in FIG. 21 at the timing of starting video monitoring. The start timing of the process by the control unit 211 is, for example, the timing when the imaging device 220 starts imaging or the timing instructed by the user. The control unit 211 executes the following process for each frame of the video. For the sake of convenience of explanation, it is assumed hereinafter that the number of persons detected in each frame is one or less.

[0099] In step S221, the control unit 211 determines whether a person is recognized from the video. The control unit 211 can recognize a person by a well-known object recognition technology. The recognition by the control unit 211 may be either general object recognition or specific object recognition. That is, the control unit 211 may recognize an object having characteristics similar to a person, or may recognize a person having specific characteristics recorded in a database (so-called blacklist) in advance. If no person is recognized from the video (S221: NO), the control unit 211 ends the process without executing the notification process.

[0100] If a person is recognized from the video (S221: YES), the control unit 211 further executes the determination in step S222. In step S222, the control unit 211 determines whether the person recognized in step S221 has entered the auxiliary warning area. At this time, the control unit 211 specifies the coordinates of the auxiliary warning area based on the setting information recorded in the setting process. The control unit 211 may determine that the person has entered the area when at least a part of the person recognized in step S221 is included in the auxiliary warning area, or may determine that the person has entered the area when the whole of the person is included in the area. If the person recognized in step S221 has not entered the auxiliary warning area (S222: NO), the control unit 211 ends the process without executing the notification process.

[0101] If the person recognized in step S221 has entered the auxiliary warning area (S222: YES), the control unit 211 further executes the measurement process in step S223. The measurement process is a process of measuring the length of time (hereinafter also referred to as "detection time") during which a person is detected in the auxiliary warning area. In step S223, when the person recognized in step S221 was not detected in the auxiliary warning area in the previous frame, the control unit 211 starts measuring the detection time. On the other hand, when the person recognized in step S221 was also detected in the auxiliary warning area in the previous frame, the control unit 211 adds the detection time that has already been measured by one frame. Note that when the person is not detected in the frame next to the frame in which the person was detected in the auxiliary warning area, the control unit 211 resets the detection time.

[0102] In step S224, the control unit 211 determines whether the person recognized in step S221 has passed the warning line. When the person recognized in step S221 has passed the warning line (S224: YES), the control unit 211 executes the first notification process (step S231).

[0103] When the person recognized in step S221 has not passed the warning line (S224: NO), the control unit 211 further executes the determination in step S225. In step S225, the control unit 211 determines whether the detection time measured by the measurement process is equal to or greater than a predetermined threshold value. When the detection time is less than the predetermined threshold value (S225: NO), the control unit 211 ends the process without executing the notification process. On the other hand, when the detection time is equal to or greater than the predetermined threshold value (S225: YES), the control unit 211 executes the second notification process (step S232).

[0104] The first notification process is a process for displaying, on the display device 240, a message such as "A person requiring attention has passed through the warning line." On the other hand, the second notification process is a process for displaying, on the display device 240, a message such as "A person requiring attention has entered the auxiliary warning area." In the second notification process, the control unit 211 may also notify the measured detection time. Note that the first notification process and the second notification process may be the same process.

[0105] As described above, according to the intrusion detection system 200 of the present embodiment, it is possible to execute from the setting of the warning line and the auxiliary warning area to the detection and notification of a person. When setting the warning line and the auxiliary warning area, the information processing device 210 can facilitate the setting of the auxiliary warning area (i.e., the set area) by the user, similarly to the setting support device 100 of the fifth embodiment.

[0106] Generally, a video taken of a three-dimensional space includes positions at different distances (i.e., depths) from the imaging device 220. As a result, the video taken by the imaging device 220 gives a sense of perspective to the viewer (i.e., the user). Therefore, when an object is included in such a video, the appearance of the object in the video changes depending on the position of the object (in other words, the distance from the imaging device 220).

[0107] Incidentally, the user may want to set the auxiliary warning area to a range equidistant from the warning line. For example, the auxiliary warning area is often set as "a range of 100 m from the warning line." In particular, when an object can enter from any position on the boundary of the auxiliary warning area, it can be said that such a range setting at an equal distance is reasonable.

[0108] However, as described above, the video has depth. Therefore, the apparent distance in the video and the actual distance (real distance) in the three-dimensional space do not necessarily match. Thus, it is generally difficult for the user to accurately input a line such as the boundary of the auxiliary warning area manually.

[0109] On the other hand, the warning line is set at a place where people enter and exit, such as the entrance of a facility (building, park, etc.) to be monitored. Such a place usually has an appearance distinguishable from other places. For example, at the entrance of a facility, there may be a gate or no object (fence, wall, etc.) that obstructs the passage of people. Therefore, it can be said that the work of the user setting the warning line manually is relatively easy compared to the work of manually setting an area such as an auxiliary warning area.

[0110] In this embodiment, the user can set an auxiliary warning area that is relatively difficult to set manually only by designating the warning line that is relatively easy to set manually in this way. Since the auxiliary warning area determined by the intrusion detection system 200 has an equal actual distance from the warning line, the actual distance from the warning line will not become shorter against the user's will. According to such an auxiliary warning area, it is possible to appropriately determine the entry into and stay in the auxiliary warning area regardless of the position from which a person enters.

[0111] Also, in this embodiment, the user can easily deform (edit) the auxiliary warning area into a more preferable shape as needed. Thereby, the intrusion detection system 200 can suppress detections against the user's will. For example, the intrusion detection system 200 can reduce the possibility of detecting a person who does not need to be detected originally.

[0112] (Modification of the Sixth Embodiment) The following modifications can be applied to the sixth embodiment.

[0113] The warning line does not have to be a straight line. For example, the warning line may be a broken line, a curved line, or a combination of a straight line and a curved line. The coordinates acquired by the information processing apparatus 210 via the input apparatus 230 are not limited to the examples in the present embodiment, and may be the same as the coordinates acquired by the acquisition unit 110 in the fifth embodiment. The information processing apparatus 210 sets a warning line based on the coordinates of the broken line or the curved line acquired via the input apparatus 230.

[0114] FIG. 22 is a diagram illustrating an auxiliary warning area when the warning line is a curved line. In this example, the curved line C3 represents a set of coordinates having an equal actual distance from the warning line L31. The control unit 211 calculates the tangents T1 and T2 at the end points P31 and P32 of the warning line L31, and sets, as an auxiliary warning area, an area A6 or A7 surrounded by the warning line L31, the tangents T1 and T2, and the curved line C3 among the areas surrounded by the curved line C3. The tangents T1 and T2 mentioned here may be rephrased as straight lines having the right differential coefficient or the left differential coefficient at the end points P31 and P32 as the slope.

[0115] Also, the setting process may be executed by a device different from the detection process and the notification process. That is, the intrusion detection system 200 may include an information processing apparatus that executes the setting process and another information processing apparatus that executes the detection process and the notification process. However, the configuration of any information processing apparatus may be the same as that of the information processing apparatus 210 in FIG. 13.

[0116] The information processing apparatus 210 may detect a plurality of types of objects. For example, the information processing apparatus 210 may simultaneously detect a human and a vehicle. However, the average moving speed differs between a human and a vehicle. Therefore, when detecting a plurality of types of objects, the information processing apparatus 210 varies R in the formula (1) according to the type of each object. dist For example, the information processing apparatus 210 may store a table associating the type of an object with R dist and determine an auxiliary warning area according to the type of the object in the storage unit 212.

[0117] Note that R distmay be specified by the user. Alternatively, the user may specify the moving speed of the object and the desired time instead of R dist R can be calculated by multiplying the moving speed and the time. In this case, the control unit 211 dist by multiplying the moving speed and the time.

[0118] The intrusion detection system 200 does not need to detect an object from the video in real time. That is, the video here may be pre-recorded and stored in a storage device or the like. Further, the information processing device 210 may be located at a remote location separated from other devices. For example, the information processing device 210 may be realized using so-called cloud computing technology.

[0119] The present invention is not limited to the above-described embodiments, and various modifications are possible within the scope of the invention described in the claims, and it goes without saying that those are also included in the scope of the present invention.

[0120] (Supplementary Note) Some or all of the embodiments of the present invention may be described as follows in the supplementary note, but are not limited thereto. (Supplementary Note 1) Detection means for detecting the intrusion position of an object that has intruded into a specific area on the video into the specific area, Control means for associating the position on the video with a predetermined time and when the object stays within the specific area on the video for a time equal to or longer than the predetermined time associated with the position that matches the detected intrusion position, a warning is issued Intrusion detection device. (Supplementary Note 2) The intrusion detection device according to Supplementary Note 1, further comprising input means for receiving an input of the intrusion position and an input of a predetermined time, wherein the control means associates the intrusion position with the predetermined time based on the received input of the intrusion position and the input of the predetermined time. (Supplementary Note 3) ​Further comprising input means for receiving an input of the intrusion position, The control means sets the predetermined time based on the received input of the intrusion position. The intrusion detection device according to Supplementary Note 1. (Supplementary Note 4) Further comprising input means for receiving an input of a predetermined time, The control means sets the specific area based on the received input of the predetermined time. The intrusion detection device according to Supplementary Note 1. (Supplementary Note 5) Detect the intrusion position of an object that has intruded into a specific area on the video into the specific area, Associate the intrusion position with a predetermined time, Warn when the object has stayed within the specific area for the predetermined time or more on the video Intrusion detection method. (Supplementary Note 6) A computer, Detection means for detecting the intrusion position of an object that has intruded into a specific area on the video into the specific area, Control means for associating the intrusion position with a predetermined time, Means for warning when the detection means determines that the object has stayed within the specific area for the predetermined time or more on the video A computer-readable program recording medium recording a program for causing the computer to function as such. (Supplementary Note 7) Acquisition means for acquiring coordinates specified by a user for a video obtained by photographing a three-dimensional space, Calculation means for calculating coordinates in the video at a position at a predetermined distance from the position in the three-dimensional space corresponding to the acquired coordinates, Determination means for determining an area set for the specified line based on the calculated coordinates A setting support device comprising. (Supplementary Note 8) The determination means, Determines the area based on the direction in which the object crosses the position in the three-dimensional space corresponding to the acquired coordinates. The setting support device described in Supplementary Note 7. (Supplementary Note 9) The determination means determines the different regions according to the direction The setting support device described in Supplementary Note 8. (Supplementary Note 10) The determination means determines the region using the acquired coordinates The setting support device described in any one of Supplementary Notes 7 to 9. (Supplementary Note 11) The determination means determines the region using the features extracted from the video The setting support device described in any one of Supplementary Notes 7 to 10. (Supplementary Note 12) The determination means further includes a selection means for selecting any one from a plurality of candidates of the region The setting support device described in any one of Supplementary Notes 7 to 11. (Supplementary Note 13) further includes a display means for displaying the plurality of candidates together with the video, The selection means selects any one of the plurality of candidates displayed by the display means according to a user's operation The setting support device described in Supplementary Note 12. (Supplementary Note 14) further includes a detection means for detecting entry of an object in the three-dimensional space into the determined region The setting support device described in any one of Supplementary Notes 7 to 13. (Supplementary Note 15) acquires coordinates specified by a user for a video obtained by photographing a three-dimensional space, calculates coordinates in the video at a position at a predetermined distance from the position in the three-dimensional space corresponding to the acquired coordinates, determines a region set for the specified line based on the calculated coordinates Setting support method. (Supplementary Note 16) A computer, a process of acquiring coordinates specified by a user for an image obtained by photographing a three-dimensional space, a process of calculating coordinates in the image at a position at a predetermined distance from the position in the three-dimensional space corresponding to the acquired coordinates, a process of determining a region set for the specified line based on the calculated coordinates A computer-readable program recording medium recording a program for causing the above to be executed.

[0121] This application claims priority based on Japanese Patent Application No. 2015-245497 filed on December 16, 2015, and incorporates the entire disclosure thereof herein.

Explanation of Reference Numerals

[0122] 1 Intrusion detection device 2 Detection means 3 Control means 4, 5, 6 Input means

Claims

1. The function of receiving images from the camera, A function of displaying the image on a touch screen display of an information processing device; a function of accepting an operation to set an area including at least a part of an area inside a line connecting a position in three-dimensional space that is a predetermined distance from a position of a line designated by a user by dragging the image displayed on the touch screen display from a first position to a second position, as an area for detecting an intrusion of an object; a function of setting the area including at least the first position based on the operation; a function of displaying a message on the touch screen display in response to detecting an intrusion of the object into the area; An intrusion detection program that causes the information processing device to realize the above.

2. the region includes the second location, 2. The intrusion detection program according to claim 1.

3. The object includes a person.

3. The intrusion detection program according to claim 1.

4. The shape of the region is determined based on the first position and the second position.

4. The intrusion detection program according to claim 1.

5. The information processing device further realizes a function of displaying at least one of the first position and the second position on the touch screen display.

5. The intrusion detection program according to claim 1.

6. A video receiving means for receiving a video from a camera; an image display means for displaying the image on a touch screen display; an operation receiving means for receiving an operation to set an area including at least a part of an area inside a line connecting a position in three-dimensional space that is a predetermined distance from a position of a line designated by a user by dragging from a first position to a second position of the image displayed on the touch screen display as an area for detecting an intrusion of an object; a setting means for setting the area including at least the first position based on the operation; a message display means for displaying a message on the touch screen display in response to detection of an intrusion of the object into the area; An intrusion detection device comprising:

7. By the information processing device, Receives images from the camera, Displaying the image on a touch screen display of the information processing device; accepting an operation to set, as an area for detecting intrusion of an object, an area including at least a part of an area inside a line connecting a position in three-dimensional space that is a predetermined distance from a position of a line designated by a user by dragging from a first position to a second position of the image displayed on the touch screen display; setting the area including at least the first position based on the operation; displaying a message on the touch screen display in response to detecting an intrusion of the object into the area. Intrusion detection methods.

Images