Alert level determination device, alert level determination system, and alert level determination method

Abstract

To determine an alert level for a moving object seen in an image captured by an imaging device.SOLUTION: An alert level determination device includes: an image acquisition unit that acquires an image where at least a whole view in an alert level determination target range is captured; an absolute coordinate acquisition unit that acquires absolute coordinate information indicating a correspondence relation between pixels of the acquired image and absolute coordinates; an attribute information acquisition unit that acquires attribute information that is information in which attributes for each area are set on the basis of an absolute coordinate system; a determination unit that identifies a position of a moving object in absolute coordinates on the basis of the coordinates in the image where the moving object captured in the acquired image is located; and determine an alert level according to the attributes of the absolute coordinates; and an output unit that outputs information based on the determined alert level.SELECTED DRAWING: Figure 16

Description

[Technical Field]

[0001] The present invention relates to an alertness level determination device, an alertness level determination system, and an alertness level determination method. [Background technology]

[0002] BACKGROUND ART Conventionally, a monitoring system for detecting an intrusion of a suspicious person or the like into a detection area has been known (see, for example, Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2008-59179 Summary of the Invention [Problem to be solved by the invention]

[0004] However, even if the technology described in Patent Document 1 is used, it is not possible to determine the level of vigilance.

[0005] Therefore, the present invention aims to provide an alert level determination device, an alert level determination system, and an alert level determination method that are capable of determining the level of alertness for a moving object captured in an image captured by an imaging device. [Means for solving the problem]

[0006] (A1) One aspect of the present invention is a coordinate determination device that determines absolute coordinates for each pixel based on image information, and includes an image acquisition unit that acquires an image in which at least three identifiable markers are captured from the image information, an absolute coordinate acquisition unit that acquires absolute coordinates for each of the markers, and an absolute coordinate determination unit that determines the absolute coordinates of the acquired image by using the position coordinates of the markers captured in the acquired image as absolute coordinates acquired by the absolute coordinate acquisition unit.

[0007] (A2) Furthermore, one aspect of the present invention is a coordinate identification device described in (A1) above, wherein the absolute coordinate acquisition unit acquires absolute coordinates for each of the markers transmitted via wireless communication from a device corresponding to each of the markers.

[0008] (A3) In another aspect of the present invention, in the coordinate specifying device described in (A1) or (A2) above, the markers are each different in color, and thus can be individually identified from image information.

[0009] (A4) In another aspect of the present invention, in the coordinate specifying device according to any one of (A1) to (A3) above, the shapes are different from each other, so that each can be identified from the image information.

[0010] (A5) Furthermore, one aspect of the present invention is a coordinate determination device described in any one of (A1) to (A4) above, wherein the markers are provided with two-dimensional information that allows each to be identified, and each can be identified from image information by reading the two-dimensional information.

[0011] (A6) Also, one aspect of the present invention is a coordinate identification device described in any one of (A1) to (A5) above, wherein the marker has an illuminating element, and each of the markers can be identified from multiple consecutive image information by the blinking pattern of the illuminating element of the marker.

[0012] (A7) Furthermore, one aspect of the present invention is a coordinate determination device according to any one of (A1) to (A6) above, further comprising a segmentation unit that divides an area based on the image acquired by the image acquisition unit according to attributes of an object depicted in the image, and the absolute coordinate determination unit determines absolute coordinates of the image for specific areas divided by the segmentation unit, but does not determine absolute coordinates of the image for other areas.

[0013] (A8) Another aspect of the present invention is a coordinate identification system comprising at least three or more of the markers, three or more terminal devices that correspond to the at least three or more of the markers and transmit the absolute coordinates of the corresponding markers via wireless communication, an imaging device that captures an image in which the at least three or more markers appear, and a coordinate identification device according to any one of (A1) to (A7) above that identifies the absolute coordinates of the image captured by the imaging device based on the image captured by the imaging device and the absolute coordinates transmitted by the terminal devices.

[0014] (A9) Also, one aspect of the present invention is that in the coordinate identification system described above in (A8), the terminal device is equipped with a location information acquisition unit that acquires location information and a location information transmission unit that transmits the acquired location information.

[0015] (A10) Another aspect of the present invention is a coordinate determination method for determining absolute coordinates for each pixel based on image information, the coordinate determination method including: an image acquisition step for acquiring an image in which at least three identifiable markers are captured from the image information; an absolute coordinate acquisition step for acquiring absolute coordinates for each of the markers; and an absolute coordinate determination step for determining the absolute coordinates of the acquired image by using the position coordinates of the markers captured in the acquired image as the absolute coordinates acquired by the absolute coordinate acquisition step.

[0016] (B1) One aspect of the present invention is an alert level determination device that includes an image acquisition unit that acquires an image of at least the range to be determined for determining the alert level; an absolute coordinate acquisition unit that acquires absolute coordinate information that indicates the correspondence between the pixels of the acquired image and absolute coordinates; an attribute information acquisition unit that acquires attribute information that is information in which attributes for each area are set based on an absolute coordinate system; a determination unit that identifies the position of a moving object in absolute coordinates based on the coordinates in the image where the moving object captured in the acquired image is located, and determines the alert level according to the attributes of the absolute coordinates; and an output unit that outputs information based on the determined alert level.

[0017] (B2) In addition, in one aspect of the present invention, the alert level determination device described in (B1) above determines the alert level based on a combination of the amount of movement and attributes of the moving object.

[0018] (B3) Also, one aspect of the present invention is that in the alertness determination device described in (B1) or (B2) above, the determination unit refers to information in which the image is divided into a grid based on absolute coordinates, and the number of grids in which the moving object exists during a specified period of time is taken as the amount of movement.

[0019] (B4) Also, one aspect of the present invention is that in the alert level determination device described in any of (B1) to (B3) above, the attribute is an alert level for each area, which is determined in advance before determining the alert level.

[0020] (B5) Another aspect of the present invention is that, in the alert level determination device described in any of (B1) to (B4) above, the determination unit determines the alert level based on multiple attributes set in the area into which the moving object can enter, among areas into which the moving object can enter and areas into which the moving object cannot enter.

[0021] (B6) Also, one aspect of the present invention is an alert level determination device described in any of (B1) to (B5) above, wherein the output unit issues an alarm when the alert level reaches or exceeds a predetermined value.

[0022] (B7) Furthermore, one aspect of the present invention is an alertness level determination device described in any of (B1) to (B6) above, further comprising a segmentation unit that divides areas based on the image acquired by the image acquisition unit according to the attributes of the object depicted in the image, and the determination unit determines the alertness level for specific areas divided by the segmentation unit, but does not determine the alertness level for other areas.

[0023] (B8) Another aspect of the present invention is an alert level determination system comprising an imaging device that captures an image in which at least an area to be determined for determining the alert level is imaged, and in which at least three markers that can each be identified from image information are captured; an absolute coordinate identification device that acquires absolute coordinates for each of the markers and identifies the absolute coordinates of the acquired image by using the position coordinates of the markers captured in the acquired image as absolute coordinates acquired by the absolute coordinate acquisition unit; and an alert level determination device described in any of (B1) to (B3) above that determines the alert level based on the acquired image and the absolute coordinates identified by the absolute coordinate identification device, in accordance with the attributes of the absolute coordinates at which a moving object is located in the acquired image.

[0024] (B9) Another aspect of the present invention is an alert level determination method having an image acquisition step of acquiring an image in which at least the range to be determined as the alert level is captured; an absolute coordinate acquisition step of acquiring absolute coordinate information indicating the correspondence between the pixels of the acquired image and absolute coordinates; an attribute information acquisition step of acquiring attribute information which is information in which attributes for each area are set based on an absolute coordinate system; a determination step of identifying the position of a moving object in absolute coordinates based on the coordinates in the image where the moving object captured in the acquired image is located, and determining the alert level according to the attributes of the absolute coordinates; and an output step of outputting information based on the determined alert level. [Effects of the Invention]

[0025] According to the present invention, it is possible to provide an alert level determination device, an alert level determination system, and an alert level determination method that are capable of determining the level of alertness for a moving object captured in an image captured by an imaging device. [Brief explanation of the drawings]

[0026] [Figure 1] FIG. 1 is a diagram illustrating an overview of a system according to an embodiment. [Figure 2] FIG. 2 is a functional configuration diagram showing an example of the functional configuration of the system according to the present embodiment. [Figure 3]FIG. 2 is a functional configuration diagram showing an example of the functional configuration of the absolute coordinate specifying device according to the present embodiment. [Figure 4] 1 is a diagram showing an example of an image for which coordinates are to be specified by an absolute coordinate specifying device according to the present embodiment; [Figure 5] 10 is a diagram showing an example of a correspondence relationship between marker identification information and absolute coordinates used by the absolute coordinate specifying device according to the present embodiment. FIG. [Figure 6] 1 is a schematic diagram showing an example of the configuration of a marker used by an absolute coordinate identifying device according to the present embodiment. [Figure 7] FIG. 2 is a functional configuration diagram showing an example of the functional configuration of a terminal device used by the absolute coordinate specifying device according to the present embodiment. [Figure 8] 10 is a schematic diagram showing a first modified example of the configuration of a marker used by the absolute coordinate identifying device according to the present embodiment. FIG. [Figure 9] FIG. 10 is a schematic diagram showing a second modified example of the configuration of the marker used by the absolute coordinate identifying device according to the present embodiment. [Figure 10] FIG. 10 is a schematic diagram showing a third modified example of the configuration of the marker used by the absolute coordinate identifying device according to the present embodiment. [Figure 11] FIG. 10 is a schematic diagram showing a fourth modified example of the configuration of the marker used by the absolute coordinate identifying device according to the present embodiment. [Figure 12] FIG. 10 is a functional configuration diagram showing a modified example of the functional configuration of the absolute coordinate specifying device according to the present embodiment. [Figure 13] 10A and 10B are diagrams for explaining an example of image processing by a segmentation unit included in the absolute coordinate specifying device according to the present embodiment. [Figure 14] FIG. 10 is an image diagram showing an example in which the absolute coordinate specifying device according to the present embodiment is used in a sports game. [Figure 15] 1 is a diagram for explaining an overview of an alertness level determination device according to an embodiment of the present invention; [Figure 16] 1 is a functional configuration diagram showing an example of a functional configuration of an alertness level determination device according to an embodiment of the present invention; [Figure 17] 10 is a diagram showing an example of a grid display of an image determined by the alertness level determination device according to the present embodiment. FIG. [Figure 18] 10 is a diagram showing an example of a case where an area determined by the alert level determination device according to the present embodiment is divided into areas according to attributes. FIG. [Figure 19] 10 is a diagram showing the correspondence relationship between area identification information, a range, and an alert level used by the alert level determination device according to the present embodiment. FIG. [Figure 20] FIG. 10 is a functional configuration diagram showing a modified example of the functional configuration of the alertness level determination device according to the present embodiment. [Figure 21] FIG. 10 is an image diagram showing an example of a case where the alertness level determination device according to the present embodiment is used in a sports match. [Figure 22] 1 is a block diagram showing an example of the internal configuration of an absolute coordinate specifying device or an alert level determination device according to the present embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0027] [Embodiment] Below, preferred embodiments of a coordinate identification device, coordinate identification system, coordinate identification method, alert level determination device, alert level determination device system, and alert level determination device method according to the present invention are presented and described in detail with reference to the accompanying drawings. Note that the present invention is not limited to these embodiments and includes various modifications or improvements. In other words, the components described below include those that can be easily imagined by a person skilled in the art and those that are substantially identical, and the components described below can be combined as appropriate. Furthermore, various omissions, substitutions, or modifications of the components can be made without departing from the spirit of the present invention. Furthermore, in the drawings below, the scale and number of each structure may differ from the scale and number of the actual structure in order to make each configuration easier to understand.

[0028] [System Overview] FIG. 1 is a diagram illustrating an overview of a system according to one embodiment. First, an overview of a system 1 according to this embodiment will be described with reference to the diagram. The system 1 includes an imaging device 73. The imaging device 73 captures an image of a predetermined target range AR. The imaging device 73 may capture a single still image, or may capture a moving image including multiple consecutive frame images. The imaging device 73 is preferably fixed to a structure, but is not limited to this example and may be movable.

[0029] A plurality of markers MK are placed within a target range AR, which is the range captured by the system 1. In the same figure, markers MK1, marker MK2, and marker MK3 are shown as the plurality of markers MK. The plurality of markers MK are placed at positions within the angle of view of the imaging device 73. The system 1 according to this embodiment uses at least three or more markers MK to identify the absolute coordinates of each pixel captured by the imaging device 73. Note that the greater the number of markers MK, the more accurately the absolute coordinates can be identified. Note that if there are too many markers MK, processing may take a long time. Therefore, the number of markers MK is preferably about four, for example.

[0030] In this embodiment, absolute coordinates are a coordinate system different from the coordinate system (relative coordinates) of the image captured by the imaging device 73. The coordinate system used to identify absolute coordinates may be, for example, a coordinate system specific to the location where the system 1 is used. The specific coordinate system is, for example, a coordinate system uniquely defined in the facility where the system 1 is used. Furthermore, in this embodiment, absolute coordinates may be a geographic coordinate system, a projected coordinate system, or a vertical coordinate system that can identify a point on the Earth. Examples of locations where the system 1 is used include the inside or premises of a factory facility, the premises of a park or a train station, and a stadium where a sporting event or the like is held.

[0031] In the illustrated example, the system 1 includes one imaging device 73 (i.e., the system 1 and the imaging device 73 have a one-to-one correspondence). However, the present embodiment is not limited to this example, and the system 1 may include multiple imaging devices 73 (i.e., the system 1 and the imaging device 73 may have a one-to-N correspondence). In this case, the system 1 performs processing based on images captured by the multiple imaging devices 73. It is preferable that three or more markers MK are captured within the angle of view of each imaging device 73. In this case, one marker MK may be shared by the multiple imaging devices 73.

[0032] After identifying the absolute coordinates, the system 1 further identifies the absolute coordinates of the position of a moving object within the target range AR based on the captured image. In the following description, a moving object may be a person, animal, vehicle, etc. that enters the angle of view. Also, a moving object may be a player playing a sport or a ball (for example, a ball in a soccer game or baseball game).

[0033] FIG. 2 is a functional configuration diagram showing an example of the functional configuration of a system according to this embodiment. An example of the functional configuration of system 1 will be described with reference to the diagram. System 1 includes a terminal device 71, an imaging device 73, an absolute coordinate identifying device 30, an absolute coordinate storage unit 75, and an alert level determination device 50. In the following description, a configuration including the terminal device 71, the imaging device 73, and the absolute coordinate identifying device 30 may be referred to as a coordinate identifying system 3. Furthermore, a configuration including the alert level determination device 50 in addition to the coordinate identifying system 3 may be referred to as an alert level determination system 5. The coordinate identifying system 3 and the alert level determination system 5 may exist independently of each other.

[0034] The terminal device 71 is a device that exists for each marker MK. The terminal device 71 has an information communication function and is capable of transmitting information via a predetermined communication network. The terminal device 71 also has, for example, a GPS (Global Positioning System) communication function and is capable of acquiring the absolute coordinates of its own location. The markers MK are each assigned in advance marker identification information MID that allows them to be distinguished from one another. The terminal device 71 outputs the marker identification information MID and the absolute coordinates AC to the absolute coordinate specifying device 30 in association with each other.

[0035] 1, the imaging device 73 captures an image of the target range AR at an angle of view that allows it to capture images of at least three markers MK. The imaging device 73 outputs the captured image IM to the absolute coordinate identifying device 30 and the alert level determination device 50.

[0036] The absolute coordinate identifying device 30 acquires information from the terminal device 71, in which marker identification information MID and absolute coordinates AC are associated with each other, and acquires an image IM from the imaging device 73. Based on the acquired information, the absolute coordinate identifying device 30 identifies the absolute coordinates of each pixel of the image IM. According to known techniques, if the pixels (or pixels) of the image IM can be associated with absolute coordinates for at least three points on a plane (ground), it is possible to associate absolute coordinates for all pixels in the image IM. This processing may be performed using an open-source library or the like based on known techniques. The points required for this processing are the points where the markers MK are placed. It is preferable that the three points required for this processing are not closely spaced, and that the surface formed by the three points has a wide range. It is also preferable that the three points required for this processing are not on the same straight line. As mentioned above, the number of markers MK is not limited to three, but may be four or more.

[0037] The absolute coordinate storage unit 75 stores correspondence information CI in which images IM are associated with absolute coordinates by the absolute coordinate identification device 30. If multiple imaging devices 73 exist in the system 1, the absolute coordinate storage unit 75 stores correspondence information CI for each imaging device 73. The absolute coordinate storage unit 75 provides the correspondence information CI in response to a request from the alert level determination device 50. If multiple imaging devices 73 exist in the system 1, the absolute coordinate storage unit 75 provides the correspondence information CI stored for each imaging device 73 in response to a request from the alert level determination device 50.

[0038] The alert level assessment device 50 acquires correspondence information CI from the absolute coordinate storage unit 75 and acquires an image IM from the imaging device 73. The alert level assessment device 50 detects an object present in the acquired image IM and identifies the absolute coordinates where the object is present. The alert level assessment device 50 then assesses the alert level based on the identified absolute coordinates. For example, when the alert level assessment device 50 is used for crime prevention purposes, the alert level may indicate the degree to which a detected object is suspicious or not. When the alert level assessment device 50 is used in a soccer match, the alert level may indicate the degree to which a detected object (e.g., a soccer ball) is in a situation that will affect the outcome of the soccer match (e.g., whether it is near the goal, etc.).

[0039] [Absolute coordinate identification device] The absolute coordinate specifying device 30 will be described with reference to FIGS.

[0040] FIG. 3 is a functional configuration diagram showing an example of the functional configuration of an absolute coordinate identifying device according to this embodiment. The absolute coordinate identifying device 30 includes an image acquisition unit 31, an absolute coordinate acquisition unit 32, and an absolute coordinate identifying unit 33. The absolute coordinate identifying device 30 includes these functional units, thereby identifying the absolute coordinates of each pixel based on image information. Each of these functional units is implemented using, for example, an electronic circuit. Each functional unit may also include internal storage means such as a semiconductor memory or a magnetic hard disk drive, as necessary. Each function may also be implemented by a computer having a central processing unit (CPU) and software. All or part of each functional unit may also be implemented using hardware such as an application-specific integrated circuit (ASIC), a programmable logic device (PLD), or a field-programmable gate array (FPGA). All or part of each functional unit may also be implemented by a combination of software and hardware.

[0041] The image acquisition unit 31 acquires an image IM from the imaging device 73. At least three markers MK are shown in the image IM. The three markers MK shown in the image IM are each identifiable from the image information.

[0042] 4 is a diagram showing an example of an image whose coordinates are to be specified by the absolute coordinate specifying device according to this embodiment. An example of an image IM will be described with reference to the diagram. The diagram shows an example in which the target range AR is within the premises of a factory or the like where buildings exist. Buildings, roads, hedges, etc. are shown in the diagram. Markers MK1 to MK4 are also shown as markers MK.

[0043] Here, the markers MK1 to MK4 can be distinguished from one another based on image information. For example, the markers MK may each have a different color. In this case, by specifying the position of the marker MK from the shape of the marker MK and identifying the color information of the marker MK, it becomes possible to distinguish and identify each marker MK from one another. Note that the method of identifying the marker MK is not limited to the example based on color information, and various methods may be used. Specific examples of the method of identifying the marker MK will be described later. Returning to FIG. 3, the functional configuration of the absolute coordinate identifying device 30 will be continued.

[0044] The absolute coordinate acquisition unit 32 acquires absolute coordinates for each marker MK. The absolute coordinate acquisition unit 32 acquires absolute coordinates for each marker MK, for example, from a terminal device 71 corresponding to each marker MK. That is, the absolute coordinate acquisition unit 32 can also acquire absolute coordinates for each marker MK transmitted via wireless communication from the terminal device 71 corresponding to each marker MK. The information transmitted from the terminal device 71 may be associated with marker identification information MID and absolute coordinates AC.

[0045] 5 is a diagram showing an example of the correspondence between marker identification information and absolute coordinates used by the absolute coordinate identifying device according to this embodiment. The diagram shows an example of information acquired by the absolute coordinate acquiring unit 32 from the terminal device 71. As shown in the diagram, the marker identification information MID and the absolute coordinates AC are associated with each other.

[0046] Specifically, the marker identification information "MK-01" is associated with absolute coordinates "35.67020, 139.75842." Furthermore, the marker identification information "MK-02" is associated with absolute coordinates "35.67006, 139.75850." Furthermore, the marker identification information "MK-03" is associated with absolute coordinates "35.67048, 139.75852." The absolute coordinate acquisition unit 32 acquires such information to acquire the absolute coordinates for each marker MK. Returning to FIG. 3, the description of the functional configuration of the absolute coordinate identifying device 30 will continue.

[0047] The absolute coordinate identification unit 33 acquires the image IM from the image acquisition unit 31, and acquires information in which the marker identification information MID and the absolute coordinates AC are associated with each other from the absolute coordinate acquisition unit 32. The absolute coordinate identification unit 33 identifies the absolute coordinates of each pixel of the acquired image IM based on the acquired information. Specifically, the absolute coordinate identification unit 33 identifies the position coordinates of the marker MK depicted in the acquired image IM as the absolute coordinates acquired by the absolute coordinate acquisition unit 32. The absolute coordinate identification unit 33 stores the identified absolute coordinates in the absolute coordinate storage unit 75.

[0048] More specifically, the absolute coordinate identification unit 33 includes an object detection unit 34, a marker detection unit 35, and a correspondence unit 36. By including these components, the absolute coordinate identification unit 33 identifies the absolute coordinates of each pixel of the acquired image IM.

[0049] The object detection unit 34 performs object detection using the image IM as input information. The object detection unit 34 may be configured using, for example, a known machine learning algorithm. The object detection unit 34 outputs the result of the object detection to the marker detection unit 35 as object detection information ODI. The object detection information ODI may include, for example, coordinate information of a processed bounding box of the detected object, a class likelihood, and the like.

[0050] The marker detection unit 35 acquires object detection information ODI from the object detection unit 34. Based on the acquired object detection information ODI, the marker detection unit 35 detects an object whose class is marker MK. The marker detection unit 35 also distinguishes and detects each of the multiple markers MK displayed in the image IM. After distinguishing and detecting the multiple markers MK, the marker detection unit 35 associates the identification information of the marker MK with the position where the marker MK exists (coordinate information within the image IM), and outputs this as marker information MKI to the association unit 36. Note that the object detection unit 34 and the marker detection unit 35 may be configured as an integrated unit.

[0051] The association unit 36 ​​acquires marker information MKI from the marker detection unit 35, and acquires marker identification information MID and absolute coordinates AC from the absolute coordinate acquisition unit 32. The association unit 36 ​​associates the acquired information. Specifically, the association unit 36 ​​first identifies the absolute coordinates of the position where the marker MK exists in the image IM. This process makes it possible to identify the absolute coordinates of at least three points in the image IM. Furthermore, the association unit 36 ​​identifies the absolute coordinates of all pixels in the image IM from the absolute coordinates of these three points.

[0052] 6 is a schematic diagram showing an example of the configuration of a marker used by the absolute coordinate identifying device according to this embodiment. An example of the configuration of the marker MK will be described with reference to the same figure. Note that the marker MK shown in the same figure is an example of a case where it is identified based on color information.

[0053] FIG. 6(A) is a diagram of the marker MK as seen from the front, i.e., as seen from the imaging device 73 side. In other words, the marker MK is placed within the target range AR so that it is oriented as shown when viewed from the imaging device 73. The marker MK includes an identification plate 81, a support 82, and a pedestal 83. The pedestal 83 abuts on the ground, and the support 82 supports the identification plate 81. The identification plate 81 is configured so that each marker MK can be identified from image information. In the example shown in the figure, the identification plates 81 are configured so that color information is different from each other, and each marker MK can be identified from an image IM captured by the imaging device 73. The absolute coordinate identifying device 30 may, for example, determine a point 84 where the marker MK abuts on the ground as the position where the marker MK exists.

[0054] 6(B) is a view of the marker MK as seen from the back, i.e., as seen from the side opposite the imaging device 73. As shown in the figure, a terminal device 71 is provided on the back of the marker MK. Note that the location of the terminal device 71 is not limited to this example, and it may be provided in any suitable location, such as on a base 83 or inside an identification plate 81 or a support 82.

[0055] 7 is a functional configuration diagram showing an example of the functional configuration of a terminal device used by the absolute coordinate identifying device according to this embodiment. An example of the functional configuration of the terminal device 71 will be described with reference to the same diagram. The terminal device 71 includes a position information acquisition unit 711, a terminal control unit 712, a terminal storage unit 713, and a position information transmission unit 714. By including these components, the terminal device 71 identifies the absolute coordinates of its own location, associates identification information that can identify itself with the absolute coordinates, and transmits the association information to the absolute coordinate identifying device 30.

[0056] The location information acquisition unit 711 acquires location information, specifically, absolute coordinates AC of the location where the device itself is located. The location information acquisition unit 711 may, for example, be equipped with a GPS communication unit (not shown) to receive radio waves received from an artificial satellite such as a GPS. The location information acquisition unit 711 acquires the absolute coordinates AC based on the received radio waves. The location information acquisition unit 711 outputs the acquired absolute coordinates AC to the terminal control unit 712.

[0057] The terminal control unit 712 acquires absolute coordinates AC from the position information acquisition unit 711, and acquires marker identification information MID from the terminal storage unit 713. Here, the terminal storage unit 713 stores the marker identification information MID, which is identification information assigned to each marker MK. The terminal control unit 712 associates the acquired absolute coordinates AC with the marker identification information MID. The terminal control unit 712 outputs the associated absolute coordinates AC and marker identification information MID to the position information transmission unit 714.

[0058] The position information transmitting unit 714 outputs information in which the absolute coordinate AC is associated with the marker identification information MID to the absolute coordinate identifying device 30 via a predetermined wireless communication network NW. The predetermined wireless communication network NW may be the Internet or the like.

[0059] Modified examples of the marker MK will be described below with reference to Figures 8 to 11. In the description with reference to these figures, the same components as those described with reference to Figure 6 will be denoted by the same reference numerals and the description thereof may be omitted.

[0060] FIG. 8 is a schematic diagram showing a first modified example of the configuration of a marker used by the absolute coordinate identifying device according to this embodiment. The first modified example is an example of a case where markers MK are identified based on the shape of the identification plates provided thereon. FIGS. 8(A), 8(B), and 8(C) have identification plates of different shapes. Specifically, the identification plate 81A-1 provided in FIG. 8(A) is round, the identification plate 81A-2 provided in FIG. 8(B) is triangular, and the identification plate 81A-3 provided in FIG. 8(C) is square. In this way, the multiple markers MK have different shapes of identification plates, so that the markers MK can be identified from each other in the image IM captured by the imaging device 73.

[0061] FIG. 9 is a schematic diagram showing a second modified example of the configuration of a marker used in the absolute coordinate identifying device according to this embodiment. The second modified example is an example in which two-dimensional codes (two-dimensional information) are attached to the identification plates of the markers MK, and the markers are identified by reading the two-dimensional codes. In FIGS. 9A, 9B, and 9C, different two-dimensional codes are attached. Specifically, the identification plate 81B-1 in FIG. 9A has a first two-dimensional code attached, the identification plate 81B-2 in FIG. 9B has a second two-dimensional code attached, and the identification plate 81B-3 in FIG. 9C has a third two-dimensional code attached. In this way, the two-dimensional codes attached to the identification plates of the multiple markers MK are different from one another, and therefore the markers MK can be identified from one another by reading the two-dimensional codes from the images IM captured by the imaging device 73.

[0062] FIG. 10 is a schematic diagram showing a third modified example of the configuration of a marker used in the absolute coordinate identifying device according to this embodiment. The third modified example is an example in which markers MK are identified by the blinking patterns of their light-emitting elements. That is, the third modified example is based on a plurality of consecutive frame images. As shown in FIGS. 10(A), 10(B), and 10(C), an identification plate 81C according to the third modified example has a light-emitting element. A specific example of the light-emitting element is a light-emitting diode (LED). The light-emitting element emits light in a unique blinking pattern corresponding to the identification information of the marker MK. Specifically, the identification plate 81C-1 in FIG. 10(A) blinks in a first blinking pattern, the identification plate 81C-2 in FIG. 10(B) blinks in a second blinking pattern, and the identification plate 81C-3 in FIG. 10(C) blinks in a third blinking pattern. In this way, the multiple markers MK blink in different blinking patterns, and by analyzing the blinking patterns from the multiple frame images IM captured by the imaging device 73, the markers MK can be distinguished from one another.

[0063] FIG. 11 is a schematic diagram showing a fourth modified example of the configuration of a marker used by the absolute coordinate identifying device according to this embodiment. The fourth modified example shows an example in which a person plays the role of the marker MK. As shown in the figure, a person P playing the role of the marker MK has a terminal device 71A. At a first location, the person P assumes a posture identified as first identification information (for example, raising both hands), and transmits absolute coordinates AC at the first location and marker identification information MID identified as first identification information. Next, the person P moves to a second location, assumes a posture identified as second identification information (for example, raising only the right hand), and transmits absolute coordinates AC at the second location and marker identification information MID identified as second identification information. Furthermore, the person P moves to a third location, assumes a posture that is identified as third identification information at the third location (for example, raising only the left hand), and transmits absolute coordinates AC at the third location and marker identification information MID that is identified as third identification information. In this way, a person can also play the role of the marker MK. Note that this is not limited to the example in which one person moves around multiple locations and transmits absolute coordinates AC as described above, and three people P holding three different terminal devices 71A may play the role of multiple markers MK. In this case, the three people P may wear clothes of different colors or may use face recognition to identify the three people P from the image IM captured by the imaging device 73.

[0064] 12 is a functional configuration diagram showing a modified example of the functional configuration of the absolute coordinate identifying device according to this embodiment. With reference to the same figure, an example of the functional configuration of an absolute coordinate identifying device 30A, which is a modified example of the absolute coordinate identifying device 30, will be described. The absolute coordinate identifying device 30A differs from the absolute coordinate identifying device 30 in that it further includes a segmentation unit 37. In the description of the absolute coordinate identifying device 30A, components similar to those of the absolute coordinate identifying device 30 will be denoted by similar reference numerals and description thereof may be omitted.

[0065] The segmentation unit 37 acquires an image IM from the image acquisition unit 31. The segmentation unit 37 performs a segmentation process on the acquired image IM. A known machine learning algorithm or the like may be used for the segmentation process. The segmentation process divides areas in the image, and clarifies whether or not a marker MK is present in the area.

[0066] FIG. 13 is a diagram for explaining an example of image processing by a segmentation unit included in the absolute coordinate identifying device according to this embodiment. An example of information obtained as a result of performing the segmentation processing will be described with reference to the same figure. The illustrated example is an example in which the segmentation processing is performed on the image IM shown in FIG. 4. As a result of the segmentation processing, for example, a specific area SAR is identified. This area is flat and is a range in which a person can move. In the image IM, areas other than the specific area SAR are, for example, sky, buildings, hedges, etc., and are areas in which a person cannot exist. An area in which a person cannot exist is also an area in which a marker MK cannot exist.

[0067] 12, the segmentation unit 37 associates segmentation information SEG, which is information indicating the specific area SAR obtained as a result of the segmentation process, with the image IM and outputs the associated information to the absolute coordinate identification unit 33. The absolute coordinate identification unit 33 can identify the marker MK based on the specific area SAR, thereby reducing the processing load.

[0068] 14 is an image diagram showing an example of a case where the absolute coordinate identifying device according to this embodiment is used in a sports match. With reference to the same figure, an example of a case where the absolute coordinate identifying device 30 is applied to a soccer match will be described. In the same figure, imaging devices 73-1, 73-2, 73-3, and 73-4 are shown as imaging devices 73. Also, markers MK-1, marker MK-2, marker MK-3, marker MK-4, marker MK-5, and marker MK-6 are shown as markers MK.

[0069] Each imaging device 73 captures images at a field of view and an imaging angle that captures at least three markers MK. The field of view and imaging angle of each imaging device 73 may be variable over time. According to this embodiment, as shown in the figure, even when multiple cameras are used, the pixels of the imaging devices 73 can be associated with absolute coordinates. Therefore, if the position of a moving object (e.g., the position of the ball or a player) in the image IM can be identified, the absolute position of the point where the moving object exists can be identified. Therefore, according to this embodiment, imaging and display processing can be performed according to the position of the moving object.

[0070] [Alertness level determination device] Next, the alert level determination device 50 will be described with reference to FIGS.

[0071] 15 is a diagram for explaining an overview of the alert level determination device according to this embodiment. First, with reference to the same figure, an overview of the alert level determination process performed by the alert level determination device 50 will be explained.

[0072] FIG. 15(A) shows a map on a plane. This figure is a top view of the target area AR captured by the imaging device 73. As shown in the figure, the target area AR contains plants, passageways, buildings, restricted areas, etc. Here, when a moving object (e.g., a person) is detected in the image IM captured by the imaging device 73, it is difficult to determine whether the moving object is a suspicious person or a security guard, etc. However, the alert level differs between when a moving object is in a restricted area and when a moving object is in a passageway. According to this embodiment, the alert level is determined according to the attributes of the location where the moving object is located.

[0073] Figure 15(B) shows an image of an absolute coordinate system for the planar map shown in Figure 15(A). In the absolute coordinate system, it is possible to identify the position of a moving object using two-dimensional coordinates. The absolute coordinate system may be divided into a grid, such as a 1 m (meter) grid.

[0074] Figure 15(B) is a diagram in which the planar map shown in Figure 15(A) is superimposed on the absolute coordinate system shown in Figure 15(B). In this embodiment, an absolute coordinate system is defined on the map as shown in the figure. By defining it in this way, it is possible to determine the alert level of a location where a moving object is present.

[0075] FIG. 16 is a functional configuration diagram showing an example of the functional configuration of the alert level determination device according to this embodiment. The alert level determination device 50 includes an image acquisition unit 51, an absolute coordinate acquisition unit 52, an attribute information acquisition unit 53, a determination unit 54, and an output unit 55. The alert level determination device 50 is configured to include these functional units, thereby determining the alert level within the range of the image captured by the imaging device 73. Each of these functional units is implemented, for example, using electronic circuits. Each functional unit may also include internal storage means such as a semiconductor memory or a magnetic hard disk drive, as necessary. Each function may also be implemented by a computer having a CPU and software. All or part of each functional unit may also be implemented using hardware such as an ASIC, PLD, or FPGA. All or part of each functional unit may also be implemented by a combination of software and hardware.

[0076] The image acquisition unit 51 acquires an image IM in which at least the target range AR is captured from the imaging device 73. In this case, the target range AR can also be said to be a range that is a target for determining the alert level.

[0077] The absolute coordinate acquisition unit 52 acquires the correspondence information CI from the absolute coordinate storage unit 75. The correspondence information CI indicates the correspondence between the pixels of the acquired image IM and the absolute coordinates. The correspondence information CI can also be called absolute coordinate information.

[0078] The attribute information acquisition unit 53 acquires attribute information ATI from the attribute storage unit 77. The attribute information ATI is information in which attributes for each area are set based on an absolute coordinate system. It is preferable that the attribute information is set in advance according to the object captured in the object range AR, but a configuration may also be adopted in which the attribute information is automatically determined by a computer by performing object detection or the like on the image IM.

[0079] The determination unit 54 acquires an image IM from the image acquisition unit 51, acquires correspondence information CI from the absolute coordinate acquisition unit 52, and acquires attribute information ATI from the attribute information acquisition unit 53. The determination unit 54 first identifies the absolute coordinates of a moving object captured in the acquired image IM, and determines the alert level according to the attributes of the absolute coordinates where the moving object is located. Here, the moving object to be determined by the determination unit may be a person, a ball in a sport such as soccer, or the like. The determination unit 54 outputs the determination result to the output unit 55 as alert level information VLI.

[0080] The output unit 55 outputs information based on the alert level determined by the determination unit 54. The output unit 55 may output the information to, for example, an information processing device provided in a central control room or the like that monitors the facility.

[0081] The output unit 55 may issue an alarm instead of outputting the alert level (i.e., the level of alertness). The alarm is output when the alert level reaches or exceeds a predetermined value. Specific examples of the alarm may include a siren when an intruder is detected, or a notification to a specific device.

[0082] FIG. 17 is a diagram illustrating an example of a grid display of an image determined by the alert level determination device according to this embodiment. Here, the determination unit 54 may determine the alert level based on, for example, a combination of the amount of movement of the moving object and the attributes. The amount of movement of the moving object may be determined according to the number of pixels in the image IM. In FIG. 17, the image IM captured by the imaging device 73 is displayed as a grid. The grid is, for example, a 1-m grid. Here, the wider the range of movement of the moving object within a predetermined time, the higher the alert level. The determination unit 54 may determine the alert level according to the size of the range of movement of the moving object. In other words, the determination unit 54 may refer to information in which the image IM is divided into a grid based on absolute coordinates, and determine the amount of movement as the number of grids in which the moving object exists within a predetermined time.

[0083] For example, the grids marked with an X in the figure indicate the trajectory of the same moving object. The alert level may be determined by the number of grids marked with an X, depending on a preset threshold. The threshold used to determine the alert level may differ depending on the attributes of the area to which the grid belongs. For example, the threshold may be set high in passageways (the alert level does not increase until the object moves over a wide area), and low in restricted areas (the alert level increases even if the object moves over a small area).

[0084] FIG. 18 is a diagram showing an example of a case where the area determined by the alert level determination device according to this embodiment is divided by attribute. In this diagram, the diagram shown in FIG. 17 is divided by area. Specifically, in this diagram, each area is divided into range AR1, range AR2, range AR3, and range AR4. The meaning of each range will be explained with reference to FIG. 19.

[0085] 19 is a diagram showing the correspondence relationship between area identification information, ranges, and alert levels used by the alert level determination device according to this embodiment. As shown in the figure, ranges AR1 to AR4 are associated with area IDs and alert levels. The area ID of range AR4 is "ARID4," and the alert level is "4: No entry area." The area ID of range AR3 is "ARID3," and the alert level is "3: Plants, buildings." The area ID of range AR2 is "ARID2," and the alert level is "2: Flat areas other than passageways." The area ID of range AR1 is "ARID1," and the alert level is "1: Passageway." The alert level increases as the number increases, and decreases as the number decreases.

[0086] Returning to Fig. 18, the determination unit 54 determines the alert level according to a combination of the alert level set for each region and the amount of movement of the moving object. Here, the attributes acquired by the attribute information acquisition unit 53 can also be said to be the alert level for each region. It is preferable that the settings shown in Fig. 18 be determined in advance before determining the alert level.

[0087] The determination unit 54 may determine in advance the areas into which a moving object can enter and the areas into which a moving object cannot enter, and set area attributes only for the areas into which a moving object can enter. In other words, the determination unit 54 may determine the alert level based on a plurality of attributes set for the areas into which a moving object can enter.

[0088] According to this embodiment, it is also possible to determine the alert level based on the attributes of the appearance point of the moving object, the trajectory of the moving object's movement through the area, and the like. In this way, by determining the alert level based on the attributes of the area, it is possible to determine the alert level with high accuracy. FIG. 18 shows three arrows (1), (2), and (3). Below, an example of a method for determining the alert level when the moving object moves as indicated by any of the arrows (1), (2), or (3) will be described.

[0089] The arrow (1) in Figure 18 points from the edge of the plantings toward the path. A moving object (especially a person) emerging from the plantings is likely to be an intruder. Therefore, it is advisable to set the alert level high in such cases.

[0090] The arrow (2) in Figure 18 shows an object entering the screen from a restricted area and moving into a passageway. Moreover, the amount of movement is wide. In this way, when an object enters the screen from a restricted area, the alert level can be said to be high. Therefore, it is preferable to set the alert level high in such cases.

[0091] The arrow (3) in FIG. 18 indicates movement in the plants. In such cases, there is a possibility that the swaying of plants or the movement of a moving object outside the site may have been mistakenly detected. Therefore, in such cases, it is possible to remove the noise. The movement time and movement distance of the moving object may also be taken into consideration when determining whether or not it is noise.

[0092] 20 is a functional configuration diagram showing a modified example of the functional configuration of the alert level determination device according to this embodiment. With reference to the same figure, an example of the functional configuration of an alert level determination device 50A, which is a modified example of the alert level determination device 50, will be described. The alert level determination device 50A differs from the alert level determination device 50 in that it further includes a segmentation unit 57. In the description of the alert level determination device 50A, components similar to those of the alert level determination device 50 may be denoted by similar reference numerals and description thereof may be omitted.

[0093] The segmentation unit 57 acquires an image IM from the image acquisition unit 51. The segmentation unit 57 performs a segmentation process on the acquired image IM. A known machine learning algorithm or the like may be used for the segmentation process. The segmentation process divides areas in the image, making it possible to easily associate the areas with the attribute information ATI. For example, when the segmentation process is performed by the segmentation unit 57, the attribute information ATI does not need to include information indicating detailed areas. The attribute information ATI only needs to indicate information about the approximate area, and the attribute information ATI can clarify the outline of the area.

[0094] Furthermore, the segmentation unit 57 may use segmentation processing to identify whether or not an area is a target for determination by the determination unit 54. In this case, the determination unit 54 may be configured to determine the alert level for specific areas segmented by the segmentation unit 57, but not for other areas.

[0095] FIG. 21 is an image diagram showing an example of a case where the alert level assessment device according to this embodiment is used in a sports match. With reference to the same figure, an example of a case where the absolute coordinate identifying device 30 and the alert level assessment device 50 are applied to a soccer match will be described. In the same figure, as the imaging devices 73, imaging devices 73-1, 73-2, 73-3, and 73-4 are shown. Also, as the markers MK, markers MK-1, marker MK-2, marker MK-3, marker MK-4, marker MK-5, and marker MK-6 are shown. Also, a moving object MO is shown as an example of a moving object that is the target of alert level assessment. Specifically, the moving object MO is a soccer ball.

[0096] As explained with reference to FIG. 14, the absolute position is identified by the absolute coordinate identifying device 30. Furthermore, the alert level determination device 50 determines the area near the goal as area AR21 and the area other than the area near the goal as area AR22. The alert level determination device 50 determines the alert level to be high when the moving object MO is within area AR21, and low when the moving object MO is within area AR22. When the alert level is high, for example, the zoom magnification of the imaging device is set high to track and capture the moving object MO, and when the alert level is low, for example, the zoom magnification of the imaging device is set low to track and capture the moving object MO. In this case, the alert level can also be said to be the level of attention.

[0097] [Internal configuration] FIG. 22 is a block diagram showing an example of the internal configuration of an absolute coordinate identification device or a vigilance level determination device according to this embodiment. At least some of the functions of the absolute coordinate identification device 30 or the vigilance level determination device 50 can be implemented using a computer. As shown in the figure, the computer includes a central processing unit 901, a RAM 902, an input / output port 903, input / output devices 904 and 905, and a bus 906. The computer itself can be implemented using existing technology. The central processing unit 901 executes instructions contained in a program read from the RAM 902 or the like. In accordance with each instruction, the central processing unit 901 writes data to the RAM 902, reads data from the RAM 902, and performs arithmetic and logical operations. The RAM 902 stores data and programs. Each element in the RAM 902 has an address and can be accessed using the address. RAM stands for "random access memory." The input / output port 903 is a port through which the central processing unit 901 exchanges data with external input / output devices. The input / output devices 904 and 905 are input / output devices. The input / output devices 904 and 905 exchange data with the central processing unit 901 via the input / output port 903. The bus 906 is a common communication path used within the computer. For example, the central processing unit 901 reads and writes data from the RAM 902 via the bus 906. Also, for example, the central processing unit 901 accesses the input / output port via the bus 906. Furthermore, all or part of the functional units provided in the absolute coordinate identification device 30 or the alert level determination device 50 may be realized using hardware such as an ASIC, a PLD, or an FPGA. Furthermore, all or part of the functional units may be realized by a combination of software and hardware.

[0098] [Summary of the embodiment] According to the embodiment described above, the absolute coordinate identifying device 30 identifies the absolute coordinates of each pixel based on image information. The absolute coordinate identifying device 30 includes an image acquiring unit 31, which acquires an image IM in which at least three identifiable markers MK are captured from the image information; an absolute coordinate acquiring unit 32, which acquires absolute coordinates AC for each marker MK; and an absolute coordinate identifying unit 33, which identifies the absolute coordinates of the captured image IM by using the absolute coordinates AC acquired by the absolute coordinate acquiring unit 32 as the position coordinates of the marker MK captured in the captured image IM. Therefore, according to this embodiment, it is possible to easily associate the pixels of the image IM captured by the imaging device 73 with the absolute coordinates AC.

[0099] Furthermore, according to the embodiment described above, the alert level determination device 50 includes an image acquisition unit 51 for acquiring an image IM in which at least the target range AR for which the alert level is to be determined is captured, an absolute coordinate acquisition unit 52 for acquiring absolute coordinate information indicating the correspondence between the pixels of the acquired image IM and absolute coordinates, an attribute information acquisition unit 53 for acquiring attribute information ATI in which attributes for each region are set based on an absolute coordinate system, a determination unit 54 for determining the alert level according to the attributes of the absolute coordinates of a moving object captured in the acquired image IM, and an output unit 55 for outputting information based on the determined alert level. By employing such a configuration, the alert level can be accurately determined according to the location and movement path of the moving object, etc.

[0100] In addition, all or part of the functions of each unit of the absolute coordinate identification device 30 or the alert level determination device 50 in the above-mentioned embodiment may be realized by recording a program for realizing these functions on a computer-readable recording medium, and reading and executing the program recorded on this recording medium into a computer system. Note that the term "computer system" here includes hardware such as an OS and peripheral devices.

[0101] Furthermore, "computer-readable recording media" refers to portable media such as flexible disks, optical magnetic disks, ROMs, and CD-ROMs, as well as storage units such as hard disks built into computer systems. Furthermore, "computer-readable recording media" may also include devices that dynamically store programs for a short period of time, such as communication lines when transmitting programs over networks like the Internet or communication lines like telephone lines, or devices that store programs for a fixed period of time, such as volatile memory within computer systems that serve as servers or clients in such cases. Furthermore, the above-mentioned programs may be programs that realize some of the aforementioned functions, or may be programs that can realize the aforementioned functions in combination with programs already stored in the computer system.

[0102] Although an embodiment of the present invention has been described above, the present invention is not limited to the above embodiment, and various modifications can be made within the scope of the invention. [Explanation of symbols]

[0103] 1...system, 3...coordinate identification system, 5...alertness level determination system, 30...absolute coordinate identification device, 50...alertness level determination device, 71...terminal device, 73...imaging device, 75...absolute coordinate memory unit, 31...image acquisition unit, 32...absolute coordinate acquisition unit, 33...absolute coordinate identification unit, 34...object detection unit, 35...marker detection unit, 36...association unit, 81...identification plate, 82...support, 83...base, 84...point, 711...position information acquisition unit, 712...terminal control unit, 713...terminal memory unit, 714...position information transmission unit, 77...attribute memory unit, 51...image acquisition unit, 52...absolute coordinate acquisition unit, 53...attribute information acquisition unit, 54...determination unit, 55...output unit

Claims

1. an image acquisition unit that acquires an image capturing at least a range that is a target for determining the alert level; an absolute coordinate acquisition unit that acquires absolute coordinate information indicating a correspondence relationship between pixels of the acquired image and absolute coordinates; an attribute information acquisition unit that acquires attribute information in which attributes for each region are set based on an absolute coordinate system; a determination unit that identifies the position of the moving object in absolute coordinates based on the coordinates in the image where the moving object is located and determines the alert level according to the attribute of the absolute coordinates; an output unit that outputs information based on the determined alert level; An alertness level determination device comprising:

2. the determination unit determines the alert level based on a combination of the movement amount and the attribute of the moving object. The alert level determination device according to claim 1 .

3. the determination unit refers to information in which the image is divided into grids based on absolute coordinates, and determines the number of grids in which the moving object exists during a predetermined time as the amount of movement; The alert level determination device according to claim 2 .

4. The attribute is a level of alertness for each area, which is determined in advance before determining the level of alertness. The alert level determination device according to claim 1 .

5. the determination unit determines the alert level based on a plurality of attributes set in the area where the moving object can enter, out of the area where the moving object can enter and the area where the moving object cannot enter; The alert level determination device according to claim 1 .

6. The output unit issues an alarm when the alert level reaches or exceeds a predetermined value. The alert level determination device according to claim 1 .

7. a segmentation unit that divides an area into regions based on the image acquired by the image acquisition unit according to attributes of an object depicted in the image, the determination unit determines the alert level for a specific area segmented by the segmentation unit, and does not determine the alert level for other areas. The alert level determination device according to claim 1 .

8. an imaging device that captures an image of at least a range that is a target for determining the alert level, and at least three markers that can be identified from image information; an absolute coordinate specifying device that acquires absolute coordinates for each of the markers and specifies absolute coordinates of the acquired image as position coordinates of the markers captured in the acquired image, using the absolute coordinates acquired by the absolute coordinate acquiring unit; 8. The alert level determination device according to claim 1, wherein the alert level is determined based on the acquired image and the absolute coordinates identified by the absolute coordinate identification device, in accordance with attributes of the absolute coordinates at which a moving object captured in the acquired image exists; An alert level determination system comprising:

9. an image acquisition step of acquiring an image capturing at least a range targeted for determining the alert level; an absolute coordinate acquisition step of acquiring absolute coordinate information indicating a correspondence relationship between pixels of the acquired image and absolute coordinates; an attribute information acquisition step of acquiring attribute information in which attributes for each region are set based on an absolute coordinate system; a determination step of identifying a position where a moving object exists in absolute coordinates based on coordinates in the image where the moving object is captured in the acquired image, and determining the alert level according to attributes of the absolute coordinates; an output step of outputting information based on the determined alert level; A method for determining the level of vigilance.

Images