Monitoring system, monitoring device, monitoring method, and program

Abstract

A monitoring device (100) comprises: a position information acquisition unit (102) that acquires suitable position information that can specify a suitable installation position for an imaging device that monitors a position to be monitored; an image acquisition unit (104) that acquires an image in which is captured an area where the imaging device can be installed; a specification unit (106) that uses the suitable position information to specify a suitable installation position within the image; and a display processing unit (108) that superimposes the specified suitable installation position on the image and displays the image on a display unit.

Description

[Technical Field]

[0001] The present invention relates to a monitoring system, a monitoring device, a monitoring method, and a recording medium. [Background technology]

[0002] In recent years, the demand for surveillance cameras in stores and other places has expanded, and their uses are diverse, ranging from monitoring crimes such as shoplifting and robbery and crime prevention purposes to product management, sales, and analysis of customer consumption behavior.

[0003] Even if multiple surveillance cameras are installed in a store, they cannot cover the entire store, and blind spots still exist. Patent Document 1 describes an example of a surveillance device designed to compensate for such blind spots. The surveillance device described in Patent Document 1 uses a second imaging device, a wearable camera worn by store staff, to compensate for the blind spots of the first imaging device, a fixed surveillance camera. The blind spots are then superimposed on the actual video on the wearable camera's display, notifying employees of the existence of blind spots, enabling them to identify and eliminate the causes of the blind spots.

[0004] Furthermore, the surveillance camera system described in Patent Document 2 is configured from a camera group consisting of multiple cameras placed within a store and a POS register where merchandise is settled, and describes a system in which still image data is displayed on the camera's display unit to prompt the camera to move to a new monitoring position based on the camera's monitoring position allocated by the POS register. In this way, the surveillance camera system described in Patent Document 2 does not require the judgment or operation of the surveillance camera system administrator when placing the cameras, and can flexibly respond to changes in the situation of the subject being photographed.

[0005] Meanwhile, image recognition using AI (Artificial Intelligence) technologies such as deep learning has become increasingly common in recent years. An example of a system using such technology is described in Patent Document 3. The system in Patent Document 3 analyzes camera images to track people in an autonomous store and determines when the tracked person picks up or moves an item within the store. The system described in Patent Document 3 determines which items are picked up from, placed on, or moved to a shelf using a neural network that processes pre- and post-event images of the shelf. Person tracking is performed by analyzing images from a fisheye ceiling camera projected onto a plane horizontal to the floor. The projected ceiling camera images are analyzed using a neural network trained to recognize the shopper's location. This system also optimizes the number of cameras by moving or increasing the number of cameras as needed. [Prior art documents] [Patent documents]

[0006] [Patent Document 1] Japanese Patent Application Laid-Open No. 2016-82506 [Patent Document 2] Japanese Patent Application Laid-Open No. 2005-286619 [Patent Document 3] Japanese Patent Application Publication No. 2020-53019 Summary of the Invention [Problem to be solved by the invention]

[0007] The technology described in Patent Document 2 changes the allocation of cameras in response to changes in the situation in the sales floor, and displays still image data (for example, a message or mark indicating the sales floor to which the camera will move) on the display unit of the camera to prompt the camera to move. The store clerk moves the camera after seeing the display. In this way, the technology described in Patent Document 2 only notifies the store clerk of the sales floor to which the camera will move.

[0008] Generally, when using image recognition technology with AI, specialized engineers visit the site to determine the optimal installation location for the camera when the camera is installed. This is because the accuracy of image recognition using AI technology depends on the installation location of the camera, making it difficult for store clerks who are not engineers and do not have specialized knowledge to determine the optimal installation location that will improve the accuracy of image recognition. Furthermore, although the technology described in Patent Document 3 above describes camera movement, it does not anticipate that store clerks without specialized knowledge will determine the optimal installation location that will ensure image recognition accuracy.

[0009] Therefore, with the technology described in any of the above-mentioned patent documents, even if it is possible to identify the sales area to which the camera should be moved, it is not possible to install the camera in an optimal location that will improve the accuracy of image recognition using AI technology. Therefore, when a store clerk without specialized knowledge moves and installs the camera, there is a problem in that the accuracy of image recognition decreases.

[0010] In view of the above-mentioned problems, one example of an object of the present invention is to provide a surveillance system, a surveillance device, a surveillance method, and a recording medium that solve the problem of a decrease in image recognition accuracy due to the installation position of a camera in store surveillance. [Means for solving the problem]

[0011] According to one aspect of the present invention, a position information acquiring means for acquiring suitable position information capable of identifying a suitable installation position of the imaging means for monitoring the position to be monitored; image acquisition means for acquiring an image of an area where the imaging means can be installed; a specifying means for specifying the suitable installation position within the image using the suitable position information; and display processing means for displaying the identified suitable installation position on the image on a display means.

[0012] According to one aspect of the present invention, a second imaging means for imaging an area from the monitoring target position where a first imaging means for monitoring the monitoring target position can be installed; a storage means for storing suitable position information that can identify a suitable installation position of the first imaging means; A display means; a location information acquiring means for acquiring the preferred location information from the storage means; an image acquisition means for acquiring an image of an area where the first imaging means can be installed, the image being captured by the second imaging means; a specifying means for specifying the suitable installation position within the image using the suitable position information; a display processing means for displaying the identified suitable installation position on the display means by superimposing the image; A monitoring system is provided, comprising:

[0013] According to one aspect of the present invention, One or more computers acquiring suitable location information that can identify a suitable installation location for the imaging means that monitors the location to be monitored; Acquire an image of an area where the imaging means can be installed; Using the preferred position information, the preferred installation position is identified within the image; The specified suitable installation position is displayed on a display means so as to be superimposed on the image.

[0014] According to one aspect of the present invention, On the computer, a step of acquiring suitable location information that can identify a suitable installation location of the imaging means for monitoring the location to be monitored; a step of acquiring an image of an area where the imaging means can be installed; a step of identifying the suitable installation position within the image using the suitable position information; There is provided a computer-readable recording medium having recorded thereon a program for executing a procedure for displaying the identified suitable installation position on the image on a display means in a superimposed manner.

[0015] Another aspect of the present invention may be a program that causes at least one computer to execute the method of the above aspect, or a computer-readable recording medium on which such a program is recorded. This recording medium includes a non-transitory tangible medium. The computer program comprises computer program code which, when executed by a computer, causes the computer to perform the monitoring method on a monitoring device.

[0016] Any combination of the above components, and any transformation of the present invention into a method, device, system, recording medium, computer program, etc., are also valid aspects of the present invention.

[0017] Furthermore, the various components of the present invention do not necessarily have to be independent entities, but may be formed as a single member by multiple components, one component may be formed from multiple components, one component may be part of another component, or part of one component may overlap with part of another component, etc.

[0018] Furthermore, although the method and computer program of the present invention describe a number of steps in a sequential order, the order in which the steps are described does not limit the order in which the steps are executed. Therefore, when implementing the method and computer program of the present invention, the order of the steps can be changed as long as it does not cause any problems in terms of the content.

[0019] Furthermore, the multiple steps of the method and computer program of the present invention are not limited to being executed at different times, and therefore, a step may occur while another step is being executed, or the execution timing of a step may partially or completely overlap with the execution timing of another step, etc. [Effects of the Invention]

[0020] According to one aspect of the present invention, it is possible to provide a surveillance system, a surveillance device, a surveillance method, and a recording medium that solve the problem of a decrease in image recognition accuracy due to the installation position of a camera in store surveillance. [Brief explanation of the drawings]

[0021] [Figure 1] 1 is a diagram illustrating an overview of a monitoring device according to an embodiment. [Figure 2] 4 is a flowchart illustrating an example of the operation of the monitoring device of the present embodiment. [Figure 3] FIG. 1 is a diagram conceptually illustrating a system configuration during operation of a monitoring system according to an embodiment. [Figure 4] FIG. 1 is a diagram conceptually illustrating a system configuration in a preparation stage of a monitoring system according to an embodiment. [Figure 5] 2 is a block diagram illustrating an example of the hardware configuration of a computer that realizes the monitoring device of FIG. 1. FIG. [Figure 6] FIG. 10 is a diagram for explaining the relationship between the camera position when learning data is constructed and the camera position when an event is detected. [Figure 7] FIG. 10 is a diagram showing a state in which the positioning camera is temporarily placed on a display shelf. [Figure 8] FIG. 10 is a diagram showing an example of a screen on which a suitable installation area is superimposed and displayed. [Figure 9] FIG. 2 is a functional block diagram illustrating an example of a logical configuration of a monitoring device according to an embodiment. [Figure 10] FIG. 10 is a diagram for explaining preferred position information. [Figure 11] FIG. 10 is a diagram showing an example of display of suitable location information for each event. [Figure 12] 10 is a flowchart illustrating an example of the operation of the monitoring device according to the embodiment. [Figure 13] 1 is a functional block diagram illustrating an example of the configuration of a main part of a monitoring device according to an embodiment. [Figure 14] 10 is a flowchart illustrating an example of the operation of the monitoring device according to the embodiment. [Figure 15] FIG. 2 is a functional block diagram illustrating an example of a logical configuration of a monitoring device according to an embodiment. [Figure 16] 10 is a flowchart illustrating an example of the operation of the monitoring device according to the embodiment. [Figure 17] FIG. 1 illustrates an example of the configuration of a monitoring device according to an embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0022] Hereinafter, embodiments of the present invention will be described with reference to the drawings. In all drawings, similar components are designated by similar reference numerals, and their description will be omitted where appropriate. In addition, in the following drawings, configurations of parts that are not related to the essence of the present invention are omitted and are not shown.

[0023] In the embodiments, "acquisition" includes at least one of the following: a device going to retrieve data or information stored in another device or storage medium (active acquisition), and inputting data or information output from another device into the device (passive acquisition). Examples of active acquisition include making a request or inquiry to another device and receiving a reply, and accessing and reading information from another device or storage medium. An example of passive acquisition is receiving information that is distributed (or transmitted, pushed, etc.). Furthermore, "acquisition" may also mean selecting and acquiring data or information from received data or information, or selecting and receiving distributed data or information.

[0024] <Minimum configuration example> 1 is a diagram showing an overview of a monitoring device 100 according to an embodiment. The monitoring device 100 includes a position information acquisition unit 102, an image acquisition unit 104, an identification unit 106, and a display processing unit 108. The location information acquisition unit 102 acquires suitable location information that can identify a suitable installation location for a camera (image capture means) that monitors the location to be monitored. The image acquisition unit 104 acquires an image of an area where a camera can be installed. The identifying unit 106 identifies a suitable installation position within the image using the suitable position information. The display processing unit 108 displays the identified suitable installation position on the display unit, superimposed on the image.

[0025] Here, the camera that monitors the monitoring target location is also called an event detection camera. Also, the camera that captures the images acquired by the image acquisition unit 104 is also called a positioning camera. The positioning camera may be the event detection camera or a different camera.

[0026] <Example of operation> FIG. 2 is a flowchart showing an example of the operation of the monitoring device 100 of this embodiment. First, a positioning camera is temporarily placed at a monitoring target location so as to capture an area where an event detection camera can be installed. The position information acquisition unit 102 acquires suitable position information that can identify a suitable installation location for an event detection camera that will monitor the monitoring target location (step S101). The image acquisition unit 104 uses the positioning camera to acquire an image of the area where an event detection camera can be installed (step S103).

[0027] The specifying unit 106 specifies a suitable installation position in the image using the suitable position information (step S105). The display processing unit 108 displays the specified suitable installation position on the image by superimposing it on the image (step S107).

[0028] This monitoring device 100 includes a location information acquisition unit 102, an image acquisition unit 104, an identification unit 106, and a display processing unit 108. In this monitoring device 100, the location information acquisition unit 102 acquires suitable location information that can identify a suitable installation location for an event detection camera, and the image acquisition unit 104 uses a positioning camera to acquire an image of an area where the event detection camera can be installed. Then, the identification unit 106 uses the suitable location information to identify a suitable installation location within the image, and the display processing unit 108 displays the identified suitable installation location on the display unit, superimposed on the image.

[0029] Typically, when installing a camera that detects events using image processing, an engineer visits the site and determines the optimal location for image recognition to identify the installation location. According to this monitoring device 100, the display processing unit 108 displays the optimal installation location on the display, so even an installer such as a store clerk without specialized knowledge can install the event detection camera in the optimal installation location according to the display, and capture images suitable for detecting the target event. Events can be detected by processing the images captured by the event detection camera installed in the optimal installation location.

[0030] In this way, the monitoring device 100 can solve the problem of a decrease in image recognition accuracy due to the installation position of a camera in store monitoring.

[0031] A detailed example of the monitoring device 100 will be described below.

[0032] (First embodiment) <System Overview> 3 and 4 are diagrams conceptually illustrating the system configuration of the monitoring system 1 according to the embodiment. Fig. 3 illustrates an example of the system configuration during operation of the monitoring system 1. Fig. 4 illustrates an example of the system configuration in a preparation stage for determining the installation positions of the event detection cameras 20 of the monitoring system 1.

[0033] The monitoring system 1 includes a monitoring device 100 that detects a predetermined event using images captured by an event detection camera 20. The monitoring device 100 detects a predetermined event at a location to be monitored by performing image processing on the images captured by the event detection camera 20 using an image processing device 150. The image processing device 150 performs image recognition processing on the images captured by the event detection camera 20 using a recognition model 160 to detect the predetermined event.

[0034] The event detection camera 20 may be, for example, a wireless camera with wireless communication capabilities, and may be freely movable. This configuration makes it possible to realize a monitoring device 100 in which the accuracy of image recognition for event detection is not reduced in the movable event detection camera 20.

[0035] In the embodiment, the image processing device 150 performs image recognition processing using a recognition model 160 generated using machine learning or deep learning, which are so-called AI technologies. The recognition model 160 is constructed using training data and may be provided for each monitored location or predetermined event. Hereinafter, "training" refers to at least one of, but is not limited to, machine learning, neural networks, and deep learning.

[0036] For example, if the monitored location is a store, specified events include a customer stopping in front of a display shelf 5, a customer picking up an item 7, a customer picking up an item 7 and then putting it back, a customer taking away an item 7 to purchase (such as putting it in a shopping cart), a store clerk stocking an item 7, a missing item 7 on the display shelf 5, the state of the display, an item 7 not facing forward or an item 7 being knocked over, an item 7 being moved from its designated location, shoplifting, vandalism against an item 7, etc.

[0037] Also, for example, in the case of an event of taking in or out a product 7, the event may be the removal of a product 7 from a specific position (for example, information indicating the height of the detection target within the display shelf 5) on a display shelf 5 located in a specific position (for example, a so-called end shelf).

[0038] However, the events are not limited to these. As another example, the predetermined events to be detected may be nuisance behavior such as people loitering, baggage pickpocketing, molestation, crime, kidnapping, fight, violence, lost property, suspicious object, sudden illness, etc. in a station or on a moving train.

[0039] As shown in FIG. 4, in an example system configuration in the preparation stage, the monitoring system 1 includes a monitoring device 100 and a positioning camera 10 connected to the monitoring device 100 via a communication network 3. The monitoring device 100 has a preferred position information storage device 120 that indicates a preferred installation position for the event detection camera 20. The preferred position information storage device 120 may be provided inside or outside the monitoring device 100. In other words, the preferred position information storage device 120 may be hardware that is integrated with the monitoring device 100, or may be hardware that is separate from the monitoring device 100. Although the image processing device 150 and the recognition model 160 are not shown in FIG. 4, the image processing device 150 and the recognition model 160 may be included in the monitoring system 1 even in the preparation stage of FIG. 4.

[0040] The positioning camera 10 is temporarily placed at the monitoring location so as to capture an image of an area where an event detection camera can be installed. The installation position of the event detection camera 20 can be freely changed, but since the images generated by the event detection camera 20 are used in image recognition processing using the recognition model 160, it must be installed in an appropriate location to improve the accuracy of the recognition results. Therefore, in this embodiment, the event detection camera 20 is installed in a suitable installation position identified by the monitoring system 1 in FIG. 4, and the monitoring system 1 in FIG. 3 detects a predetermined event. This makes it possible to capture images that can improve recognition accuracy.

[0041] The positioning camera 10 and the event detection camera 20 each include an imaging element such as a lens and a CCD (Charge Coupled Device) image sensor, and are, for example, network cameras such as IP (Internet Protocol) cameras. The network cameras have, for example, a wireless LAN (Local Area Network) communication function and are connected to the monitoring device 100 via a communication network 3, i.e., a relay device (not shown) such as a router. These cameras may be so-called monitoring cameras, with multiple cameras installed in a store or facility. The cameras may also include mechanisms for controlling the orientation of the camera body and lens, zooming, focusing, etc., in accordance with the movement of a person.

[0042] The images generated by the camera are preferably taken in real time and transmitted to the monitoring device 100 via the communication network 3. However, the images transmitted to the monitoring device 100 do not have to be transmitted directly from the camera, but may be images delayed by a predetermined time. The images captured by the camera may be temporarily stored in another storage device, and the monitoring device 100 may read them out from the storage device sequentially or at predetermined intervals. Furthermore, the images transmitted to the monitoring device 100 are preferably moving images, but may also be frame images transmitted at predetermined intervals or still images.

[0043] Furthermore, in the preparation stage, the monitoring system 1 may have an operation terminal 30. The operation terminal 30 has a display 32 and a camera 34. The operation terminal 30 is a terminal operated by an operator such as a store clerk, and may be a computer such as a personal computer, a smartphone, or a tablet terminal.

[0044] The display 32 is, for example, a liquid crystal display, an organic EL (Electro-Luminescence) display, etc. The display 32 may also be a touch panel integrated with an operation unit.

[0045] <Hardware configuration example> Fig. 5 is a block diagram illustrating an example of the hardware configuration of a computer 1000 that realizes the monitoring device 100 of Fig. 1. The image processing device 150 of Fig. 3 (and Fig. 4) and the operation terminal 30 of Fig. 4 are also realized by the computer 1000. The event detection camera 20 of Fig. 3, the positioning camera 10 of Fig. 4, and the learning camera 22 described later are also realized by the computer 1000. The operation terminal 30 may also realize at least a part of the functions of the monitoring device 100.

[0046] The computer 1000 includes a bus 1010 , a processor 1020 , a memory 1030 , a storage device 1040 , an input / output interface 1050 , and a network interface 1060 .

[0047] The bus 1010 is a data transmission path for transmitting and receiving data among the processor 1020, memory 1030, storage device 1040, input / output interface 1050, and network interface 1060. However, the method of connecting the processor 1020 and the like to each other is not limited to bus connection.

[0048] The processor 1020 is implemented by a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), or the like.

[0049] The memory 1030 is a main storage device realized by a RAM (Random Access Memory) or the like.

[0050] The storage device 1040 is an auxiliary storage device realized by a hard disk drive (HDD), a solid state drive (SSD), a memory card, a read only memory (ROM), or the like. The storage device 1040 stores program modules that realize each function of the monitoring device 100 (e.g., the location information acquisition unit 102, the image acquisition unit 104, the identification unit 106, the display processing unit 108, the output processing unit 112 described below, and the notification unit 116). The processor 1020 loads each of these program modules into the memory 1030 and executes them, thereby realizing each function corresponding to the program module. The storage device 1040 may also store each data of the preferred location information storage device 120 of the monitoring device 100 and the recognition model 160 of the image processing device 150.

[0051] The program module may be recorded on a recording medium. The recording medium on which the program module is recorded may include a non-transitory, tangible medium usable by the computer 1000, and the program code readable by the computer 1000 (processor 1020) may be embedded in the medium.

[0052] The input / output interface 1050 is an interface for connecting the computer 1000 with various input / output devices. The input / output interface 1050 also functions as a communication interface for performing short-range wireless communication such as Bluetooth (registered trademark) and NFC (Near Field Communication).

[0053] The network interface 1060 is an interface for connecting the computer 1000 to a communication network. This communication network is, for example, a LAN (Local Area Network) or a WAN (Wide Area Network). The method for connecting the network interface 1060 to the communication network may be a wireless connection or a wired connection.

[0054] The computer 1000 is connected to necessary devices (for example, the display 32, camera 34, operation buttons, speaker, microphone, etc. of the operation terminal 30) via the input / output interface 1050 or the network interface 1060.

[0055] The components of the monitoring device 100 in each of the embodiments shown in Figure 1 and Figures 9, 13, 15, and 17 described below are realized by any combination of hardware and software of the computer 1000 in Figure 5. Those skilled in the art will understand that there are many variations in the realization methods and devices. The functional block diagrams showing the monitoring device 100 in each embodiment show logical functional blocks rather than a hardware-based configuration.

[0056] <Example of functional configuration> The following explanation will be given with reference to FIG. The location information acquisition unit 102 acquires suitable location information that can identify a suitable installation location for the event detection camera 20 that monitors the location to be monitored. Specifically, the location information acquisition unit 102 reads and acquires the suitable location information from the suitable location information storage device 120.

[0057] The location to be monitored includes at least a part of the display shelf 5 displaying the products 7. This makes it possible to detect the above-mentioned predetermined store-specific events with high accuracy.

[0058] The preferred position information storage device 120 stores the preferred position information of the event detection camera 20 relative to the position of the display shelf 5 or product 7 to be monitored. proper position The location information is stored.

[0059] Fig. 6 is a diagram for explaining the relationship between the camera position when building learning data and the camera position when detecting an event. Fig. 6(a) shows the installation position of the learning camera 22 when building learning data for recognizing a predetermined event. Fig. 6(b) shows the installation position of the event detection camera 20 when detecting an event. However, the same camera may be used as the learning camera 22 and the event detection camera 20.

[0060] In this example, the learning camera 22 captures images for collecting learning data to detect an event in which a person U standing in front of the display shelf 5 picks up a product 7 at position P. By installing the event detection camera 20 at the same position as this learning camera 22, it is expected that the recognition accuracy will improve. Therefore, as shown in FIG. 6(b), it is preferable to install the event detection camera 20 within the range of area R, with position P as the reference.

[0061] The preferred installation position indicates the shooting direction of the event detection camera 20 relative to the position of the monitored object. As described above, by setting the shooting direction of the event detection camera 20 to be the same as the shooting direction when the learning data was generated, the accuracy of image recognition using the learning data can be improved. Details of the preferred installation position will be described in the second embodiment.

[0062] The image acquisition unit 104 acquires an image of an area where the event detection camera 20 can be installed. The image acquisition unit 104 acquires an image captured by the positioning camera 10. FIG. 7 is a diagram showing the positioning camera 10 temporarily placed on the display shelf 5. As shown in the figure, the positioning camera 10 is temporarily placed at the position to be monitored. In other words, the image acquired by the image acquisition unit 104 is an image captured from the position to be monitored.

[0063] In this configuration, the image acquisition unit 104 acquires an image of an area where the event detection camera 20 can be installed, and therefore it is possible to display a suitable installation position for the event detection camera 20 superimposed on the image of the area where the event detection camera 20 can be installed. Since the suitable installation position for the planned installation location of the event detection camera 20 can be specifically confirmed, the installation work of the event detection camera 20 becomes easier and the installation work can be supported.

[0064] The identification unit 106 identifies a suitable installation position within the image using the suitable position information acquired by the position information acquisition unit 102. Here, the "image" refers to the image captured by the positioning camera 10. Specifically, the identification unit 106 identifies a suitable installation range for the event detection camera 20 by providing a predetermined width in both the horizontal and vertical directions in the shooting direction of the event detection camera 20 relative to the position of the monitoring target indicated by the suitable position information.

[0065] Furthermore, the identifying unit 106 may perform a process of correcting distortion aberration caused by lens distortion of the event detection camera 20 on the suitable position information of the event detection camera 20 .

[0066] The display processing unit 108 displays the identified suitable installation position on the image on the display unit. In the example embodiment, the display processing unit 108 displays the image on the display 32 of the operation terminal 30. In another example, the display unit may be the display of the positioning camera 10. Alternatively, the camera 34 of the operation terminal 30 may be the positioning camera 10, and in that case, the display unit may be the display 32 of the operation terminal 30.

[0067] 8 is a diagram showing an example of a screen 200 on which a suitable installation area 210 is superimposed. The screen 200 includes an image captured by the positioning camera 10 and a drawing element indicating the suitable installation area 210 identified by the identification unit 106 in the image.

[0068] The drawing elements indicating the suitable installation area 210 are, for example, a line drawing that frames the suitable installation area 210, or a highlight or hatched pattern that indicates the range that covers the suitable installation area 210. The display processing unit 108 displays these drawing elements superimposed on the image captured by the positioning camera 10 on the display 32 of the operation terminal 30. Here, the image displayed by the display processing unit 108 is described as a moving image, but a still image may also be displayed.

[0069] <Example of operation> An example of the operation of the monitoring device 100 will be described with reference to FIG. First, the positioning camera 10 is temporarily placed at a location to be monitored, for example, a display shelf 5, so as to capture an image of an area where the event detection camera 20 can be installed. Then, the position information acquisition unit 102 reads and acquires suitable position information that can identify a suitable installation location for the event detection camera 20 from the suitable position information storage device 120 (step S101). The image acquisition unit 104 uses the positioning camera 10 to acquire an image of the area where the event detection camera 20 can be installed (step S103). As described above, the image acquisition unit 104 may acquire the video being captured by the positioning camera 10 in real time.

[0070] The identification unit 106 uses the suitable position information acquired in step S101 to identify a suitable installation position (suitable installation area) in the image captured by the positioning camera 10 (step S105). The display processing unit 108 displays a drawing element indicating the identified suitable installation area 210 on the display 32 of the operation terminal 30, superimposed on the image captured by the positioning camera 10 (step S107).

[0071] This monitoring device 100 includes a location information acquisition unit 102, an image acquisition unit 104, an identification unit 106, and a display processing unit 108. In this monitoring device 100, the location information acquisition unit 102 acquires suitable location information that can identify a suitable installation location for an event detection camera, and the image acquisition unit 104 uses a positioning camera to acquire an image of an area where the event detection camera can be installed. Then, the identification unit 106 uses the suitable location information to identify a suitable installation location within the image, and the display processing unit 108 displays the identified suitable installation location on the display unit, superimposed on the image.

[0072] In this way, the monitoring device 100 can solve the problem of a decrease in image recognition accuracy due to the installation position of a camera in store monitoring.

[0073] (Second embodiment) FIG. 9 is a functional block diagram showing an example of the logical configuration of a monitoring device 100 according to an embodiment. This embodiment is the same as the above-described embodiment, except that it has a configuration in which a suitable installation position for the event detection camera 20 is identified and suitable position information is stored in a preparation stage. The monitoring device 100 of FIG. 9 further includes a storage processing unit 110. However, the storage processing unit 110 may be realized by a computer 1000 separate from the monitoring device 100 of FIG. 1. The configuration of this embodiment may be combined with at least one of the configurations of the other embodiments to the extent that no contradiction occurs.

[0074] <Example of functional configuration> When constructing learning data to be used for detecting events by image processing the images generated by the event detection camera 20, the storage processing unit 110 stores in advance in the preferred position information storage device 120 information that can identify the position of the learning camera 22 (imaging means) that captured the monitored position as preferred position information. The location information acquisition unit 102 reads and acquires the preferred location information from the preferred location information storage device 120 .

[0075] Examples of storage formats for the preferred position information are shown below, but are not limited to these. Furthermore, the preferred installation position may be determined by an engineer measuring information capable of identifying the learning camera 22 when constructing the learning data (for example, angle information (angles θ, α) described below), and receiving the input of the measurement value as the preferred position information. Alternatively, the image processing device 150 may identify the angle information (angles θ, α) described below through image processing. Note that the angle α is within the allowable range of the angle θ, and may be a value determined in advance taking into account, for example, the angle of view of the event detection camera 20. Alternatively, the angle α may be a value set according to the type of event.

[0076] The preferred location information stored in the preferred location information storage device 120 may be stored in association with the learning data of the event to be detected stored in the recognition model 160 .

[0077] Furthermore, the storage processing of the suitable position information by the storage processing unit 110 may be performed as appropriate in response to addition, update, or deletion of an event to be detected.

[0078] <Example 1: Save as image> The storage processing unit 110 stores the suitable position information in the suitable position information storage device 120 in the form of an image showing an area where the event detection camera 20 can be installed.

[0079] 10 is a diagram for explaining the preferred position information, in which the xyz coordinates indicate the coordinates shown in FIG. 10(a) shows the angle θ between the optical axis L of the learning camera 22 that captured the image used to generate the learning data and the front surface 5a of the display shelf 5. In FIG. 10(b), the range r of angles ±α centered on the angle θ is set as the preferred installation position. In FIG. 10(c), the horizontal range r (the rectangular range indicated by the dashed line) is expressed in the form of an image projected onto the image plane 50.

[0080] In the example of FIG. 10, the range r of suitable installation positions in the horizontal direction is shown. Furthermore, a range r of suitable installation positions is similarly set for the vertical direction as well. The storage processing unit 110 stores the range of the logical product of the horizontal range and the vertical range as the suitable installation position in the suitable position information storage device 120. However, the suitable position information storage device 120 may store the range r of suitable installation positions in the horizontal direction and the range r of suitable installation positions in the vertical direction, respectively. The identification unit 106 may read the range r of suitable installation positions in the horizontal direction and the range r of suitable installation positions in the vertical direction from the suitable position information storage device 120, and determine the range of the logical product of the horizontal range and the vertical range as the suitable installation position.

[0081] <Example 2: Store as numerical data> The storage processing unit 110 stores the suitable position information in the suitable position information storage device 120 as numerical data indicating the installation direction of the event detection camera 20 with reference to the position of the monitoring target.

[0082] In this example, the storage processing unit 110 stores the values ​​of the angles θ and α in FIG. 10(b) in the preferred position information storage device 120 for both the horizontal and vertical directions. The identifying unit 106 can convert the suitable installation position into image format data showing the suitable installation area 210 in Fig. 8 using the values ​​of angles θ and α read from the suitable position information storage device 120. In this example as well, the identifying unit 106 can determine, for example, as the suitable installation position, the range of the logical product of the range of suitable installation positions in the horizontal direction and the range of suitable installation positions in the vertical direction converted using the values ​​of angles θ and α.

[0083] As described above, the images generated by the event detection camera 20 are used to detect events. The location information acquisition unit 102 acquires suitable location information for each event.

[0084] When a plurality of events are to be detected, the specifying unit 106 specifies the suitable installation location using the suitable location information of the plurality of events.

[0085] FIG. 11 is a diagram showing an example of display of suitable location information for each event. 11(a), three suitable installation areas 210a, 210b, and 210c are displayed in a superimposed manner on the screen 200. The three suitable installation areas 210a, 210b, and 210c are preferably displayed in a superimposed manner using different drawing elements so that they can be distinguished from one another. The drawing elements can be distinguished by, for example, changing the type of line or hatching pattern, or by changing the color of the line or hatching.

[0086] Information indicating the event corresponding to each suitable installation area 210 may also be displayed on the screen 200 as a legend for each suitable installation area 210 .

[0087] In the example of FIG. 11(b), a drawing element is displayed superimposed on the screen 200, with the region 210d being the logical product of three suitable installation regions 210a, 210b, and 210c as the suitable installation region.

[0088] <Example of operation> FIG. 12 is a flowchart showing an example of the operation of the monitoring device 100 according to the embodiment. This flow shows the storage process of suitable position information in the preparation stage. First, before starting the process, the learning camera 22 is placed at a position where it will capture images for detecting events at the monitoring target location. Then, the image processing device 150 of the monitoring device 100 acquires images from the learning camera 22 and constructs learning data for event detection (step S111).

[0089] Then, the storage processing unit 110 acquires position information (angles θ, α) of the training camera 22 when constructing the training data using the captured images (step S113). As described above, the position information may be acquired by accepting input of measurements taken by an engineer, or may be acquired by the image processing device 150 as a value calculated by image processing. Then, the storage processing unit 110 stores the acquired position information of the training camera 22 as preferred position information in the preferred position information storage device 120 (step S115).

[0090] As described above, the preferred position information is stored in the preferred position information storage device 120 in the form of at least one of image data and numerical data indicating angles.

[0091] As described above, learning data is constructed for each event, so the storage processing unit 110 may acquire suitable location information for each event and store it in the suitable location information storage device 120 for each event.

[0092] The display processing unit 108 may also acquire event selection information and display the suitable installation position corresponding to the selected event. For example, the display processing unit 108 may display a UI ( UserA UI (User Interface) is displayed on the display 32 of the operation terminal 30. The UI is not particularly limited and may be, for example, radio buttons, check boxes, drop-down lists, combo boxes, drum rolls, etc. As described above, in the case of a product 7 removal event, the selection of a predetermined condition, for example, a specific installation position on the display shelf 5 or a specific display position of the product 7 to be detected, may be further accepted, and the accepted condition may be included in the selection information of the event.

[0093] The display processing unit 108 receives a selection of at least one event from among a plurality of events and acquires selection information. The display processing unit 108 may, for example, switch and display the suitable installation area 210 corresponding to the event selected by a radio button each time a selection is received.

[0094] Alternatively, the identification unit 106 may acquire the selection information of the event, identify the suitable installation location corresponding to the selected event, and cause the display processing unit 108 to display it.

[0095] As described above, in the monitoring device 100 of this embodiment, when constructing learning data to be used for detecting an event by image processing of images generated by the event detection camera 20, the storage processing unit 110 stores in advance, as preferred position information, information capable of identifying the position of the learning camera 22 that captured the image of the monitoring target position in the preferred position information storage device 120. Then, the position information acquisition unit 102 reads out and acquires the preferred position information from the preferred position information storage device 120.

[0096] As described above, the monitoring device 100 of this embodiment achieves the same effects as the above-described embodiment. Furthermore, since the preferred installation position is the same as the position of the training camera 22 when constructing the training data for detecting events monitored by the monitoring device 100, the accuracy of event detection using the training data is not reduced and the effectiveness of the training data can be maximized. Therefore, even if the event detection camera 20 is moved by a store clerk without specialized knowledge of AI technology, the event detection camera 20 can be installed without reducing the event detection accuracy. In other words, this embodiment can assist in the installation of a movable event detection camera 20.

[0097] Furthermore, the preferred position information may be stored in the form of an image indicating an area where the event detection camera 20 can be installed, or may be stored as numerical data indicating the installation direction of the event detection camera 20 relative to the position of the monitoring target. With this configuration, information capable of identifying the position of the training camera 22 when constructing training data for event detection can be stored in the preferred position information storage device 120 in an appropriate format depending on the storage capacity of the storage device (memory 1030 or storage device 1040) of the computer 1000, the processing power of the processor 1020 of the computer 1000, the type of event, etc.

[0098] Also, the training data for detecting events Construction Since the event detection camera 20 can be installed in an installation position that is considered suitable for the event, an image captured by the event detection camera 20 installed based on the suitable installation position can be used for event detection, preventing a decrease in the accuracy of event detection. Furthermore, even when multiple events are to be detected, the display processing unit 108 can display the suitable installation position for each event, or can acquire event selection information and selectively display multiple suitable installation positions, or display the result of the logical product of multiple suitable installation positions, so that the suitable installation position suitable for the event to be detected can be provided to an installation worker such as a store clerk.

[0099] (Third embodiment) Fig. 13 is a functional block diagram showing an example of the configuration of the main parts of a monitoring device 100 according to an embodiment. This embodiment is the same as the above-described embodiments except that it has a configuration that provides recommended information on the installation position of the positioning camera 10. The monitoring device 100 in Fig. 13 further includes an output processing unit 112 in addition to the configuration of the first embodiment in Fig. 1. Note that the configuration of this embodiment may be combined with at least one of the configurations of the other embodiments to the extent that no contradiction occurs.

[0100] <Example of functional configuration> The output processing unit 112 causes the output unit to output, in response to an event, recommended information on the installation position of the positioning camera 10 that captures the image acquired by the position information acquisition unit 102.

[0101] The positioning camera 10 is preferably installed at position P, which serves as a reference for event detection targets, as shown in Fig. 6. Therefore, in this embodiment, the monitoring target positions when learning data is acquired for each event are further stored in the preferred position information storage device 120. Then, before starting to capture images with the positioning camera 10 in step S101 of Fig. 2, recommended information is output.

[0102] The recommended information indicating the installation position of the positioning camera 10 may include at least one of the floor name, the location of the display shelf 5, and the position within the display shelf 5 (at least one of the horizontal and vertical directions (number of shelves)). Alternatively, the recommended information may be a value indicated by position information from a GPS (Global Positioning System).

[0103] Specifically, the output processing unit 112 acquires selection information of an event to be detected, acquires a recommended installation position of the positioning camera 10 corresponding to the acquired event, and outputs the information to the output unit. The recommendation information is not particularly limited, and may be, for example, the floor name, the location of the display shelf 5, or the position within the display shelf 5 (at least one of the horizontal and vertical directions (number of shelves)). Alternatively, as will be described later, the recommendation information may include information using the current position of the positioning camera 10 to prompt fine adjustment of the installation position to match the recommended installation position, such as "a little more to the right" or "a little more forward." Alternatively, the recommendation information may include information using the current position of the positioning camera 10 to indicate that the positioning camera 10 has been correctly installed at the recommended installation position (an alert sound or a voice message such as "Installed correctly").

[0104] Alternatively, the recommendation information may be a diagram of a recommended installation position on the screen. Furthermore, the recommendation information may be information that superimposes the current position of the positioning camera 10 on the illustrated recommended installation position and encourages the user to move the camera so that the recommended installation position overlaps with the current position. The current position of the positioning camera 10 can be identified by acquiring location information identified by a GPS (Global Positioning System) receiving function of the positioning camera 10.

[0105] The output unit may, for example, output audio to a speaker (not shown) of at least one of the operation terminal 30 and the positioning camera 10, or may output image or text information to a display of at least one of the operation terminal 30 and the positioning camera 10.

[0106] <Example of operation> FIG. 14 is a flowchart showing an example of the operation of the monitoring device 100 according to the embodiment. This flow is performed before step S101 in Fig. 1. First, the output processing unit 112 acquires selection information of an event to be detected (step S121). As described above, the output processing unit 112 displays a UI for accepting the selection of an event on the screen, accepts the selection of the event, and acquires the selection information.

[0107] Then, the output processing unit 112 reads and acquires recommended information indicating the installation position of the positioning camera 10 corresponding to the selected event from the suitable position information storage device 120, and outputs the information to the output unit (step S123). The output processing unit 112, for example, displays the recommended information on the display 32 of the operation terminal 30, or outputs the recommended information as sound from the speaker of the operation terminal 30.

[0108] As described above, in the monitoring device 100 of this embodiment, the output processing unit 112 outputs recommended information on the installation location of the positioning camera 10 that captures the images acquired by the position information acquisition unit 102 to the output unit in response to an event.

[0109] As described above, the monitoring device 100 of this embodiment not only achieves the same effects as the above-described embodiment, but also makes it possible to install the positioning camera 10 in an appropriate position, thereby enabling the event detection camera 20 to be installed in an appropriate position and eliminating factors that reduce the accuracy of event detection due to misalignment of the positioning camera 10. Furthermore, since the positioning camera 10 can be installed according to the recommended information, it is possible to support the installation work of workers when installing the positioning camera 10.

[0110] (No. 4 Embodiment) Fig. 15 is a functional block diagram showing an example of the logical configuration of the monitoring device 100 of an embodiment. This embodiment is the same as any of the above-described embodiments except that it has a configuration that supports the installation of the event detection camera 20. Fig. 15 has the same configuration as Fig. 1 and further includes a determination unit 114 and a notification unit 116. However, the configuration of this embodiment may be combined with at least one of the configurations of the other embodiments to the extent that no contradiction occurs.

[0111] <Example of functional configuration> The determination unit 114 processes the image acquired by the position information acquisition unit 102 to determine whether or not the event detection camera 20 is installed within the area indicated by the suitable installation position. Based on the determination result by the determination unit 114, the notification unit 116 notifies that the event detection camera 20 has been installed within the area indicated by the suitable installation position.

[0112] Here, it is assumed that the event detection camera 20 is installed while the display processing unit 108 displays the suitable installation area 210 on the screen 200. It is also assumed that the image processing device 150 has been trained in advance so that it can detect the event detection camera 20.

[0113] The determination unit 114 causes the image processing device 150 to process the image captured by the positioning camera 10 and identify the position of the event detection camera 20 within the image. The determination unit 114 then determines whether or not the identified position of the event detection camera 20 is included within the area indicating the suitable installation position identified by the identification unit 106, for example, within the suitable installation area 210 on the screen 200.

[0114] Furthermore, when acquiring the installation position of the training camera 22, information capable of identifying at least one of the angle of view and lens orientation of the training camera 22 relative to the position to be monitored may be acquired from the training camera 22 and stored in the preferred position information storage device 120. Then, the determination unit 114 may acquire information capable of identifying at least one of the angle of view and lens orientation of the event detection camera 20 from the event detection camera 20, and determine whether or not it is the same as the setting of the training camera 22 (or within a predetermined range).

[0115] When the determination result by the determination unit 114 indicates that the position of the event detection camera 20 is determined to be included in the area indicating the suitable installation position, the notification unit 116 notifies that the event detection camera 20 has been installed in the area indicated by the suitable installation position. Specifically, the notification unit 116 outputs a notification sound or a voice notification message from the speaker of at least one of the positioning camera 10 and the operation terminal 30.

[0116] Alternatively, the notification unit 116 may display information indicating that the device has been installed within the area indicated by the suitable installation position on the display of at least one of the positioning camera 10 and the operation terminal 30. Specifically, on the screen 200 of FIG. 8 , the display of the suitable installation area 210 may be switched to a highlighted display, such as blinking, to notify at least one of the fact that the device has not been installed within the area indicated by the suitable installation position and the fact that the device has been installed within the area indicated by the suitable installation position. In other words, the highlighting may be continued until the device is installed within the area indicated by the suitable installation position, and may be stopped once the device is installed within the area indicated by the suitable installation position. Conversely, the highlighting may be stopped until the device is installed within the area indicated by the suitable installation position, and may be continued once the device is installed within the area indicated by the suitable installation position.

[0117] <Example of operation> FIG. 16 is a flowchart showing an example of the operation of the monitoring device 100 according to the embodiment. This flow starts after step S107 in FIG. Then, the determination unit 114 first transmits the image captured by the positioning camera 10 to the image processing device 150, which processes the image and identifies the position of the event detection camera 20 (step S131). Upon acquiring the position of the event detection camera 20, the determination unit 114 determines whether the position of the event detection camera 20 is within the region indicating the suitable installation position identified in step S105 of Fig. 2 (step S133).

[0118] If it is determined that the event detection camera 20 is within the area indicating the suitable installation position (YES in step S133), the notification unit 116 notifies that the event detection camera 20 has entered the area of ​​the suitable installation position (step S135). On the other hand, while it is determined in step S133 that the event detection camera 20 is not within the area indicating the suitable installation position (NO in step S133), the process returns to step S131, and the process of acquiring an image of the positioning camera 10 and causing the image processing device 150 to identify the position of the event detection camera 20 is repeated. Furthermore, after the notification in step S135, this process may be terminated, or, for example, the process may return to step S131, and thereafter repeatedly determine whether the position of the event detection camera 20 has deviated from the area of ​​the suitable installation position, and notify the result.

[0119] For example, when the event detection camera 20 enters the area of ​​the suitable installation position, the notification unit 116 outputs a notification sound from the speaker of the event detection camera 20. This allows the worker installing the event detection camera 20 to know that the event detection camera 20 has been installed in the appropriate position.

[0120] 8, the display processing unit 108 may highlight the drawing elements in the suitable installation area 210 until the event detection camera 20 enters the suitable installation area 210 (NO in step S133). Then, when the event detection camera 20 enters the suitable installation area 210 (YES in step S133), the notification unit 116 may cause the display processing unit 108 to stop the highlighting, thereby notifying that the event detection camera 20 has entered the area of ​​the suitable installation position (step S135).

[0121] 8, the display processing unit 108 may normally display the drawing elements of the suitable installation area 210 until the event detection camera 20 enters the suitable installation area 210 (NO in step S133). Then, when the event detection camera 20 enters the suitable installation area 210 (YES in step S133), the notification unit 116 may cause the display processing unit 108 to highlight the drawing elements of the suitable installation area 210, thereby notifying that the event detection camera 20 has entered the area of ​​the suitable installation position (step S135).

[0122] As described above, in the monitoring device 100 of this embodiment, the determination unit 114 processes the image acquired by the location information acquisition unit 102 to determine whether or not the event detection camera 20 has been installed within the area indicated by the suitable installation position, and the notification unit 116 notifies the user that the event detection camera 20 has been installed within the area indicated by the suitable installation position based on the determination result by the determination unit 114.

[0123] As described above, the monitoring device 100 of this embodiment not only produces the same effects as the above-described embodiment, but also notifies whether the event detection camera 20 has been installed within the area indicated by the appropriate installation position, thereby assisting in the installation of the event detection camera 20. Furthermore, since the event detection camera 20 can be installed in an appropriate position, it is possible to eliminate factors that reduce the accuracy of event detection due to a deviation in the installation position of the event detection camera 20.

[0124] (No. 5 Embodiment) Fig. 17 is a diagram showing an example of the configuration of a monitoring device 100 using an event detection camera 20 installed in a position more suitable for the monitoring device 100 of the embodiment described above. In this embodiment, the monitoring device 100 in the monitoring system 1 described in Fig. 3 has a configuration in which an event is detected using an image processing device 150. The configuration of the monitoring device 100 of this embodiment shows the configuration of the monitoring device 100 when it is in operation. Note that the configuration of this embodiment may be combined with at least one of the configurations of the other embodiments to the extent that no contradiction occurs.

[0125] The monitoring device 100 further includes an event detection unit 130 . The event detection unit 130 performs image processing on the image generated by the event detection camera 20 using the learning data to detect an event.

[0126] The monitoring device 100 further includes a camera-side communication unit 132 and an AI-side communication unit 134. The camera-side communication unit 132 has a communication function for connecting the event detection camera 20 to the communication network 3. The AI-side communication unit 134 has a communication function for connecting the monitoring device 100 to the communication network 3.

[0127] The images captured by the event detection camera 20 are transmitted to the monitoring device 100 via the camera-side communication unit 132. The event detection unit 130 then receives the images captured by the event detection camera 20 via the AI-side communication unit 134. The event detection unit 130 then causes the image processing device 150 to process the received images and detect an event.

[0128] As described above, in the monitoring device 100 of this embodiment, the event detection unit 130 detects an event by performing image processing on the image generated by the event detection camera 20 using learning data. In this way, the monitoring device 100 of this embodiment not only achieves the same effects as the above-described embodiments, but also detects events by processing images generated by the event detection cameras 20 installed in the suitable installation positions identified when the learning data for event detection was generated using the learning data, thereby maximizing recognition accuracy. Furthermore, the monitoring device 100 can assist in the task of moving the event detection cameras 20.

[0129] Although the embodiments of the present invention have been described above with reference to the drawings, these are merely examples of the present invention, and various other configurations can also be adopted.

[0130] In addition, although the flowcharts used in the above description describe multiple steps (processes) in a sequential order, the execution order of the steps in each embodiment is not limited to the order described. In each embodiment, the order of the steps shown in the drawings can be changed to the extent that the content is not affected. Furthermore, at least one step may be performed by another operating entity, such as another device or person. Furthermore, the above-described embodiments can be combined to the extent that the content is not contradictory.

[0131] Although the present invention has been described above with reference to the embodiments, the present invention is not limited to the above embodiments. Various modifications that can be understood by those skilled in the art can be made to the configuration and details of the present invention within the scope of the present invention. In the present invention, when information about users (including customers, passengers, etc.) is acquired and used, it is assumed that this is done lawfully.

[0132] Some or all of the above-described embodiments can be described as, but are not limited to, the following supplementary notes. 1. A location information acquisition means for acquiring suitable location information that can identify a suitable installation location of an imaging means for monitoring a location to be monitored; image acquisition means for acquiring an image of an area where the imaging means can be installed; a specifying means for specifying the suitable installation position within the image using the suitable position information; a display processing means for displaying the identified suitable installation position on the image on a display means. 2. In the monitoring device described in 1., A monitoring device, wherein the image is an image taken from the monitored location. 3. In the monitoring device described in 2., A monitoring device, wherein the preferred position information indicates the photographing direction of the imaging means based on the position of the monitored object. 4. In the monitoring device according to any one of 1. to 3., The monitoring device, wherein the monitored location includes at least a portion of a product shelf. 5. In the monitoring device according to any one of 1. to 4., a storage processing means for storing in advance in a storage means, as the preferred position information, information capable of identifying the position of the imaging means that captured the monitoring target position when constructing learning data to be used for detecting an event by image processing the image generated by the imaging means; The position information acquisition means reads and acquires the preferred position information from the storage means. 6. In the monitoring device according to 5., The storage processing means stores the suitable position information in the storage means in an image format showing an area where the imaging means can be installed. 7. In the monitoring device according to 5. or 6., The storage processing means stores the suitable position information in the storage means as numerical data indicating the installation direction of the imaging means with respect to the position of the monitored object. 8. In the monitoring device according to any one of 1. to 7., the image generated by the imaging means is used to detect an event; The location information acquisition means acquires the preferred location information for each event. 9. In the monitoring device according to 8., When a plurality of events are to be detected, the specifying means specifies the suitable installation location using a plurality of pieces of suitable location information for the plurality of events. 10. In the monitoring device according to 8. or 9., The display processing means acquires the selection information of the event, and displays the suitable installation position corresponding to the selected event. 11. The monitoring device according to any one of items 8 to 10, The monitoring device further comprises an output processing means for causing an output means to output, in response to the event, recommended information on the installation position of an imaging means that captures the image acquired by the image acquisition means. 12. In the monitoring device according to any one of 1. to 11., a determination means for determining whether the imaging means is installed within the area indicated by the suitable installation position by processing the image acquired by the image acquisition means; The monitoring device further comprises a notification means for notifying that the imaging means is installed within the area indicated by the suitable installation position based on a determination result by the determination means. 13. In the monitoring device according to any one of 1. to 12., The monitoring device further comprises an event detection means for detecting an event by performing image processing on the image generated by the imaging means using learning data. 14. In the monitoring device according to any one of 1. to 13., A monitoring device, wherein the imaging means is a movable wireless camera.

[0133] 15. A second imaging means for imaging an area from the monitoring target position where a first imaging means for monitoring the monitoring target position can be installed; a storage means for storing suitable position information that can identify a suitable installation position of the first imaging means; A display means; a location information acquiring means for acquiring the preferred location information from the storage means; an image acquisition means for acquiring an image of an area where the first imaging means can be installed, the image being captured by the second imaging means; a specifying means for specifying the suitable installation position within the image using the suitable position information; a display processing means for displaying the identified suitable installation position on the display means by superimposing the image; A monitoring system comprising: 16. In the monitoring system according to 15., A surveillance system, wherein the image is an image taken from the monitored location. 17. In the monitoring system according to 16., A monitoring system, wherein the preferred position information indicates the imaging direction of the first imaging means based on the position of the monitored object. 18. In the monitoring system according to any one of 15. to 17., A monitoring system, wherein the monitored location includes at least a portion of a store shelf. 19. In the monitoring system according to any one of 15. to 18., a storage processing means for storing in advance in a storage means, as the preferred position information, information capable of identifying the position of the third imaging means that captured the image of the monitoring target position when constructing learning data to be used for detecting an event by image processing the image generated by the first imaging means; The location information acquisition means reads and acquires the preferred location information from the storage means. 20. In the monitoring system according to 19., The storage processing means stores the suitable position information in the storage means in an image format showing an area where the first imaging means can be installed. 21. In the monitoring system according to 19. or 20., A monitoring system in which the storage processing means stores the suitable position information in the storage means as numerical data indicating the installation direction of the first imaging means with respect to the position to be monitored. 22. In the monitoring system according to any one of 15. to 21., the image generated by the first imaging means is used to detect an event; The location information acquisition means acquires the preferred location information for each event. 23. In the monitoring system according to 22., When a plurality of events are to be detected, the specifying means specifies the suitable installation location using a plurality of pieces of suitable location information for the plurality of events. 24. In the monitoring system according to 22. or 23., The display processing means acquires the event selection information and displays the suitable installation position corresponding to the selected event. 25. In the monitoring system according to any one of 22. to 24., The monitoring system further comprises an output processing means for causing an output means to output recommended information on the installation position of the second imaging means in response to the event. 26. In the monitoring system according to any one of 15. to 25., a determination means for determining whether or not the first image capturing means is installed within the area indicated by the suitable installation position by processing the image acquired by the image acquiring means; a notification unit configured to notify that the first imaging unit has been installed within the area indicated by the suitable installation position based on a determination result by the determination unit. 27. In the monitoring system according to any one of 15. to 26., A surveillance system comprising an event detection means that performs image processing on the image generated by the first imaging means using learning data to detect an event. 28. In the monitoring system according to any one of 15. to 27., A surveillance system, wherein the first imaging means is a movable wireless camera.

[0134] 29. One or more computers acquiring suitable location information that can identify a suitable installation location for the imaging means that monitors the location to be monitored; Acquire an image of an area where the imaging means can be installed; Using the preferred position information, the preferred installation position is identified within the image; The monitoring method further comprises displaying the identified suitable installation position on the image on a display means. 30. In the monitoring method described in 29., A monitoring method, wherein the image is an image taken from the monitored location. 31. In the monitoring method according to 30., A monitoring method, wherein the preferred position information indicates an imaging direction of the imaging means based on the position of the monitored object. 32. In the monitoring method according to any one of 29. to 31., The method of monitoring, wherein the monitored location includes at least a portion of a shelf. 33. In the monitoring method according to any one of 29. to 32., the one or more computers further When constructing learning data to be used for detecting an event by image processing the image generated by the imaging means, information capable of identifying the position of the imaging means that captured the image of the monitoring target position is stored in advance in a storage means as the preferred position information, A monitoring method, comprising: reading and acquiring the preferred position information from the storage means. 34. In the monitoring method according to 33., the one or more computers: a monitoring method in which the suitable position information is stored in the storage means in the form of an image showing an area in which the imaging means can be installed; 35. In the monitoring method according to 33. or 34., the one or more computers: A monitoring method in which the suitable position information is stored in the storage means as numerical data indicating the installation direction of the imaging means with respect to the position of the object to be monitored. 36. In the monitoring method according to any one of 29. to 35., the image generated by the imaging means is used to detect an event; the one or more computers: The monitoring method further comprises obtaining the preferred location information for each of the events. 37. In the monitoring method according to 36., the one or more computers: A monitoring method, wherein when a plurality of the events are to be detected, the preferable installation position is specified using a plurality of pieces of preferable position information for the plurality of the events. 38. In the monitoring method according to 36. or 37., the one or more computers: A monitoring method that acquires selection information of the event and displays the suitable installation position corresponding to the selected event. 39. In the monitoring method according to any one of 36. to 38., the one or more computers further A monitoring method in which recommended information on the installation position of an imaging means for capturing the image to be acquired is output to an output means in response to the event. 40. In the monitoring method according to any one of 29. to 39., the one or more computers further determining whether the imaging means is installed within the area indicated by the suitable installation position by processing the acquired image; A monitoring method, comprising: based on a determination result, notifying that the imaging means is installed within the area indicated by the suitable installation position. 41. In the monitoring method according to any one of 29. to 40., the one or more computers further A monitoring method comprising: detecting an event by performing image processing on the image generated by the imaging means using learning data. 42. In the monitoring method according to any one of 29. to 41., A monitoring method, wherein the imaging means is a movable wireless camera.

[0135] 43. To the computer, a step of acquiring suitable location information that can identify a suitable installation location of a first imaging means that monitors the location to be monitored; acquiring an image of an area where the first imaging means can be installed; a step of identifying the suitable installation position within the image using the suitable position information; a computer-readable recording medium having recorded thereon a program for executing a procedure for displaying the identified suitable installation position on the image on a display means in a superimposed manner; 44. The recording medium according to 43., A recording medium, wherein the image is an image taken from the monitored location. 45. In the recording medium according to 44., A recording medium, wherein the preferred position information indicates the photographing direction of the first imaging means based on the position of the monitored object. 46. ​​The recording medium according to any one of 43 to 45, The monitored location includes at least a portion of a product shelf. 47. The recording medium according to any one of 43 to 46, a step of storing in advance in a storage means, as the preferred position information, information capable of identifying the position of the second imaging means that captured the image of the monitoring target location when constructing learning data to be used for detecting an event by image processing the image generated by the first imaging means; A computer-readable recording medium having recorded thereon a program for causing a computer to execute a procedure for reading and acquiring the preferred position information from the storage means. 48. In the recording medium according to 47, A computer-readable recording medium having recorded thereon a program for causing a computer to execute a procedure for storing the suitable position information in the storage means in the form of an image indicating an area where the first imaging means can be installed. 49. In the recording medium according to 47. or 48., A computer-readable recording medium having recorded thereon a program for causing a computer to execute a procedure for storing the preferred position information in the storage means as numerical data indicating the installation direction of the first imaging means relative to the position to be monitored. 50. The recording medium according to any one of items 43 to 49, the image generated by the first imaging means is used to detect an event; A computer-readable recording medium having recorded thereon a program for causing a computer to execute a procedure for acquiring the preferred position information for each of the events. 51. In the recording medium according to 50., A computer-readable recording medium having recorded thereon a program for causing a computer to execute a procedure for identifying the suitable installation location using the suitable location information for the plurality of events when the plurality of events are to be detected. 52. In the recording medium according to 50. or 51., A computer-readable recording medium having recorded thereon a program for causing a computer to execute a procedure of acquiring the event selection information and displaying the suitable installation position corresponding to the selected event. 53. In the recording medium according to any one of 50. to 52., A computer-readable recording medium having recorded thereon a program for causing a computer to execute a procedure for causing an output means to output, in response to the event, recommended information on the installation position of a third imaging means that images an area where the first imaging means can be installed. 54. In the recording medium according to any one of 43. to 53., a step of determining whether or not the first image capturing means is installed within the area indicated by the suitable installation position by processing the acquired image; A computer-readable recording medium having recorded thereon a program for causing a computer to execute a procedure of notifying that the first imaging means is installed within the area indicated by the preferred installation position based on the judgment result of the judgment procedure. 55. The recording medium according to any one of 43 to 54, A computer-readable recording medium having recorded thereon a program for causing a computer to execute a procedure for detecting an event by processing an image generated by the first imaging means using learning data. 56. In the recording medium according to any one of 43. to 55., The first imaging means is a movable wireless camera.

[0136] 57. To the computer, a step of acquiring suitable location information that can identify a suitable installation location of a first imaging means that monitors the location to be monitored; acquiring an image of an area where the first imaging means can be installed; a step of identifying the suitable installation position within the image using the suitable position information; a program for executing a procedure for displaying the identified suitable installation position on a display means by superimposing it on the image. 58. In the program described in 57., The image is an image taken from the monitored location. 59. In the program described in 58., The program, wherein the preferred position information indicates the photographing direction of the first imaging means based on the position of the monitored object. 60. In the program according to any one of items 57 to 59, The monitored location includes at least a portion of a shelf. 61. In the program according to any one of 57. to 60., a step of storing in advance in a storage means, as the preferred position information, information capable of identifying the position of the second imaging means that captured the image of the monitoring target location when constructing learning data to be used for detecting an event by image processing the image generated by the first imaging means; a program for causing a computer to execute a procedure for reading and acquiring the preferred position information from the storage means; 62. In the program described in 61., a program for causing a computer to execute a procedure for storing the suitable position information in the storage means in the form of an image showing an area where the first imaging means can be installed; 63. In the program described in 61. or 62., A program for causing a computer to execute a procedure for storing the suitable position information in the storage means as numerical data indicating the installation direction of the first imaging means with respect to the position to be monitored. 64. In the program according to any one of 57. to 63., the image generated by the first imaging means is used to detect an event; A program for causing a computer to execute a procedure for acquiring the preferred position information for each of the events. 65. In the program described in 64., When a plurality of events are to be detected, the program causes a computer to execute a procedure for identifying the suitable installation position using the suitable position information for the plurality of events. 66. In the program described in 64. or 65., a program for causing a computer to execute a procedure of acquiring the event selection information and displaying the suitable installation position corresponding to the selected event; 67. In the program according to any one of 64. to 66., a program for causing a computer to execute a procedure for causing an output unit to output, in response to the event, recommended information on the installation position of a third imaging unit that images an area where the first imaging unit can be installed; 68. In the program according to any one of 57. to 67., a step of determining whether or not the first image capturing means is installed within the area indicated by the suitable installation position by processing the acquired image; a program for causing a computer to execute a procedure for notifying that the first imaging means is installed within the area indicated by the suitable installation position, based on a determination result of the procedure for determining; 69. In the program according to any one of 57. to 68., A program for causing a computer to execute a procedure for detecting an event by processing the image generated by the first imaging means using learning data. 70. In the program described in any one of paragraphs 57 to 69, The program, wherein the first imaging means is a movable wireless camera. [Explanation of symbols]

[0137] 1. Surveillance System 3. Communication Network 5 Display shelf 7 items 10 Positioning camera 20 Event detection cameras 22 Educational Camera 30 Operation terminal 32 Display 34 Camera 50 image planes 100 Monitoring equipment 102 Location information acquisition unit 104 Image acquisition unit 106 Specific part 108 Display processing unit 110 Memory Processing Unit 112 Output Processing Unit 114 Judgment section 116 Information Department 120 Preferred location information storage device 130 Event detection unit 132 Camera communication unit 134 AI side communication department 150 Image processing device 160 Recognition Model 200 screens 210, 210a, 210b, 210c, 210d Suitable installation areas 1000 computers 1010 Bus 1020 processor 1030 memory 1040 Storage Device 1050 Input / Output Interface 1060 Network Interface

Claims

1. a position information acquiring means for acquiring suitable position information capable of identifying a suitable installation position of the imaging means for monitoring the position to be monitored; image acquisition means for acquiring an image of an area where the imaging means can be installed; a specifying means for specifying the suitable installation position within the image using the suitable position information; a display processing means for displaying the identified suitable installation position on the image on a display means, the image is an image taken from the monitored location, A monitoring device, wherein the preferred position information indicates the photographing direction of the imaging means based on the position of the monitored object.

2. a position information acquiring means for acquiring suitable position information capable of identifying a suitable installation position of the imaging means for monitoring the position to be monitored; image acquisition means for acquiring an image of an area where the imaging means can be installed; a specifying means for specifying the suitable installation position within the image using the suitable position information; a display processing means for displaying the identified suitable installation position on the image on a display means, The monitoring device, wherein the monitored location includes at least a portion of a product shelf.

3. a position information acquiring means for acquiring suitable position information capable of identifying a suitable installation position of the imaging means for monitoring the position to be monitored; image acquisition means for acquiring an image of an area where the imaging means can be installed; a specifying means for specifying the suitable installation position within the image using the suitable position information; a display processing means for displaying the identified suitable installation position on the image on a display means; a storage processing means for storing in advance in a storage means, as the preferred position information, information capable of identifying the position of the imaging means that has imaged the location to be monitored, when constructing learning data to be used for detecting an event by image processing the image generated by the imaging means; The position information acquisition means reads and acquires the preferred position information from the storage means.

4. a position information acquiring means for acquiring suitable position information capable of identifying a suitable installation position of the imaging means for monitoring the position to be monitored; image acquisition means for acquiring an image of an area where the imaging means can be installed; a specifying means for specifying the suitable installation position within the image using the suitable position information; a display processing means for displaying the identified suitable installation position on the image on a display means, the image generated by the imaging means is used to detect an event; The location information acquisition means acquires the preferred location information for each event.

5. a second imaging means for imaging an area from the monitoring target position where a first imaging means for monitoring the monitoring target position can be installed; a storage means for storing suitable position information that can identify a suitable installation position of the first imaging means; A display means; a location information acquiring means for acquiring the preferred location information from the storage means; an image acquisition means for acquiring an image of an area where the first imaging means can be installed, the image being captured by the second imaging means; a specifying means for specifying the suitable installation position within the image using the suitable position information; a display processing means for displaying the identified suitable installation position on the display means by superimposing the image; Equipped with the image is an image taken from the monitored location, A surveillance system, wherein the preferred position information indicates the photographing direction of the imaging means based on the position of the object to be monitored.

6. a second imaging means for imaging an area from the monitoring target position where a first imaging means for monitoring the monitoring target position can be installed; a storage means for storing suitable position information that can identify a suitable installation position of the first imaging means; A display means; a location information acquiring means for acquiring the preferred location information from the storage means; an image acquisition means for acquiring an image of an area where the first imaging means can be installed, the image being captured by the second imaging means; a specifying means for specifying the suitable installation position within the image using the suitable position information; a display processing means for displaying the identified suitable installation position on the display means by superimposing the image; Equipped with A monitoring system, wherein the monitored location includes at least a portion of a store shelf.

7. 7. The monitoring system according to claim 5, a storage processing means for storing in advance in the storage means, as the preferred position information, information capable of identifying the position of the third imaging means that has imaged the location to be monitored, when constructing learning data to be used for detecting an event by image processing the image generated by the first imaging means; The location information acquisition means reads and acquires the preferred location information from the storage means.

8. One or more computers acquiring suitable location information that can identify a suitable installation location for the imaging means that monitors the location to be monitored; Acquire an image of an area where the imaging means can be installed; Using the preferred position information, the preferred installation position is identified within the image; displaying the identified suitable installation position on the image on a display means; the image is an image taken from the monitored location, A monitoring method, wherein the preferred position information indicates an imaging direction of the imaging means based on the position of the monitored object.

9. One or more computers acquiring suitable location information that can identify a suitable installation location for the imaging means that monitors the location to be monitored; Acquire an image of an area where the imaging means can be installed; Using the preferred position information, the preferred installation position is identified within the image; displaying the identified suitable installation position on the image on a display means; The method of monitoring, wherein the monitored location includes at least a portion of a shelf.

10. On the computer, a step of acquiring suitable location information that can identify a suitable installation location of the imaging means for monitoring the location to be monitored; a step of acquiring an image of an area where the imaging means can be installed; a step of identifying the suitable installation position within the image using the suitable position information; a step of displaying the identified suitable installation position on the image on a display means; the image is an image taken from the monitored location, The program, wherein the preferred position information indicates the photographing direction of the imaging means based on the position of the monitored object.

11. On the computer, a step of acquiring suitable location information that can identify a suitable installation location of the imaging means for monitoring the location to be monitored; a step of acquiring an image of an area where the imaging means can be installed; a step of identifying the suitable installation position within the image using the suitable position information; a step of displaying the identified suitable installation position on the image on a display means; The monitored location includes at least a portion of a shelf.

Images