Monitoring device, monitoring system, program, and monitoring method

Abstract

Provided are a monitoring device, a monitoring system, a program and a monitoring method which make it possible to improve the convenience of a service for monitoring belongings. A monitoring system equipped with a camera provided in a store, an individual terminal in the possession of a user of the store, and a monitoring device for receiving a store image captured by the camera and communicating with the individual terminal, wherein said monitoring device is set to a monitoring mode for monitoring an item on the basis of a command from the individual terminal to start monitoring, an image of an item specified via the individual terminal of the user or an image region specified via said individual terminal is set as the monitoring target in the camera image, and an abnormality is detected if movement of the target item depicted in the image captured by the camera is detected while set to the monitoring mode.

Description

[Technical field]

[0001] The present disclosure relates to a monitoring device, a monitoring system, a program, and a monitoring method. [Background technology]

[0002] Patent Document 1 discloses an order terminal for self-ordering installed in a store such as a restaurant. A customer of the store uses the order terminal to specify a package on a table or seat. The order terminal can monitor whether the specified package has been moved based on a camera image. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2016-173840 Summary of the Invention [Problem to be solved by the invention]

[0004] However, the order terminal described in Patent Document 1 is installed on a table in a store. If a user leaves the table, the user cannot specify the package that he or she wishes to monitor. This reduces the convenience of the package monitoring service.

[0005] The present disclosure has been made to solve the above-mentioned problems. An object of the present disclosure is to provide a monitoring device, a monitoring system, a program, and a monitoring method that can improve the convenience of a service for monitoring luggage. [Means for solving the problem]

[0006] The monitoring device according to the present disclosure is a monitoring device that receives video of a store, which is a series of images captured by a camera installed in the store, and communicates with a personal terminal carried by a user of the store, and includes a mode setting unit that sets a monitoring mode for monitoring an object based on a command to start monitoring from the personal terminal, a target setting unit that sets, as a monitoring target, an image of a target to be monitored that is specified from the personal terminal among the images captured by the camera, or a region of an image captured by the camera in which the target to be monitored is shown that is specified from the personal terminal of the user, and a movement detection unit that detects an abnormality when it detects that the target shown in the video captured by the camera has moved when the monitoring mode is set by the mode setting unit, and a store display unit that displays an image of the camera capturing the target of monitoring on the store terminal when a command to display the target of monitoring is received from a store terminal installed in the store while the monitoring mode is set; Equipped with:

[0007] The monitoring system according to the present disclosure includes a camera installed in a store, a personal terminal carried by a user of the store, and a monitoring device that receives a video of the store, which is a series of images captured by the camera, and communicates with the personal terminal; A store terminal provided in the store; The monitoring device sets a monitoring mode for monitoring an object based on a command to start monitoring from the personal terminal, sets an image of an object to be monitored that is specified from the personal terminal among images captured by the camera, or a region of an image captured by the camera in which the object to be monitored is shown and that is specified from the personal terminal of the user, as an object to be monitored, and when the monitoring mode is set and it is detected that the object shown in the image captured by the camera has moved, detects an abnormality. and when a command to display the object is received from the store terminal while the monitoring mode is set, the store terminal is caused to display an image of the object captured by the camera. . In addition, the monitoring system according to the present disclosure includes a camera installed in a store, a personal terminal carried by a user of the store, and a monitoring device that receives a video of the store, which is a series of images captured by the camera, and communicates with the personal terminal; A notice is provided in the store, which indicates that the monitoring device is providing a luggage monitoring service for monitoring items owned by the user. and , Equipped with picture The monitoring device sets a monitoring mode for monitoring an object based on a command to start monitoring from the personal terminal, and sets as the monitoring target an image of the object to be monitored that is specified from the personal terminal among the images captured by the camera, or an area of ​​the image captured by the camera in which the object to be monitored is shown that is specified from the user's personal terminal, and when the monitoring mode is set, if it detects that the object shown in the image captured by the camera has moved, it detects an abnormality.

[0008] The program according to the present disclosure includes a mode setting step of receiving video of the store, which is a series of images captured by a camera installed in the store, and setting a monitoring mode to monitor an object based on a command from a personal terminal carried by a user of the store to start monitoring in a computer that communicates with the personal terminal; an object detection step of setting an image of an object to be monitored that is specified from the personal terminal among the images captured by the camera installed in the store, or an area of ​​an image captured by the camera in which the object to be monitored is shown and that is specified from the personal terminal of the user, as the object to be monitored; and a movement detection step of detecting an abnormality when it is detected that the object shown in the image captured by the camera has moved when the monitoring mode is set by the mode setting step. a store display step of displaying an image of the camera photographing the target of monitoring on the store terminal when a command to display the target of monitoring is received from a store terminal installed in the store while the monitoring mode is set by the mode setting step; Execute the command.

[0009] The monitoring method according to the present disclosure includes a mode setting step of setting a monitoring mode for monitoring an object based on a command to start monitoring from a personal terminal carried by a user of a store, an object detection step of setting an image of an object to be monitored that is specified from the personal terminal among images captured by the camera or an area of ​​an image captured by the camera in which an object to be monitored is shown and that is specified from the personal terminal of the user, as an object to be monitored, and a movement detection step that is performed after the object detection step and detects an abnormality if it is detected that the object shown in the image captured by the camera has moved when the monitoring mode is set by the mode setting step. a store display step of displaying an image of the target being watched on the store terminal when a command to display the target being watched is received from a store terminal installed in the store while the monitoring mode is set by the mode setting step; Equipped with: Effect of the Invention

[0010] According to the present disclosure, a target to be monitored is set in response to a command from a user's personal terminal, thereby improving the convenience of the package monitoring service. [Brief description of the drawings]

[0011] [Figure 1] 1 is a diagram showing an overview of a store to which a monitoring system in a first embodiment is applied. [Diagram 2] FIG. 2 is a diagram showing an outline of the operation performed by the watching system in the first embodiment. [Diagram 3] 1 is a block diagram of a monitoring system according to a first embodiment. [Figure 4] 4 is a flowchart for explaining an overview of the operation of the monitoring system in the first embodiment. [Diagram 5] 1 is a hardware configuration diagram of a monitoring device of a monitoring system in accordance with embodiment 1. FIG. [Figure 6] FIG. 2 is a block diagram of a first modified example of the watching system in the first embodiment. [Figure 7] 10 is a flowchart for explaining an overview of the operation of a first modified example of the watching system in the first embodiment. [Figure 8] FIG. 11 is a block diagram of a second modified example of the watching system in the first embodiment. [Figure 9] 13 is a flowchart for explaining an overview of the operation of the second modified example of the watching system in the first embodiment. [Figure 10] FIG. 11 is a block diagram of a third modified example of the watching system in the first embodiment. [Figure 11] 13 is a flowchart for explaining an overview of the operation of the third modified example of the watching system in the first embodiment. [Figure 12] FIG. 13 is a block diagram of a fourth modified example of the watching system in the first embodiment. [Figure 13] 13 is a flowchart for explaining an overview of the operation of a fourth modified example of the watching system in the first embodiment. [Figure 14] FIG. 13 is a block diagram of a fifth modified example of the watching system in the first embodiment. [Figure 15] 13 is a flowchart for explaining an overview of the operation of the fifth modified example of the watching system in the first embodiment. [Figure 16] FIG. 11 is a diagram showing an object before the monitoring system in the second embodiment is applied. [Figure 17]FIG. 11 is a diagram showing a covering body of a monitoring system in accordance with a second embodiment. [Figure 18] 11 is a diagram showing a main part of a covering body of a monitoring system in accordance with a second embodiment. FIG. [Figure 19] FIG. 11 is a block diagram of a watching system in a second embodiment. [Figure 20] 11 is a flowchart for explaining an overview of the operation of the monitoring system in the second embodiment. [Figure 21] FIG. 11 is a diagram showing a monitoring card of the monitoring system in the third embodiment. [Figure 22] FIG. 11 is a diagram showing a monitoring card of the monitoring system in the third embodiment. [Figure 23] FIG. 13 is a diagram showing the blinking pattern of light emitted by a monitoring tag of the monitoring system in embodiment 3. [Figure 24] FIG. 11 is a block diagram of a monitoring system according to a third embodiment. [Diagram 25] 11 is a flowchart for explaining an overview of the operation of the monitoring system in the third embodiment. [Figure 26] 13 is a flowchart for explaining an overview of the operation of a first modified example of the watching system in the third embodiment. [Figure 27] FIG. 13 is a diagram showing a monitoring card of a second modified example of the monitoring system in the third embodiment. [Figure 28] 13 is a flowchart for explaining an overview of the operation of a second modified example of the watching system in the third embodiment. [Figure 29] FIG. 13 is a diagram showing a monitoring card of a third modified example of the monitoring system in the third embodiment. [Diagram 30] FIG. 13 is a block diagram of a third modified example of the watching system in the third embodiment. [Diagram 31] 13 is a flowchart for explaining an overview of the operation of a third modified example of the watching system in the third embodiment. [Diagram 32] FIG. 13 is a diagram showing a monitoring card of a fourth modified example of the monitoring system in the third embodiment. [Diagram 33]FIG. 11 is a block diagram of a fourth modified example of the watching system in the third embodiment. [Diagram 34] 13 is a flowchart for explaining an overview of the operation of a fourth modified example of the watching system in the third embodiment. [Diagram 35] FIG. 13 is a diagram showing a desk of a monitoring system in accordance with a fourth embodiment. [Diagram 36] FIG. 13 is a block diagram of a monitoring system in a fourth embodiment. [Figure 37] 13 is a flowchart for explaining an overview of the operation of the monitoring system in the fourth embodiment. [Figure 38] FIG. 13 is a diagram showing a desk in a first modified example of the watching system in the fourth embodiment. [Figure 39] 13 is a flowchart for explaining an overview of the operation of a first modified example of the watching system in the fourth embodiment. [Diagram 40] 13 is a flowchart for explaining an overview of the operation of a second modified example of the watching system in the fourth embodiment. [Diagram 41] FIG. 13 is a diagram showing an example of a desk design in the monitoring system according to the fourth embodiment. [Diagram 42] 13 is a flowchart for explaining an overview of the operation of a third modified example of the watching system in the fourth embodiment. [Diagram 43] 13 is a flowchart for explaining an overview of the operation of a fourth modified example of the watching system in the fourth embodiment. [Diagram 44] FIG. 13 is a block diagram of a monitoring system in embodiment 5. [Diagram 45] 13 is a flowchart for explaining an overview of the operation of the monitoring system in the fifth embodiment. [Diagram 46] 13 is a flowchart for explaining an overview of the operation of a modified example of the watching system in embodiment 5. [Figure 47] FIG. 23 is a block diagram of a monitoring system in a sixth embodiment. [Figure 48]23 is a flowchart for explaining an overview of the operation of the monitoring system in the sixth embodiment. [Figure 49] FIG. 23 is a block diagram of a monitoring system in embodiment 7. [Figure 50] 22 is a flowchart for explaining an overview of the operation of the monitoring system in the seventh embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0012] The embodiments for carrying out the present disclosure will be described with reference to the accompanying drawings. In each drawing, the same or corresponding parts are denoted by the same reference numerals. The duplicated description of the parts will be appropriately simplified or omitted.

[0013] Embodiment 1 FIG. 1 is a diagram showing an overview of a store to which the monitoring system according to the first embodiment is applied.

[0014] In Fig. 1, a monitoring system 1 provides a luggage monitoring service that monitors a user's luggage. The monitoring system 1 is installed in a store 2. For example, the store 2 is a shared office, a cafe, or the like. For example, in the store 2, a user occupies a desk in the store and performs tasks such as work, study, etc. In the store 2, a store terminal 3, multiple cameras 4, and a bulletin board 6 are provided.

[0015] For example, the store terminal 3 is a personal computer. The store terminal 3 may launch a store application for the luggage monitoring service. For example, the store terminal 3 is provided at an employee counter in the store 2. The store terminal 3 may also be a device such as a tablet-type mobile terminal. The multiple cameras 4 are security cameras in the store 2. Each of the multiple cameras 4 may capture video of the interior of the store 2. The video is treated as a continuous image. The notice 6 is a poster printed with a notice that the monitoring system 1 has been introduced in the store 2 and that a luggage monitoring service is being provided. The notice 6 is put up in the store 2. A two-dimensional notice code 6a is displayed on the notice 6.

[0016] For example, the personal terminal 5 is a smartphone-type mobile terminal. The personal terminal 5 is carried by a user of the store 2. The personal terminal 5 can start a personal application for using the luggage monitoring service.

[0017] The monitoring device 10 is installed in a building different from the store 2. The monitoring device 10 can communicate with a store terminal 3, a plurality of cameras 4, and a personal terminal 5 via a network.

[0018] A store use screen, which is a store-side interface screen for the luggage monitoring service, is displayed on the store terminal 3 based on the information received from the monitoring device 10. An employee of the store 2 monitors the store use screen.

[0019] When a user of the store 2 uses the luggage monitoring service, the user accesses the monitoring device 10 from the personal terminal 5. The monitoring device 10 displays a usage screen, which is a personal interface screen for the luggage monitoring service, on the screen of the personal terminal 5. The user uses the luggage monitoring service by performing operations such as checking the usage screen displayed on the personal terminal 5 and inputting information into designated fields on the usage screen.

[0020] Next, the operation performed in the monitoring system 1 will be described with reference to FIG. FIG. 2 is a diagram showing an outline of the operation performed by the monitoring system in the first embodiment.

[0021] Figure 2 (a) to (d) show the situations that may arise when using the luggage monitoring service.

[0022] FIG. 2(a) shows "Step 1" when using the luggage monitoring service. Items A and B are owned by the user. Of the multiple cameras 4, camera 4a captures items A and B. When using the luggage monitoring service, the user inputs information that identifies store 2 on the usage screen displayed on personal terminal 5. On the usage screen, multiple images captured by the multiple cameras 4 in store 2 are displayed. The user selects the image from camera 4a.

[0023] FIG. 2(b) shows the usage screen of the personal terminal 5 on which the image of the camera 4a is displayed as "Step 2" when using the luggage monitoring service. The user designates the object A and the object B as the objects to be monitored on the usage screen. Specifically, for example, the user designates the area on the usage screen where the object A and the object B are displayed by an operation such as swiping on the screen. At this time, the user designates the area including the objects A and B, which are the objects. For example, the user may designate the object A and the object B as the objects to be monitored by tapping the screen on which the object A and the object B are displayed. After that, the user instructs the start of the monitoring mode on the usage screen. When the object is designated, a list of objects that are candidates for the object may be displayed on the usage screen. In this case, the user may designate the object A and the object B as the objects to be monitored by selecting the object A and the object B from the list.

[0024] FIG. 2(c) shows the interior of store 2 as "Step 3" when using the luggage monitoring service. After instructing the user to start the monitoring mode, the user moves away from items A and B. For example, the user orders a product at the employee counter. For example, the user goes to the restroom. Although not shown, at this time, the employee can check the image from camera 4a through the screen displayed on store terminal 3. The user can check the image from camera 4a through personal terminal 5.

[0025] FIG. 2(d) shows the interior of the store 2 and the usage screen of the personal terminal 5 as "Step 4" when using the luggage monitoring service. In "Step 4", for example, a person other than the user lifts the user's item B with the intention of stealing it. In this case, the monitoring device 10, not shown in FIG. 2, detects that the position of the monitored object B has changed based on the image of the camera 4a. The monitoring device 10 issues an alarm to the store terminal 3 and the personal terminal 5. The user checks the alarm that the item B has moved and the image of the camera 4a on the usage screen of the personal terminal 5. The employee of the store 2 checks the alarm that the item B has moved and the image of the camera 4a on the store usage screen of the store terminal 3. For example, the employee takes action in response to the alarm, such as talking to the other person.

[0026] Next, the monitoring system 1 will be described with reference to FIG. FIG. 3 is a block diagram of the monitoring system according to the first embodiment.

[0027] Fig. 3 shows devices in the monitoring system 1 that are related to the store 2 shown in Fig. 1. The monitoring system 1 includes a store terminal 3, multiple cameras 4, a camera database 11, a personal terminal 5, and a monitoring device 10. Although not shown, when the monitoring system 1 is applied to a store other than the store 2, the monitoring system 1 includes a store terminal 3 and cameras 4 provided in the other store. Furthermore, although not shown, when multiple users use the luggage monitoring service, the monitoring system 1 includes multiple personal terminals 5 carried by the multiple users.

[0028] For example, a storage medium that stores the camera database 11 is provided in the same building as the monitoring device 10. The camera database 11 stores information that associates identification information of the cameras included in the monitoring system 1 with information about the store where the cameras are installed.

[0029] The store terminal 3 includes a communication unit 3a, a display unit 3b, an input unit 3c, a sound output unit 3d, and an operation unit 3e.

[0030] The communication unit 3a communicates with the watching device 10. The display unit 3b displays information to a person. For example, the display unit 3b is a liquid crystal display. The input unit 3c accepts information input from a person. For example, the input unit 3c is a mouse and keyboard of a personal computer. The sound output unit 3d emits sound. For example, the sound output unit 3d is a speaker.

[0031] The operation unit 3e controls the store application. The operation unit 3e displays a store usage screen on the display unit 3b based on information received from the watching device 10. The operation unit 3e receives information input to the input unit 3c. The operation unit 3e transmits the input information to the watching device 10 via the communication unit 3a. The operation unit 3e causes the display unit 3b and the sound output unit 3d to issue an alarm based on the information received from the watching device 10. Specifically, when a command to issue an alarm is received, the operation unit 3e causes the display unit 3b to display that an alarm has been received. The operation unit 3e causes the sound output unit 3d to issue a sound indicating an alarm.

[0032] The multiple cameras 4 include a camera 4a and a camera 4b. Each of the multiple cameras 4 transmits to the watching device 10 information in which information on the captured image is associated with information for identifying the camera 4.

[0033] The personal terminal 5 includes a communication unit 5a, a display unit 5b, an input unit 5c, a sound output unit 5d, and an operation unit 5e.

[0034] The communication unit 5a communicates with the watching device 10. The display unit 5b displays information to a person. For example, the display unit 5b is a touch panel type liquid crystal display. The input unit 5c accepts information input from a person. For example, the input unit 5c is a touch panel tactile sensor. The sound output unit 5d emits sound. For example, the sound output unit 5d is a speaker.

[0035] The operation unit 5e controls a personal application for using the luggage monitoring service. The operation unit 5e displays a usage screen on the display unit 5b based on information received from the monitoring device 10. The operation unit 5e receives information input to the input unit 5c. The operation unit 5e transmits the input information to the monitoring device 10 via the communication unit 5a. The operation unit 5e causes the display unit 5b and the sound output unit 5d to issue an alarm based on the information received from the monitoring device 10. Specifically, when a command to issue an alarm is received, the operation unit 5e causes the display unit 5b to display that an alarm has been received. The operation unit 5e causes the sound output unit 5d to issue a sound indicating an alarm.

[0036] The monitoring device 10 identifies the store 2 in which the camera 4 is installed based on the information stored in the camera database 11. The monitoring device 10 includes a memory unit 10a, a store display unit 10b, a personal display unit 10c, a target setting unit 10d, a mode setting unit 10e, a movement detection unit 10f, and an alarm unit 10g.

[0037] The storage unit 10a stores information about the target of monitoring. The information about the target of monitoring is information that associates identification information of the store 2 in which the target of monitoring is set, identification information of the camera 4 that captures the image of the target of monitoring, identification information of the personal terminal 5 that specifies the target of monitoring, and information about the area of ​​the image that is set as the target of monitoring. When the target of monitoring is an image of an object, the information about the image of the object is associated with the target of monitoring information, not information about the area of ​​the image that is set as the target of monitoring.

[0038] The information on the object to be watched may be associated with location identification information that identifies the location of the object. For example, the location identification information is coordinate information of the object in the image of the camera 4. The location identification information may be information that indicates the external characteristics of the image of the object in the image of the camera 4.

[0039] The store display unit 10b creates information for a store use screen to be displayed on the store terminal 3. The store display unit 10b receives information from the store terminal 3 via the store use screen.

[0040] Specifically, for example, the store display unit 10b creates store usage screen information on which the image from the camera 4 is displayed. In the image, the target of monitoring is marked by, for example, being surrounded by a frame. The store display unit 10b may create store usage screen information that also includes information on the user who uses the monitoring service. For example, the user information is the ID information of the user's personal terminal 5. In this case, the target of monitoring may also be displayed with the corresponding ID information in the image.

[0041] The personal display unit 10c receives information such as identification information of the specified store 2, identification information of the specified camera 4, information designating an area of ​​the image of the camera 4 including an object as a monitoring object, information on the set object, a command to start monitoring, etc. from the personal terminal 5 via the usage screen. For example, the personal display unit 10c accepts instructions input to the personal terminal 5 via the usage screen.

[0042] The personal display unit 10c displays information on the personal terminal 5 by creating usage screen information to be displayed on the personal terminal 5 based on an instruction from the personal terminal 5. Specifically, for example, when a command to display a monitoring target set by the personal terminal 5 is received from the personal terminal 5, the personal display unit 10c creates usage screen information in which an image of the monitoring target, captured by the camera 4, is displayed. In the image, the monitoring target is marked, for example, by being surrounded by a frame. When the monitoring target is being watched, the personal display unit 10c creates usage screen information in which it is displayed that the monitoring target is being watched.

[0043] When a command to designate an area of ​​an image captured by the camera 4 as a target to be watched over is received from the personal terminal 5 via the usage screen, the target setting unit 10d sets the area of ​​the image as a target to be watched over. When the target setting unit 10d sets a target to be watched over, it creates information about the target to be watched over and stores it in the storage unit 10a.

[0044] The target setting unit 10d may set an image of an object in the image of the camera 4 as the image of the target. In this case, the target setting unit 10d may detect an image of the object in the image of the camera 4. For example, the target setting unit 10d detects an image of a notebook computer, a bag, a desk, etc. in the image of the camera 4. When a command to designate an object as a target of monitoring is received from the personal terminal 5, the target setting unit 10d identifies the image of the object and sets the image of the object as the target of monitoring. When the target setting unit 10d sets a target of monitoring, it creates information of the target of monitoring corresponding to the target and stores it in the storage unit 10a.

[0045] When a command to start watching is received from the personal terminal 5, the mode setting unit 10e starts watching over the watching target associated with the personal terminal 5. Specifically, the mode setting unit 10e sets a watching mode. When a command to cancel watching is received from the personal terminal 5, the mode setting unit 10e cancels the watching mode over the watching target associated with the personal terminal 5.

[0046] When the position of the object moves, the movement detection unit 10f detects that the position of the object captured by the camera 4 has moved by analyzing the image of the camera 4. Specifically, the movement detection unit 10f performs differential analysis only on the changes that have occurred within the area of ​​the image that is the object of monitoring. That is, the movement detection unit 10f compares the image of the area of ​​the image set as the object of monitoring with the image of the corresponding area of ​​the image received from the camera 4, and analyzes only whether or not a difference has occurred in the image. When the movement detection unit 10f detects that the image of the area of ​​the image has changed, it detects that the position of the object has moved. For example, the position of the object moves when a person's movement, a disturbance such as wind, or the like acts on the object. When the movement detection unit 10f detects that the position of the object has moved, it detects an abnormality.

[0047] When an image of an object is set as the object to be watched over, the movement detection unit 10f detects a change in the image of the object in the image of the camera 4 by image difference analysis. At this time, the movement detection unit 10f performs the same operation as when an image area is set as the object to be watched over.

[0048] When the movement detection unit 10f detects an abnormality, the alarm unit 10g transmits a command to issue an alarm notifying the occurrence of the abnormality to the store terminal 3 of the store 2 and the personal terminal 5 associated with the watching target.

[0049] Next, the operations performed in the luggage monitoring service will be described with reference to FIG. FIG. 4 is a flowchart for explaining an outline of the operation of the monitoring system in the first embodiment.

[0050] FIG. 4 shows the operation of the luggage monitoring service performed by the monitoring system 1.

[0051] In step S101, the personal display unit 10c of the watching device 10 determines whether or not access has been received from the personal terminal 5 for the luggage watching service.

[0052] In step S101, if no access has been received from the personal terminal 5, the personal display section 10c repeats the operation of step S101.

[0053] If it is determined in step S101 that access has been received, the operation of step S102 is performed. In step S102, the personal display unit 10c creates information for a usage screen to be displayed on the personal terminal 5. The personal display unit 10c accepts input of identification information for the store 2 from the personal terminal 5. The personal display unit 10c accepts a selection of either the cameras 4a or 4b from the personal terminal 5. The personal display unit 10c displays an image captured by the camera 4 selected from the cameras 4a and 4b on the usage screen. Note that when accepting the selection of the camera, the personal display unit 10c may display the images captured by the cameras 4a and 4b on the usage screen, respectively.

[0054] After that, the operation of step S103 is performed. In step S103, the personal display unit 10c determines whether or not a watching target has been specified on the personal terminal 5.

[0055] If a watching target is not specified in step S103, the personal display unit 10c repeats the operation of step S103.

[0056] When a watching target is designated in step 103, the operation of step S104 is performed. In step S104, the target setting unit 10d creates information on the watching target with the designated image area or object image as the watching target. The personal display unit 10c judges whether or not the start of watching has been instructed on the personal terminal 5.

[0057] If an instruction to start watching has not been issued in step S104, the operation of step S104 is repeated.

[0058] When the start of watching is instructed in step S104, the operation of step S105 is performed. In step S105, the mode setting unit 10e sets the watching mode.

[0059] Thereafter, the operation of step S106 is performed. In step S106, the personal display unit 10c determines whether or not a command has been received from the personal terminal 5 to display the video of the target being watched over.

[0060] If it is determined in step S106 that the command to display the video of the target being watched over has not been received from the personal terminal 5, the operation of step S107 is performed. In step S107, the store display unit 10b determines whether or not the command to display the video of the target being watched over has been received from the store terminal 3.

[0061] In step S107, if it is determined that a command to display the video of the target being watched over has not been received from the store terminal 3, the operation of step S108 is performed. In step S108, the movement detection unit 10f determines whether the target has moved.

[0062] If no movement of the target object is detected in step S108, the operation of step 109 is performed. In step S109, the mode setting unit 10e determines whether or not a command to stop watching has been received from the personal terminal 5.

[0063] If it is determined in step S109 that a command to stop watching has not been received, the operations in and after step S106 are performed.

[0064] If it is determined in step S109 that a command to cancel the monitoring mode has been received, the operation of step S110 is performed. In step S110, the mode setting unit 10e cancels the monitoring mode.

[0065] Thereafter, the monitoring system 1 ends its operation.

[0066] If it is determined in step S106 that a command to display the video of the watching target has been received from the personal terminal 5, the operation of step S111 is performed. In step S111, the personal display unit 10c displays the video showing the watching target on the personal terminal 5. Thereafter, the operations from step S107 onwards are performed.

[0067] If it is determined in step S107 that a command to display the video of the watching target has been received from the store terminal 3, the operation of step S112 is performed. In step S112, the store display unit 10b displays the video showing the watching target on the store terminal 3. Thereafter, the operations from step S108 onwards are performed.

[0068] In step S108, if the movement detection unit 10f detects the movement of the object, the operation of step 113 is performed. In step S113, the movement detection unit 10f detects an abnormality. The alarm unit 10g transmits a command to the store terminal 3 and the personal terminal 5 to issue an alarm that an abnormality has occurred in the object.

[0069] Then, the operation of step S114 is performed. In step S114, the store terminal 3 issues an alarm. The personal terminal 5 issues an alarm. Then, the watching system 1 ends its operation.

[0070] According to the above-described first embodiment, the monitoring device 10 includes a mode setting unit 10e, a target setting unit 10d, and a movement detection unit 10f. The monitoring device 10 sets the image area or the image of the target specified by the personal terminal 5 as the monitoring target. The monitoring device 10 detects an abnormality when the object set as the monitoring target moves. Even if the user is in a location away from the luggage and his / her seat, the user can set the luggage as the monitoring target by operating the personal terminal 5. That is, even if the user forgets to set the luggage as the monitoring target and leaves his / her seat, the user can set the luggage as the monitoring target. This improves the convenience of the luggage monitoring service.

[0071] Furthermore, the monitoring device 10 detects that the object has moved when the image of the object being monitored or the image of the area of ​​the image changes in the image from the camera 4. This makes it possible to detect the movement of the object based on the image information from the camera 4. Furthermore, when a change is detected by image difference analysis, the movement of the object can be detected with a small amount of calculation.

[0072] The monitoring device 10 also includes an alarm unit 10g. When an abnormality is detected in the object, the monitoring device 10 issues an alarm to the store terminal 3 and the personal terminal 5. For example, the user can receive the alarm at the personal terminal 5. Therefore, when an abnormality is detected, the employees and users of the store 2 can know that an abnormality has occurred in the object. For example, the employees or users can take action such as heading to the location of the object where the abnormality has occurred. As a result, crime prevention is improved. Here, consider a case where the order terminal described in Patent Document 1 is installed. When the order terminal detects that the luggage has been moved, it displays a warning and issues a warning voice. In this case, if the user of the store is located away from his / her seat, he / she cannot know that the warning has been output. According to the monitoring device 10 of the present embodiment, a warning is issued to the user's personal terminal 5, so crime prevention can be improved. As a result, the user can easily get up from his / her seat without worrying about theft or the like, leaving his / her luggage at his / her seat.

[0073] The watching device 10 also includes a personal display unit 10c. The watching device 10 accepts the specification of an object to be set as a target or the specification of an area of ​​an image to be watched on the usage screen of the personal terminal 5 on which the image captured by the camera 4 is displayed. This allows the user to more accurately specify an object to be set as a target.

[0074] Furthermore, the watching device 10 displays the image of the camera 4 capturing the object of watching on the personal terminal 5 based on a command from the personal terminal 5. This allows the user to monitor and check the state of the object of watching from a location away from his / her own desk. As a result, the user can feel at ease.

[0075] The monitoring device 10 also includes a store display unit 10b. Based on a command from the store terminal 3, the monitoring device 10 causes the store terminal 3 to display an image captured by the camera 4 capturing an image of the object being monitored. This allows store employees to check the condition of the object. As a result, crime prevention is improved.

[0076] The monitoring system 1 also includes a bulletin board 6. The bulletin board 6 notifies the public that a monitoring service is being provided in the store 2. This makes it possible to notify people who intend to commit crimes such as baggage pickpocketing that there is a high risk of them committing a crime in the store 2. As a result, crimes can be deterred.

[0077] It should be noted that the monitoring system 1 does not necessarily have to include the store terminal 3 and the camera database 11.

[0078] The luggage monitoring service may be provided through a web browser rather than a dedicated application. In this case, the store terminal 3 may display a store usage screen through the web browser. The operation unit 3e of the store terminal 3 may transmit and receive information to and from the monitoring device 10 through software that controls the web browser. The personal terminal 5 may display a usage screen through the web browser. The operation unit 5e of the personal terminal 5 may transmit and receive information to and from the monitoring device 10 through software that controls the web browser.

[0079] The watching device 10 may be provided in the same building as the store 2. The watching device 10 may be built into the store terminal 3.

[0080] The camera database 11 may be a database that exists on a cloud server. The camera database 11 may be provided in a building separate from the monitoring device 10. In this case, the camera database 11 may be divided and stored in multiple storage media provided in different locations.

[0081] It should be noted that the notice board 6 does not have to be provided in the monitoring system 1, and does not have to be provided in the store 2.

[0082] In addition to the bulletin board 6, a bulletin board image indicating that the monitoring system 1 has been introduced in the store 2 may be displayed on a public relations website for the store 2.

[0083] Next, an example of hardware constituting the watching device 10 will be described with reference to FIG. FIG. 5 is a hardware configuration diagram of the watching device of the watching system in the first embodiment.

[0084] Each function of the watching device 10 can be realized by a processing circuit. For example, the processing circuit includes at least one processor 100a and at least one memory 100b. For example, the processing circuit includes at least one dedicated hardware 200.

[0085] When the processing circuit includes at least one processor 100a and at least one memory 100b, each function of the watching device 10 is realized by software, firmware, or a combination of software and firmware. At least one of the software and firmware is written as a program. At least one of the software and firmware is stored in at least one memory 100b. The at least one processor 100a realizes each function of the watching device 10 by reading and executing the program stored in the at least one memory 100b. The at least one processor 100a is also called a central processing unit, processing unit, arithmetic unit, microprocessor, microcomputer, or DSP. For example, the at least one memory 100b is a non-volatile or volatile semiconductor memory such as a RAM, a ROM, a flash memory, an EPROM, or an EEPROM, a magnetic disk, a flexible disk, an optical disk, a compact disk, a mini disk, a DVD, or the like.

[0086] When the processing circuit includes at least one dedicated hardware 200, the processing circuit is realized, for example, by a single circuit, a composite circuit, a programmed processor, a parallel programmed processor, an ASIC, an FPGA, or a combination thereof. For example, each function of the monitoring device 10 is realized by a processing circuit. For example, each function of the monitoring device 10 is realized collectively by a processing circuit.

[0087] Some of the functions of the monitoring device 10 may be realized by dedicated hardware 200, and the remaining parts may be realized by software or firmware. For example, the function of analyzing image differences may be realized by a processing circuit as the dedicated hardware 200, and functions other than the function of analyzing image differences may be realized by at least one processor 100a reading and executing a program stored in at least one memory 100b. This may be more feasible.

[0088] In this way, the processing circuitry realizes each function of the watching device 10 by hardware 200, software, firmware, or a combination of these.

[0089] Although not shown, each function of the store terminal 3 is also realized by a processing circuit equivalent to the processing circuit that realizes each function of the monitoring device 10. Although not shown, each function of the personal terminal 5 is also realized by a processing circuit equivalent to the processing circuit that realizes each function of the monitoring device 10.

[0090] The program included in the monitoring system 1 may execute steps equivalent to each function of the monitoring device 10. For example, the program may cause the monitoring device 10 to execute a mode setting step, an object detection step, and a movement detection step. In the mode setting step, the monitoring device 10 sets a monitoring mode for monitoring an object based on a command to start monitoring from the personal terminal 5. In the object detection step, the monitoring device 10 sets the image area or the image of the object specified from the user's personal terminal 5 as the monitoring target. In the movement detection step, the monitoring device 10 detects an abnormality if it detects that an object captured in the video captured by the camera 4 has moved while the monitoring mode is set.

[0091] The watching device 10 also provides a luggage watching service using a watching method. The watching method includes steps corresponding to each function of the watching device 10. For example, the watching method includes a mode setting step, an object detection step, and a movement detection step.

[0092] Next, a first modified example of the watching system 1 in the first embodiment will be described with reference to FIG. 6 and FIG. Fig. 6 is a block diagram of a first modified example of the watching system in accordance with Embodiment 1. Fig. 7 is a flowchart for explaining an outline of the operation of the first modified example of the watching system in accordance with Embodiment 1.

[0093] As shown in FIG. 6, in the first modification of the first embodiment, the watching device 10 further includes an approach detection unit 10h.

[0094] The approach detection unit 10h detects the positions of people and objects captured in the image captured by the camera 4. The approach detection unit 10h detects that a person or object is present within a specified distance from the target based on the image captured by the camera 4. The approach detection unit 10h detects an abnormality when a person or object is present within a specified distance from the target for a specified period of time or longer. Note that when the area of ​​the image is set as a monitoring target, the approach detection unit 10h may consider the distance on the image from the center of the area of ​​the image to the person or object as the distance between the person or object and the target.

[0095] When the approach detection unit 10h detects an abnormality, the alarm unit 10g transmits a command to issue an alarm notifying the occurrence of the abnormality to the store terminal 3 of the store 2 and the personal terminal 5 associated with the watching target.

[0096] As shown in Fig. 7, in the first modified example, steps S101 to S107, step S111, and step S112 of the flowchart are the same as those of the flowchart in Fig. 4. That is, if it is determined in step S106 that a command to display the video of the target being watched has been received from the personal terminal 5, the operation of step S111 is performed. After the operation of step S111 is performed, the operation of step S107 is performed. If it is determined in step S107 that a command to display the video of the target being watched has been received from the store terminal 3, the operation of step S112 is performed.

[0097] If it is determined in step S107 that a command to display the video of the target being watched has not been received from the store terminal 3, or if the operation of step S112 has been performed, the operation of step S115 is performed. In step S115, the approach detection unit 10h of the watching device 10 determines whether or not a person or object has been present within a specified distance from the target for a specified period of time or longer.

[0098] If it is determined in step S115 that the time during which the person and object are present within the specified distance from the target does not exceed the specified time, the operation of step S109 is performed. Steps S109 to S110 are the same as those in the flowchart of FIG.

[0099] If it is determined in step S115 that a person or object has been present within a specified distance from the target object for a specified period of time or longer, the operations in and after step S113 are performed. Steps S113 to S114 are the same as those in the flowchart of FIG.

[0100] According to the first modification of the first embodiment described above, the watching device 10 includes the approach detection unit 10h. Therefore, the watching device 10 can detect an abnormality before the object being watched moves and issue an alarm. As a result, crimes such as theft can be prevented before they occur.

[0101] In the first modified example, the watching device 10 may detect an abnormality when it detects that the position of the target object has moved. In this case, for example, the operation of step S108 may be performed when no abnormality is detected in step S115 of FIG.

[0102] Next, a second modified example of the watching system 1 in the first embodiment will be described with reference to FIGS. Fig. 8 is a block diagram of a second modified example of the watching system in accordance with Embodiment 1. Fig. 9 is a flowchart for explaining an outline of the operation of the second modified example of the watching system in accordance with Embodiment 1.

[0103] As shown in FIG. 8, in the second modification of the first embodiment, the watching device 10 further includes a motion detector 10i.

[0104] The motion detection unit 10i detects the motion of a person attempting to pick up an object by detecting the motion of the person captured in the image of the camera 4. Specifically, the motion detection unit 10i analyzes the motion of the person's skeleton based on the image of the camera 4. For example, the motion detection unit 10i analyzes the motion of the person's skeleton to identify each part of the person, such as the tip of the person's hand, the joints of the arm and the shoulder. In this case, the motion detection unit 10i may use a skeleton analysis program such as "bone print". The motion detection unit 10i detects that the person is attempting to pick up an object based on the identified motion of the person's hand and arm. For example, the motion of a person attempting to pick up an object may be a motion of a person reaching for an object, a motion of a person trying to reach for an object, or the like.

[0105] When a person is present within a specified distance from an object, if the motion detection unit 10i detects a motion of the person attempting to pick up an object, the approach detection unit 10h detects an abnormality.

[0106] As shown in FIG. 9, in the second modified example, steps S101 to S107, S111, and S112 of the flowchart are the same as those of the flowchart in FIG.

[0107] If it is determined in step S107 that a command to display the video of the target being watched has not been received from the store terminal 3, or if the operation of step S112 has been performed, the operation of step S116 is performed. In step S116, the approach detection unit 10h of the watching device 10 determines whether or not the operation detection unit 10i has detected the operation of a person attempting to pick up an object when the person is within a specified distance from the target object.

[0108] In step S116, if a person is not present within the specified distance from the object, or if a person is present within the specified distance from the object and a motion of the person attempting to pick up the object is not detected, the operation of step S109 is performed. Steps S109 to S110 are the same as those in the flowchart of FIG.

[0109] In step S116, if a motion of a person attempting to pick up an object within a specified distance from the object is detected, the operation of step S113 is performed. Steps S113 to S114 are the same as those in the flowchart of FIG.

[0110] According to the second modification of the first embodiment described above, the monitoring device 10 includes an approach detection unit 10h and a motion detection unit 10i. When the monitoring device 10 detects a motion of a person attempting to take an object from within a specified distance of the object, the monitoring device 10 detects an abnormality. Therefore, it is possible to detect only a person who approaches the object with the intention of taking an object. As a result, it is possible to suppress false alarms that are issued in response to the movement of a person who has no intention of stealing or the like.

[0111] In addition, the watching device 10 detects the movement of the person trying to reach for an object by analyzing the skeletal movement of the person captured in the image of the camera 4. This makes it possible to detect the movement of the person more accurately.

[0112] The watching device 10 may perform both the operation of the embodiment 1 and the operation of the first modified example of the embodiment 1. Specifically, when the watching device 10 does not detect an abnormality in S116 in the flowchart of Fig. 9, the watching device 10 may perform the operation of step S108 in the flowchart of Fig. 4 and the operation of step S115 in the flowchart of Fig. 7.

[0113] Next, a third modified example of the watching system 1 in the first embodiment will be described with reference to Figs. Fig. 10 is a block diagram of a third modified example of the watching system in accordance with Embodiment 1. Fig. 11 is a flowchart for explaining an outline of the operation of the third modified example of the watching system in accordance with Embodiment 1.

[0114] As shown in FIG. 10, the storage unit 10a stores user characteristic information. The characteristic information is information indicating the user's external characteristics such as height, clothing, face, etc. The characteristic information is stored in advance in the storage unit 10a. The characteristic information may be created by the personal display unit 10c based on the content input by the user to the usage screen. The characteristic information may be created by the personal display unit 10c based on an image showing the registered user.

[0115] The approach detection unit 10h analyzes the video of the camera 4 based on the feature information stored in the storage unit 10a to determine whether or not a person within a specified distance from the target is a user designated as a target to be watched. If the approach detection unit 10h determines that the person is a user, it does not detect an abnormality even if it detects that a person is within a specified distance from the target.

[0116] As shown in FIG. 11, in the third modified example, steps S101 to S107 and S115 of the flowchart are the same as those of the flowchart in FIG.

[0117] If it is determined in step S115 that a person or object has been present within a specified distance from the target object for a specified period of time or longer, the operation of step S117 is performed. In step S117, the approach detection unit 10h of the monitoring device 10 determines whether the person present within the specified distance from the target object is a person and whether the person is the user who specified the target object.

[0118] If it is determined in step S117 that a person present within a prescribed distance from the object is the user who specified the object, the operation of step S109 is performed. Steps S109 to S110 are the same as those in the flowchart of FIG.

[0119] In step S117, if it is determined that the object within the specified distance from the target is an object, or if it is determined that the person within the specified distance from the target is not the user who specified the target, the operation of step S113 is performed. Steps S113 to S114 are the same as those in the flowchart of FIG.

[0120] According to the third modification of the first embodiment described above, the monitoring device 10 does not detect an abnormality even after a specified time has elapsed if a person who is present within a specified distance from an object is a user corresponding to the object. This makes it possible to prevent an abnormality from being detected when, for example, a person who has designated his / her own object as a target to watch over returns to his / her seat.

[0121] The third modification may be applied to the second modification. Specifically, in the second modification, even if the approach detection unit 10h detects a person who has made an action of trying to pick up an object, if the approach detection unit 10h determines that the person is a user, the approach detection unit 10h may not detect the occurrence of an abnormality. For this reason, for example, it is possible to suppress detection of an abnormality when a person who has specified an object to be watched makes an action of picking up the object. Also, in the third modification, the movement detection unit 10f may detect that the object has moved, as in the second modification.

[0122] Next, a fourth modified example of the watching system 1 in the first embodiment will be described with reference to Figs. Fig. 12 is a block diagram of a fourth modified example of the watching system in accordance with Embodiment 1. Fig. 13 is a flowchart for explaining an outline of the operation of the fourth modified example of the watching system in accordance with Embodiment 1.

[0123] As shown in FIG. 12, in the fourth modified example, the storage unit 10a stores information on the video when a warning is issued.

[0124] When the alarm unit 10g transmits a command to issue an alarm to the store terminal 3 and the personal terminal 5 to notify them that an abnormality has occurred, the alarm unit 10g stores in the memory unit 10a information on the image captured by the camera 4 showing the monitored subject in which the abnormality has been detected. The alarm unit 10g may store in the memory unit 10a information on the image captured by the camera 4 showing the monitored subject in which the abnormality has been detected.

[0125] As shown in FIG. 13, in the fourth modified example, steps S101 to S114 of the flowchart are the same as those of the flowchart in FIG.

[0126] After step S114, the operation of step S118 is performed. In step S118, the alarm unit 10g of the monitoring device 10 stores in the storage unit 10a the information on the video image of the camera 4 showing the monitoring target in which the abnormality has been detected. Thereafter, the monitoring system 1 ends the operation.

[0127] According to the fourth modification of the first embodiment described above, the monitoring device 10 stores information on the video or image captured by the camera 4 showing the monitored object when an alarm is issued. This makes it possible to leave a record of the object being stolen by a person. As a result, this can contribute to proving crimes such as theft.

[0128] The watching device 10 may perform a combination of the operations of the first modified example, the second modified example, and the third modified example of embodiment 1. Specifically, when no abnormality is detected in S108 in the flowchart of Fig. 13, the watching device 10 may perform the operation of step S115 in the flowchart of Fig. 7, the operation of step S116 in the flowchart of Fig. 9, and the operations from step S115 to step S117 in the flowchart of Fig. 9.

[0129] Next, a fifth modified example of the watching system 1 in the first embodiment will be described with reference to Figs. Fig. 14 is a block diagram of a fifth modified example of the watching system in accordance with Embodiment 1. Fig. 15 is a flowchart for explaining an outline of the operation of the fifth modified example of the watching system in accordance with Embodiment 1.

[0130] Although not shown in FIG. 14, a two-dimensional posting code 6a is displayed on the posting body 6. For example, the two-dimensional posting code 6a is a QR code (registered trademark). The two-dimensional posting code 6a indicates access information for accessing the monitoring device 10 from the personal terminal 5. Specifically, for example, the access information is a URL of a usage screen. For example, the access information is a URL for automatically launching a personal application for using the luggage monitoring service.

[0131] A two-dimensional code similar to the two-dimensional code 6a may be displayed as part of a notice image posted on a website for public relations of the store 2. A URL or the like may be displayed as access information in the notice image.

[0132] As shown in FIG. 14, in the fifth modified example, the personal terminal 5 includes a reading unit 5f.

[0133] For example, the reading unit 5f has a camera. The reading unit 5f can capture an image showing a two-dimensional code such as a QR code (registered trademark). When the reading unit 5f captures the two-dimensional posted code 6a, it extracts access information from the two-dimensional posted code 6a in the captured image.

[0134] When the reading unit 5f extracts the access information, the personal terminal 5 accesses the usage screen.

[0135] As shown in the flowchart of FIG. 15, in step S119, the reader 5f of the personal terminal 5 determines whether or not the posted two-dimensional code 6a has been read.

[0136] In step S119, if the reading unit 5f has not read the posted two-dimensional code 6a, the personal terminal 5 repeats the operation of step S119.

[0137] In step S119, if the reading unit 5f reads the posted two-dimensional code 6a, the operations from step S102 onwards are carried out. Step S102 onwards in the flowchart are the same as step S102 onwards in the flowchart of FIG.

[0138] According to the fifth modification of the first embodiment described above, the bulletin board 6 of the monitoring system 1 has a two-dimensional bulletin code 6a. Therefore, the user can access the luggage monitoring service by reading the two-dimensional bulletin code 6a with the personal terminal 5. As a result, the convenience for the user can be improved. The user experience (UX) of the luggage monitoring service can be improved.

[0139] Embodiment 2 Fig. 16 is a diagram showing an object before the monitoring system in embodiment 2 is applied. Fig. 17 is a diagram showing a covering body of the monitoring system in embodiment 2. Fig. 18 is a diagram showing a main part of the covering body of the monitoring system in embodiment 2. Note that parts that are the same as or equivalent to parts in embodiment 1 are given the same reference numerals. Explanation of these parts will be omitted.

[0140] 16, multiple objects C, D, E, and F are placed on a desk. In the monitoring system 1 of the first embodiment, the monitoring device 10 (not shown in FIG. 16) detects the multiple objects C, D, E, and F, and monitors each of them as a monitoring target.

[0141] FIG. 17 shows the covering body 20 in the second embodiment. For example, the covering body 20 is a cloth having a specific pattern. The form of the covering body 20 is not limited to the form of cloth as long as it has the property of covering an object. For example, a plurality of covering bodies 20 are prepared in the store 2. In FIG. 17, a user of the luggage monitoring service covers a plurality of objects C, D, E, and F shown in FIG. 16 with the covering body 20. The user uses the personal terminal 5 to set the covering body 20 as a target object.

[0142] 17 sets the covered body 20 as the target and monitors the covered body 20. Specifically, the monitoring device 10 sets the image of the covered body 20 as the monitored target. Note that the monitoring device 10 may set a region of an image including the image of the covered body 20 as the monitored target.

[0143] FIG. 18 shows a portion of the covering body 20. The covering body 20 has a specific characteristic pattern that is an identifiable unique pattern. For example, the specific characteristic pattern is a pattern consisting of at least one combination of a regular pattern, an irregular pattern, and colors. The covering body 20 has a covering body two-dimensional code 20a. The covering body two-dimensional code 20a is provided on a portion of the covering body 20. For example, the covering body two-dimensional code 20a is a QR code (registered trademark). The covering body two-dimensional code 20a indicates covering body access information. For example, the covering body access information is information in which a URL for accessing the monitoring device 10 is associated with identification information of the covering body 20.

[0144] For example, a user photographs the covered object two-dimensional code 20a with a personal terminal 5 not shown in Fig. 18. The personal terminal 5 extracts the covered object access information and accesses the monitoring device 10 not shown in Fig. 18. In this case, although not shown, the monitoring device 10 identifies a camera 4 that photographs the covered object 20 corresponding to the covered object access information. An image of the camera 4 photographing the corresponding covered object 20 is displayed on the personal terminal 5.

[0145] Next, the monitoring system 1 will be described with reference to FIGS. Fig. 19 is a block diagram of the watching system in the embodiment 2. Fig. 20 is a flowchart for explaining an outline of the operation of the watching system in the embodiment 2.

[0146] As shown in Fig. 19, the monitoring system 1 further includes a covered body database 21. Note that the covered body 20 is not shown in Fig. 19.

[0147] For example, a storage medium that stores the covering body database 21 is provided in the same building as the monitoring device 10. The covering body database 21 stores covering body information in which identification information of the covering body 20 registered in the monitoring system 1, identification information of the store 2 where the covering body 20 is prepared, and pattern information of the covering body 20 are associated with each other.

[0148] In the personal terminal 5, the reading unit 5f extracts the covered object access information from the image of the covered object two-dimensional code 20a. The operation unit 5e of the personal terminal 5 transmits the covered object access information to the watching device 10. The operation unit 5e accesses the usage screen created by the watching device 10.

[0149] When the watching device 10 receives the covered object access information, the personal display unit 10c displays the image of the camera 4 showing the covered object 20 on the usage screen corresponding to the personal terminal 5 based on the covered object access information.

[0150] When the monitoring device 10 receives the covered body access information, the target setting unit 10d analyzes the image of the covered body 20 captured by the camera 4 based on the covered body information in the covered body database 21, thereby identifying the identification information of the covered body 20. Thereafter, the target setting unit 10d sets the covered body 20 as the object to be monitored. In this case, the target setting unit 10d sets the image of the covered body 20 as the target to be monitored. Note that after setting the covered body 20 as the object to be monitored, the target setting unit 10d may set the area of ​​the image of the camera 4 that includes the image of the covered body 20 as the target to be monitored.

[0151] As shown in FIG. 20, in step S201, the personal terminal 5 determines whether or not the reading unit 5f has read the two-dimensional code 20a on the covering body.

[0152] In step S201, if the reader 5f has not read the two-dimensional code 20a on the covering, the personal terminal 5 repeats the operation of step S201.

[0153] In step S201, when the reading unit 5f reads the two-dimensional code 20a of the covered body, the operation of step S202 is performed. In step S202, the monitoring device 10 displays an image of the covered body 20 on the usage screen. The monitoring device 10 sets the image of the covered body 20 as the monitoring target.

[0154] Then, the operation of step S203 is performed. The operations performed from step S203 to S204 are the same as the operations performed from step S104 to S105 in the flowchart of FIG.

[0155] After step S204, the operation of step S205 is performed. The operations performed from step S205 to step S209 are the same as the operations performed from step S108 to step S110 and the operations performed from step S113 to S114 in the flowchart of Fig. 4. After step S207 or step S209, the monitoring system 1 ends its operation.

[0156] Note that between steps S204 and S205, the operations performed in steps S106 and S107 and the operations performed in steps S111 and S112 in the flowchart of FIG. 4 may be performed.

[0157] According to the above-described second embodiment, the monitoring system 1 includes the covering body 20. The monitoring device 10 detects the registered covering body 20 from the image of the camera 4. The monitoring device 10 sets the image of the covering body 20 or the area of ​​the image including the image of the covering body 20 as the monitoring target. Therefore, the amount of calculation processing performed by the monitoring device 10 to detect the target object from the image of the camera 4 is reduced. As a result, the accuracy of monitoring the target object is improved. In addition, the covering body 20 is placed on the object to be monitored. Therefore, for example, a relatively small object such as a wallet or a smartphone can be monitored via the covering body 20. In addition, multiple objects can be monitored via one covering body 20. As a result, the amount of calculation processing of the monitoring device 10 is reduced.

[0158] In addition, the monitoring system 1 may only set the covering body 20 as an object that can be set as a monitoring target. In this case, the amount of calculation processing performed by the monitoring device 10 to detect the object from the image of the camera 4 can be reduced. Also, the accuracy of monitoring can be improved. Also, it is possible to prevent a user from arbitrarily setting another person's object as a monitoring target.

[0159] In addition, the covering body 20 has a unique pattern. Therefore, the monitoring device 10 can easily detect the covering body 20 from the image captured by the camera 4.

[0160] Moreover, the covered body 20 has a covered body two-dimensional code 20a indicating covered body access information. When the monitoring device 10 receives covered body access information from the personal terminal 5, it sets the image of the corresponding covered body 20 or the area of ​​the image including the image of the covered body 20 as the monitoring target. Therefore, the user can set the target by simply reading the covered body two-dimensional code 20a with the personal terminal 5. That is, the user does not need to access the usage screen and specify the target on the usage screen or specify the area of ​​the image in which the target is reflected. As a result, the user can use the luggage monitoring service via a simple user interface (UI). The UX comfort of the luggage monitoring service for the user can be improved.

[0161] Embodiment 3 21 is a diagram showing a monitoring tag of a monitoring system in accordance with embodiment 3. Note that the same or corresponding parts as those in embodiment 1 or 2 are denoted by the same reference numerals, and a description of these parts will be omitted.

[0162] As shown in Fig. 21, the monitoring system 1 further includes a plurality of monitoring tags 30. However, Fig. 21 shows only one of the plurality of monitoring tags 30.

[0163] For example, each of the multiple monitoring tags 30 is a plate having a specific pattern. For example, the words "luggage being monitored" are written on each of the multiple monitoring tags 30. The multiple monitoring tags 30 are prepared in the store 2. Each of the multiple monitoring tags 30 has a two-dimensional tag code 31. For example, the two-dimensional tag code 31 is a QR code (registered trademark). The two-dimensional tag code 31 indicates tag access information. For example, the tag access information is information in which a URL for accessing the monitoring device 10 is associated with identification information of the monitoring tag 30.

[0164] Although not shown in FIG. 21 , the monitoring device 10 detects the monitoring tag 30 by analyzing the pattern of the monitoring tag 30 captured in the image captured by the camera 4. The monitoring device 10 displays a list of the multiple monitoring tags 30 prepared in the store 2 on the usage screen. The list of the multiple monitoring tags 30 also displays information indicating whether each of the multiple monitoring tags 30 is being used by other users. The user selects the monitoring tag 30 that he or she placed on the usage screen displayed on the personal terminal 5. The monitoring device 10 displays an image captured by the camera 4 that captures the selected monitoring tag 30 on the usage screen. The user can designate an object captured on the usage screen that is within a specified distance from the monitoring tag 30 as the object to be watched.

[0165] Next, an example of the watch tag 30 will be described with reference to FIG. FIG. 22 is a diagram showing a monitoring tag of the monitoring system in the third embodiment.

[0166] FIG. 22 shows monitoring tags 30a, 30b, 30c, 30d, and 30e as examples of the monitoring tags 30.

[0167] 22(a), the watch tag 30a is a watch tag that is identified by a unique pattern. When multiple watch tags 30a exist, each of the multiple watch tags 30a has a unique pattern.

[0168] As shown in (b) and (c) of Fig. 22, the watch tag 30b and the watch tag 30c are watch tags that are identified by their unique color and unique shape. Specifically, for example, the watch tag 30b is formed by folding a single board in two. The watch tag 30c has the shape of a traffic cone (registered trademark).

[0169] As shown in (d) of Fig. 22, the watch tag 30d has a light source 32d. For example, the light source 32d is an LED. The watch tag 30d is a watch tag that is identified by the blinking pattern of the light source 32d. The light source 32d may be a light source that emits light of multiple colors.

[0170] As shown in (e) of FIG. 22, the watch tag 30e has a first light source 33e, a second light source 34e, and a third light source 35e. For example, the first light source 33e, the second light source 34e, and the third light source 35e are LEDs. The first light source 33e, the second light source 34e, and the third light source 35e all emit yellow, red, and green light. The watch tag 30e is a watch tag that is identified by the blinking patterns of the first light source 33e, the second light source 34e, and the third light source 35e.

[0171] Next, examples of blinking patterns of the monitoring tags 30d and 30e will be described with reference to FIG. FIG. 23 is a diagram showing a blinking pattern of light emitted by a monitoring tag of the monitoring system in the third embodiment.

[0172] Figure 23 shows three blinking patterns (a), (b), and (c) as examples of blinking patterns. (a), (b), and (c) in Figure 23 show one cycle of the blinking patterns (a), (b), and (c), respectively. For example, the blinking patterns (a), (b), and (c) are repeated a specified number of times.

[0173] FIG. 23(a) shows blinking pattern (a) of light source 32d of monitoring tag 30d. Blinking pattern (a) is a pattern in which a single color of light is turned on or off. Light source 32d is turned on or off for a specific period of time in the order indicated by arrow X. For example, the line "On: 1.0 sec" indicates that light source 32d is continuously turned on for 1.0 second.

[0174] FIG. 23(b) shows a blinking pattern (b) of light source 32d that emits light of multiple colors. Blinking pattern (b) is a pattern in which light of any one of yellow, red, and green is turned on or off. Light source 32d is turned on or off for a specific color and for a specific period of time in the order indicated by arrow Y. For example, the line "Yellow on: 0.5 seconds" indicates that light source 32d is turned on in yellow continuously for 0.5 seconds.

[0175] FIG. 23(c) shows a blinking pattern (c) of the first light source 33e, the second light source 34e, and the third light source 35e of the monitoring tag 30e. The blinking pattern (c) is a pattern in which a plurality of light sources are turned on or off in a specific color sequence. The first light source 33e, the second light source 34e, and the third light source 35e are turned on or off in a specific color and for a specific time in the sequence shown by the arrow Z, such as the combination shown by (first light source 33e, second light source 34e, third light source 35e). For example, the line "(yellow, red, green): 1.0 second" indicates that the first light source 33e is turned on in yellow, the second light source 34e is turned on in red, and the third light source is turned on in green for 1.0 second. For example, the line "(all lights on): 1.0 sec" indicates that the state in which the first light source 33e, the second light source 34e, and the third light source are turned off continues for 1.0 second.

[0176] Next, the monitoring system 1 will be described with reference to FIG. FIG. 24 is a block diagram of a monitoring system according to the third embodiment.

[0177] As shown in Fig. 24, the watching system 1 further includes a watching tag database 36. Note that the watching tag 30 is not shown in Fig. 24.

[0178] For example, a storage medium that stores the monitoring tag database 36 is provided in the same building as the monitoring device 10. The monitoring tag database 36 stores monitoring tag information in which identification information of the monitoring tag 30 registered in the monitoring system 1, identification information of the store 2 in which the monitoring tag 30 is prepared, and information that identifies the monitoring tag 30 are associated with each other. The information that identifies the monitoring tag 30 includes information indicating the pattern of the monitoring tag 30a, information indicating the combination of the shape and pattern of the monitoring tags 30b and 30c, information indicating the blinking pattern of the monitoring tags 30d and 30e, and the like.

[0179] The target setting unit 10d analyzes the image of the watch tag 30 captured by the camera 4 based on the watch tag information in the watch tag database 36 to identify the identification information of the watch tag 30. The target setting unit 10d can set only objects that are located within a specified distance from the watch tag 30 as objects corresponding to the watch tag 30. That is, the target setting unit 10d does not set objects that are located at a specified distance away from the watch tag 30 as objects corresponding to the watch tag 30. Specifically, the target setting unit 10d does not set the image of an object that is located at a specified distance away from the watch tag 30 as a watch target. Alternatively, the target setting unit 10d does not set an area of ​​the image that includes an image of an object that is located at a specified distance away from the watch tag 30 as a watch target. At this time, for example, the target setting unit 10d does not set an area of ​​the image that is located at a specified distance away from the image of the watch tag 30 as a watch target, thereby not setting an area of ​​the image that includes an image of an object that is located at a specified distance away from the watch tag 30 as a watch target.

[0180] When the monitoring device 10 is accessed from a personal terminal 5, the personal display unit 10c identifies the store 2 in which the personal terminal 5 is located. The personal display unit 10c displays a list of monitoring tags 30 prepared in the identified store 2 on the usage screen. At this time, the personal display unit 10c displays whether or not the monitoring tag 30 is being used by another user in association with the monitoring tag 30. When a monitoring tag 30 is selected on the usage screen, the personal display unit 10c displays an image of the camera 4 showing the selected monitoring tag 30 on the usage screen.

[0181] Next, the operations performed in the luggage monitoring service in the third embodiment will be described with reference to FIG. FIG. 25 is a flowchart for explaining an outline of the operation of the monitoring system in the third embodiment.

[0182] As shown in FIG. 25, in step S301, the personal display unit 10c of the watching device 10 determines whether or not access has been received from the personal terminal 5 for the luggage watching service.

[0183] In step S301, if there is no access from the personal terminal 5, the personal display section 10c repeats the operation of step S301.

[0184] If it is determined in step S301 that access has been received, the operation of step S302 is performed. In step S302, the personal display unit 10c displays a list of the multiple monitoring tags 30 prepared in the store 2 on the usage screen of the personal terminal 5.

[0185] Then, the operation of step S303 is performed. In step S303, the personal display unit 10c determines whether or not any one of the monitoring tags 30 has been selected from the list.

[0186] If it is determined in step S303 that the watch tag 30 has not been selected, the operation of step S303 is repeated.

[0187] If a watch tag 30 is selected in step S303, the operation of step S304 is performed. In step S304, the personal display unit 10c displays an image of the selected watch tag 30 on the usage screen of the personal terminal 5. After that, the personal display unit 10c judges whether or not a watch target has been selected. At this time, the target setting unit 10d does not accept an instruction to designate an image of an object located at a position farther away than a specified distance from the selected watch tag 30 or an area of ​​an image including an image of the object as a watch target.

[0188] If the watching target is not specified in step S304, the operation of step S304 continues.

[0189] When a watching target is designated in step S304, the operations from step S305 onwards are carried out. The operations carried out in steps S305 to S311 are the same as the operations carried out in steps S203 to S209 in the flowchart of FIG.

[0190] According to the above-described third embodiment, the monitoring system 1 includes a plurality of monitoring tags 30. The monitoring device 10 displays on the personal terminal 5 a usage screen that accepts the selection of one of the plurality of monitoring tags 30. This allows the user to easily select a monitoring tag 30.

[0191] In addition, the monitoring device 10 does not set as a target to be monitored an image of an object or an area of ​​an image including an image of the object that exists at a position that is farther away than a specified distance from the monitoring tag 30. This makes it possible to prevent a user from mistakenly setting another person's object as a target.

[0192] Furthermore, the monitoring tag 30 has a unique shape and a unique pattern. The monitoring device 10 identifies the monitoring tag 30 based on the shape and pattern of the monitoring tag 30 captured in the image of the camera 4. Therefore, the monitoring device 10 can identify the camera 4 that captures the monitoring tag 30 to be used without the user having to select the camera 4. As a result, the convenience of the luggage monitoring service is improved.

[0193] Furthermore, the monitoring tag 30 is equipped with one or more light sources that light up with a unique blinking pattern. The monitoring device 10 identifies the monitoring tag 30 based on the blinking pattern of the monitoring tag 30 captured in the image of the camera 4. Therefore, the monitoring device 10 can identify the camera 4 that captures the monitoring tag 30 to be used without the user having to select the camera 4. As a result, the convenience of the luggage monitoring service is improved.

[0194] Next, a first modification of the third embodiment will be described with reference to FIG. FIG. 26 is a flowchart for explaining an outline of the operation of the first modified example of the watching system in the third embodiment.

[0195] In a first modified example of the third embodiment, the user reads the two-dimensional tag code 31 of the monitoring tag 30 with the personal terminal 5. The reading unit 5f of the personal terminal 5 acquires tag access information from the image of the two-dimensional tag code 31. The personal terminal 5 accesses the monitoring device 10 based on the tag access information. At this time, the personal terminal 5 transmits the tag access information to the monitoring device 10.

[0196] When the monitoring device 10 receives the tag access information, the target setting unit 10d of the monitoring device 10 identifies the camera 4 that captures the monitoring tag 30 corresponding to the tag access information based on the monitoring tag information. The personal display unit 10c displays the video of the camera 4 that captures the monitoring tag 30 on the usage screen accessed by the personal terminal 5 based on the tag access information.

[0197] As shown in FIG. 26, in step S312 of the flowchart, the personal terminal 5 determines whether or not the two-dimensional code 31 on the card has been read.

[0198] If it is determined in step S312 that the two-dimensional code 31 on the card has not been read, the personal terminal 5 repeats the operation of step S312.

[0199] If it is determined in step S312 that the tag two-dimensional code 31 has been read, the operation of step S313 is performed. In step S313, the personal terminal 5 transmits tag access information to the monitoring device 10. The target setting unit 10d of the monitoring device 10 identifies the image of the camera 4 in which the monitoring tag 30 is captured. The personal display unit 10c displays the image of the camera 4 in which the monitoring tag 30 is captured on the usage screen of the personal terminal 5.

[0200] Then, the operations from step S304 onwards are carried out. Steps S304 to S311 are the same as steps S304 to S311 in the flowchart of FIG.

[0201] According to the first modified example of the third embodiment described above, the monitoring card 30 has a two-dimensional card code 31. When the personal terminal 5 reads the two-dimensional card code 31, it accesses the monitoring device 10. At this time, the personal terminal 5 transmits card access information indicated by the two-dimensional card code 31 to the monitoring device 10. The monitoring device 10 displays an image of the camera 4 showing the monitoring card 30 indicating the card access information on the usage screen. That is, the monitoring device 10 identifies the monitoring card 30 to be used by the user without accepting a selection from among multiple monitoring cards 30 on the usage screen. This improves user convenience.

[0202] Next, a second modified example of the watching system 1 according to the third embodiment will be described with reference to FIGS. Fig. 27 is a diagram showing a watching tag of a second modified example of the watching system in accordance with embodiment 3. Fig. 28 is a flowchart for explaining an outline of the operation of the second modified example of the watching system in accordance with embodiment 3.

[0203] As shown in FIG. 27, in the second modified example of the third embodiment, the user places a watching tag 30 on an object that the user wishes to watch over. The user operates the personal terminal 5 to designate the watching tag 30 as the object to be watched over. Although not shown, at this time, when a certain watching tag 30 is selected from the list of watching tags 30 on the usage screen, the watching device 10 sets the watching tag 30 as the object to be watched over. In this case, the watching device 10 sets the image of the watching tag 30 in the image of the camera 4 as the object to be watched over. Note that the watching device 10 may set the image area including the image of the watching tag 30 in the image of the camera 4 as the object to be watched over.

[0204] For example, when an object under a monitoring tag 30 set for a target object moves, the monitoring tag 30 moves together with the object. In this case, the monitoring device 10 detects an abnormality.

[0205] In FIG. 28, steps S301 to S303 are the same as steps S301 to S303 in the flowchart of FIG.

[0206] In step S303, when a monitoring tag 30 is selected from the list of monitoring tags 30, the operation of step S314 is performed. In step S314, the target setting unit 10d of the monitoring device 10 sets the image of the selected monitoring tag 30 or the area of ​​the image including the image of the monitoring tag 30 as the monitoring target. The personal display unit 10c displays the image of the camera 4 showing the selected monitoring tag 30 on the usage screen.

[0207] Then, the operations from step S305 onwards are carried out. Steps S305 to S311 are the same as steps S305 to S311 in the flowchart of FIG.

[0208] According to the second modification of the third embodiment described above, the watching device 10 sets the watching tag 30 selected on the usage screen of the personal terminal 5 as the target, and sets the image of the watching tag 30 or the area of ​​the image including the image of the watching tag 30 as the target to be watched. Therefore, the user can set the target without specifically selecting the object to be watched. For example, when the watching tag 30 placed on the object to be watched is set as the target, the same watching effect as when the object to be watched is being monitored is generated. As a result, the convenience for the user can be improved.

[0209] When the monitoring device 10 receives tag access information, it may set the monitoring tag 30 corresponding to the tag access information as the target, and set the image of the monitoring tag 30 or the area of ​​the image including the image of the monitoring tag 30 as the target to be watched. Therefore, the user can set the target without selecting the object that he or she wishes to watch.

[0210] Next, a third modified example of the watching system 1 according to the third embodiment will be described with reference to Figs. Fig. 29 is a diagram showing a monitoring tag of a third modified example of the monitoring system in accordance with embodiment 3. Fig. 30 is a block diagram of the third modified example of the monitoring system in accordance with embodiment 3. Fig. 31 is a flowchart for explaining an overview of the operation of the third modified example of the monitoring system in accordance with embodiment 3.

[0211] FIG. 29 shows monitoring tags 30c and 30d as examples of the monitoring tag 30.

[0212] As shown in Fig. 29(a), the monitoring tag 30c further includes a communicator 37c and a speaker 38c. The communicator 37c communicates with the monitoring device 10 (not shown in Fig. 29) via a network. The speaker 38c emits sound.

[0213] 29(b), the monitoring tag 30d further includes a communicator 37d and a speaker 38d. The communicator 37d communicates with the monitoring device 10 via the network. The speaker 38d emits sound.

[0214] As shown in FIG. 30, in the third modified example, the watch tag 30 is not limited to the shape shown in FIG.

[0215] When the alarm unit 10g detects an abnormality, that is, when sending a command to issue an alarm to the store terminal 3 and the personal terminal 5, the alarm unit 10g sends a command to issue an alarm to the communicator 37 of the monitoring tag 30. The monitoring tag 30 to which the alarm unit 10g sends a command is the monitoring tag 30 selected on the usage screen or the monitoring tag 30 set for the target object.

[0216] When the communication device 37 receives the command, it causes the speaker 38 to issue an alarm.

[0217] Fig. 31 shows a flowchart when a user accesses the monitoring system 1 via the tag two-dimensional code 31. Steps S312 to S309 are the same as steps S312 to S309 in the flowchart of Fig. 26. Also, step S310 is the same as step S310 in the flowchart of Fig. 26.

[0218] After the operation of step S310 is performed, the operation of step S315 is performed. In step S315, the alarm unit 10g of the monitoring device 10 further transmits a command to the monitoring tag 30 to issue an alarm indicating that an abnormality has occurred in the target object. The store terminal 3, the personal terminal 5, and the speaker 38 of the monitoring tag 30 issue an alarm. Thereafter, the monitoring system 1 ends its operation.

[0219] According to the third modification of the third embodiment described above, the watch tag 30 has a speaker 38. When the watch device 10 detects an abnormality in the object, it causes the speaker 38 to sound an alarm. At this time, the speaker 38 is the speaker 38 of the watch tag 30 selected on the usage screen or the speaker 38 of the watch tag 30 set for the object. Therefore, it is possible to inform people around the watch tag 30 that an abnormality has occurred. As a result, even when the user and the employees of the store 2 are not near the watch tag 30, the crime prevention effect can be achieved.

[0220] Next, a fourth modified example of the watching system 1 according to the third embodiment will be described with reference to Figs. Fig. 32 is a diagram showing a monitoring tag of a fourth modified example of the monitoring system in accordance with embodiment 3. Fig. 33 is a block diagram of the fourth modified example of the monitoring system in accordance with embodiment 3. Fig. 34 is a flowchart for explaining an overview of the operation of the fourth modified example of the monitoring system in accordance with embodiment 3.

[0221] As shown in FIG. 32, in the fourth modification of the third embodiment, the watching system 1 further includes a mobile camera 39.

[0222] The mobile camera 39 is provided on the monitoring tag 30. (a) and (b) of FIG. 32 show monitoring tags 30c and 30d, respectively, on which the mobile camera 39 is provided. The mobile camera 39 is a camera capable of capturing images of a wide range. Specifically, for example, the mobile camera 39 is a 360-degree camera or a wide-angle camera. The mobile camera 39 transmits information on the captured image to the monitoring device 10 via the communication device 37.

[0223] The user places the watch tag 30 so that the mobile camera 39 can capture the object he or she wishes to watch.

[0224] The watching device 10 uses the image from the mobile camera 39 in the same way as the image from the camera 4. That is, the user can operate the usage screen based on the image captured by the mobile camera 39.

[0225] Although not shown, the store 2 may be provided with only the mobile camera 39 without the camera 4 being installed.

[0226] 33, the camera database 11 stores information including information on the mobile camera 39. Specifically, the camera database 11 stores information in which the identification information of the mobile camera 39, the identification information of the monitoring tag 30 on which the mobile camera 39 is provided, and information on the store in which the mobile camera is installed are associated with each other.

[0227] The store display unit 10b can display the image from the camera 4 or the image from the mobile camera 39 on the store use screen of the store terminal 3.

[0228] FIG. 34 shows a flowchart for a case where a user accesses the monitoring system 1 via the two-dimensional tag code 31.

[0229] Step S312 is the same as step S312 in the flowchart of FIG.

[0230] If it is determined in step S312 that the two-dimensional card code 31 has been read, the operation of step S316 is performed. In step S316, the personal display unit 10c identifies the moving camera 39 that corresponds to the two-dimensional card code 31 based on the information stored in the camera database 11. The personal display unit 10c displays the image captured by the moving camera 39 that corresponds to the two-dimensional card code 31 on the usage screen of the personal terminal 5.

[0231] Thereafter, the operations from steps S304 to S315 are carried out. Steps S304 to S315 are the same as steps S304 to S315 in FIG.

[0232] According to the fourth modification of the third embodiment described above, the watch tag 30 includes a moving camera 39. The image of the moving camera 39 is treated in the same way as the image of the camera 4. That is, the watch system 1 executes the luggage watch service using the image of the moving camera 39. Therefore, the watch system 1 can provide the luggage watch service in a store where the camera 4 is not installed in advance. That is, when introducing the luggage watch service, it is not necessary to install a new camera. The manager of the store can easily introduce the luggage watch service to the store. In addition, the moving camera 39 can capture the object from a close distance at a seat far from the position of the camera 4 installed in advance. Therefore, in various cases, such as when the resolution of the camera 4 is low, when the object is located far from the camera 4, or when the object is located in a place where the camera 4 cannot capture it, the watch device 10 can use an image in which the object is clearly captured. As a result, the accuracy of monitoring the object can be improved.

[0233] Embodiment 4 35 is a diagram showing a desk of a monitoring system in accordance with embodiment 4. Note that the same reference numerals are used to designate parts that are the same as or equivalent to any of the parts in embodiments 1 to 3. Explanation of these parts will be omitted.

[0234] As shown in FIG. 35, in the fourth embodiment, the monitoring system 1 includes a plurality of desks 40. FIG. 35 shows one of the plurality of desks 40. The plurality of desks 40 are installed in a store 2. The plurality of desks 40 each have a two-dimensional desk code 40a. For example, the two-dimensional desk code 40a is a QR code (registered trademark). The two-dimensional desk code 40a indicates desk access information. For example, the desk access information is information in which a URL for accessing the monitoring device 10 is associated with identification information of the desk 40.

[0235] When a user wishes to use the luggage monitoring service while using a certain desk 40, the user reads the two-dimensional desk code 40a of the desk 40 with the personal terminal 5. The monitoring device 10, not shown in Fig. 35, displays an image of the desk 40 captured by the camera 4 on the user screen. The monitoring device 10 can set only objects that are within a specified distance from the desk 40 as objects to be monitored.

[0236] Next, the watching system 1 according to the fourth embodiment will be described with reference to Figs. Fig. 36 is a block diagram of the watching system in the embodiment 4. Fig. 37 is a flowchart for explaining an outline of the operation of the watching system in the embodiment 4.

[0237] As shown in Fig. 36, the watching system 1 further includes a desk database 41. Note that the desk 40 is not shown in Fig. 36.

[0238] For example, a storage medium that stores the desk database 41 is provided in the same building as the monitoring device 10. The desk database 41 stores desk information in which identification information of the desk 40 registered in the monitoring system 1, identification information of the store 2 in which the desk 40 is installed, and information identifying the desk 40 are associated with each other. For example, the information identifying the desk 40 includes information on the seat number of the desk 40, information on the position of the desk 40 within the store 2, information on the pattern of the desk 40, and the like.

[0239] When the monitoring device 10 receives desk access information, the target setting unit 10d identifies the camera 4 that captures the corresponding desk 40 based on the desk information in the desk database 41. The target setting unit 10d can set only an object that exists within a specified distance from the desk 40 as an object corresponding to the desk 40. That is, the target setting unit 10d does not set an image of an object that exists at a position farther away than the desk 40 than the specified distance as a monitoring target corresponding to the desk 40. In addition, the target setting unit 10d does not set an area of ​​an image that includes an image of an object that exists at a position farther away than the desk 40 than the specified distance as a monitoring target. At this time, for example, the target setting unit 10d does not set an area of ​​an image that is farther away from the image of the desk 40 than the specified distance on the image as a monitoring target, thereby not setting an area of ​​an image that includes an image of an object that is farther away from the desk 40 than the specified distance on the image as a monitoring target.

[0240] As shown in the flowchart of FIG. 37, in step S401, the personal terminal 5 determines whether or not the two-dimensional desk code 40a has been read.

[0241] In step S401, if the two-dimensional desk code 40a has not been read, the personal terminal 5 repeats the operation of step S401.

[0242] If it is determined in step S401 that the desk two-dimensional code 40a has been read, the operation of step S402 is performed. In step S402, the personal terminal 5 transmits desk access information to the monitoring device 10. The target setting unit 10d of the monitoring device 10 identifies the camera 4 that captures the desk 40 corresponding to the desk access information. The personal display unit 10c displays the image of the identified camera 4 on the usage screen of the personal terminal 5.

[0243] Then, the operation of step S403 is performed. In step S403, the target setting unit 10d determines whether or not a monitoring target has been specified. At this time, the target setting unit 10d accepts the specification of a monitoring target only for objects that exist within a specified distance from the desk 40.

[0244] If a watching target is not specified in step S403, the operation of step S403 is repeated.

[0245] When a watching target is designated in step S403, the operations from step S404 onwards are carried out. Here, the operations carried out from step S404 to S410 are the same as the operations carried out from step S305 to S311 in the flowchart of FIG. 25 in the third embodiment.

[0246] According to the fourth embodiment described above, the monitoring system 1 includes a plurality of desks 40. Each of the plurality of desks 40 has a two-dimensional desk code 40a. When the monitoring device 10 receives desk access information from a personal terminal 5, it displays an image of the camera 4 capturing an image of the corresponding desk 40 on the usage screen of the personal terminal 5. This allows the user to easily access the usage screen. As a result, convenience for the user is improved.

[0247] Furthermore, the monitoring device 10 does not set an image of an object that is located at a position that is farther away than a specified distance from the desk 40 corresponding to the desk access information, or an area of ​​an image that includes an image of the object, as a monitoring target. This makes it possible to prevent a user from mistakenly setting another person's object as a target.

[0248] Next, a first modified example of the watching system 1 according to the fourth embodiment will be described with reference to FIGS. Fig. 38 is a diagram showing a desk in a first modified example of the watching system in accordance with the embodiment 4. Fig. 39 is a flowchart for explaining an outline of the operation of the first modified example of the watching system in accordance with the embodiment 4.

[0249] 38, each of the plurality of desks 40 is provided with information for identifying the desk 40. For example, an identification number of the desk 40 is written on each of the plurality of desks 40.

[0250] Although not shown, the user inputs the identification number of the desk 40 to be occupied on the usage screen of the personal terminal 5. The personal display unit 10c of the watching device 10 accepts the input of the identification number of the desk 40 from the usage screen of the personal terminal 5.

[0251] Although not shown, the target setting unit 10d of the monitoring device 10 identifies the camera 4 that captures the desk 40 corresponding to the input identification number based on the desk information stored in the desk database 41. The target setting unit 10d detects a specified area set on the desk 40. For example, the specified area is the entire area on the desk. In this case, the target setting unit 10d sets the specified area in the image of the camera 4 as the monitoring target. At this time, an object that is to be the target is present in the specified area.

[0252] The target setting unit 10d may set the image of an object present within a specified area set on the desk 40 as the monitoring target. In this case, the target setting unit 10d detects a plurality of objects C, D, E, and F present within the specified area. The target setting unit 10d sets the images of the plurality of objects C, D, E, and F as the monitoring targets.

[0253] In step S411 of the flowchart in FIG. 39, the personal display unit 10c of the watching device 10 determines whether or not access has been received from the personal terminal 5 for the luggage watching service.

[0254] If it is determined in step S411 that no access has been received from the personal terminal 5, the personal display section 10c repeats the operation of step S411.

[0255] If it is determined in step S411 that access has been received, the operation of step S412 is performed. In step S412, the personal display unit 10c determines whether the identification number of the desk 40 has been input on the usage screen of the personal terminal 5.

[0256] If an identification number has not been input in step S412, the operation of step S412 is repeated.

[0257] If it is determined in step S412 that the identification number has been input, the operation of step S413 is performed. In step S413, the target setting unit 10d detects a specified area on the desk 40 in the image captured by the camera 4, and sets the detected area in the image of the camera 4 as a monitoring target.

[0258] Then, the operation of step S414 is performed. In step S414, the personal display unit 10c displays on the usage screen of the personal terminal 5 an image captured by the camera 4 that shows the desk 40 that corresponds to the access information.

[0259] Then, the operations from step S404 onwards are carried out. Steps S404 to S410 are the same as steps S404 to S410 in the flowchart of FIG.

[0260] According to the first modification of the fourth embodiment described above, when the personal terminal 5 receives input of information designating any one of the desks 40, it transmits the information to the watching device 10. The watching device 10 detects a specified area among the areas on the designated desk 40, and sets the specified area in the image of the camera 4 as the watching target. Alternatively, the watching device 10 sets the image of an object existing in the specified area on the designated desk 40 as the watching target. Therefore, the watching system 1 can set the target by a simple operation from the user. It can also prevent a user from erroneously setting another user's object as the watching target.

[0261] Furthermore, when the specified area is the entire area on the desk 40, the monitoring device 10 sets the entire area on the desk 40 or the images of all objects on the desk 40 as the monitoring target. This improves the convenience for the user.

[0262] The specified area set on the desk 40 may be any area. For example, the specified area may be half of the area on the desk 40.

[0263] A pattern indicating the specified area may be provided on the surface of the desk 40. This allows the user and the employees of the store 2 to know the area to be set as the monitoring target. It is possible to prevent an unintended object from being set as the target object due to a user accidentally placing an object in the specified area.

[0264] Next, a second modified example of the fourth embodiment will be described with reference to FIG. FIG. 40 is a flowchart for explaining an outline of the operation of the second modified example of the watching system in the fourth embodiment.

[0265] Although not shown, in a second modified example of the fourth embodiment, desk 40 is provided with a two-dimensional desk code 40a instead of an identification number.

[0266] The user reads the two-dimensional desk code 40a on the desk 40 with the personal terminal 5. The personal terminal 5 transmits desk access information to the watching device 10.

[0267] The target setting unit 10d of the monitoring device 10 identifies the camera 4 that captures the desk 40 corresponding to the desk access information, based on the desk access information and the desk information stored in the desk database 41. The target setting unit 10d detects a specified area set on the desk 40, and sets it as a monitoring target. At this time, an object exists on the desk 40.

[0268] The target setting unit 10d may set, as the watch target, an image of an object present within a specified area set on the desk 40 corresponding to the desk access information.

[0269] As shown in FIG. 40, step S401 is the same as step S401 in the flowchart of FIG.

[0270] If it is determined in step S401 that the desk two-dimensional code 40a has been read, the operation of step S415 is performed. In step S415, the personal terminal 5 transmits desk access information to the watching device 10. The target setting unit 10d of the watching device 10 identifies the camera 4 that captures the desk 40 corresponding to the desk access information. The target setting unit 10d sets a specified area on the desk 40 as the watching target.

[0271] Then, the operations from step S414 onwards are carried out. Steps S414 to S410 are the same as steps S414 to S410 in the flowchart of FIG.

[0272] According to the second modification of the fourth embodiment described above, when the watching device 10 receives desk access information, it detects a specified area among the areas on the desk 40 corresponding to the desk access information, and sets the specified area in the image from the camera 4 as the watching target. Alternatively, the watching device 10 sets the image of an object that exists in the specified area on the specified desk 40 as the watching target. This allows the user to easily set the target. As a result, convenience for the user is improved.

[0273] In the first and second modified examples of the fourth embodiment, the pattern on the surface of the desk 40 may be a distinctive pattern. A distinctive pattern is a pattern in which colors and designs are regularly arranged. FIG. 41 is a diagram showing an example of a desk design in the monitoring system according to the fourth embodiment.

[0274] Figure 41(a) is a checkerboard pattern with two or more colors arranged alternately in square shapes, while Figure 41(b) is a striped pattern with two or more colors arranged in rectangular shapes.

[0275] As described above, the surface of the desk 40 may have a pattern in which colors and patterns are regularly arranged. When the surface of the desk 40 has the pattern shown in FIG. 41, the target setting unit 10d and the movement detection unit 10f of the monitoring device 10 can easily detect the image of an object on the desk 40 from the video. For example, it is possible to prevent an object on the desk from being omitted from the target setting due to the object having a similar color or pattern to the desk surface. For example, it is possible to prevent a change in the image of an object from not being detected due to the object on the desk having a similar color or pattern to the desk surface.

[0276] Next, a third modified example of the watching system 1 according to the fourth embodiment will be described with reference to FIG. FIG. 42 is a flowchart for explaining an outline of the operation of the third modified example of the watching system in the fourth embodiment.

[0277] The third modified example of the fourth embodiment differs from the second modified example of the fourth embodiment in that the watching device 10 notifies the store terminal 3 of the setting or cancellation of the watching mode.

[0278] As shown in FIG. 42, steps S401 to S405 are the same as steps S401 to S405 in the flowchart of FIG. 40 of the second modified example.

[0279] After step S405, the operation of step S416 is performed. In step S416, the store display unit 10b of the monitoring device 10 notifies the store terminal 3 of the information of the specified desk 40. Specifically, the store display unit 10b displays, on the store usage screen of the store terminal 3, the identification information of the desk 40 corresponding to the desk access information and a message indicating that the monitoring mode has been set for the area above the desk 40.

[0280] After step S416, the operations from step S406 onwards are carried out. Steps S406 to S410 are the same as steps S406 to S410 in the flowchart of FIG.

[0281] After step S408, the operation of step S417 is performed. In step S417, the store display unit 10b notifies the store terminal 3 of information about the desk 40 for which the monitoring mode has been canceled. Specifically, the store display unit 10b displays, on the store usage screen of the store terminal 3, the identification information of the desk 40 corresponding to the monitoring target for which the monitoring mode has been canceled and a message that the monitoring mode has been canceled. Thereafter, the monitoring system 1 ends its operation.

[0282] Note that the third variant of embodiment 4 may differ from the first variant of embodiment 4, but not from the second variant of embodiment 4, in that the monitoring device 10 notifies the store terminal 3 of the setting or cancellation of the monitoring mode.

[0283] According to the third modification of the fourth embodiment described above, when the monitoring device 10 sets a specified area on the desk 40 as a monitoring target, the monitoring device 10 displays information on the store terminal 3 that the area on the desk 40 has been set as a target object. Therefore, the employees of the store 2 can know that an object on the desk 40 has been set as a target object. For example, tableware on the desk 40 may be set as a target object. In this case, it is possible to prevent a warning from being issued due to a service action by an employee, such as an action of the employee clearing away the tableware, an action of the employee moving the tableware to place other tableware on the desk 40, or the like. In addition, when the monitoring device 10 sets an image of an object existing within a specified area on the desk 40 as a monitoring target, the monitoring device 10 may display information on the store terminal 3 that the image of the object on the desk 40 has been set as a monitoring target.

[0284] Furthermore, the monitoring device 10 causes the store terminal 3 to display a message indicating that the monitoring mode has been cancelled. This allows the employee to know that the monitoring mode for the corresponding desk has been cancelled.

[0285] Next, a fourth modified example of the watching system 1 according to the fourth embodiment will be described with reference to FIG. FIG. 43 is a flowchart for explaining an outline of the operation of the fourth modified example of the watching system in the fourth embodiment.

[0286] The fourth modified example of the fourth embodiment differs from the third modified example of the fourth embodiment in that the watching mode can be suspended and resumed from the store terminal 3. Although not shown, the store display unit 10b of the watching device 10 receives a command from the store terminal 3 to suspend the watching mode set for an area on a certain desk 40. The store display unit 10b receives a command from the store terminal 3 to resume the watching mode suspended by a command from the store terminal 3. When the watching mode is suspended or resumed by a command from the store terminal 3, the personal display unit 10c of the watching device 10 notifies the personal terminal 5 corresponding to the watching mode of that fact.

[0287] When the watching mode is resumed, the target setting unit 10d of the watching device 10 sets the state of the desk 40 at the time when the watching mode is resumed as a new watching target. Specifically, the target setting unit 10d acquires an image of the camera 4 that shows the desk 40 at the time when the watching mode is resumed. The target setting unit 10d sets a specified area on the desk 40 in the image as a new watching target.

[0288] Similarly, the target setting unit 10d may set, as the watching target, the image of an object that exists within a specified area on the desk 40 at the time when the watching mode is resumed.

[0289] As shown in FIG. 43, steps S401 to S416 in the flowchart are the same as steps S401 to S416 in the flowchart of FIG.

[0290] After step S416, the operation of step S418 is performed. In step S418, the store display unit 10b determines whether or not a command to interrupt the watching mode has been received on the store use screen of the store terminal 3.

[0291] If it is determined in step S418 that a command to interrupt the monitoring mode has been received, the operation of step S419 is performed. In step S418, the mode setting unit 10e interrupts the monitoring mode of the monitoring target on the corresponding desk 40. The personal display unit 10c notifies the personal terminal 5 of information that the monitoring mode has been interrupted by the store terminal 3. Specifically, the personal display unit 10c displays the information on the usage screen of the personal terminal 5.

[0292] Then, the operation of step S420 is performed. In step S420, the store display unit 10b determines whether or not the store terminal 3 has received a command to resume the watching mode on the store use screen.

[0293] If it is determined in step S420 that the restart of the watching mode has not been accepted, the operation of step S420 is repeated.

[0294] If it is determined in step S420 that the restart of the watching mode has been accepted, the operation of step S421 is performed. In step S421, the mode setting unit 10e restarts the interrupted watching mode. The target setting unit 10d sets the state of the desk 40 at the time when the watching mode is restarted as the watching target.

[0295] Then, the operation of step S422 is performed. In step S422, the personal display unit 10c notifies the personal terminal 5 of information that the watching mode has been resumed.

[0296] After step S422, or if it is not determined in step S418 that a command to interrupt the monitoring mode has been received, the operation of step S406 is performed. Step S406 is the same as step S406 in the flowchart of FIG.

[0297] If it is determined in step S406 that the position of the target object has not moved, the operation of step S407 is performed. Step S407 is the same as step S407 in the flowchart of FIG.

[0298] If it is determined in step S407 that the cancellation of the watching mode has not been accepted from the personal terminal 5, the operations in and after step S418 are performed.

[0299] If it is determined in step S407 that the cancellation of the watching mode has been accepted from the personal terminal 5, the operations from step S408 onwards are carried out. Steps S408 to S417 are the same as steps S408 to S417 in the flowchart of FIG.

[0300] If it is determined in step S406 that the position of the target object has moved, the operations from step S409 onwards are carried out. Steps S409 to S410 are the same as steps S409 to S410 in the flowchart of FIG.

[0301] According to the fourth modification of the fourth embodiment described above, the watching device 10 receives from the store terminal 3 a command to suspend or resume the watching mode set for a watching target on the desk 40. The watching device 10 suspends or resumes the watching mode corresponding to the target based on the command to suspend or resume the watching mode. Therefore, when a store employee performs a service action on a certain desk 40, the employee can suspend the watching mode corresponding to the object on the desk 40. Therefore, it is possible to prevent an alarm from being issued due to the employee's service action.

[0302] Furthermore, when the watching mode is resumed, the watching device 10 sets the state of the desk 40 at that time as a new watching target. If an object on the desk 40 moves while the watching mode is interrupted, the image of the desk 40 captured by the camera 4 will be different before and after the watching mode is resumed. In this case, the watching device 10 may detect an abnormality. By setting a new watching target, it is possible to prevent the watching device 10 from detecting an abnormality due to a change during the interruption.

[0303] Furthermore, when the watching device 10 receives a command to suspend or resume the watching mode, it notifies the personal terminal 5 corresponding to the target of watching of the command. This allows the user to know that the watching mode has been suspended or resumed.

[0304] Embodiment 5. Fig. 44 is a block diagram of a monitoring system in embodiment 5. Fig. 45 is a flowchart for explaining an outline of the operation of the monitoring system in embodiment 5. Note that the same reference numerals are used to refer to parts that are the same as or equivalent to any of the parts in embodiments 1 to 4. Explanation of these parts will be omitted.

[0305] As shown in FIG. 44, the watching system 1 further includes a position detection device 50.

[0306] The position detection device 50 is provided inside the store 2. The position detection device 50 detects the position of the personal terminal 5 present inside the store 2 by using radio waves transmitted from the personal terminal 5. For example, the position detection device 50 is a beacon device that uses BLE [Bluetooth Low Energy (registered trademark)]. In this case, the position detection device 50 can detect the position of the personal terminal 5 with high accuracy by using BLE.

[0307] When the position detection device 50 detects the position of the personal terminal 5, it creates position information of the personal terminal 5 in the store 2. The position detection device 50 transmits the position information of the personal terminal 5 to the watching device 10 via the network.

[0308] The communication unit 5a of the personal terminal 5 transmits radio waves corresponding to the radio waves used by the position detection device 50 to detect the position of the personal terminal 5.

[0309] In the monitoring device 10, when location information of the personal terminal 5 is received from the position detection device 50, the personal display unit 10c identifies the camera 4 capturing the location where the personal terminal 5 is located, based on the information stored in the camera database 11. The personal display unit 10c displays the image of the identified camera 4 on the usage screen of the personal terminal 5.

[0310] When the position information of the personal terminal 5 is received from the position detection device 50, the target setting unit 10d estimates the position of an object existing around the personal terminal 5 based on the image captured by the camera 4. The monitoring device 10 calculates the distance between the personal terminal 5 and the object based on the position information of the personal terminal 5 and the information of the estimated position of the object. The target setting unit 10d can set only an object existing within a specified first distance from the personal terminal 5 as the object corresponding to the personal terminal 5. In other words, the target setting unit 10d does not set an image of an object existing at a position farther away than the specified first distance from the personal terminal 5 or an area of ​​an image including an image of the object as the monitoring target corresponding to the personal terminal 5.

[0311] In the flowchart of FIG. 45, the operation performed in step S501 is the same as the operation performed in step S301 in the flowchart of FIG. 25 of the third embodiment.

[0312] If it is determined in step S501 that access has been received from the personal terminal 5, the operation of step S502 is performed. In step S502, the personal display unit 10c of the watching device 10 identifies the camera 4 capturing an image of the position where the personal terminal 5 is located. The personal display unit 10c displays an image of the identified camera 4 on the usage screen of the personal terminal 5.

[0313] Then, the operation of step S503 is performed. In step S503, the target setting unit 10d determines whether or not an image of an object that exists within a specified first distance from the personal terminal 5 or an area of ​​an image including the image of the object has been set as a target to be watched over.

[0314] In step S503, if a watching target is not set, the operation of step S503 is repeated.

[0315] When a watching target is set in step S503, the operations from step S504 onwards are carried out. The operations carried out from step S504 to S510 are the same as the operations carried out from step S305 to S311 in the flowchart of FIG.

[0316] According to the fifth embodiment described above, the watching system 1 includes a position detection device 50. The position detection device 50 detects the position of the personal terminal 5. The position detection device 50 transmits the position information of the personal terminal 5 to the watching device 10. Based on the position information of the personal terminal 5, the watching device 10 does not set an image of an object existing at a position farther than a specified first distance from the personal terminal 5 as a watching target. Alternatively, based on the position information of the personal terminal 5, the watching device 10 does not set an image region including an image of an object existing at a position farther than a specified first distance from the personal terminal 5 as a watching target. This can prevent a user from erroneously setting another person's object as a target.

[0317] Furthermore, the monitoring device 10 displays the image captured by the camera 4 capturing the personal terminal 5 on the personal terminal 5 based on the position information of the personal terminal 5. This allows the user to easily access the image captured by the camera 4 capturing the user. As a result, the comfort of the user interface on the usage screen can be improved.

[0318] Next, a modification of the watching system 1 according to the fifth embodiment will be described with reference to FIG. FIG. 46 is a flowchart for explaining an outline of the operation of a modified example of the watching system according to the fifth embodiment.

[0319] In the watching device 10 according to the modification of the fifth embodiment, when the watching mode is set and position information of the personal terminal 5 is received from the position detection device 50, the target setting unit 10d calculates the distance between the personal terminal 5 and the target. When the watching mode is set, the target setting unit 10d determines whether the distance between the personal terminal 5 and the target is within a specified second distance.

[0320] When the object setting unit 10d determines that the distance between the personal terminal 5 and the object is within a specified second distance while the monitoring mode is set, the mode setting unit 10e cancels the monitoring mode set for the object. The mode setting unit 10e notifies the personal terminal 5 that the monitoring mode has been cancelled. Note that the personal display unit 10c, rather than the mode setting unit 10e, may notify the personal terminal 5 that the monitoring mode has been cancelled.

[0321] Steps S501 to S506 in the flowchart in FIG. 46 are the same as steps S501 to S506 in FIG. 45 of the fifth embodiment.

[0322] If it is determined in step S506 that the object has moved, the operations from step S509 onwards are carried out. Steps S509 to S510 are the same as steps S509 to S510 in FIG.

[0323] If it is not determined in step S506 that the object has moved, the operation of step S511 is performed. In step S511, the object setting unit 10d determines whether or not the user has approached the object. Specifically, the object setting unit 10d determines whether or not the distance between the personal terminal 5 and the object is within a specified second distance.

[0324] If it is determined in step S511 that the distance between the personal terminal 5 and the target object is greater than the second distance, the operation of step S507 is performed. Step S507 is the same as step S507 in the flowchart of FIG.

[0325] If it is determined in step S511 that the distance between the personal terminal 5 and the object is within the second distance, the operation of step S508 is performed. In step S508, the mode setting unit 10e cancels the watching mode set for the object.

[0326] After step S508, the operation of step S512 is performed. In step S512, the mode setting unit 10e notifies the personal terminal 5 that the watching mode has been released. Thereafter, the watching system 1 ends its operation.

[0327] According to the modification of the fifth embodiment described above, when the monitoring device 10 determines that the distance between the personal terminal 5 and the object is closer than the specified second distance based on the position information of the personal terminal 5, the monitoring mode for the object is cancelled. That is, when the user approaches the object, the monitoring mode is automatically cancelled. This improves the user's convenience. In addition, it is possible to avoid an alarm being issued due to the user forgetting to cancel the monitoring mode.

[0328] Embodiment 6 Fig. 47 is a block diagram of a monitoring system in embodiment 6. Fig. 48 is a flowchart for explaining an outline of the operation of the monitoring system in embodiment 6. Note that the same reference numerals are used to refer to parts that are the same as or equivalent to any of the parts in embodiments 1 to 5. Explanation of these parts will be omitted.

[0329] As shown in FIG. 47, in the sixth embodiment, the watching system 1 further includes an access control device 60.

[0330] The access control device 60 is provided in the store 2. The access control device 60 can communicate with the monitoring device 10 via a network. The access control device 60 controls the locking and unlocking of the entrances to the store 2. Specifically, the entrances to the store 2 are the entrance and exit doors of the store 2, the automatic doors of the store 2, etc.

[0331] When the alarm unit 10g of the monitoring device 10 issues an alarm to the store terminal 3 and the personal terminal 5, it transmits a command to the access control device 60 to lock the entrance to the store 2.

[0332] The operations performed in steps S601 to S605 in the flowchart of Fig. 48 are the same as the operations performed in steps S101 to S105 in Fig. 4 of the first embodiment. The operations performed in steps S606 to S610 are the same as the operations performed in steps S306 to S311 in Fig. 25 of the third embodiment.

[0333] After the operation of step S610 is performed, the operation of step S611 is performed. In step S611, the alarm unit 10g transmits a command to the access control device 60 to lock the entrance. The access control device 60 locks the entrance of the store 2 based on the command from the monitoring device 10. Thereafter, the monitoring system 1 ends its operation.

[0334] According to the sixth embodiment described above, the monitoring system 1 includes the access control device 60. When the monitoring device 10 issues an alarm, it causes the access control device 60 to lock the entrance to the store. This makes it possible to prevent the criminal from escaping when an object is stolen. As a result, it is possible to improve the arrest rate of criminals in crimes such as baggage pickpocketing.

[0335] Embodiment 7 Fig. 49 is a block diagram of the monitoring system in the seventh embodiment. Fig. 50 is a flow chart for explaining an outline of the operation of the monitoring system in the seventh embodiment. Note that the same reference numerals are used to refer to parts that are the same as or equivalent to any of the parts in the first to sixth embodiments. Explanation of these parts will be omitted.

[0336] As shown in FIG. 49, in the seventh embodiment, the watching device 10 includes a person tracking unit 10j.

[0337] When the alarm unit 10g issues an alarm to the store terminal 3 and the personal terminal 5, the person tracking unit 10j identifies the person closest to the object in the image of the camera 4 that captures the object as the specified person. Alternatively, when an area of ​​the image is set as a monitoring target, the person tracking unit 10j identifies the person closest to the center of the area of ​​the image on the image as the specified person. The person tracking unit 10j stores characteristic information of the specified person in the storage unit 10a. For example, the characteristic information of the specified person is the appearance characteristics of the specified person, such as the height and clothing. The person tracking unit 10j tracks the image of the specified person in the image of the camera 4. Specifically, the person tracking unit 10j marks the image of the specified person in the image of the camera 4. At this time, the person tracking unit 10j may mark the image of the specified person in the images of multiple cameras 4.

[0338] When the person tracking unit 10j identifies a specific person, the store display unit 10b displays the video of the camera 4 on which the specific person is marked on the store usage screen of the store terminal 3. The store display unit 10b accepts a command from the store terminal 3 to remove the marking of the specific person on the store usage screen.

[0339] When the person tracking unit 10j identifies a specific person, the personal display unit 10c displays the image of the camera 4 on which the specific person is marked on the usage screen of the personal terminal 5. The personal display unit 10c accepts a command from the personal terminal 5 to cancel the marking of the specific person on the usage screen.

[0340] The operations performed in steps S701 to S710 in the flowchart of FIG. 50 are the same as the operations performed in steps S601 to S610 in FIG.

[0341] After the operation of step S710 is performed, the operation of step S711 is performed. In step S711, the person tracking unit 10j of the watching device 10 identifies the specified person. The person tracking unit 10j stores the characteristic information of the specified person in the storage unit 10a.

[0342] Then, the operation of step S712 is performed. In step S712, the person tracking unit 10j tracks the image of a specific person in the image captured by the camera 4.

[0343] Then, the operation of step S713 is performed. In step S713, the store display unit 10b displays the image of the camera 4 on which the specific person is marked on the store usage screen of the store terminal 3. The personal display unit 10c displays the image of the camera 4 on which the specific person is marked on the usage screen of the personal terminal 5.

[0344] After that, the operation of step S714 is performed. In step S714, the person tracking unit 10j determines whether or not a command to cancel the marking has been received from the store terminal 3 or the personal terminal 5.

[0345] If it is determined in step S714 that a command to remove the marking has not been received, the operations from step S712 onwards are repeated.

[0346] In step S417, when a command to cancel the marking is received, the person tracking unit 10j cancels the marking of the specific person. After that, the watching system 1 ends the operation.

[0347] According to the seventh embodiment described above, the monitoring device 10 includes a person tracking unit 10j. When the monitoring device 10 detects an abnormality, it identifies the person closest to the target as a specific person. The monitoring device 10 displays an image showing the specific person on the store terminal 3 and the personal terminal 5. Therefore, when an alarm is issued, the employees and users of the store 2 can know the specific person who caused the alarm. For example, when an object is stolen, the culprit can be easily found. As a result, the rate of arresting criminals in crimes such as baggage pickpocketing can be improved. [Industrial Applicability]

[0348] As described above, the monitoring device, monitoring system, program, and monitoring method according to the present disclosure can be used in store security systems. [Explanation of symbols]

[0349] 1 system, 2 store, 3 store terminal, 3a communication unit, 3b display unit, 3c input unit, 3d sound output unit, 3e operation unit, 4, 4a, 4b camera, 5 personal terminal, 5a communication unit, 5b display unit, 5c input unit, 5d sound output unit, 5e operation unit, 5f reading unit, 5g wireless communication unit, 6 posting body, 6a posting two-dimensional code, 10 monitoring device, 10a memory unit, 10b store display unit, 10c personal display unit, 10d target setting unit, 10e mode setting unit, 10f movement detection unit, 10g alarm unit, 10h approach detection unit, 10i motion detection unit, 10j person tracking unit, 11 camera database, 20 covering body, 20a Covering body two-dimensional code, 21 Covering body database, 30, 30a, 30b, 30c, 30d, 30e Monitoring tag, 31 Tag two-dimensional code, 32d Light source, 33e First light source, 34e Second light source, 35e Third light source, 36 Monitoring tag database, 37, 37c, 37d Communication device, 38, 38c, 38d Speaker, 39 Mobile camera, 40 Desk, 40a Desk two-dimensional code, 41 Desk database, 50 Position detection device, 60 Access control device, 100a Processor, 100b Memory, 200 Hardware

Claims

1. A monitoring device that receives a video of a store, which is a series of images captured by a camera installed in the store, and communicates with a personal terminal carried by a user of the store, a mode setting unit that sets a monitoring mode for monitoring an object based on a command to start monitoring from the personal terminal; a target setting unit that sets, as a target to be watched, an image of a target to be watched designated from the personal terminal among the images captured by the camera or a region of an image captured by the camera in which a target to be watched is shown and designated from the personal terminal of the user; a movement detection unit that detects an abnormality when it is detected that the object captured in the image captured by the camera has moved while the monitoring mode is set by the mode setting unit; a store display unit that displays an image of the camera capturing the target of monitoring on the store terminal when a command to display the target of monitoring is received from a store terminal installed in the store while the monitoring mode is set; A monitoring device equipped with the above.

2. a personal display unit that displays the image captured by the camera on the personal terminal as a usage screen; Further comprising: The monitoring device of claim 1, wherein the personal display unit, when receiving an instruction from the personal terminal to display the target of monitoring when the monitoring mode is set, causes the personal terminal to display an image from the camera capturing the target of monitoring.

3. The monitoring device according to claim 2 , wherein the personal display unit accepts designation of the object or designation of an area of ​​the image as the monitoring target on the usage screen.

4. The monitoring device according to claim 1 , wherein the movement detection unit detects that the object has moved when an image of the object or an image of the image area changes.

5. an alarm unit that issues an alarm to the personal terminal and a store terminal provided in the store when the movement detection unit detects an abnormality; The monitoring device according to any one of claims 1 to 4, further comprising:

6. an approach detection unit that detects an abnormality when it is detected that a person or object is present within a specified distance from the target object for a specified period of time or more based on the image captured by the camera when the monitoring mode is set; Further comprising: The monitoring device according to claim 5 , wherein the alarm unit issues an alarm to the personal terminal and the store terminal when the approach detection unit detects an abnormality.

7. The monitoring device of claim 6, wherein the approach detection unit detects that a person captured by the camera is a user carrying the personal terminal, and does not detect an abnormality if a person who is within a specified distance from the object for a specified period of time or longer is the user.

8. a motion detection unit that detects, based on the image captured by the camera, that a person has made a motion to grab an object; Further comprising: the approach detection unit detects an abnormality when detecting that a person who has made an action of trying to pick up an object detected by the action detection unit is present within a specified distance from the object while the monitoring mode is set, The monitoring device according to claim 6 , wherein the alarm unit issues an alarm to the personal terminal and the store terminal when the approach detection unit detects an abnormality.

9. The monitoring device according to claim 8 , wherein the motion detection unit detects a motion of a person attempting to grab an object by analyzing skeletal movement of the person captured in the video captured by the camera.

10. The monitoring device described in claim 8 or claim 9, wherein the approach detection unit detects that a person captured by the camera is a user carrying the personal terminal, and does not detect an abnormality if the person performing the action of attempting to grab an object detected by the action detection unit is the user.

11. A storage unit for storing information; Further comprising: A monitoring device as described in any one of claims 5 to 10, wherein the alarm unit stores in the memory unit video or images from the camera capturing the subject being monitored when an alarm is issued to the personal terminal and the store terminal.

12. A monitoring device as described in any one of claims 5 to 11, wherein the alarm unit sends a command to a device that controls locking and unlocking of entrances and exits provided in the store to lock the entrances and exits provided in the store when an alarm is issued to the personal terminal and a store terminal provided in the store.

13. an alarm unit that issues an alarm to the personal terminal and a store terminal provided in the store when the movement detection unit detects an abnormality; a person tracking unit that, when the alarm unit issues an alarm to the personal terminal and the store terminal, identifies a person who is closest to the object shown in the image captured by the camera as a specific person and tracks an image of the specific person in the image captured by the camera; Further comprising: When the person tracking unit identifies the specific person, the individual display unit displays, on the personal terminal, an image captured by the camera on which the specific person is marked, The monitoring device according to claim 2 or 3, wherein the store display unit, when the person tracking unit identifies the specific person, causes the store terminal to display the image captured by the camera on which the specific person is marked.

14. an alarm unit that issues an alarm to the personal terminal and a store terminal provided in the store when the movement detection unit detects an abnormality; a person tracking unit that, when the alarm unit issues an alarm to the personal terminal and the store terminal, identifies a person who is closest to the object shown in the image captured by the camera as a specific person and tracks an image of the specific person in the image captured by the camera; The monitoring device according to claim 1 , further comprising:

15. A monitoring device as described in any one of claims 1 to 14, wherein the target setting unit detects a registered covered object from the image captured by the camera, sets the covered object specified from the user's personal terminal as the target of monitoring, and sets the image of the covered object or an area of ​​an image including the image of the covered object in the image captured by the camera as the target of monitoring.

16. The monitoring device described in claim 15, wherein when the target setting unit receives covered body access information identifying the covered body from the personal terminal, it sets the covered body indicated in the covered body access information as the target of monitoring, and sets the image of the covered body or an area of ​​an image including the image of the covered body in the video captured by the camera as the target of monitoring.

17. The monitoring device described in claim 2 or claim 3, wherein the personal display unit displays information indicating a list of multiple monitoring tags present in the store and information indicating whether each of the multiple monitoring tags is being used by another user as the usage screen on the personal terminal, and accepts selection of any of the multiple monitoring tags on the usage screen.

18. The monitoring device described in claim 17, wherein the target setting unit does not set as the monitoring target an image area on the usage screen displayed by the personal display unit that includes an image of an object that is located more than a specified distance away from a selected monitoring card among the multiple monitoring cards and an image area that includes an object that is located more than a specified distance away from the monitoring card.

19. The monitoring device described in claim 17, wherein the target setting unit sets a selected one of the multiple monitoring cards as the object on the usage screen displayed by the personal display unit, and sets the image of the monitoring card or an area of ​​an image including the image of the monitoring card in the image captured by the camera as the monitoring target.

20. The monitoring device described in any one of claims 17 to 19, wherein when any one of the multiple monitoring tags is captured in the camera's image, the target setting unit identifies which of the multiple monitoring tags the monitoring tag captured in the camera's image is based on the shape and pattern of the monitoring tag captured in the camera's image.

21. The monitoring device described in any one of claims 17 to 19, wherein when any one of the multiple monitoring tags is captured in the camera's image, the target setting unit identifies which of the multiple monitoring tags the monitoring tag captured in the camera's image is based on the blinking pattern of a light source possessed by the monitoring tag captured in the camera's image.

22. The monitoring device described in claim 20 or claim 21, wherein when the personal display unit receives tag access information identifying any one of the multiple monitoring tags from the personal terminal, it displays an image from the camera showing the monitoring tag indicated in the tag access information as a usage screen on the personal terminal.

23. The monitoring device described in claim 20 or claim 21, wherein when the target setting unit receives tag access information identifying any one of the multiple monitoring tags from the personal terminal, it sets the monitoring tag indicated in the tag access information as the target, and sets the image of the monitoring tag or an area of ​​an image including the image of the monitoring tag in the image captured by the camera as the monitoring target.

24. an alarm unit that issues an alarm to the personal terminal and a store terminal provided in the store when the movement detection unit detects an abnormality; Further comprising: A monitoring device as described in any one of claims 17 to 23, wherein the alarm unit, when the movement detection unit detects an abnormality in the object, issues an alarm to a speaker provided on a monitoring card selected from the multiple monitoring cards on the usage screen or on a monitoring card set for the object.

25. The monitoring device of claim 2 or claim 3, wherein when the personal display unit receives desk access information from the personal terminal that identifies one of a plurality of desks provided in the store, the personal display unit displays an image from the camera showing the desk indicated in the desk access information as the usage screen on the personal terminal.

26. The monitoring device described in claim 25, wherein when the target setting unit receives desk access information from the personal terminal identifying any one of a plurality of desks provided in the store, the target setting unit does not set as the monitoring target an image of an object located more than a specified distance away from the desk indicated in the desk access information and an area of ​​an image including an object located more than a specified distance away from the desk.

27. the personal display unit accepts an input of information designating one of a plurality of desks provided in the store on the usage screen displayed on the personal terminal, A monitoring device as described in claim 2 or claim 3, wherein the target setting unit detects a specified area on a specified desk corresponding to the information received by the personal display unit, and sets the specified area including an image of an object in the camera image as the monitoring target.

28. the personal display unit accepts an input of information designating one of a plurality of desks provided in the store on the usage screen displayed on the personal terminal, A monitoring device as described in claim 2 or claim 3, wherein the target setting unit sets an object that exists within a specified area of ​​a specified area on a desk corresponding to the information received by the personal display unit as the target, and sets an image of an object that exists within the specified area in the camera image as the monitoring target.

29. A monitoring device as described in any one of claims 1 to 14, wherein when the target setting unit receives desk access information from the personal terminal identifying one of a plurality of desks provided in the store, the target setting unit detects a specified area among the areas on the desk indicated in the desk access information, and sets the specified area including an image of an object in the camera image as the monitoring target.

30. A monitoring device as described in any one of claims 1 to 14, wherein when the target setting unit receives desk access information from the personal terminal identifying one of a plurality of desks provided in the store, the target setting unit sets an object that is present within a specified area on the desk indicated in the desk access information as the target, and sets an image of an object that is present within the specified area in the camera image as the monitoring target.

31. The monitoring device according to any one of claims 27 to 30, wherein the specified area is an entire area on the specified desk.

32. the personal display unit accepts an input of information designating one of a plurality of desks provided in the store on the usage screen displayed on the personal terminal, The target setting unit detects a specified area on the specified desk corresponding to the information received by the personal display unit, and sets the specified area including the object in the image of the camera as the monitoring target; The monitoring device of claim 2 or claim 3, wherein when the mode setting unit sets the monitoring mode after the target setting unit sets the specified area as the monitoring target, the store display unit displays on the store terminal the identification information of the specified desk and a message indicating that the monitoring mode has been set for the specified area.

33. the personal display unit accepts an input of information designating one of a plurality of desks provided in the store on the usage screen displayed on the personal terminal, The target setting unit sets an object present within a specified area of ​​the designated area on the desk corresponding to the information received by the personal display unit as a target, and sets an image of the object present within the specified area in the image of the camera as the monitoring target, The monitoring device of claim 2 or claim 3, wherein when the mode setting unit sets the monitoring mode after the target setting unit sets the image of an object present within the specified area as the monitoring target, the store display unit displays on the store terminal the identification information of the specified desk and a message indicating that the monitoring mode has been set for the object present within the specified area.

34. When the target setting unit receives desk access information identifying one of a plurality of desks provided in the store from the personal terminal, the target setting unit detects a specified area among areas on the desk indicated in the desk access information, and sets the specified area including an object in the image of the camera as the monitoring target; The monitoring device of claim 2 or claim 3, wherein when the mode setting unit sets the monitoring mode after the target setting unit sets the specified area as the monitoring target, the store display unit displays on the store terminal the identification information of the specified desk and a message indicating that the monitoring mode has been set for the specified area.

35. the target setting unit, when receiving desk access information identifying any one of a plurality of desks provided in the store from the personal terminal, sets an object present within a specified area among areas on the desk indicated in the desk access information as a target, and sets an image of the object present within the specified area in the image of the camera as the monitoring target; A monitoring device as described in any one of claims 2, 3 and 34, wherein when the mode setting unit sets the monitoring mode after the target setting unit sets the image of an object present within the specified area as the monitoring target, the store display unit displays on the store terminal the identification information of the desk indicated in the desk access information and a message indicating that an object present within the specified area has been set as the target.

36. the mode setting unit cancels the monitoring mode when a cancellation command is received from the personal terminal while the monitoring mode is set; The monitoring device according to any one of claims 32 to 35, wherein the store display unit, when the mode setting unit cancels the monitoring mode, causes the store terminal to display a message indicating that the monitoring mode has been cancelled.

37. the store display unit displays, on the store terminal, a screen for receiving a command to interrupt the watching mode set for the watching target corresponding to the specified area or a command to resume the interrupted watching mode; The monitoring device according to any one of claims 32 to 36, wherein the mode setting unit suspends the monitoring mode corresponding to the target being monitored when the store display unit receives an instruction to suspend the monitoring mode, and resumes the monitoring mode corresponding to the target being monitored when the store display unit receives an instruction to resume the monitoring mode.

38. The watching device according to claim 37 , wherein the target setting unit, when the watching mode is resumed, newly sets, as the watching target, a state of the specified area at the time when the watching mode is resumed.

39. The monitoring device described in claim 37 or claim 38, wherein the personal display unit, when the mode setting unit cancels the monitoring mode based on an instruction from the store display unit, displays on the personal terminal corresponding to the person being monitored that the monitoring mode has been canceled, and when the mode setting unit sets the monitoring mode based on an instruction to resume from the store display unit, displays on the personal terminal corresponding to the person being monitored that the monitoring mode has been resumed.

40. A monitoring device as described in any one of claims 1 to 14, wherein when the target setting unit receives information indicating the position of the personal terminal within the store, based on the information indicating the position of the personal terminal and the image captured by the camera, the target setting unit does not set as the monitoring target an image of an object located more than a specified first distance from the personal terminal or an area of ​​an image including an image of an object located more than a specified first distance from the personal terminal.

41. The monitoring device of claim 2 or claim 3, wherein when the personal display unit receives information indicating the position of the personal terminal within the store, the personal display unit displays an image from the camera capturing the position of the personal terminal on the personal terminal based on the information indicating the position of the personal terminal.

42. when the target setting unit receives information indicating a position of the personal terminal within the store, the target setting unit determines whether or not a distance between the personal terminal and the target object is closer than a specified second distance based on the information indicating the position of the personal terminal and the image captured by the camera; The monitoring device according to any one of claims 1 to 41, wherein the mode setting unit cancels the monitoring mode when the target setting unit determines that the distance between the personal terminal and the target object is closer than the second distance when the monitoring mode is set.

43. Cameras installed in the store, A personal terminal carried by a user of the store; A monitoring device that receives images of the store, which are successive images captured by the camera, and communicates with the personal terminal; A store terminal provided in the store; Equipped with The monitoring device includes: a monitoring mode for monitoring an object is set based on a command to start monitoring from the personal terminal, an image of an object to be monitored that is specified from the personal terminal among the images captured by the camera or an area of ​​the image captured by the camera in which the object to be monitored is shown and that is specified from the personal terminal of the user is set as the object to be monitored, and when the monitoring mode is set and it is detected that the object shown in the image captured by the camera has moved, an abnormality is detected; A monitoring system that, when a command to display the object is received from the store terminal while the monitoring mode is set, causes the store terminal to display the image of the camera capturing the object.

44. The monitoring system of claim 43, wherein the monitoring device detects that the object has moved when the image of the object or the image area of ​​the image changes, and issues an alarm to the personal terminal and the store terminal when an abnormality is detected.

45. The monitoring device displays the image captured by the camera on the personal terminal as a usage screen, accepts designation of the object or designation of an area of ​​the image on the usage screen, and, when a command to display the object is received from the personal terminal when the monitoring mode is set, displays the image of the camera capturing the object on the personal terminal.

46. Cameras installed in the store, A personal terminal carried by a user of the store; A monitoring device that receives images of the store, which are successive images captured by the camera, and communicates with the personal terminal; A notice is provided in the store, and indicates that the monitoring device is providing a luggage monitoring service for monitoring items owned by the user. Equipped with The monitoring device sets a monitoring mode to monitor an object based on a command to start monitoring from the personal terminal, sets the image of the object to be monitored specified from the personal terminal among the images captured by the camera, or the area of ​​the image captured by the camera in which the object to be monitored is shown and specified from the user's personal terminal, as the object to be monitored, and when the monitoring mode is set, if it detects that the object shown in the image captured by the camera has moved, the monitoring system detects an abnormality.

47. The bulletin board has a bulletin two-dimensional code indicating access information for accessing the monitoring device, The monitoring system described in claim 46, wherein when the personal terminal captures an image showing the posted two-dimensional code, it reads the access information from the image of the posted two-dimensional code shown in the image, and accesses the usage screen of the monitoring device based on the access information.

48. A covering body placed in the store so as to cover an object that the user wishes to watch over; Further comprising: The monitoring system described in any one of claims 43 to 46, wherein the monitoring device detects a registered covered object from the image captured by the camera, and when an instruction is received from the user's personal terminal, sets the covered object as the target of monitoring, and sets the image of the covered object or an area of ​​an image containing the image of the covered object in the image captured by the camera as the target of monitoring.

49. The monitoring system of claim 48, wherein the covering has a unique and identifiable pattern.

50. the covering body has a covering body two-dimensional code indicating covering body access information in which information for accessing the monitoring device and identification information of the covering body are associated with each other, When the personal terminal captures an image showing the image of the two-dimensional code of the covering body, the personal terminal reads the covering body access information from the image of the two-dimensional code of the covering body shown in the image, accesses the usage screen of the monitoring device based on the covering body access information, and transmits the covering body access information to the monitoring device; The monitoring system described in claim 48 or claim 49, when the monitoring device receives the covered body access information from the personal terminal, sets the covered body indicated in the covered body access information as the target of monitoring, and sets the image of the covered body or an area of ​​an image including the image of the covered body in the image captured by the camera as the target of monitoring.

51. A plurality of guard tags prepared in the store; Further comprising: The monitoring system described in any one of claims 43 to 46, wherein the monitoring device displays a list of the multiple monitoring tags and information corresponding to whether each of the multiple monitoring tags is being used by another user as a usage screen on the personal terminal, and accepts selection of any of the multiple monitoring tags on the usage screen.

52. The monitoring system of claim 51, wherein the monitoring device does not set as the monitoring target an image area on the usage screen that includes an image of an object that is located more than a specified distance away from a selected monitoring card from among the multiple monitoring cards and an image area that includes an object that is located more than a specified distance away from the monitoring card.

53. The monitoring system described in claim 51, wherein the monitoring device sets one of the multiple monitoring tags as the target object based on an instruction from the personal terminal, and sets the image of the monitoring tag or an area of ​​an image containing the image of the monitoring tag in the image captured by the camera as the monitoring target.

54. Each of the plurality of tags has a unique shape and a unique pattern; The monitoring system described in any one of claims 51 to 53, wherein when any one of the multiple monitoring tags is captured in the camera's image, the monitoring device identifies which of the multiple monitoring tags the monitoring tag captured in the camera's image is based on the shape and pattern of the monitoring tag captured in the camera's image.

55. Each of the plurality of monitoring tags has one or more light sources, and causes the one or more light sources to be turned on and off in a unique blinking pattern; The monitoring system described in any one of claims 51 to 53, wherein when any one of the multiple monitoring tags is captured in the camera image, the monitoring device identifies which of the multiple monitoring tags the monitoring tag captured in the camera image is based on the blinking pattern of the one or more light sources possessed by the monitoring tag captured in the camera image.

56. Each of the plurality of monitoring tags has a two-dimensional code indicating tag access information in which information for accessing the monitoring device and identification information of the monitoring tag are associated with each other; When the personal terminal captures an image showing the image of the tag two-dimensional code, the personal terminal reads the tag access information from the image of the tag two-dimensional code shown in the image, accesses the usage screen of the monitoring device based on the tag access information, and transmits the tag access information to the monitoring device. The monitoring system described in any one of claims 51 to 55, wherein when the monitoring device receives the tag access information from the personal terminal, the monitoring device displays the camera image showing the monitoring tag indicated in the tag access information as a usage screen on the personal terminal.

57. Each of the plurality of monitoring tags has a two-dimensional code indicating tag access information in which information for accessing the monitoring device and identification information of the monitoring tag are associated with each other; When the personal terminal captures an image showing the image of the tag two-dimensional code, the personal terminal reads the tag access information from the image of the tag two-dimensional code shown in the image, accesses the usage screen of the monitoring device based on the tag access information, and transmits the tag access information to the monitoring device. The monitoring system described in any one of claims 51 to 55, when the monitoring device receives the tag access information from the personal terminal, sets the monitoring tag indicated in the tag access information as the target object, and sets the image of the monitoring tag or an area of ​​an image including the image of the monitoring tag in the image captured by the camera as the monitoring target.

58. Each of the plurality of monitoring tags has a speaker that emits sound, A monitoring system as described in any one of claims 51 to 57, wherein when the monitoring device detects an abnormality in the object, it causes an alarm to be sounded from the speaker provided on a monitoring card selected from the multiple monitoring cards on the usage screen or on a monitoring card set for the object.

59. The monitoring system according to any one of claims 51 to 58, wherein any one of the plurality of monitoring tags is equipped with the camera.

60. A plurality of desks provided in the store; Further comprising: The plurality of desks each have a two-dimensional desk code indicating desk access information in which information for accessing the monitoring device and each identification information are associated with each other, When the personal terminal captures an image showing the image of the two-dimensional desk code, the personal terminal reads the desk access information from the image of the two-dimensional desk code shown in the image, accesses the usage screen of the monitoring device based on the desk access information, and transmits the desk access information to the monitoring device; The monitoring system of any one of claims 43 to 46, wherein when the monitoring device receives desk access information from the personal terminal that identifies one of a plurality of desks provided in the store, the monitoring device causes the personal terminal to display an image from the camera showing the desk indicated in the desk access information as the usage screen.

61. The monitoring system of claim 60, wherein the monitoring device does not set as the monitoring target an image of an object located more than a specified distance away from the desk indicated in the desk access information and an image area including an object located more than a specified distance away from the desk.

62. A plurality of desks provided in the store; Further comprising: When the personal terminal receives input of information designating one of the plurality of desks, the personal terminal transmits information about the designated desk to the monitoring device; A monitoring system as described in any one of claims 43 to 46, wherein when the monitoring device receives information about the designated desk from the personal terminal, it detects a specified area on the designated desk and sets the specified area including an image of an object in the camera image as the monitoring target.

63. a plurality of desks provided in the store, each having a two-dimensional desk code indicating desk access information in which information for accessing the monitoring device is associated with identification information; Further comprising: When the personal terminal captures an image showing the image of the two-dimensional desk code, the personal terminal reads the desk access information from the image of the two-dimensional desk code shown in the image, accesses the usage screen of the monitoring device based on the desk access information, and transmits the desk access information to the monitoring device; The monitoring system of any one of claims 43 to 46, wherein when the monitoring device receives desk access information from the personal terminal identifying one of a plurality of desks provided in the store, the monitoring device detects a specified area among the areas on the desk indicated in the desk access information, and sets the specified area including an image of an object in the camera image as the monitoring target.

64. The monitoring system according to any one of claims 60 to 63, wherein the desks have surfaces on which colors and patterns are regularly arranged.

65. a location detection device that identifies the location of the personal terminal by radio waves, creates information indicating the location of the personal terminal within the store, and transmits the information to the monitoring device; Further comprising: A monitoring system as described in any one of claims 43 to 46, wherein when the monitoring device receives information indicating the position of the personal terminal within the store from the position detection device, based on the information indicating the position of the personal terminal and the image captured by the camera, the monitoring device does not set as the monitoring target an image of an object located more than a specified first distance from the personal terminal or an image area including an image of an object located more than a specified first distance from the personal terminal.

66. a location detection device that identifies the location of the personal terminal by radio waves, creates information indicating the location of the personal terminal within the store, and transmits the information to the monitoring device; Further comprising: A monitoring system as described in any one of claims 43 to 46, wherein when the monitoring device receives information indicating the position of the personal terminal within the store from the position detection device, the monitoring device displays on the personal terminal an image from the camera capturing the position of the personal terminal based on the information indicating the position of the personal terminal.

67. a location detection device that identifies the location of the personal terminal by radio waves, creates information indicating the location of the personal terminal within the store, and transmits the information to the monitoring device; Further comprising: A monitoring system as described in any one of claims 43 to 66, wherein when the monitoring device receives information indicating the position of the personal terminal within the store from the position detection device, the monitoring device determines whether the distance between the personal terminal and the target object is closer than a specified distance based on the information indicating the position of the personal terminal and the image captured by the camera, and when the monitoring mode is set and it determines that the distance between the personal terminal and the target object is closer than a specified second distance, the monitoring mode is cancelled.

68. an access control device for controlling locking and unlocking of an entrance provided in the store; Further comprising: A monitoring system as described in any one of claims 43 to 67, wherein the monitoring device sends a command to the access control device to lock an entrance / exit provided at the store when an alarm is issued at the personal terminal and a store terminal provided at the store.

69. A video of the store, which is a series of images taken by a camera installed in the store, is received, and the video is transmitted to a computer that communicates with a personal terminal carried by a user of the store. a mode setting step of setting a monitoring mode for monitoring an object based on a command to start monitoring from the personal terminal; an object detection step of setting an image of a target of monitoring designated from the personal terminal among images captured by the camera or a region of an image captured by the camera in which a target of monitoring is shown and designated from the personal terminal of the user as a target of monitoring; a movement detection step of detecting an abnormality when it is detected that the object shown in the image captured by the camera has moved while the monitoring mode is set by the mode setting step; a store display step of displaying an image of the camera photographing the target of monitoring on the store terminal when a command to display the target of monitoring is received from a store terminal installed in the store while the monitoring mode is set by the mode setting step; A program that executes the following.

70. A mode setting process for setting a monitoring mode for monitoring an object based on a command to start monitoring from a personal terminal carried by a user of the store; an object detection process for setting an image of the object of monitoring designated from the personal terminal among images captured by a camera installed in the store or an area of ​​an image captured by the camera that shows the object of monitoring and that is designated from the personal terminal of the user as the object of monitoring; a movement detection step, which is performed after the object detection step, and detects an abnormality when it is detected that the object shown in the image captured by the camera has moved while the monitoring mode is set by the mode setting step; a store display step of displaying an image of the target being watched on the store terminal when a command to display the target being watched is received from a store terminal installed in the store while the monitoring mode is set by the mode setting step; A monitoring method that includes the following:

Images