Management method for watching service and management system

Abstract

To efficiently recover from the lost when tracking of a watching target is lost in a service for providing camera video, in which the camera video of the watching target is captured, to a user.SOLUTION: A watching service includes a plurality of information processes relating to the watching service. The plurality of information processes has priorities. The plurality of information processes is implemented in the order from a highest priority that the information processes have. The order of the plurality of information processes is adjusted. When implementing the step of retrieving or re-retrieving a watching target; in the adjustment of the order, processing is performed for interrupting an information process for the retrieval or the re-retrieval after an information process having a higher priority than the information process for the retrieval or the re-retrieval and before an information process having a lower priority than the information process for the retrieval or the re-retrieval.SELECTED DRAWING: Figure 6

Description

Technical Field

[0001] The present disclosure relates to a method and a system for managing a service that provides a user with a camera image in which a subject to be monitored is reflected.

Background Art

[0002] Japanese Unexamined Patent Application Publication No. 2008-017093 discloses a system that provides a guardian with a camera image in which a monitored child is reflected. This system detects a face region of a child included in the camera image and identifies the monitored child from the feature amounts of the detected face region. This system also masks the face regions of children other than the monitored child when the monitored child is identified, and generates a masked camera image.

[0003] Examples of documents indicating the technical level of the technical field related to the present disclosure include Japanese Unexamined Patent Application Publication No. 2014-067315 and Japanese Unexamined Patent Application Publication No. 2020-079990 in addition to Japanese Unexamined Patent Application Publication No. 2008-017093.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Patent Document 2

Patent Document 3

Summary of the Invention

Problems to be Solved by the Invention

[0005] Consider a service that provides a user with a camera image in which a person or object to be monitored is reflected (hereinafter also referred to as a "monitoring service"). In this case, a system that manages the monitoring service needs to perform tracking of the person or object to be monitored using a group of frames that make up the camera image. However, when performing tracking, it is possible that the tracking is lost (tracking is interrupted) due to the movement of the person or object to be monitored or the like.

[0006] When the tracking is lost, recovery from this loss will be performed. However, the processing related to the monitoring service includes various types of information processing. Therefore, assuming that processing for recovering from this loss is performed based on the time when the tracking was lost, it may take time and is not efficient.

[0007] One object of the present disclosure is to provide a technique capable of efficiently recovering from the loss of tracking of a person or object to be monitored in a service that provides a user with a camera image in which the person or object to be monitored is reflected.

Means for Solving the Problem

[0008] A first aspect of the present disclosure is a method for managing a monitoring service, which has the following features. When the method receives a monitoring request from a communication terminal of a user of the monitoring service, the method includes steps of searching for the user's person or object to be monitored using a group of frames that make up the camera image; when the person or object to be monitored is detected in the step of searching for the person or object to be monitored, tracking the person or object to be monitored; during the tracking, transmitting a group of frames including an image of the person or object to be monitored to the communication terminal; and when the person or object to be monitored is not detected in the step of searching for the person or object to be monitored, re-searching for the person or object to be monitored using a group of frames that make up the camera image. The monitoring service includes a plurality of information processes related to the monitoring service. Each of the plurality of information processes has a priority. The plurality of information processes are processed in descending order of their priorities. The method further includes a step of adjusting the order of the plurality of information processes. When the step of searching or re-searching for the object under surveillance is performed, in the step of adjusting the order, the information process for the search or re-search is interrupted after an information process having a higher priority than the information process for the search or re-search and before an information process having a lower priority than the information process for the search or re-search.

[0009] A second aspect of the present disclosure is a system for managing a surveillance service, which has the following features. The system includes a communication terminal of a user of the surveillance service and a management server that communicates with the communication terminal. When the management server receives a surveillance request from the communication terminal, it searches for the user's object under surveillance using a group of frames constituting a camera image. When the object under surveillance is detected in the search for the object under surveillance, it tracks the object under surveillance, and during the tracking, it transmits a group of frames including an image of the object under surveillance to the communication terminal. When the object under surveillance is not detected in the search for the object under surveillance, it is configured to re-search for the object under surveillance using the group of frames constituting the camera image. The surveillance service includes a plurality of information processes related to the surveillance service. The plurality of information processes each have a priority. The plurality of information processes are processed in descending order of their priorities. The management server is further configured to adjust the order of the plurality of information processes. When the search or re-search for the object under surveillance is performed, in the adjustment of the order, the information process for the search or re-search is interrupted after an information process having a higher priority than the information process for the search or re-search and before an information process having a lower priority than the information process for the search or re-search.

Advantages of the Invention

[0010] According to the present disclosure, when a monitoring request is received from a user's communication terminal, a search for a monitoring target is performed. Further, when a monitoring target is detected in the search, tracking of this monitoring target is performed, and during this tracking, a group of frames including an image of the monitoring target is provided to the communication terminal. On the other hand, when a monitoring target is not detected in the search, a re-search for this monitoring target is performed.

[0011] According to the present disclosure, furthermore, the order of a plurality of information processes is adjusted. When a search or re-search for a monitoring target is performed, in this order adjustment, a process is performed to interrupt the information process for the search or re-search after an information process having a higher priority than the information process for the search or re-search and before an information process having a lower priority than the information process for the search or re-search. According to this interrupt process, it becomes possible to perform the information process for the search or re-search before an information process having a relatively low priority. Therefore, even when the tracking of the monitoring target is lost, it becomes possible to resolve this situation in a relatively short time. That is, it becomes possible to efficiently perform recovery from the loss. This leads to an improvement in the convenience of the monitoring service.

Brief Description of the Drawings

[0012]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Embodiments for Carrying Out the Invention

[0013] Hereinafter, embodiments of the present disclosure will be described with reference to the drawings. In each figure, the same or corresponding parts are denoted by the same reference numerals, and the description thereof is simplified or omitted.

[0014] 1. Monitoring Service FIG. 1 is a diagram for explaining the outline of the monitoring service. The monitoring service identifies a frame group FR_CA including an image IMG_TG of a monitoring target TG from among a group of frames FR_CA acquired by a plurality of infrastructure cameras constituting the infrastructure camera group 20 (in the example shown in FIG. 1, a full-body image IMG_TGB), and provides the identified frame group FR_CA to a communication terminal (hereinafter, also referred to as a "user terminal") 30 of a user US. Here, the user US is a person who uses the monitoring service. The monitoring target TG is a person whom the user US wishes to monitor (for example, a family member of the user US, a friend of the user US, a person cared for by the user US).

[0015] FIG. 1 is also a diagram showing an overall configuration example of a management system for the monitoring service according to the embodiment. In the example shown in FIG. 1, the management system includes a management server 10, an infrastructure camera group 20, a user terminal 30, and a communication terminal (hereinafter, also referred to as a "target terminal") 40 of the monitoring target TG. The infrastructure camera group 20, the user terminal 30, and the target terminal 40 communicate with the management server 10 via a communication line network (not shown). The communication line network is not particularly limited, and wired and wireless networks are used.

[0016] The management server 10 includes a data processing device 11 and a database 12. The data processing device 11 includes at least one processor and at least one memory. The processor includes a CPU (Central Processing Unit). The memory is a volatile memory such as a DDR memory, and performs deployment of various programs and temporary storage of various data used in various processes performed by the processor. The various data used by the processor includes the data stored in the database 12.

[0017] The database 12 is formed in a predetermined storage device (for example, a hard disk, a flash memory). The database 12 stores user data USR and camera data CAM. The user data USR is transmitted from the user terminal 30 to the management server 10. The user data USR includes identification information of the user US, identification information of the monitoring target TG, and the like. The camera data CAM includes identification information of each of the plurality of infrastructure cameras constituting the infrastructure camera group 20, position information of these infrastructure cameras, frame groups FR_CA respectively acquired by these infrastructure cameras, and the like.

[0018] The infrastructure camera group 20 includes a plurality of infrastructure cameras. These infrastructure cameras include not only infrastructure cameras installed outdoors but also infrastructure cameras installed indoors. A part or all of the shooting ranges of two or more infrastructure cameras may overlap. Each infrastructure camera acquires a frame group FR_CA. The frame group FR_CA is a set of still images (frames) constituting the video (that is, the camera video) acquired by the infrastructure camera. Each infrastructure camera also transmits the acquired frame group FR_CA to the management server 10 together with its own identification information.

[0019] The user terminal 30 is a terminal having a communication function such as a smartphone, a tablet, or a notebook computer carried by the user US. The user terminal 30 is used when the user US first uses the monitoring service. At the first use, an application for use (AFU) of the monitoring service is transmitted from the user terminal 30 to the management server 10. The application AFU includes user data USR including the identification information of the user US, the setting information and contract information of the monitoring service, the identification information of the monitoring target TG, and the like. When the user data USR is registered in the database 12, the use of the monitoring service becomes possible.

[0020] Examples of the identification information of the user US include the attribute information of the user US (for example, name, gender, age) and the identification information of the user terminal 30. Examples of the setting information of the monitoring service include the plan information specified by the user US. The plan information includes, for example, basic settings such as the total number of monitoring targets and the total monitoring time, and position settings such as the time zone and area for monitoring. The option settings can also include priority designation of a plurality of monitoring targets (for example, giving priority to the younger brother over the older brother), emergency designation of the monitoring target (for example, detecting a specific posture of the cared-for person), and the like. The contract information of the monitoring service includes, for example, charge information proportional to the granularity of the plan information. The charge information is composed of a combination of a basic charge and an option charge. Examples of the identification information of the monitoring target TG include the face image IMG_TGF of the monitoring target TG and the attribute information of the monitoring target TG (for example, name, gender, age). The identification information of the monitoring target TG may include the identification information of the target terminal 40 and the relationship information between the user US and the monitoring target TG (for example, family, friend, person cared for by the user US).

[0021] The user terminal 30 is also used when the user US uses the monitoring service for the second time and later. When using it for the second time and later, a monitoring request RFW (Request For Watch) is sent from the user terminal 30 to the management server 10. The monitoring request RFW includes, for example, the login information of the user US for accessing the database 12. The monitoring request RFW may include information for updating some or all of the user data USR registered in the database 12. When such update information is included in the monitoring request RFW, the user data USR registered in the database 12 is updated.

[0022] The target terminal 40 is, for example, a terminal having a communication function such as a smartphone or a wearable device carried by the monitoring target TG. The target terminal 40 also has a GPS (Global Positioning System) function. By having the GPS function, the target terminal 40 transmits the position information of the target terminal 40 to an external device (for example, the management server 10, the user terminal 30). Note that the target terminal 40 is an arbitrary configuration of the management system according to the present disclosure. That is, the management system according to the present disclosure may be composed of the management server 10, the infrastructure camera group 20, and the user terminal 30.

[0023] 2. Provision of Camera Images FIG. 2 is a flowchart showing an example of information processing performed when providing the frame group FR_CA including the image IMG_TG to the user terminal 30. The routine shown in FIG. 2 is repeatedly executed by, for example, the data processing device 11 shown in FIG. 1.

[0024] In the routine shown in FIG. 2, first, as the process of step S11, it is determined whether a monitoring request RFW has been received. As described above, the monitoring request RFW includes the login information of the user US for accessing the database 12. If the determination result in step S11 is affirmative, the process of step S12 is performed.

[0025] In the process of step S12, a search for the monitoring target TG is performed using the frame group FR_CA stored in the database 12. At the time of this search, the database 12 is referenced using the login information received in the process of step S11 as a key, and the face image IMG_TGF included in the user data USR corresponding to the login information is specified. Then, the database 12 is further referenced using this face image IMG_TGF as a key, and the frame group FR_CA including the image of the person who matches the person of the face image IMG_TGF and the infrastructure camera that acquired this frame group FR_CA are specified. The specified frame group FR_CA is a frame group including the frame closest to the current time t.

[0026] The process of step S12 is performed over a predetermined period of time. When a predetermined time has elapsed since the start of the process of step S12, the process of step S13 is performed. In the process of step S13, it is determined whether or not the monitoring target TG has been specified. That is, it is determined whether or not the frame group FR_CA including the image of the person who matches the person of the face image IMG_TGF and the infrastructure camera that acquired this frame group FR_CA have been specified. If the determination result of step S13 is negative, the process of step S14 is performed.

[0027] In the process of step S14, a re-search for the monitoring target TG is performed using the frame group FR_CA stored in the database 12. The method of this re-search is basically the same as the method described in the process of step S12. Similar to the process of step S12, the process of step S14 is performed over a predetermined period of time. However, in the process of step S12, a search is performed focusing on the frame at the current time t, whereas in the process of step S14, a search is performed focusing on the frames at the current time t and the time t-k (k≧1).

[0028] FIG. 3 is a diagram for explaining an example of the re-search performed in step S14. In FIG. 3, frames at times t-1, t-2, t, t+1, and t+2 are schematically shown. In the example shown in FIG. 3, the frame at the current time t does not include an image of the target TG to be monitored. On the other hand, the frame at time t-2 includes an image IMG_TG (IMG_TGB) of the target TG to be monitored. In the re-search in step S14, the frame group FR_CA acquired by a certain infrastructure camera is searched for the image IMG_TG in order from the current time t backwards. As a result, since the target TG to be monitored is detected from the frame at time t-2, it is estimated that the target TG to be monitored exists around this infrastructure camera.

[0029] During the processing of step S14, the latest frame group is stored in the database 12 every moment. Therefore, by paying attention to the frame group of the infrastructure camera estimated by the above-described backward search, within the processing time of step S14, it becomes possible to efficiently identify the frame including the image IMG_TG (the frame at time t+2 in the example shown in FIG. 3) and the infrastructure camera that acquired this frame. Incidentally, in order to perform such a backward search, it is desirable that the number of infrastructure cameras to be the target of the backward search is small. Therefore, in the processing of step S14, the candidates of the infrastructure cameras may be narrowed down. The narrowing down of the candidates can select, for example, an infrastructure camera within a predetermined value of the distance (for example, Euclidean distance) from the current position of the target terminal 40 as a candidate of the infrastructure camera based on the position information of the target terminal 40 and the position information of the infrastructure camera.

[0030] Returning to FIG. 2, if the determination result in step S13 is affirmative, the processes of steps S15 and S16 are performed. In the process of step S15, tracking of the monitoring target TG is performed. Tracking is a technique for automatically tracking the same person included in a group of frames based on a tracking algorithm. In tracking, specifically, the same person included in the group of frames is tracked by tracking the bounding box representing the same person in the group of frames. Note that tracking itself is a well-known technique, and the tracking method applied to the process of step S15 is not particularly limited.

[0031] In the process of step S15, extraction of the feature amount of the monitoring target TG based on the image IMG_TG may be performed in parallel with the tracking of the monitoring target TG. This feature amount is used for re-identifying the same person and is also called a Re-ID feature amount. Extraction of the Re-ID feature amount is performed, for example, by applying a group of bounding boxes representing the same person in a plurality of time steps to a Re-ID model based on machine learning. Note that extraction of the Re-ID feature amount itself is a well-known technique, and the extraction method applied to the process of step S15 is not particularly limited.

[0032] In the process of step S15, estimation of the current abnormal state (motion, posture) of the monitoring target TG based on the image IMG_TG may be performed in parallel with the tracking of the monitoring target TG. This abnormal state is a state recognized as abnormal from the viewpoints of maintaining a person's health or traffic safety. Examples of states recognized as abnormal from the viewpoint of maintaining health include a person falling, crouching, bleeding, and having an abnormal body posture. Examples of states recognized as abnormal from the viewpoint of traffic safety include a person falling and having an abnormal body posture. Estimation of the abnormal state is performed, for example, based on a known image recognition technique based on a machine learning model.

[0033] In the process of step S16, the group of frames FR_CA including the image IMG_TG is transmitted to the terminal that is the source of the monitoring request RFW (that is, the user terminal 30).

[0034] Following the process of step S16, the process of step S17 is performed. In the process of step S17, it is determined whether a monitoring end request RFT (Request For Termination) is received. If the determination result of step S17 is affirmative, the transmission of the frame group FR_CA including the image IMG_TG is terminated. Otherwise, the processes of steps S115 and S16 are performed. That is, the processes of steps S15 to S17 are repeatedly executed until the end request RFT is received.

[0035] 3. Problems of the monitoring service In the tracking of a person, it may be lost due to the movement of the tracking target or the like. When the tracking target is lost, recovery from this loss is performed. Even when the tracking of the monitoring target is lost in the case where the tracking target is the monitoring target, recovery from this loss is performed. FIG. 4 is a flowchart for explaining the flow of processing performed in relation to the tracking of the monitoring target. FIG. 4 is performed as part of the process of step S15 shown in FIG. 2. The routine shown in FIG. 4 is repeatedly executed by, for example, the data processing device 11 shown in FIG. 1.

[0036] In the routine shown in FIG. 4, first, as the process of step S151, it is determined whether a loss of tracking of the monitoring target TG has occurred. If the determination result of step S151 is affirmative, the process of step S152 is performed.

[0037] In the process of step S152, a re-search for the monitoring target TG using the frame group FR_CA stored in the database 12 is performed. The method of this re-search is basically the same as the method described in the process of step S14 shown in FIG. 2. That is, the process of step S152 is performed over a predetermined time. Also, in the process of step S152, a search is performed focusing on the frames at the current time t and the time t-k. When the Re-ID feature amount of the monitoring target TG is extracted, in the process of step S152, a search for the frames at the current time t and the time t-k may be performed using this Re-ID feature amount.

[0038] When a predetermined time has elapsed since the start of the process of step S152, the process of step S153 is performed. In the process of step S153, it is determined whether or not the monitoring target TG has been specified. That is, it is determined whether or not the situation where the tracking of the monitoring target TG has been lost has been resolved. If the determination result of step S153 is affirmative, as the process of step S153, the tracking of the monitoring target TG is restarted.

[0039] If the process of step S153 is negative, the process returns to step S152. Thus, when the tracking of the monitoring target TG is lost, the processes of steps S152 and S153 are repeatedly performed until the situation where this loss has occurred is resolved.

[0040] The problem here is that the processes related to the monitoring service include a plurality of information processes. Therefore, if a process for recovery from this loss is performed based on the time when the tracking of the monitoring target TG is lost, it may take time for this recovery. This problem will be described with reference to FIG. 5. FIG. 5 is a diagram for explaining an example of the processing order of information processing related to the monitoring service.

[0041] Figure 5 depicts blocks of Jobs Job1 to Job5 corresponding to a plurality of information processes included in the information process related to the monitoring service. The time when each of these jobs occurred is also depicted in these blocks. Specifically, the occurrence time of Job1 is time t - 5, that of Job2 is time t - 4, that of Job3 is time t - 3, that of Job4 is time t - 2, and the occurrence time of Job5 is time t - 1. That is, Jobs Job1 to Job5 are arranged in the order of their occurrence times.

[0042] In the example shown in Figure 5, Jobs Job1 to Job5 are processed in the order of the times when these jobs occurred, starting from the oldest. Then, a new process (New Job) that occurred at the current time t will be processed after Job5 that occurred at time t - 1. However, if this new process corresponds to a process for recovering from the loss of tracking of the monitoring target TG (for example, a re-search process for the monitoring target TG), it may take time until the camera image showing the monitoring target TG is provided to the user US who wishes to continue the monitoring.

[0043] This problem can also occur when accepting the monitoring request RFW. That is, when the search process for the monitoring target TG (step S12 in Figure 2) that occurs upon accepting the monitoring request RFW corresponds to a new process, it may take time until the camera image showing the monitoring target TG is provided to the user US who wishes to start the monitoring. Furthermore, even when the re-search process (the process of step S14 in Figure 2) performed when the monitoring target TG is not detected in this search process corresponds to a new process, it may take time until the camera image is provided.

[0044] 4. Adjustment of the processing order Therefore, in the embodiment, priority PRs are calculated for a plurality of information processes in a waiting state of processing. Then, after rearranging these information processes in descending order of this priority PR, these information processes are processed. Here, as elements for calculating the priority PR, a fixed score FS and a variable score VS are exemplified. The fixed score FS is a score set in advance according to the content of the information process related to the monitoring service. The variable score VS is a score that reflects elements unrelated to the content of the information process in the calculation of the priority PR. The priority PR is calculated, for example, based on the following formula (1). PR = FS + VS ··· (1)

[0045] Examples of the information processes for which the fixed score FS is set include the registration process of user data USR, the update process of user data USR, the search process for the monitoring target TG, the re-search process for the monitoring target TG, the tracking process for the monitoring target TG, the extraction process of feature amounts of the monitoring target TG, the prediction process of the abnormal state of the monitoring target TG, the tracking process for a person other than the monitoring target TG, the extraction process of feature amounts of a person other than the monitoring target TG, and the prediction process of the abnormal state of a person other than the monitoring target TG. Note that a person other than the monitoring target TG means a person recognized as the same person in the frame group and not the monitoring target TG.

[0046] FIG. 6 is a diagram for explaining an example of the adjustment process of the processing order using the fixed score FS as an element for calculating the priority PR. Similar to FIG. 5, in FIG. 6, blocks of Jobs Job1 to Job5 are drawn. Also, the time when each job occurred is drawn in these blocks. So far, it is the same as the explanation of FIG. 5. In FIG. 6, further, the priority PRs are drawn in these blocks. These priority PRs are calculated only from the fixed score FS.

[0047] For example, let the fixed score FS of the search process for the monitoring target TG be FS1. Then, in the adjustment process, the search process for the monitoring target TG that occurs upon reception of the monitoring request RFW at the current time t is interrupted between another information process (i.e., job Job5) having a priority PR higher than the priority PR = 5 calculated based on the fixed score FS1 and another information process having a priority lower than the priority PR = 5. Note that in the example of FIG. 6, there is another information process (i.e., job Job3) having a priority PR = 5. In this case, in order to process the information process that occurred earlier, the processing order of the search process for the monitoring target TG is after another information process (i.e., job Job3) and before another information process (i.e., job Job1) having a priority lower than the priority PR = 5.

[0048] FIG. 7 is a diagram for explaining another example of the adjustment process of the processing order using the fixed score FS as a calculation element of the priority PR. In FIG. 7, the block of job Job4 shown in FIG. 6 is not drawn, and instead, job Job6 is drawn. Job Job6 corresponds to the search process for the monitoring target TG described in FIG. 6. This is because the information process in the waiting state of the process has changed over time.

[0049] In the example of FIG. 7, let the fixed score FS of the re-search process for the monitoring target TG be FS2 (> FS1). Then, in the adjustment process, the re-search process for the monitoring target TG that occurs at the current time t is interrupted between another information process (i.e., job Job5) having a priority PR higher than the priority PR = 6 calculated based on the fixed score FS2 and another information process (i.e., job Job3) having a priority lower than the priority PR = 6. Note that the fixed score FS2 is set to a value larger than the fixed score FS1 in order to give priority to the re-search of another monitoring target TG (e.g., TG2) over the new search of a certain monitoring target TG (e.g., TG1) and detect the other monitoring target TG (i.e., TG2) earlier.

[0050] When using the fixed score FS and the variable score VS as calculation elements for the priority PR, the items for setting the variable score VS and the calculation formula for the variable score VS in those items shall be set in advance. And when there are items set for the variable score VS, calculate the variable score VS based on the calculation formula corresponding to this item and apply it to the right side of the above formula (1). The following items can be mentioned as items for setting the variable score VS. (i) A score according to the current estimated state of the person under surveillance TG or a person other than the person under surveillance TG (ii) A score according to the position of the camera that acquired the group of frames including the image of the person under surveillance TG or a person other than the person under surveillance TG (iii) A score according to the attributes of the person under surveillance TG (iv) A score according to the usage history of the surveillance service by the user US (v) A score according to the setting information of the surveillance service by the user (vi) A score according to the contract information of the surveillance service by the user

[0051] The calculation formula for the variable score VS in item (i) can be set to vary according to the current emergency level of the person under surveillance TG or a person other than the person under surveillance TG. The calculation formula for the variable score VS in item (ii) can be set to vary according to the regional level based on public security data (for example, data on the crime incidence rate). The calculation formula for the variable score VS in item (iii) can be set to vary according to the attribute level based on public security data (for example, data on the crime victimization rate for each age and gender).

[0052] The calculation formula for the variable score VS in item (iv) can be set to vary according to the history such as the time zone with a high usage frequency by the user US or having been used until just before. The calculation formula for the variable score VS in item (v) can be set to vary according to the information on the option settings described above. The calculation formula for the variable score VS in item (vi) can be set to vary according to the fee information described above.

[0053] By performing such a processing order adjustment process, it becomes possible to perform information processing for search or re-search prior to information processing with a relatively lower priority PR. Therefore, it becomes possible to solve the problems of the above-described monitoring service. This leads to an improvement in the convenience of the monitoring service.

[0054] 5. Example of Processing Order Adjustment Process FIG. 8 is a flowchart for explaining the flow of a process performed in relation to the adjustment of the order of processes related to the monitoring service. The routine shown in FIG. 8 is repeatedly executed, for example, by the data processing device 11 shown in FIG. 1. The routine shown in FIG. 8 can be executed by a processor different from the processor that executes the routines shown in FIGS. 2 and 4.

[0055] In the routine shown in FIG. 8, first, as the process of step S21, the order of waiting jobs is adjusted. The process of step S21 is a normal order adjustment. In the process of step S21, for each of the waiting jobs, that is, the jobs Job in the waiting state for processing at the current time t, the priority PR using the above-described fixed score FS and variable score VS is calculated. Then, a command is sent to the processor that processes these jobs Job so that the processing is performed in descending order of this priority PR.

[0056] Following the process of step S21, the process of step S22 is performed. In the process of step S22, it is determined whether a search job or a re-search job has occurred. A search job is information processing for searching for the monitoring target TG, and occurs, for example, in response to receiving a monitoring request RFW. A re-search job is information processing for re-searching for the monitoring target TG, and occurs, for example, when the monitoring target TG is not detected in the information processing for searching for the monitoring target TG, or when a tracking loss of the monitoring target TG occurs.

[0057] If the process of step S22 is affirmative, the process of step S23 is performed. The content of the process of step S21 is basically the same as that of the process of step S21. However, the process of step S23 is an order adjustment characteristic of the embodiment. In the process of step S23, for each of the jobs waiting, a priority PR using the above-described fixed score FS and variable score VS is calculated. Then, a command is sent to the processor that processes these jobs so that the processing is performed in descending order of this priority PR.

Explanation of Signs

[0058] 10… Management server, 11··· Data processing device, 12… Database, 20… Infrastructure camera group, 30… User terminal, 40··· Target terminal, FS… Fixed score, PR… Priority, TG… Target under surveillance, US… User of surveillance service, VS… Variable score, AFU… Application for use, CAM… Camera data, RFW… Surveillance request, RFT… End request for surveillance, FR_CA… Frame group, IMG_TG… Image of target TG under surveillance, IMG_TGB… Full body image of target TG under surveillance, IMG_TGF… Facial image of target TG under surveillance

Claims

1. A method for managing a monitoring service, comprising: When receiving a monitoring request from a communication terminal of a user of the monitoring service, searching for a monitoring target of the user using a group of frames constituting a camera image; When the monitoring target is detected in the step of searching for the monitoring target, tracking the monitoring target; During the tracking, transmitting a group of frames including an image of the monitoring target to the communication terminal; When the monitoring target is not detected in the step of searching for the monitoring target, re-searching for the monitoring target using a group of frames constituting the camera image; including The monitoring service includes a plurality of information processes related to the monitoring service, The plurality of information processes each have a priority, The plurality of information processes are processed in descending order of the priority they have, The method further includes adjusting the order of the plurality of information processes, When the step of searching or re-searching for the monitoring target is performed, in the step of adjusting the order, the information process for the search or re-search is interrupted after an information process having a higher priority than the information process for the search or re-search and before an information process having a lower priority than the information process for the search or re-search. A method for managing a monitoring service, characterized in that.

2. The method according to claim 1, wherein The step of adjusting the order further includes calculating the priority of the plurality of information processes, The calculation elements of the priority used in the step of calculating the priority include fixed scores preset according to each content of the plurality of information processes, The fixed score set for the information processing for the re-search is higher than the fixed score set for the information processing for the search A method for managing a monitoring service, characterized in that **Claim 3** The method according to claim 2, wherein the plurality of information processes include a process of tracking a person included in a group of frames constituting the camera image and a person other than the monitoring target, the calculation elements of the priority used in the step of calculating the priority further include a variable score, the variable score includes at least one of a score according to the current estimated state of the person or the monitoring target, a score according to the position of the camera that acquired the group of frames including the image of the person or the monitoring target, a score according to the attribute of the monitoring target, a score according to the usage history of the monitoring service by the user, a score according to the setting information of the monitoring service by the user, and a score according to the contract information of the monitoring service by the user A method for managing a monitoring service, characterized in that **Claim 4** The method according to claim 1 or 2, wherein the step of re-searching for the monitoring target includes a step of estimating the position of the monitoring target; and a step of narrowing down candidates for the camera that acquired the frame including the image of the monitoring target based on the position of the monitoring target; and a step of searching for a frame including the image of the monitoring target using the current and past groups of frames acquired by the candidate cameras and further includes A method for managing a monitoring service, characterized in that **Claim 5** A system for managing a monitoring service, comprising a communication terminal of a user of the monitoring service; and a management server that communicates with the communication terminal comprises, When the management server receives a monitoring request from the communication terminal, it searches for the user's monitoring target using the frame group that constitutes the camera video, When the monitoring target is detected in the search for the monitoring target, it tracks the monitoring target, During the tracking, it transmits the frame group including the image of the monitoring target to the communication terminal, When the monitoring target is not detected in the search for the monitoring target, it re-searches for the monitoring target using the frame group that constitutes the camera video is configured as The monitoring service includes a plurality of information processes related to the monitoring service, The plurality of information processes each have a priority, The plurality of information processes are processed in descending order of their priorities, The management server is further configured to adjust the order of the plurality of information processes, When the search or re-search for the monitoring target is performed, in the adjustment of the order, a process is performed to interrupt the information process for the search or re-search after the information process having a higher priority than the information process for the search or re-search and before the information process having a lower priority than the information process for the search or re-search A management system for a monitoring service, characterized in that.

Images