Information processing device

Abstract

An information processing device, an information processing method, and a program for controlling processing related to captured images of a target location are provided. [Solution] The information processing device 100 includes a detection means 110 that receives a photographed image taken by a camera and detects the contents of the photographed image, a determination means 120 that determines a processing mode related to the photographed image based on the detection result of the contents of the photographed image by the detection means 110, and an execution means 130 that executes processing related to the photographed image corresponding to the processing mode determined by the determination means 120.

Description

[Technical field]

[0001] The present invention relates to an information processing device, an information processing method, and a program for controlling processing related to captured images of a target location. [Background technology]

[0002] Surveillance cameras are installed in places where a large number of people gather, such as airports, stations, stores, and event venues, to detect people's behavior and the people themselves. From the images captured by the surveillance cameras, processing such as detecting the movement of crowds of many people and detecting pre-registered people by face recognition is performed.

[0003] As an example, Patent Document 1 describes detecting objects and extracting features from input images captured by a camera. In particular, Patent Document 1 describes evaluating and selecting a detection method or extraction method for input images over time. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] International Publication No. 2014 / 155639 Summary of the Invention [Problem to be solved by the invention]

[0005] However, the technology of the above-mentioned Patent Document 1 only switches the processing of the input image every time. Therefore, the input image cannot be processed efficiently and appropriately. As a result, there is a problem that the imaging device installed to capture the input image cannot be used efficiently.

[0006] SUMMARY OF THE PRESENT DISCLOSURE ... An object of the present invention is to solve the above-mentioned problem of the inability to efficiently utilize the imaging device. [Means for solving the problem]

[0007] An information processing device according to one embodiment of the present invention includes: A detection means for detecting the contents of a captured image; a determination means for determining a processing mode related to the photographed image based on a result of detection of the contents of the photographed image; an execution unit for executing a process related to the captured image corresponding to the processing mode; Equipped with The structure is as follows.

[0008] In addition, a program according to one aspect of the present invention includes: In the information processing device, A detection means for detecting the contents of a captured image; a determination means for determining a processing mode related to the photographed image based on a result of detection of the contents of the photographed image; an execution unit for executing a process related to the captured image corresponding to the processing mode; To achieve this, The structure is as follows.

[0009] Further, an information processing method according to one aspect of the present invention includes: Detect the contents of the captured image, determining a processing mode associated with the captured image based on the detected content of the captured image; executing a process related to the captured image corresponding to the processing mode; The structure is as follows. Effect of the Invention

[0010] With the above-described configuration, the present invention can efficiently utilize the imaging device. [Brief description of the drawings]

[0011] [Figure 1] 1 is a diagram showing an overall configuration of an information processing system according to a first embodiment of the present invention. [Diagram 2]1 is a diagram showing an overall configuration of an information processing system according to a first embodiment of the present invention. [Figure 3A] 2 is a block diagram showing a configuration of the monitoring device disclosed in FIG. 1. [Figure 3B] 3B is a diagram showing an example of information stored in a criterion storage unit of the monitoring device disclosed in FIG. 3A. [Figure 4] 2 is a diagram showing a state of control processing by the monitoring device disclosed in FIG. 1; [Diagram 5] 2 is a diagram showing a state of control processing by the monitoring device disclosed in FIG. 1; [Figure 6] 2 is a diagram showing a state of control processing by the monitoring device disclosed in FIG. 1; [Figure 7] 2 is a diagram showing a state of control processing by the monitoring device disclosed in FIG. 1; [Figure 8] 4 is a flowchart showing a processing operation of the monitoring device disclosed in FIG. 1. [Figure 9] 2 is a diagram showing a state in which captured images are monitored by the monitoring device disclosed in FIG. 1. FIG. [Figure 10] 2 is a diagram showing a state in which captured images are monitored by the monitoring device disclosed in FIG. 1. FIG. [Figure 11] FIG. 11 is a block diagram showing a configuration of an information processing device according to a second embodiment of the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0012] <Embodiment 1> A first embodiment of the present invention will be described with reference to Figures 1 to 10. Figures 1 to 7 are diagrams for explaining the configuration of an information processing system, and Figures 8 to 10 are diagrams for explaining the processing operation of the information processing system.

[0013] [composition] The information processing system of the present invention is a system for controlling a camera C, which is an image capturing device installed at a target location such as indoors or outdoors, and the processing of captured images. In this embodiment, an information processing system equipped with multiple cameras C installed at a stadium S, which is a target location where events such as sports and concerts are held, will be described as an example. However, the information processing system of the present invention may be used in any location.

[0014] As shown in Fig. 1, the camera C constituting the information processing system is composed of an internal camera that photographs the inside of the stadium S as the target location, that is, the event venue such as the ground and the spectator seats, and an external camera that photographs the outside of the stadium S, that is, the vicinity of the entrance / exit gate and the surroundings of the stadium. Note that Fig. 2 shows an example of the camera C that photographs the vicinity of the entrance / exit gate G. However, the installation location of the camera C is not limited to the above-mentioned locations.

[0015] 1 and 2, the information processing system in this embodiment is configured to include a monitoring device 10 connected to a camera C, and an output device 20 and an information providing device 30 connected to the monitoring device 10. The monitoring device 10 executes analysis processing on images captured by the camera C and control processing of the camera C. The output device 20 outputs the captured images themselves, as well as outputting the results of processing performed by the monitoring device 10. The information providing device 30 provides various information such as the progress of an event being held in the stadium S and weather information around the stadium S. Each component will be described in detail below.

[0016] The monitoring device 10 is composed of one or more information processing devices each having a calculation device and a storage device. As shown in Fig. 3A, the monitoring device 10 includes a video detection unit 11, an information acquisition unit 12, a processing mode determination unit 13, and a control unit 14, which are constructed by the calculation device executing a program. The monitoring device 10 also includes a determination criterion storage unit 15 formed in the storage device.

[0017] The video detection unit 11 (detection means) first receives images captured by a camera C at regular time intervals. For example, as shown in FIG. 2, the video detection unit 11 receives images captured by a camera C installed near an entrance / exit gate G. The video detection unit 11 then detects the contents of the captured image, particularly the status of a person P in the captured image in this embodiment, from the shape, color, movement, etc. of an object shown in the captured image (step S1 in FIG. 8). As an example, the video detection unit 11 detects the number, density, and movement direction of the people P detected from the captured image. The video detection unit 11 then notifies the processing mode determination unit 13 of the detected status of the people P.

[0018] The information acquisition unit 12 acquires various information such as the progress of an event (phenomenon) taking place in the stadium S and weather information around the stadium S from the information providing device 30 connected to the monitoring device 10 via a network (step S2 in FIG. 8). Specifically, the information acquisition unit 12 acquires information such as before the start of a game, during a game, and after the game ends as the progress of a game (match) taking place in the stadium S, and acquires weather information such as sunny, rainy, and temperature as current weather information around the stadium S. Then, the information acquisition unit 12 notifies the processing mode determination unit 13 of the acquired information.

[0019] The video detection unit 11 may detect the above-mentioned game progress and weather information based on the contents of the captured image taken by the camera C, and the video detection unit 11 may notify the processing mode determination unit 13. For example, the video detection unit 11 may detect the number of people P on the ground, the presence or absence of a referee, and their movements based on the captured image taken by the camera C in the stadium S, and detect whether the game progress is before the start of the game, during the game, or after the end of the game from the detected contents. The video detection unit 11 may also detect whether a person P, who is a spectator, is holding an umbrella in the captured image, image distortion due to rain, and detect weather information such as the weather from the detected contents. The video detection unit 11 may detect various information about the stadium S, such as the above-mentioned progress and weather information, from the video image by any method.

[0020] The processing mode determination unit 13 (determination means) determines the processing mode to be executed in relation to the captured image based on the detection result of the content of the captured image notified by the video detection unit 11 and the information notified by the information acquisition unit 12 (step S3 in FIG. 8). Note that a determination criterion that defines what processing mode should be determined based on the detection result of the content of the captured image and the information received from the information acquisition unit 12 is stored in the determination criterion storage unit 15 of the monitoring device 10. Therefore, the processing mode determination unit 13 determines the processing mode using the determination criterion.

[0021] Here, the processing modes executed in association with the shooting mode include analysis processing for the captured image and control processing for the camera C for capturing the captured image. More specifically, the analysis processing for the captured image includes crowd detection processing, behavior detection processing, and face recognition processing for people in the captured image. Also, the control processing for the camera C includes control processing such as camera operation / stop, zoom, angle of view switching, movement, etc.

[0022] The above-mentioned judgment criteria are stored in association with the processing modes, for example, as shown in Fig. 3B. In the example of Fig. 3B, judgment criteria for captured images and acquired information, an area (camera) subject to the processing mode to be judged, and the processing mode to be judged (analysis processing and control processing) are associated with each other.

[0023] Here, a specific example of the determination process by the processing mode determination unit 13 will be described. In this example, a case where the determination criterion No. 1 shown in FIG. 3B is applied will be described. When the processing mode determination unit 13 receives information indicating the number and density of people P in the captured image as the contents of the captured image from the camera C near the entrance / exit gate G, the processing mode determination unit 13 checks whether the number and density exceed a threshold value for determining that it is a crowd. Then, as shown in FIG. 4, if the number and density exceed the threshold value, the processing mode for the captured image taken by the camera C near the entrance / exit gate G is determined to be the analysis process of "crowd detection process" (Yes in step S4, step S5 in FIG. 8). The crowd detection process is a process for detecting whether a crowd is generated by people in the captured image taken by the camera C, the moving direction and moving speed of the crowd, etc., and is executed by the analysis engine E connected to the monitoring device 10. Furthermore, when the number of people or density exceeds the threshold and it is determined that the analysis process of the crowd detection process is to be performed, the processing mode determination unit 13 also determines that a zoom control process is to be performed on the camera C near the entrance / exit gate G (Yes in step S6 of FIG. 8, step S7). That is, in this case, it is determined that a zoom down control is to be performed so that a wide-angle image can be captured so that the crowd detection process can be easily performed on the captured image.

[0024] Also, as an example, a case where the judgment criterion No. 2 shown in FIG. 3B is applied will be described. Conversely to the above, as shown in FIG. 5, when the number or density of people P in a photographed image received from a camera C near the entrance / exit gate G is equal to or less than a threshold, the processing mode judgment unit 13 judges the processing mode for the camera C to be the analysis processing of "face recognition processing". Note that the face recognition processing is an authentication processing that extracts features from the face image of a person in the photographed image and checks whether or not it matches a preregistered face image, and is executed by the analysis engine E connected to the monitoring device 10. Furthermore, when the number or density is equal to or less than a threshold and it is judged to be the analysis processing of face recognition processing, the processing mode judgment unit 13 also judges to perform a zoom control processing for the camera C near the entrance / exit gate G. That is, in this case, it is judged that zoom-up control is performed so that a close-up image can be captured so that the face image of a person can be easily acquired from the photographed image.

[0025] Also, as an example, a case where the judgment criteria No. 3, 4, and 5 shown in FIG. 3B are applied will be described. When the processing mode judgment unit 13 receives information indicating the progress of an event in the stadium S from the information acquisition unit 12, the processing mode judgment unit 13 checks the contents of the progress. Then, the processing mode is judged according to the progress of the event. For example, when the progress is "before the game starts", the processing mode for the image taken by the camera C near the entrance / exit gate G is judged to be "face recognition processing", and the processing mode for the camera C is judged to be "zoom-up control". When the progress is "during the game", the processing mode for the image taken by the camera C near the entrance / exit gate G is judged to be "behavior detection processing", and the processing mode for the camera C is judged to be "zoom-down control". When the progress is "after the game ends", the processing mode for the image taken by the camera C near the entrance / exit gate G is judged to be "crowd detection processing", and the processing mode for the camera C is judged to be "zoom-down control". The above-mentioned “behavior detection process” is an analysis process that detects a person engaging in specific behavior, such as suspicious behavior or staggering, from the movement and behavior of person P in the captured image, and is executed by an analysis engine E connected to the monitoring device 10.

[0026] As an example, the processing mode determination unit 13 determines the processing mode based on both the content of the captured image and the information of the target location. In this case, it is assumed that "progress: before the game starts" and "camera 1 captured image: number of people / density≦threshold" are set as the determination criteria, and "face recognition processing" and "zoom-up" are set as the corresponding processing modes. Then, when the progress is before the game starts and the number and density of people P in the captured image captured by the camera C near the entrance / exit gate G are equal to or less than the threshold, the processing mode for the captured image captured by the camera C is determined to be the analysis processing of "face recognition processing", and the processing mode for the camera C is determined to be "zoom-up control". As another example, when the progress is before the game starts and the number and density of people P in the captured image captured by the camera C near the entrance / exit gate G exceed the threshold, the processing mode for the captured image captured by the camera C is determined to be the analysis processing of "crowd detection processing", and the processing mode for the camera C is determined to be "zoom-down control".

[0027] Also, as an example, a case where the judgment criterion No. 6 shown in FIG. 3B is applied will be described. The processing mode judgment unit 13 checks whether an event is being held in the stadium S based on the progress of the event in the stadium S. For example, the processing mode judgment unit 13 collects information on the progress of the event, such as a time schedule, the time elapsed since the start of the event, and the movement of spectators analyzed from the captured image (leaving, sitting), and checks whether the event is not being held or has ended, or other progress status (being held, taking a break, etc.). Then, when the processing mode judgment unit 13 detects that the event is not being held, it judges a processing mode for controlling the operation / stop of the camera C itself and the analysis engine. For example, as shown by the cross mark in FIG. 6, the processing mode for the camera C near the entrance / exit gate G is judged to be "stop" and the shooting itself is stopped. Also, as shown by the cross mark in FIG. 6, the processing mode for some of the cameras C that shoot inside the stadium S is judged to be "stop", the processing mode for the remaining cameras C is judged to be "behavior detection processing", and the processing mode for the cameras C is judged to be "zoom down control". This makes it possible to detect illegal intruders into Stadium S while limiting the number of operating cameras.

[0028] Also, as an example, a case where the judgment criterion No. 7 shown in FIG. 3B is applied will be described. When the processing mode judgment unit 13 receives weather information around the stadium S from the information acquisition unit 12, the processing mode judgment unit 13 checks the contents of the weather. Then, the processing mode judgment unit 13 judges the processing mode according to the weather conditions. For example, when the weather around the stadium S is "sunny", the processing mode for the captured image taken from the camera C in the stadium S is judged to be "behavior detection processing", and the processing mode for the camera C is also judged to be "zoom down control". On the other hand, as an example where a different judgment criterion is applied, when the weather around the stadium S is "rainy", the processing mode for only a part of the cameras C that capture the inside of the stadium S is judged to be "stop" as shown in FIG. 7, and the analysis processing for the captured image is stopped. This is because it is expected that the number of spectators who put up umbrellas will increase due to the rain, and the processing accuracy of the behavior detection processing will decrease, so the shooting and analysis processing are stopped. As an example of the application of a different judgment criterion, when the temperature near the stadium S is high and exceeds a threshold value, the processing mode for the image captured by the camera C in the stadium S is determined to be "behavior detection processing," and the processing mode for the camera C is also determined to be "zoom-up control." This makes it possible to detect poor physical condition, such as staggering, among spectators in the stadium S.

[0029] In addition, as described above, when the video detection unit 11 detects the progress of the event or weather information around the stadium S from the contents of the captured image, the processing mode determination unit 13 may determine the processing mode based on the progress of the event and the weather information notified by the video detection unit 11.

[0030] In the above, the processing mode determination unit 13 determines that one analysis process is to be performed on the captured image of one area (camera), but it may determine that multiple analysis processes are to be performed on the captured image of one area (camera). That is, as shown in No. 8 of FIG. 3B, multiple analysis processes, "face recognition process" and "crowd detection process", may be associated with the judgment criterion "number of people / density≦threshold 2" for area 1 (camera 1). In this case, both the analysis processes "face recognition process" and "crowd detection process" are performed on the captured image of area 1 (camera 1). As shown in No. 8 of FIG. 3B, when one of the analysis processes, "face recognition process", is set to "priority", the processing mode determination unit 13 determines that the "face recognition process" is to be performed with priority over the "crowd detection process". In this case, the "face recognition process" is processed in the order of precedence over the "crowd detection process" by the analysis engine E, or is processed by allocating a large amount of resources such as the CPU of the analysis engine E, or when the resources are scarce, only the "face recognition process" is performed. In addition, the "face recognition process" may be processed with a larger number of frames of the captured image or with higher image quality than the "crowd detection process." In this manner, the processing mode determination unit 13 may determine the processing level of the processing mode.

[0031] In the above, the processing mode determination unit 13 determines the processing mode for each area (camera), but the processing mode may be determined for each divided area obtained by dividing an area, that is, an image captured by the camera C, into a plurality of areas. For example, the processing mode may be determined as "face recognition processing" for the left half area of ​​the captured image because the left half area satisfies the determination criterion "number of people / density≦threshold", and the processing mode may be determined as "crowd detection processing" for the right half area of ​​the captured image because the right half area satisfies the determination criterion "number of people / density>threshold". In this case, the processing mode may be determined as "face recognition processing" for the left half area of ​​the captured image, and no processing mode may be determined for the right half area of ​​the captured image. In this case, the processing mode for the camera C may be determined as "zoom-up control" in response to the "face recognition processing" for the left half area. Furthermore, when a person in the left half area of ​​the captured image in which the processing mode is determined as "face recognition processing" moves, the area in which the processing mode is determined as "face recognition processing" may be moved and set in accordance with the movement of the person. In this manner, the processing mode may be determined by checking whether or not the determination criterion is satisfied for each area of ​​the captured image.

[0032] Here, in the above description, the processing mode determination unit 13 detects the "number or density" of people appearing in the captured image as the content of the captured image to determine the processing mode, but the processing mode may be determined by detecting the content of the captured image as shown below. For example, the moving direction of the person appearing in the captured image may be detected, and the processing mode may be determined as follows: face authentication processing if the person is facing the camera, and full-body authentication processing if the person is moving away. Note that the full-body authentication processing is, for example, person authentication processing using a full-body image including the person's clothes, hairstyle, silhouette, belongings, etc. Also, for example, the face area of ​​the person appearing in the captured image may be detected, and the processing mode may be determined as face authentication processing if the size of the face exceeds a predetermined value, and full-body authentication processing if the size is equal to or smaller than the predetermined value. Also, for example, the behavior of the person appearing in the captured image may be detected, and when a specific behavior (such as waving something around, people fighting with each other, or falling down) is detected, it may be determined to be a control process to zoom in on the camera. However, the contents of the captured image used by the processing mode determination unit 13 when determining the processing mode are not limited to the above-mentioned contents.

[0033] In the example using the information in FIG. 3B described above, the processing mode determination unit 13 determines the processing mode depending on whether one type of information among the contents of the captured image, the event progress status, and the weather information satisfies the judgment criterion. However, when multiple types of information satisfy the judgment criterion, the processing mode corresponding to the judgment criterion may be determined. That is, when one type of information among the contents of the captured image, the event progress status, and the weather information, or two or three types of information among them satisfy the judgment criterion, the processing mode corresponding to the judgment criterion may be determined. Specifically, when the contents of the captured image and the event progress status, the contents of the captured image and the weather information, the event progress status and the weather information, the contents of the captured image, the event progress information, and the weather information satisfy the judgment criterion, the processing mode corresponding to the judgment criterion may be determined. Furthermore, at this time, the processing mode may be determined depending on whether multiple pieces of information in one type satisfy the judgment criterion. For example, when the number of people / density and the moving direction of people among the contents of the captured image satisfy the judgment criterion, the processing mode corresponding to the judgment criterion may be determined. In addition, in the example of Figure 3B described above, the processing modes to be determined are the case of "analysis processing" only and the case of "analysis processing" and "camera control processing", but it is also possible to determine only "camera control processing".

[0034] The control unit 14 (notification means, execution means) first notifies the outside by outputting the processing mode determined as described above from the output device 20. The control unit 14 also executes processing related to the captured image corresponding to the determined processing mode (step S8 in FIG. 8). That is, in accordance with the determined processing mode, it controls the operation / stop of the camera C and the zoom, and controls each analysis engine E to execute various analytical processes on the captured image. Furthermore, the control unit 14 outputs the processing results of the executed analytical processes from the output device 20. This allows an observer in the stadium S to recognize the processing mode being executed as well as the processing results.

[0035] 9 and 10 show an example of the state of analysis processing for a captured image output by the above-mentioned control unit 14 from the output device 20. First, as shown in Fig. 9, the output device 20 displays and outputs an image display area 21 for displaying the captured image, a camera name display area 22 for displaying the name of the camera capturing the captured image displayed in the image display area 21, an analysis processing name display area 23 for displaying the name of the analysis processing being performed on the captured image, a preview analysis processing name display area 24 for displaying the name of the analysis processing to be switched to, and a stop button 25.

[0036] The example of FIG. 9 shows a state where "face recognition processing" is performed on a photographed image captured by the camera C of the "gate camera 1". At this time, the entire photographed image may be output to the entire image display area 21, but in this example, the entire photographed image 21a is displayed in a reduced size at the top right, and a part 22b of the photographed image 21a is enlarged and displayed in the entire image display area 21. This enlarged image 22b is a display showing the processing result of the face recognition processing performed on the photographed image 21a, and is particularly an image in which an area in which a person who matches a person previously registered by face recognition (for example, a person registered as a person to be suspicious) exists is enlarged. At this time, the enlarged image 21a displays the face part of the person who matches the registered person by the face recognition processing in an emphasized manner. For example, the person who matches the registered person is displayed in black, and the face part of the person is displayed surrounded by a rectangular frame. Note that, when the face recognition processing is performed and a person who matches the registered person does not exist, the entire photographed image is displayed in the image display area 21 as shown in FIG. 10.

[0037] Then, while the face recognition process is being performed on the captured image as described above, the process mode determination unit 13 determines a new process mode. That is, when the content of the captured image, the event progress status, or the weather information meets another determination criterion, the process mode determination unit 13 determines a different process mode associated with the different determination criterion. Then, the control unit 14 displays and outputs the newly determined different process mode in the advance analysis process name display area 24, and switches to the new process mode after a certain time has passed. For example, in the example of FIG. 10, the number of people in the captured image has increased, and the number of people / density has exceeded a threshold value, so the analysis process among the process modes is determined to be a "crowd detection process", and such a display is performed in the advance analysis process name display area 24. At this time, if the operator operating the output device 20 does not want to switch to the "crowd detection process", he or she presses the stop button 25. As a result, the control unit 14 does not switch the analysis process on the captured image to the "crowd detection process", and continues to execute the "face recognition process". Furthermore, if a certain amount of time passes without the cancel button 25 being pressed after "crowd detection processing" is displayed in the preview analysis processing name display area 24, the control unit 14 switches the analysis processing for the captured image to "crowd detection processing."

[0038] Here, if the operator wishes to set a desired processing mode (analysis process) for the captured image, he or she can select the desired analysis process from the pull-down menu in the analysis process name display area 23. The control unit 14 then switches to the selected analysis process. This allows the operator to execute the desired analysis process, for example, by returning to the analysis process before the switch and executing it, even if the analysis process has been switched.

[0039] Furthermore, when the operator presses the stop button 25 or selects a desired analysis process from the pull-down menu in the analysis process name display area 23 as described above, the control unit 14 acquires information on the content of the captured image, the progress of the event, and the weather conditions at that time.The control unit 14 then learns to associate the acquired information with the analysis process in the processing mode before switching or the selected analysis process.In other words, the acquired information on the content of the captured image, the progress of the event, and the weather conditions may be used as a judgment criterion, and new judgment criterion information may be generated by associating the analysis process before switching or the selected analysis process with the judgment criterion.

[0040] In the examples of Figures 9 and 10, the image captured by one camera C and the analysis processing results for the captured image are displayed large in the image display area 21, but multiple images captured by multiple cameras C and the analysis processing results may also be displayed in the image display area 21.

[0041] As described above, according to the information processing system of the present invention, the shooting conditions and the analysis process of the captured images by the camera C installed in the target location such as the stadium S can be controlled according to the situation of the target location. Therefore, the observer can recognize the processing mode and the processing result executed according to the situation, and can take a quick action according to the processing result. As a result, the camera C installed in the target location can be used efficiently.

[0042] In the above, the situation of a person in the photographed image is detected as the content of the photographed image, and the processing mode for the photographed image is determined based on the situation of the person, but the processing mode may be determined based on the detection result of any content in the photographed image. For example, when an action such as a person leaving something behind or an animal is detected in the photographed image, the processing mode may be determined to perform a control process such as zooming up the camera C and an analysis process such as an object detection process. In the above, the processing mode for the photographed image is determined based on the weather information and the progress of the event in the target location, but the processing mode may be determined based on any information of the target location. Furthermore, in the above, the processing mode to be determined is determined based on the content of the analysis process for the photographed image and the content of the control process for the photographing device, but other processing modes may be determined as long as they are processes related to the photographed image.

[0043] <Embodiment 2> Next, a second embodiment of the present invention will be described with reference to Fig. 9. Fig. 9 is a block diagram showing the configuration of an information processing device in the second embodiment. Note that this embodiment shows an outline of the configuration of the monitoring device described in the first embodiment.

[0044] As shown in FIG. 9, the information processing device 100 according to the present embodiment includes: A detection means 110 for detecting the contents of a captured image; A determination means 120 for determining a processing mode related to the photographed image based on a result of detection of the contents of the photographed image; An execution means 130 for executing a process related to a captured image corresponding to a processing mode; Equipped with.

[0045] The above-mentioned detection means 110, determination means 120, and execution means 130 may be constructed by a calculation device equipped in the information processing device 100 executing a program, or may be constructed by electronic circuits.

[0046] The information processing device 100 having the above configuration: Detect the contents of the captured image, determining a processing mode associated with the captured image based on the detected content of the captured image; Execute a process related to the captured image corresponding to the processing mode; The above process is executed.

[0047] According to the above invention, a processing mode related to the captured image is determined according to the content of the image captured by the image capturing device installed at the target location, and processing related to the captured image corresponding to the determined processing mode is executed. Therefore, processing related to the captured image can be executed according to the situation of the target location, and the image capturing device installed at the target location can be efficiently used.

[0048] <Additional Notes> A part or all of the above-described embodiments can be described as follows: The following describes an overview of the configuration of an information processing device, an information processing method, and a program according to the present invention. However, the present invention is not limited to the following configuration.

[0049] (Appendix 1) A detection means for detecting the contents of a captured image; a determination means for determining a processing mode related to the photographed image based on a result of detection of the contents of the photographed image; an execution unit for executing a process related to the captured image corresponding to the processing mode; An information processing device comprising:

[0050] (Appendix 2) 2. The information processing device according to claim 1, The detection means detects a state of a person in the captured image, the determining means determines the processing mode based on a state of a person in the captured image. Information processing device.

[0051] (Appendix 3) The information processing device according to claim 1 or 2, The determination means determines an analysis processing mode representing the content of an analysis processing for the photographed image as the processing mode based on a detection result of the content of the photographed image, The execution means executes an analysis process corresponding to the analysis process mode on the captured image. Information processing device.

[0052] (Appendix 4) The information processing device according to claim 3, The detection means detects the number or density of people in the captured image, the determination means determines the analysis processing mode based on a detection result of the number or density of people in the captured image. Information processing device.

[0053] (Appendix 5) 5. The information processing device according to claim 3, The detection means detects a behavior of a person in the captured image, the determination means determines the analysis processing mode based on a detection result of a behavior of a person in the captured image. Information processing device.

[0054] (Appendix 6) 6. An information processing device according to any one of claims 1 to 5, The determination means determines, as the processing mode, an analysis processing mode representing the content of analysis processing for the photographed image based on a detection result of the content of the photographed image, and determines a control process for a photographing device for photographing the photographed image corresponding to the analysis processing mode. Information processing device.

[0055] (Appendix 7) 7. The information processing device according to claim 1, The determination means determines, as the processing mode, one of crowd detection processing, behavior detection processing, and face recognition processing for people in the captured image. Information processing device.

[0056] (Appendix 8) An information processing device according to any one of claims 1 to 7, the determination means determines, as the processing mode, a control process for a photographing device for photographing the photographic image; Information processing device.

[0057] (Appendix 9) An information processing device according to any one of claims 1 to 8, the determination means determines the processing mode based on a detection result of the content of the photographed image and information outputted in relation to a location where the photographed image is photographed; Information processing device.

[0058] (Appendix 10) 10. The information processing device according to claim 9, the determination means determines the processing mode based on information representing a progress status of an event taking place at a location where the photographed image is being photographed; Information processing device.

[0059] (Appendix 11) The information processing device according to claim 9 or 10, the determining means determines the processing mode based on meteorological information of a location where the photographed image is taken; Information processing device.

[0060] (Appendix 12) 12. An information processing device according to any one of claims 1 to 11, A notification means for notifying an external device of the processing mode is provided. Information processing device.

[0061] (Appendix 13) In the information processing device, A detection means for detecting the contents of a captured image; a determination means for determining a processing mode related to the photographed image based on a result of detection of the contents of the photographed image; an execution unit for executing a process related to the captured image corresponding to the processing mode; A program to achieve this.

[0062] (Appendix 14) Detect the contents of the captured image, determining a processing mode associated with the captured image based on the detected content of the captured image; executing a process related to the captured image corresponding to the processing mode; Information processing methods.

[0063] (Appendix 15) 15. The information processing method according to claim 14, Detecting a situation of a person in the photographed image as the content of the photographed image; determining the processing mode based on a state of a person in the captured image; Information processing methods.

[0064] (Appendix 16) 16. The information processing method according to claim 14, further comprising: determining an analysis processing mode representing the content of an analysis processing performed on the photographed image as the processing mode based on a detection result of the content of the photographed image; performing an analysis process corresponding to the analysis process mode on the captured image; Information processing methods.

[0065] (Appendix 17) 17. An information processing method according to any one of claims 14 to 16, comprising: determining, as the processing mode, a control process for a photographing device for photographing the photographed image; Information processing methods.

[0066] (Appendix 18) 18. An information processing method according to any one of claims 14 to 17, determining the processing mode based on a result of detecting the content of the photographed image and information outputted in relation to a location where the photographed image is photographed; Information processing methods.

[0067] The above-mentioned program can be stored and supplied to a computer using various types of non-transitory computer readable media. The non-transitory computer readable medium includes various types of tangible storage media. Examples of the non-transitory computer readable medium include magnetic recording media (e.g., flexible disks, magnetic tapes, hard disk drives), magneto-optical recording media (e.g., magneto-optical disks), CD-ROM (Read Only Memory), CD-R, CD-R / W, and semiconductor memory (e.g., mask ROM, PROM (Programmable ROM), EPROM (Erasable PROM), flash ROM, RAM (Random Access Memory)). The program may also be supplied to a computer by various types of transitory computer readable media. Examples of the transitory computer readable medium include electric signals, optical signals, and electromagnetic waves. The transitory computer readable medium can supply the program to a computer via a wired communication path such as an electric wire and an optical fiber, or via a wireless communication path.

[0068] Although the present invention has been described with reference to the above-mentioned embodiment, the present invention is not limited to the above-mentioned embodiment. Various modifications that can be understood by a person skilled in the art can be made to the configuration and details of the present invention within the scope of the present invention. [Explanation of symbols]

[0069] 10 Monitoring equipment 11 Video detection section 12 Information acquisition department 13 Processing mode determination unit 14 Control section 15 Judgment criteria storage section 20 Output Devices 30 Information provision device 100 Information processing device 110 Detection means 120 Judgment means 130 Means of Execution C Camera E Analysis Engine G Entry / Exit Gate P person S Stadium

Claims

1. An information processing device comprising: Acquire the captured image, Acquire the temperature of the location where the photographed image is taken; determining, based on the temperature, an analysis processing mode by the information processing device for the captured image of the location where the temperature was acquired, to be a behavior detection processing for a person in the captured image; Information processing methods.

2. An information processing device comprising: Acquire the captured image, Acquire the temperature of the location where the photographed image is taken; determining, based on the temperature, a control processing mode by the information processing device for the photographing device that photographed the location where the temperature was acquired, to be a zoom control processing mode of the photographing device; Information processing methods.

3. An information processing device comprising: Acquire the captured image, Acquire the temperature of the location where the photographed image is taken; when determining, based on the temperature, an analysis processing mode by the information processing device for the captured image of the location where the temperature was acquired and a control processing mode by the information processing device for the photographing device that captured the location where the temperature was acquired, if the temperature is equal to or higher than a threshold, the analysis processing mode is determined to be behavior detection processing for a person in the captured image, and the control processing mode is determined to be zoom control processing of the photographing device; Information processing methods.

4. 4. The information processing method according to claim 3, The information processing device, performing processing corresponding to the determined analysis processing mode and control processing mode, and detecting swaying of a person in the captured image; Information processing methods.

5. A means for acquiring a photographed image; A means for acquiring the temperature of a location where the photographed image is taken; a means for determining, based on the temperature, an analysis processing mode by an information processing device for the captured image of the location where the temperature was acquired, to be a behavior detection process for a person in the captured image; An information processing device comprising:

6. A means for acquiring a photographed image; A means for acquiring the temperature of a location where the photographed image is taken; a means for determining, based on the temperature, a control processing mode by an information processing device for an image capturing device that captured the image of the location from which the temperature was acquired, to be a zoom control processing mode of the image capturing device; An information processing device comprising:

7. A means for acquiring a photographed image; A means for acquiring the temperature of a location where the photographed image is taken; a means for determining, based on the temperature, an analysis processing mode to be performed by the information processing device for the photographed image of the location where the temperature was acquired, and a control processing mode to be performed by the information processing device for the photographing device that captured the location where the temperature was acquired; Equipped with the means for determining the analysis processing mode and the control processing mode determines, when the temperature is equal to or higher than a threshold, the analysis processing mode to be a behavior detection process for a person in the captured image, and determines, as the control processing mode, a zoom control process of the image capturing device; Information processing device.

8. Acquire the captured image, Acquire the temperature of the location where the photographed image is taken; determining, based on the temperature, a computer-based analysis processing mode for the captured image of the location where the temperature was acquired, to be a behavior detection process for a person in the captured image; A program that causes a computer to execute a process.

Images