Information processing device, imaging apparatus, client apparatus, control method of the same and program

Abstract

To provide a zoom control technique according to the imaging target size and the detection limit size of a subject.SOLUTION: An information processing device includes: detection means that detects a prescribed subject from an image captured by imaging means; decision means which decides a speed of changing the imaging field angle of imaging means according to the subject size of the detected prescribed subject; and control means that controls the change of the imaging field angle of the imaging means at the speed decided by the decision means. The detection means has the subject size of the detection limit that is capable of detecting the prescribed subject. The decision means decides the speed so as not to change the imaging field angle while the detected subject size takes a value within the first range which is determined based on the size of the imaging target, and changes the subject size associated with the end of the first range so that the first difference is greater than or equal to the first prescribed value when the first difference between the subject size of the detection limit and the subject size associated with the end of the first range is smaller than the first prescribed value.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to an information processing device, an imaging device, a client device, and a control method and program thereof. [Background technology]

[0002] Video distribution and recording are often performed for lectures, sports, etc. In recent years, automatic tracking shooting has started to be put into practical use with the aim of reducing costs such as labor costs. In Patent Document 1, it is determined whether a subject is within a predetermined area in a shooting range, and if it is determined that the subject is not within the predetermined area, the shooting range including the subject is zoomed out. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2013-9435 A Summary of the Invention [Problem to be solved by the invention]

[0004] However, Patent Document 1 does not anticipate setting the size of the subject's shooting target or zoom speed control that takes into account the detection limit size for detecting the subject, and there is a risk of losing the subject depending on the detection limit size.

[0005] An object of the present invention is to provide a zoom control technique that corresponds to a target shooting size and a detection limit size of a subject. [Means for solving the problem]

[0006] The present invention for solving the above problem is an information processing device, A detection means for detecting a predetermined subject from an image captured by the imaging means; a determination means for determining a speed at which the photographing angle of view of the photographing means is changed in accordance with the detected subject size of the predetermined subject; a control means for controlling a change of the photographing angle of view of the photographing means at the speed determined by the determination means; Equipped with the detection means has a detection limit object size capable of detecting the predetermined object, The determining means is determining the speed so as not to change the photographing angle of view while the detected subject size is within a first range determined based on a size of a photographing target; When a first difference between the subject size of the detection limit and the subject size associated with the end of the first range is smaller than a first predetermined value, the subject size associated with the end of the first range is changed so that the first difference is equal to or greater than the first predetermined value. Effect of the Invention

[0007] According to the present invention, it is possible to provide a zoom control technique according to the target shooting size and the detection limit size of the subject. [Brief description of the drawings]

[0008] [Figure 1] FIG. 1 is a diagram showing an example of a system configuration according to an embodiment. [Diagram 2] 2 is a diagram showing an example of a functional configuration of a network camera 100 and an example of a hardware configuration of a client device 140 according to an embodiment. [Diagram 3] FIG. 4 is a diagram showing an example of a user interface according to the embodiment. [Figure 4] 5A to 5C are diagrams for explaining a zoom speed control method according to the first embodiment. [Diagram 5] 5 is a flowchart showing an example of processing in the client device 140 according to the first embodiment. [Figure 6] 5 is a flowchart showing an example of processing in the network camera 100 according to the first embodiment. [Figure 7]8A to 8C are diagrams for explaining a zoom speed control method according to the second embodiment. [Figure 8] 10 is a flowchart showing another example of the processing in the client device 140 according to the second embodiment. [Figure 9] FIG. 11 is a diagram showing an example of the functional configuration of a network camera 100 according to a third embodiment. [Figure 10] 13A to 13C are diagrams for explaining a zoom speed control method according to the third embodiment. [Figure 11] 11 is a flowchart showing another example of the processing in the client device 140 and another example of the processing in the network camera 100 according to the third embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] Hereinafter, the embodiments will be described in detail with reference to the attached drawings. Note that the following embodiments do not limit the invention according to the claims. Although the embodiments describe a number of features, not all of these features are essential to the invention, and the features may be combined in any manner. Furthermore, in the attached drawings, the same reference numbers are used for the same or similar configurations, and duplicated descriptions are omitted.

[0010] [Embodiment 1] Fig. 1 shows an example of the configuration of a tracking system according to this embodiment. Fig. 1 is a block diagram showing an example of the functional configuration of a tracking system 10 according to this embodiment. The tracking system 10 is configured such that a network camera 100 and a client device 140 are connected and communicate with each other via a network 150. The network camera 100 includes an imaging device 110, a zoom driving device 120, and an information processing device 130, and is configured to be able to communicate with the client device 140 via the network 150, and may be realized as, for example, an imaging device having a network connection function, or a digital video camera.

[0011] In this embodiment, the network camera 100 controls the operation of the photographing device 110 and the zoom driving device 120 based on the setting information input from the client device 140 to photograph an image (including a still image and a video, the same applies below) of the photographing target area, processes the image obtained by the photographing by the information processing device 130, and outputs the image to the client device 140 via the network 150. The client device 140 is configured to include a display device such as a monitor, an input device, a personal computer (PC), etc. as an information processing device, and can accept input of setting information from a user and output the setting information to the network camera 100 via the network 150. In addition, the image photographed by the network camera 100 can be received via the network 150 and displayed on the display device. Although only one client device 140 is shown in FIG. 1, multiple client devices that receive images may be connected to the network 150. In that case, a distinction may be made between the client device 140 for an administrator who can input setting information and the client device 140 for a general user who only receives images.

[0012] 1 shows a configuration in which only one network camera 100 is arranged, the number of network cameras 100 that can be arranged in the tracking system 10 is not limited to one, and a greater number of cameras can be arranged. In addition, the settings of each of the multiple network cameras 100 may be unique to each network camera, or may be common to the multiple network cameras.

[0013] In this embodiment, the network camera 100 captures an image of the shooting space and transmits it to the client device 140 via the network 150. At that time, the network camera 100 detects a specific subject in the shooting space, automatically adjusts the zoom magnification and changes the shooting angle of view so that the size of the subject in the screen becomes the size specified by the client device 140 (the shooting target size or the target size). This zoom control operation ensures that the desired subject is always displayed in a size that is approximately the same as the shooting target size on the image provided to the client device 140. Therefore, for example, in applications such as live broadcasting of a lecture, the lecturer in the image is displayed in an approximately constant size, enabling stable video distribution.

[0014] In this way, since the tracking system 10 is required to photograph the subject at a size that matches the size of the photographing target, it is desirable to keep the photographing angle of view constant without performing zoom control while the subject is photographed at the photographing target size. On the other hand, when the subject to be detected is moving, the size of the subject detected due to the movement may fall below or exceed the limit size (detection limit size) at which it is possible to determine whether the subject is a specified subject. If the subject size exceeds the detection limit size, the subject cannot be recognized, and if this state continues for a certain period of time, the subject will be determined to be "lost."

[0015] Therefore, in this embodiment, the size of the dead zone is adjusted according to the relationship between the range of subject sizes for which zoom control is not performed (dead zone) and the detection limit size, thereby making it possible to avoid a situation in which the size of the detected subject exceeds the detection limit size and prevent the subject from being lost.

[0016] The functional configuration of the network camera 100 according to this embodiment will be described with reference to Fig. 2(A). Fig. 2 is a block diagram showing an example of the functional configuration of the network camera 100.

[0017] The photographing device 110 functions as an imaging unit for photographing the photographing space and outputting the image to the information processing device 130. The photographing device 110 includes an imaging element such as a CCD or CMOS sensor, an A / D converter, an image processing unit, and the like, and can output image information. The photographing device 110 also has a zoom mechanism and can change the photographing angle of view. The zoom mechanism is controlled by a zoom driving device 120. The zoom driving device 120 controls the zoom mechanism of the photographing device 110 according to a control signal from the control unit 134 of the information processing device 130, and automatically zooms in or out. At that time, the zoom driving device 120 can vary the zoom change speed according to the control signal.

[0018] The information processing device 130 controls the operation of the zoom driving device 120 based on the video information generated by the image capturing device 110 and the setting information acquired from the client device 140, and adjusts the capturing angle of view so that the subject to be tracked can be captured at a desired size. The information processing device 130 can function as a tracking device that tracks the subject so as to capture the subject at a desired size within the angle of view. The information processing device 130 can be configured to include a setting information input unit 131, a detection unit 132, a zoom determination unit 133, a control unit 134, and a communication unit 135.

[0019] Although the information processing device 130 is shown to be disposed inside the network camera 100, the detection unit 132, the zoom determination unit 133, and the control unit 134 among the components may be provided on the client device 140 side. In this case, zoom control can be performed from the client device 140 via the network 150.

[0020] The setting information input unit 131 receives setting information related to the subject to be photographed by the photographing device 110 from the client device 140 via the communication unit 135. The received setting information is provided to the detection unit 132 and the zoom determination unit 133. In this embodiment, the setting information may include at least information (designation information) designating the tracking target, a shooting target size, and a speed table for zoom control. The designation information may include, for example, information for identifying the designated subject (if the subject is a person, feature information extracted from the person's face, etc.). The information is used for subject detection. In addition, when one or more subjects are included in the video photographed by the photographing device 110, the designation information may be information designating one of them. In that case, a number may be assigned to the detected subject in advance, and the selected number may be included in the designation information. Alternatively, the designation information may be information designating the position or area in the screen where the subject to be tracked exists. The speed table is table information designating the zoom speed according to the size of the detected subject. When the zoom determination unit 133 determines that it is necessary to change the zoom based on the detected subject size, it can refer to the speed table, select a zoom speed corresponding to the current subject size, and notify the control unit 134. The designation information may further include information such as the position of the subject in the screen being tracked, and a tracking target lost determination criterion (for example, the time period over which the subject cannot be detected must exceed a certain number of seconds before it is determined that the subject is lost).

[0021] Based on the setting information input from the setting information input unit 131, the detection unit 132 analyzes the video information input from the image capturing device 110 to detect the subject to be tracked, and outputs the detection information to the zoom determination unit 133. In this embodiment, the detection information output to the zoom determination unit 133 includes at least information on the size of the subject to be tracked within the screen, but may also include other information such as position information of the subject to be tracked, detection accuracy, etc.

[0022] When the zoom determination unit 133 determines that it is necessary to change the zoom based on the subject size detected by the detection unit 132, it can refer to the speed table to select a zoom speed corresponding to the current subject size and notify the control unit 134. In addition, the control unit 134 also outputs the image information provided by the detection unit 132 to the control unit 134. When the control unit 134 acquires an instruction for a zoom speed and image information from the zoom determination unit 133, it outputs a control signal for zoom driving according to the instructed zoom speed to the zoom driving device 120. In addition, it outputs the image information to the communication unit 135. The zoom driving device 120 operates the zoom mechanism of the imaging device 110 according to the input control signal to change the zoom magnification. The communication unit 135 transmits the acquired image information to the client device 140 via the network 150. In addition, it provides the setting information received from the client device 140 to the setting information input unit 131.

[0023] Next, an example of the hardware configuration of the client device 140 will be described with reference to FIG. 2(B). The client device 140 can be realized as an information processing device such as a personal computer (PC), a smartphone, or a tablet terminal. In FIG. 2(B), a CPU 201 executes an OS, application programs, etc. stored in a HD (hard disk) 203, and controls temporary storage of information, files, etc. required for executing the programs in a RAM 202. The RAM 202 functions as a main memory, a work area, etc. for the CPU 201. The HD 203 stores application programs, driver programs, an OS, a control program, a processing program for executing processing corresponding to this embodiment, etc.

[0024] A display 204 is a display means for displaying commands input from an operation unit 209, information acquired from the outside, etc. An interface (hereinafter, referred to as I / F) 205 is a communication interface for connecting to an external device or a network. A ROM 206 stores programs such as a basic I / O program.

[0025] An external storage drive 207 can load programs and the like stored in a medium 208 into this computer system. The medium 208 as a recording medium stores predetermined programs and related data. An operation unit 209 is a user interface that allows an operator of this device to input instructions, and is composed of a keyboard and a mouse. A system bus 210 controls the flow of data within the device.

[0026] 2B is a diagram showing an example of the hardware configuration of the client device 140, but the hardware configuration of the information processing device 130 in the network camera 100 can also be realized in the same manner as the configuration shown in FIG. 2B. That is, the functions of the setting information input unit 131, the detection unit 132, the zoom determination unit 133, and the control unit 134 are realized by a configuration of the CPU 201, the RAM 202, the HD 203, the ROM 206, and the system bus 210. For example, the CPU 201 may execute a predetermined program stored in the ROM 206 or the HD 203, and temporarily store information, files, etc. required for executing the program in the RAM 202. The communication unit 135 is realized as the interface 105. The flowcharts of the processes in the network camera 100 shown below can also be realized by the configuration.

[0027] Next, the concept of subject size, a method for setting a target size for shooting, and a method for specifying a subject in this embodiment will be described with reference to FIG.

[0028] In this embodiment, as shown in FIG. 3A, the width of the screen 300 is "X", and the width of the subject region 302 surrounding the subject 301 is "x". Here, in this embodiment, the size at which the detection unit 132 can detect the subject is called the detection limit size as described above. In order to detect a specific subject from a video, a certain size is required to identify the information of the subject. For example, if the detected subject size is too small, or if it is too large and only part of the information of the subject is included in the video, it is difficult to identify the subject. Therefore, there are a minimum size DLmin and a maximum size DLmax at which the subject can be detected for each detection unit 132.

[0029] In this embodiment, the subject size is represented by "x / X", and the subject size where x / X=DLmin is the detection limit size in the minimum direction. Similarly, the subject size where x / X=DLmax is the detection limit size in the maximum direction. DLmin can be set to, for example, 0.06, i.e., 6%, and DLmax can be set to, for example, 0.8, i.e., 80%. However, these are merely examples, and the detection limit size can be set according to the screen size (number of pixels) and the detection performance of the detection unit 132.

[0030] In this embodiment, the subject region 302 can be a rectangular region surrounding the region of the subject 301, and the subject size can be the width of this subject region 302. Alternatively, when the subject 301 is a person, the person can be identified by the face, so the detection size can be the width of the face or head of the detected subject 301.

[0031] In this embodiment, the subject is assumed to be a person, and the person is recognized and identified by the face. Therefore, if the face can be determined, the person can also be specified, and in that respect, it is sufficient that the size of the face is ensured. In addition to the face, the person may be identified based on, for example, clothing, height, body shape, etc. In the following, a case will be described in which the subject size and the detection limit size are regarded as the width of the detected subject or subject area. Therefore, the value of the height "y" of the subject area is not included in the determination of the detection limit. However, depending on the determination target, the detection limit may be determined based on the value of the height "y" of the subject area or the ratio of the width "x" to the height "y". In that case, the following description of only the width can be applied in the same manner.

[0032] Next, a method for setting the target size of a subject for shooting will be described with reference to Fig. 3(B). In Fig. 3(B), a captured image 311 is displayed on a screen 310, the captured image 311 having a size corresponding to the shooting angle of view, a subject 312 is shown within the captured image 311, and a frame 313 indicating a subject area for determining the subject size is displayed so as to surround the subject 312. A value of "target size for shooting" can be input in an input area 314 as a target value for the subject size to be detected here. At this time, the size of the subject area 313 may be controlled so as to change in response to the input value in the display on the screen 310.

[0033] In addition, if the value of the detection limit size is predetermined, it is possible to control so that the value that can be input as the shooting target size is not smaller (or not larger) than the detection limit size. Alternatively, it is possible to control so that input of a value that is larger than the detection limit size by a predetermined value or more is permitted.

[0034] Fig. 3(C) shows an example of a subject selection screen. In Fig. 3(C), a captured image 321 is displayed on a screen 320, and persons 1, 2, and 3 are shown that are recognized as subjects. It is possible to specify which of these is to be the detection target in an input area 323. Fig. 3(C) shows a case where subject 2 is specified, and a frame 322 indicating that subject 2 has been specified is displayed on subject 2. Fig. 3(C) shows a case where one of a plurality of subjects is selected when there are multiple subjects in the image, but when only a single subject is shown, the single subject may be automatically set as the detection target.

[0035] Next, the setting of the zoom speed in this embodiment will be described with reference to Fig. 4. The zoom determination unit 133 performs processing to determine the zoom speed based on the subject size of the tracking target input from the detection unit 132 and the information on the shooting target size in the setting information input from the setting information input unit 131. In this embodiment, the zoom speed is changed in stages so that the zoom speed becomes slower as the difference between the subject size in the video information captured by the imaging device 110 and the set shooting target size becomes smaller, and when the subject size is near the shooting target size, the zoom speed is 0, that is, the shooting angle of view is maintained without being changed.

[0036] Specifically, in this embodiment, a speed table is prepared that defines the correspondence between subject size and zoom speed as a default, as shown in Fig. 4A, and zoom control is performed in seven steps according to the ratio of the subject size to the target size. According to this speed table, the zoom speed can be assigned in advance to each subject size based on the target size for shooting.

[0037] In FIG. 4(A), the case where the detected subject size matches the target shooting size is shown as 100%. Zoom control is not performed when the deviation between the target shooting size and the subject size is within a range of ±20% of the target shooting size. As the ratio of the subject size to the target shooting size becomes smaller, the zoom-in speed Vi is increased. In FIG. 4(A), when the subject size is in the range of 80% to 50% of the target shooting size, it is set to Vi1, when it is in the range of 50% to 10%, it is set to Vi2, and when it is in the range of less than 10%, it is set to Vi3. In this case, the magnitude relationship of the zoom-in speed is Vi1 <Vi2<Vi3となる。

[0038] Similarly, the zoom-out speed Vi is increased as the ratio of the subject size to the target size increases. In FIG. 4A, when the subject size is in the range of 120% to 200% of the target size, it is Vo1, when it is in the range of 200% to 300%, it is Vo2, and when it is in the range of more than 300%, it is Vo3. At this time, the magnitude relationship of the zoom-out speed is Vo1. <Vo2<Vo3となる。

[0039] In this manner, in this embodiment, the zoom speed is controlled so that the further away the subject size is from the target size, the faster the zoom speed becomes. In Fig. 4(A), the zoom speed is switched between three stages for zooming in and zooming out, but the zoom speed may be two stages or four stages or more as long as it is multiple stages. In addition, the default settings are not limited to those shown in Fig. 4(A), and the settings can be flexibly changed according to the environment in which this system is applied.

[0040] In addition, in the vicinity of the target size for shooting (within a range of ±20% of the target size for shooting), the zoom speed is set to 0 and the shooting angle of view is not changed. In this embodiment, the range in which zoom control is not performed is called the "dead zone." If the subject size belongs to the range of the "dead zone," and the subject to be detected moves in a direction away from the network camera 100 (in a direction in which the detection size becomes smaller), if the subject size becomes smaller beyond the dead zone, zoom control is performed to zoom in and bring the subject size closer to the target size for shooting. At this time, if the subject size associated with the end of the dead zone is close to or adjacent to the detection limit size, or if the target size for shooting is set near the detection limit size, there is a risk that the subject size will become smaller than the detection limit size at the timing when the subject size becomes smaller beyond the range of the dead zone and zoom in is about to be started. If the detection size of the subject becomes smaller than the detection limit size in this way, the possibility of losing the subject increases, so it is necessary to control it so that it does not fall below the detection limit.

[0041] Therefore, in this embodiment, when the difference (first difference: D1) between the range of the dead zone and the detection limit size is smaller than the first threshold (Dth1) or the first predetermined value, the range of the dead zone is narrowed to maintain the difference between the range of the dead zone and the detection limit at a certain level or more, thereby preventing the subject from being lost. This process can be performed, for example, when the target size is set in the user interface of FIG. 3(B). Here, the size of the threshold can be arbitrarily set by the user. Alternatively, a threshold set as a default according to the type of detection target (person, vehicle, etc.) may be prepared, and a threshold associated with the selected type may be used according to the type of detection target selected by the user.

[0042] Next, a zoom speed control method according to this embodiment will be described with reference to Figs. 4(B) and (C). Figs. 4(B) and (C) are diagrams for explaining a zoom control correction method in this embodiment. Fig. 4(B) shows the state of a default speed table 400 before the zoom speed is corrected (adjusted), and Fig. 4(C) shows the state of a speed table 410 after the zoom speed is corrected (adjusted). The percentages on the vertical axis in Figs. 4(B) and (C) indicate the subject size. Here, as an example, the shooting target size is 8%, the detection limit size is 6%, and the first threshold value that is the criterion for determining whether to adjust the dead zone is 1%.

[0043] 4B and 4C, the percentages shown on the right side indicate subject sizes, and subject size 401 indicates a size corresponding to a target size set by the user. Subject size 402 indicates a size corresponding to the minimum detection limit size of detection unit 132, and size 403 indicates a size corresponding to the maximum detection limit size of detection unit 132. Reference numbers 404 and 411 indicate dead zones where the zoom speed is 0, and subject sizes 405 and 412 indicate subject sizes at the minimum end of the zoom dead zone. Subject size 406 and 413 indicate subject sizes at the maximum end of the zoom dead zone.

[0044] In this embodiment, the difference in detection size (first difference: D1) between object size 502 corresponding to the minimum detection limit size and object size 405 at the minimum end of dead zone 404 is calculated and compared with a first threshold value (Dth1: 1% in the above example). If the first difference is smaller than the first threshold value, object size 405 at the minimum end of dead zone 404 is corrected so that the first difference becomes equal to or greater than the threshold value. If the correction value of size 405 is m, object size 412 at the minimum end of dead zone 411 after correction can be calculated by the following formula 1.

[0045] Object size 412 = Object size 402 + m Equation 1 4B, for example, the first difference between object size 402 corresponding to the minimum detection limit size and object size 405 at the minimum end of dead zone 404 is 0.4%, which is smaller than the first threshold value of 1% that has been set. Therefore, the threshold value of 1% is added to the size 6% of object size 402 at the minimum detection limit, and object size 412 at the minimum end of dead zone 411 after correction is set to 7%.

[0046] In this way, the default speed table 400 in Fig. 4(B) is corrected to the speed table 410 in Fig. 4(C) by modifying the association between the zoom speed and the subject size. The speed table 410 is provided to the network camera 100 from the client device 140. The zoom determination unit 133 refers to the speed table 410, and while the subject size detected by the detection unit 132 is within the dead zone 411, specifies the zoom speed as 0 in the zoom speed instruction output to the control unit 134. However, when the subject size falls below 7%, the zoom speed is switched from 0 to Vi1, and a control signal specifying the zoom speed is sent to the control unit 134.

[0047] Next, an example of processing in the tracking system 10 of this embodiment will be described with reference to the flowchart of Fig. 5. Fig. 5(A) is a flowchart showing an example of processing for generating setting information for the network camera 100 by the client device 140. Fig. 5(B) is a flowchart showing an example of processing for setting zoom control information in the flowchart of Fig. 5(A). The processing corresponding to this flowchart can be realized, for example, by the CPU 201 operating in the client device 140 executing a corresponding program (stored in HD 203, etc.).

[0048] First, in S501, CPU 201 accepts designation of a subject from the user via operation unit 209. At this time, CPU 201 displays screen 320 as shown in Fig. 3(C) on display 204 by superimposing information for identifying the subject detected by CPU 201 or detection unit 132 on an image captured by imaging device 110, and can accept selection of any of the displayed subjects. When designation of a subject is accepted, CPU 201 extracts and stores information expressing the characteristics of the subject (characteristic information).

[0049] In the next step S502, the CPU 201 accepts the setting of the target size (Ts) of the subject to be detected from the user via the operation unit 209. At this time, the display 204 displays a screen 310 shown in Fig. 3B, and can accept the input of the target size.

[0050] After accepting the input of the target shooting size, in the next step S503, the CPU 201 sets the zoom control information and generates a speed table. The details of the processing in step S503 will be described later with reference to Fig. 5(B). After the zoom control information is set, in the next step S504, the CPU 201 saves the set zoom control information, and in step S505, transmits setting information including information for identifying the subject, including the above-mentioned characteristic information, the target shooting size (Ts), and the zoom control information to the network camera 100.

[0051] Next, the details of the process in S503 will be described with reference to FIG. 5(B). First, in S511, the CPU 201 sets a default zoom speed based on the shooting target size (Ts) (speed table 1). An example of the setting of the speed table 1 here corresponds to, for example, the speed table 400 shown in FIG. 4(B). In addition, when the shooting target size (Ts) is set, the subject size (NST) at the end of the dead zone on the minimum side can be specified accordingly. Here, the minimum side (subject size 405 in FIG. 4(B)) will be mainly discussed, so in the following, the description of which end it is will be omitted for the sake of simplicity. Although the description in this embodiment will be omitted, the relationship between the subject size 406 at the end on the maximum side and the subject size 403 corresponding to the detection limit size can also be handled in the same way.

[0052] In the next step S512, the CPU 201 compares the subject size (NST) at the end of the dead zone, which is determined from the shooting target size (Ts), with the subject size (DL) corresponding to the detection limit. If the absolute value of the first difference (D1) between NST and DL is smaller than the first threshold value Dth1 as a result of this comparison (YES in S513), the process proceeds to S514. On the other hand, if the first difference D1 is equal to or larger than the threshold value Dth1 (NO in S513), the process ends and proceeds to S504. In this case, the speed table 1 set in S511 is not modified, and the contents of the speed table 1 are stored as they are as zoom control information.

[0053] In S514, the CPU 201 corrects the speed table 1. Specifically, the value of the object size (NST) at the end of the dead zone in the speed table 1 is updated by adding the object size (DL) corresponding to the detection limit to the first threshold value Dth1. The value added here may be a value different from the threshold value Dth1. As a result, the situation in which the object size 405 at the end of the dead zone is adjacent to the object size 402 corresponding to the detection limit as shown in FIG. 4B is changed to a state in which the object size 412 at the end of the dead zone is disposed at a certain distance from the object size 402 corresponding to the detection limit as shown in FIG. 4C. This correction changes the default setting speed table 1 as shown in FIG. 4B to the corrected speed table 2 as shown in FIG. 4C. Thereafter, the process proceeds to S504, and the contents of the corrected speed table 2 are stored as zoom control information. The process in FIG. 5B may be executed not on the client device 140 side but on the network camera side in response to receiving setting information of the shooting target size.

[0054] Next, the process of the network camera 100 in this embodiment will be described with reference to the flowchart in Fig. 6. The process corresponding to the flowchart can be realized, for example, by one or more processors of the network camera 100 executing a corresponding program (stored in a RAM, HD, etc.).

[0055] In S601, the communication unit 135 of the network camera 100 receives setting information from the client device 140 via the network 150. The communication unit 135 supplies the received setting information to the setting information input unit 131. The setting information input unit 131 provides information for identifying a subject from the received setting information to the detection unit 132. The setting information input unit 131 also provides information on a target shooting size and zoom control information to the zoom determination unit 133.

[0056] When shooting is started in the following S602, the shooting device 110 provides image information obtained by shooting the shooting area to the detection unit 132 of the information processing device 130. In S603, the detection unit 132 detects the subject based on information for identifying the subject provided from the setting information input unit. Information on the detected subject is provided to the zoom determination unit 133 together with the image information. Although not described in the explanation of each step below, the image information is provided to the communication unit 135 via the zoom determination unit 133 and the control unit 134, and is then transmitted from the communication unit 135 to the client device 140 via the network 150.

[0057] The zoom determination unit 133 determines the subject size based on the subject information provided by the detection unit 132 in S604. In the following S605, the zoom determination unit 133 determines the zoom speed according to the zoom control information provided by the setting information input unit 131 based on the relationship between the subject size and the shooting target size. According to the example of FIG. 4(C), the zoom speed is set to 0 while the detected subject size is within the range of 9.6% to 7% of the screen width. Then, for the zoom-in operation, the zoom speed is set to Vi1 when the subject size is between 7% and 4%, Vi2 when it is between 4% and 0.8%, and Vi3 when it is smaller than 0.8%. Also, for the zoom-out operation, the zoom speed is set to Vo1 when the subject size is between 9.6% and 16%, Vo2 when it is between 16% and 24%, and Vo3 when it is larger than 24%.

[0058] In the next S606, the zoom determination unit 133 provides the determined zoom speed to the control unit 134, and the control unit 134 controls the zoom drive device 120 to operate at the designated zoom speed. In the next S607, it is determined whether or not to end the shooting, and if the shooting is to end ("YES" in S607), this process ends, and if the shooting is not to end ("NO" in S607), the process returns to S603 and continues.

[0059] In the above embodiment, as shown in FIG. 4B, when the subject size of the end of the dead zone is located near the subject size of the detection limit, the subject size corresponding to the end is adjusted to change the range of the dead zone. Here, for example, when the setting of the shooting target size is accepted in S502, if it is determined that the subject size of the end specified based on the input shooting target size is located near the subject size of the detection limit, a message to that effect may be displayed to notify that the range of the dead zone will be changed. At this time, if an operation instruction is accepted from the user who has confirmed the message to the effect that the range of the dead zone is not desired to be changed, the change of the range of the dead zone may be skipped.

[0060] Also, the input of the shooting target size that would change the range of the dead zone as described above may not be permitted, or may be permitted after displaying the above message. Specifically, the input lower limit value of the shooting target size may be specified based on the relationship between the subject size at the end of the dead zone and the subject size at the detection limit, and only values ​​larger than the input lower limit value may be permitted as the input of the shooting target size.

[0061] In the example of FIG. 4B, the subject size 402 at the detection limit is 6%. In order to set the subject size 405 at the end of the dead zone to 7% by moving it away from this detection limit by the first threshold value (Dth1=1%), the target size for shooting needs to be 8.75%. In this case, it is possible to accept only values ​​larger than 8.75% as the target size for shooting. Alternatively, when a target size for shooting below 8.75% is input, the input may be accepted after displaying a message or warning to the effect that the range of the dead zone will be narrowed or that the possibility of losing the subject will increase.

[0062] As described above, according to this embodiment, when the set shooting target size is close to the detection limit size of the subject, the range of the dead zone is changed, and the zoom speed at the detection limit is increased ahead of the default setting. This makes it possible to reduce the possibility of losing the subject due to failure to detect the subject by increasing the zoom speed at the detection limit.

[0063] [Embodiment 2] A second embodiment will be described below. The system configuration corresponding to this embodiment is similar to that shown in FIG. 1, so a description thereof will be omitted here. In the first embodiment, a case was described in which the zoom speed is changed from the default speed table 1 to speed table 2 based on the relationship between the subject size at the end of the dead zone and the subject size corresponding to the detection limit. In this embodiment, as an alternative embodiment to the first embodiment or an additional embodiment, a case will be described in which the zoom speed is changed from the default value based on the relationship between the size at which the zoom speed switches and the detection limit size.

[0064] Fig. 7 is a diagram for explaining a zoom speed correction method according to this embodiment. Fig. 7(A) shows the state of a default speed table 700 before the zoom speed is corrected (adjusted), and Fig. 7(B) shows the state of a speed table 710 after the zoom speed is corrected (adjusted). The percentages on the vertical axis in Fig. 7(A) and (B) indicate the subject size. In Fig. 7, the shooting target size is 12%, and the detection limit size is 6%. In addition, the second threshold value (Dth2) or the second predetermined value, which is the criterion for determining whether to adjust the subject size at which the zoom speed is switched, is set to 2%.

[0065] First, in Fig. 7(A), when the shooting target size (Ts) is set to 12%, according to the default zoom speed calculation method of Fig. 4(A), the range of subject size from 9.6% to 14.4% is set as the dead zone 704. Also, the zoom-in speed Vi1 is associated with the range of subject size from 9.6% to 6%. Also, Vi2 is associated with the subject size from 6% to 1.2%. At this time, the zoom-in speed switches at a subject size of 6%, which coincides with the subject size detection limit.

[0066] In this case, if the subject moves away from the network camera 100 at a speed faster than the speed at which the subject is zoomed in at the zoom speed Vi1, there is no point in increasing the zoom-in speed after the subject size reaches the detection limit. Therefore, the subject size at which the zoom-in speed is switched is changed in advance so that the timing of switching from the zoom-in speed Vi1 to Vi2 is brought forward. In FIG. 4(B), the zoom-in speed is changed from Vi1 to Vi2 when the detected size of the subject becomes 8%. This makes it more certain that the subject can be continuously photographed at the target shooting size without losing the subject.

[0067] The process of generating setting information for the network camera 100 by the client device 140 according to this embodiment is similar to that shown in Fig. 5(A). In this embodiment, the details of the process of setting the zoom control information in S503 are different, and will be described with reference to Fig. 8.

[0068] Fig. 8 is a flowchart corresponding to an example of the zoom control information setting process in S503 in Fig. 5(A). The processes in steps with reference numbers S511 to S514 in Fig. 8 are similar to those shown in Fig. 5(B), so the description here is omitted. After S514, in S801, the CPU 201 compares the subject size (CS) at the zoom speed switching position with the subject size (DL) at the detection limit. If there are multiple sizes for the zoom speed switching position, the comparison is performed with each of them.

[0069] In the next S802, if the absolute value of the difference (second difference: D2) between the size at the switching position (CS) and the subject size at the detection limit (DL) is equal to or greater than the second threshold Dth2 (NO in S513), this process ends. On the other hand, if the absolute value of the difference D2 is smaller than the second threshold Dth2 (YES in S513), the process proceeds to S803.

[0070] In S803, the CPU 201 updates the object size (CS) at the switching position by adding the detection limit object size (DL) to the second threshold Dth2. The value added here may be a value different from the second threshold Dth2. As a result, the state in which the object size (CS) at the zoom speed switching position is adjacent to the detection limit object size (DL) as shown in FIG. 7A is changed to a state in which the object size (CS) at the switching position is disposed at a certain distance from the detection limit object size (DL) as shown in FIG. 7B. This correction changes the default speed table 1' as shown in FIG. 7A to the corrected speed table 2' as shown in FIG. 7B. Note that, although the zoom speed correction corresponding to the first embodiment is not performed in FIG. 7B, the zoom speed correction of the first embodiment can also be performed as long as the conditions are satisfied in the processes from S511 to S514 according to the flowchart in FIG. 8. Similarly to FIG. 5(B), the process of FIG. 8 may be executed not on the client device 140 side but on the network camera side in response to receiving setting information on the target shooting size.

[0071] The information in the speed table 2' of the zoom speed thus changed is stored by the CPU 201 as zoom control information in S504, and is also transmitted to the network camera 100 as setting information together with other information in S505.

[0072] In this embodiment, the network camera 100 can also execute the process according to the flowchart of Fig. 6, and at that time, the setting information received by the communication unit 135 of the network camera 100 from the client device 140 via the network 150 includes zoom control information corresponding to the above-mentioned embodiment. The communication unit 135 supplies the received setting information to the setting information input unit 131. The setting information input unit 131 provides the information on the shooting target size and the zoom control information from the received setting information to the zoom determination unit 133. The zoom determination unit 133 determines the subject size based on the subject information provided from the detection unit 132 in S604, and determines the zoom speed according to the subject size by referring to the zoom control information provided from the setting information input unit 131 in S605. The rest is the same as in the first embodiment.

[0073] According to the example of Fig. 7(B), the zoom speed is set to 0 while the detected subject size is within the range of 14.4% to 9.6% of the screen width. Then, for the zoom-in operation, the zoom speed is set to Vi1 when the subject size is between 9.6% and 8%, Vi2 when it is between 8 and 1.2%, and Vi3 when it is less than 1.2%. This makes it possible to perform zoom control by shifting the subject size at the timing of switching the zoom-in speed from the subject size at the detection limit, making it possible to more reliably track the subject within the detection limit.

[0074] As described above, according to this embodiment, when the subject size at the zoom speed switching position determined based on the set shooting target size is close to the subject size at the detection limit, the zoom speed near the detection limit can be increased to reduce loss due to detection failure.

[0075] [Embodiment 3] Next, a description will be given of embodiment 3. In the above description of embodiments 1 and 2, the zoom speed is not controlled in consideration of the moving speed of the subject. In contrast, in this embodiment, the zoom is controlled in consideration of the moving speed of the subject.

[0076] The configuration of a network camera 100 according to this embodiment is as shown in Fig. 9. Among these, components corresponding to those shown in Fig. 2 are given the same reference numerals. As a new component in this embodiment, the network camera 100 has a calculation unit 901.

[0077] The calculation unit 901 calculates the subject speed based on the change in the subject between multiple frames of the acquired video information. The subject speed can be calculated by calculating an average value of the subject size change rate from the subject size history for n frames before the current frame. Alternatively, the subject speed may be calculated by dividing the amount of movement of the center of gravity position of the subject area for n frames before the current frame by time. The method of calculating the subject speed is not limited to the above method. As long as the speed of the subject moving forward and backward, approaching or moving away from the network camera 100, is known, the calculation may be performed by another method other than the above method.

[0078] The operation of the information processing device 130 corresponding to this embodiment will be described below. The zoom determination unit 133 determines the zoom speed based on the size of the subject detected by the detection unit 132. The method of determining the zoom speed is the same as that described in the first embodiment, and therefore a description thereof will be omitted here. In addition to the method, this embodiment is characterized in that the speed table used to determine the zoom speed is switched according to the subject speed, as described below.

[0079] The zoom determination unit 133 calculates a first difference (D1) between the object size corresponding to the detection limit and the object size at the end of the dead zone, and determines whether the difference is equal to or greater than a third threshold Dth3. Here, the third threshold Dth3 or the third predetermined value can be a value greater than the first threshold Dth1. If the difference is equal to or greater than the third threshold Dth3, the information on the object size is output to the calculation unit 901. When the information on the object size is input, the calculation unit 901 determines whether the object size is smaller than a predetermined object determination size based on the setting information input from the setting information input unit 131, and calculates the object speed v if it is determined to be smaller. The calculation unit 901 provides the information on the calculated object speed v to the zoom determination unit 133, and the zoom determination unit 133 determines the zoom speed based on the value of the object speed v.

[0080] Fig. 10 is a diagram for explaining a zoom speed correction method according to this embodiment. Fig. 10(A) shows a default speed table 1000 before the zoom speed is corrected (adjusted), and Fig. 10(B) shows a speed table 1010 after the zoom speed is corrected (adjusted). The percentages on the vertical axis in Fig. 10(A) and (B) indicate the subject size. In Fig. 10, the shooting target size is 12%, and the detection limit size is 6%.

[0081] First, in FIG. 10A, when the shooting target size (Ts) is set to 12%, the range of the subject size from 9.6% to 14.4% is set to the dead zone 1004 according to the calculation method of the default zoom speed in FIG. 10A. The zoom-in speed Vi1 is associated with the range of the subject size from 9.6% to 6%. Vi2 is associated with the subject size from 6% to 1.2%. Reference numeral 1009 indicates the subject determination size that is the criterion for determining whether or not the subject speed is determined in the calculation unit 901, and is set to 11% here. The subject determination size can be the subject detection size included in the dead zone. In this embodiment, the subject determination size is set to a value obtained by subtracting 1% from the shooting target size, but the determination method is not limited to this method and can be determined by other methods as long as the value is smaller than the shooting target size.

[0082] 10A is the same as that in FIG 7A, the zoom speed may be corrected according to the second embodiment. However, the zoom speed correction method of this embodiment will be described here, and the zoom speed correction according to the second embodiment will be omitted.

[0083] In FIG. 10A, the subject size 1005 at the end of the dead zone is 9.6%, and the subject size 1002 at the detection limit is 6%. If the first difference is equal to or greater than the third threshold Dth3, the subject determination size 1009 is set. For example, if the third threshold Dth3 is 3%, the first difference is greater than the third threshold Dth3, and the subject determination size 1009 is set. In this case, the calculation unit 901 calculates the subject speed v. If the subject speed v is faster than a predetermined speed, for example, the speed threshold Sth, the subject size corresponding to the switching positions (1005, 1007, 1008) of the zoom speeds Vi1, Vi2, and Vi3 as shown in the speed table 1010 in FIG. 10B is changed, and the zoom speed itself is increased from Vi1 to Vi1', from Vi2 to Vi2', and from Vi3 to Vi3'. This makes it possible to ensure a zoom speed that corresponds to a moving subject, and to avoid losing the subject. On the other hand, when the subject speed v is equal to or lower than a predetermined speed, for example, equal to or lower than the speed threshold value Sth, the speed table 1000 shown in FIG. 10(A) is used.

[0084] The process of generating setting information for the network camera 100 by the client device 140 corresponding to this embodiment is similar to that shown in Fig. 5(A). In this embodiment, the details of the zoom control information setting process in S503 are different, so they will be described with reference to Fig. 11(A). Fig. 11(A) is a flowchart corresponding to a modified example of the zoom control information setting process in S503 in Fig. 5(A), and can be executed in place of or in addition to the zoom control information setting process in Fig. 5(B) or Fig. 8.

[0085] First, in S1101, the CPU 201 sets a default zoom speed based on the shooting target size (Ts). An example of the zoom speed setting here corresponds to the example shown in FIG. 10(A). The default speed table set here is called speed table 1". In addition, when the shooting target size (Ts) is set, the subject size (NST) 1005 at the end of the dead zone can be specified accordingly.

[0086] In the next step S1102, CPU 201 compares the subject size (NST) at the end of the dead zone, which is determined from the shooting target size, with the subject size (DL) at the detection limit. If the result of this comparison shows that the first difference (D1) between NST and DL is equal to or greater than the third threshold value Dth3 (YES in S1103), the process proceeds to S1104. On the other hand, if the first difference is smaller than the third threshold value Dth3 (NO in S1103), the process ends, and then the process proceeds to S504. In this case, the subject determination size is not set, and the calculation unit 901 does not calculate the subject speed.

[0087] In S1104, the size for subject determination is set. As described above, in this embodiment, as an example, the size for subject determination can be set to a value obtained by subtracting 1% from the shooting target size (Ts). In the following S1105, the zoom speed is changed from the default speed table 1" set in S1101 to generate speed table 2". Thereafter, the process proceeds to S504. In the speed table 2" generated at this time, as shown in FIG. 10(B), the subject size corresponding to the zoom-in speed switching position is different from the subject size corresponding to the switching position shown in FIG. 10(A), and the zoom speed itself in each speed section is also increased. In addition, the zoom speed at the subject size corresponding to the detection limit is set to the fastest (Vi3' in FIG. 10(B)).

[0088] In this embodiment, the network camera 100 performs zoom control by switching between two tables based on the subject speed. Therefore, in S504 in FIG. 5A, information on speed table 1" and speed table 2" is included in the zoom control information, and in S505, the two speed tables, the subject determination size, and the speed information on the speed threshold Sth are included in the setting information and transmitted to the network camera 100. Note that the process in FIG. 11 may also be executed on the network camera side, rather than on the client device 140 side, in response to receiving setting information on the shooting target size, as in the case of FIG. 5B and FIG. 8.

[0089] Next, the process of the network camera 100 in this embodiment will be described with reference to the flowchart in Fig. 11(B). The process corresponding to the flowchart can be realized, for example, by one or more processors of the network camera 100 executing a corresponding program (stored in RAM, HD, etc.).

[0090] In S1111, the communication unit 135 of the network camera 100 receives setting information from the client device 140 via the network 150. The communication unit 135 supplies the received setting information to the setting information input unit 131. The setting information input unit 131 provides information for identifying the subject from the received setting information to the detection unit 132. In addition, it provides information on the shooting target size, the subject determination size, the speed threshold Sth, and zoom control information (speed table 1 and speed table 2) to the zoom determination unit 133.

[0091] When shooting is started in subsequent S1112, the shooting device 110 provides image information obtained by shooting the shooting area to the detection unit 132 of the information processing device 130. In S1113, the detection unit 132 detects the subject based on information for identifying the subject provided from the setting information input unit 131. Information on the detected subject is provided to the zoom determination unit 133 together with the image information. This image information is transmitted to the client device 140 via the zoom determination unit 133, the control unit 134, and the communication unit 135 and through the network 150.

[0092] In S1114, zoom determination unit 133 determines the subject size based on the subject information provided from detection unit 132, and determines whether the subject size is smaller than the subject determination size. If the subject size is smaller than the subject determination size ("YES" in S1114), the process proceeds to S1115. On the other hand, if the subject size is equal to or larger than the subject determination size ("NO" in S1114), the process proceeds to S1116.

[0093] In S1115, the zoom determination unit 133 provides the subject information and image information to the calculation unit 901 to calculate the subject speed v, and acquires this from the calculation unit 901. The zoom determination unit 133 holds images of multiple frames including the current frame and previous frames, and provides them to the calculation unit 901 as image information for determining the subject speed v. Upon receiving the subject speed v from the calculation unit 901, the zoom determination unit 133 compares the subject speed v with a speed threshold Sth to determine the magnitude of the subject speed v. In the following S1116, the zoom determination unit 133 selects a speed table from either speed table 1" or speed table 2" depending on the magnitude relationship between the subject speed v and the speed threshold Sth. Specifically, if the subject speed v is greater than the speed threshold Sth, speed table 2" is selected, and if the subject speed v is equal to or less than the speed threshold Sth, speed table 1" is selected.

[0094] When the speed table is selected, the zoom determination unit 133 determines the subject size in the following S1117, and in S1118, based on the determined subject size, refers to the speed table selected in S1116 to determine the zoom speed. In S1119, the zoom determination unit 133 provides the determined zoom speed to the control unit 134, and the control unit 134 controls the zoom drive device 120 to operate at the specified zoom speed. In the following S1120, if shooting is to end ("YES" in S1120), this process ends, and if shooting is not to end ("NO" in S1120), the process returns to S1113 and continues.

[0095] In the explanation of Fig. 11(B), a comparison between the subject size and the subject determination size is basically performed in S1114, but the embodiment is not limited to this. For example, if the subject determination size is not set in the processing corresponding to Fig. 11(A) in the client device 140, the subject determination size will not be provided to the network camera 100. In such a case, the judgments of S1114, S1115, and S1116 may be skipped, and speed table 1" may be selected as the default speed table.

[0096] As described above, in this embodiment, when the subject speed is equal to or faster than a certain speed, the zoom speed boundary position is changed and the zoom-in speed is controlled to be increased. In this embodiment, the boundary position of the zoom speed boundary and the zoom-in speed are changed simultaneously, but only one of them may be performed. The method of increasing the zoom speed near the detection limit is not limited to the above-mentioned method, and other methods may be used as long as the objective of increasing the zoom speed near the detection limit can be achieved.

[0097] In this embodiment, the subject determination size can be determined in advance based on the relationship between the set shooting target size and the subject size at the detection limit. In addition, when the subject size changes toward the detection limit and falls below the subject determination size, the zoom speed near the detection limit can be increased to reduce loss due to detection failure. This embodiment is particularly effective when the subject moves away from the network camera 100.

[0098] [Technical ideas derived from embodiments 1 to 3] The disclosure of this specification follows the technical ideas of the above-mentioned first to third embodiments and includes the following imaging device, imaging system, method, and program.

[0099] (Item 1) A detection means for detecting a predetermined subject from an image captured by the imaging means; a determination means for determining a speed at which the photographing angle of view of the photographing means is changed in accordance with the detected subject size of the predetermined subject; a control means for controlling a change of the photographing angle of view of the photographing means at the speed determined by the determination means; Equipped with the detection means has a detection limit object size capable of detecting the predetermined object, The determining means is determining the speed so as not to change the photographing angle of view while the detected subject size is within a first range determined based on a size of a photographing target; when a first difference between the detection limit object size and the object size associated with the end of the first range is smaller than a first predetermined value, changing the object size associated with the end of the first range so that the first difference becomes equal to or greater than the first predetermined value; 23. An information processing apparatus comprising: (Item 2) The determining means is determining the speed to be switched from among a plurality of speeds including a first speed and a second speed in accordance with the size of the subject; when a second difference between the object size at the time of switching between the first speed and the second speed and the object size at the detection limit is smaller than a second predetermined value, the object size at the time of the switching is changed so that the second difference becomes equal to or larger than the second predetermined value. 2. The information processing device according to item 1, (Item 3) A calculation means for calculating a moving speed of the predetermined object is further provided, The determining means is 3. The information processing device according to item 2, wherein, when the calculated moving speed is faster than a predetermined speed, the speed is switched at a larger subject size than when the moving speed is equal to or lower than the predetermined speed. (Item 4) The determining means is a first speed table of a change speed of the photographing angle of view to be selected when the calculated moving speed is equal to or less than the predetermined speed; a second speed table of the change speed of the photographing angle of view to be selected when the calculated moving speed is faster than the predetermined speed; having The information processing device described in item 3, characterized in that in the first speed table, the change speed associated with the subject size of the detection limit is a third speed, and in the second speed table, the change speed associated with the subject size of the detection limit is a fourth speed faster than the third speed. (Item 5) The second speed table includes: the change speeds associated with the respective detected object sizes in the second speed table are faster than the change speeds associated with the respective detected object sizes in the first speed table; a subject size when the speed is switched in the second speed table is larger than a subject size when the change speed is switched in the first speed table; 5. The information processing device according to item 4, characterized in that it is configured to satisfy at least one of the above. (Item 6) The information processing device according to item 4 or 5, characterized in that the second speed table is configured so that the change speed associated with the subject size of the detection limit is the fastest change speed in the second speed table. (Item 7) 7. The information processing device according to any one of items 3 to 6, wherein the calculation means calculates the moving speed when the subject size is smaller than a predetermined subject size. (Item 8) 8. The information processing device according to item 7, wherein the predetermined subject size is included in the first range. (Item 9) when the first difference is equal to or greater than a third predetermined value, the determining means compares the subject size with the predetermined subject size, and when the subject size is smaller than the predetermined subject size, causes the calculating means to calculate the moving speed; Item 9. The information processing device according to item 7 or 8, wherein the third predetermined value is a value greater than the first predetermined value. (Item 10) 10. The information processing device according to any one of items 1 to 9, wherein the subject size is determined based on a ratio of a width of the specified subject to a width of an image captured by the imaging means. (Item 11) An information processing device according to any one of items 1 to 10, A photographing means; A communication means for communicating with an external client device; An imaging device comprising: (Item 12) A client device configured to be able to communicate with the imaging device according to item 11, a reception means for receiving a designation of a size of a target for photographing a predetermined subject to be photographed by the photographing means of the imaging device; a generating means for generating speed information that associates a speed at which the photographing angle of view of the photographing means is changed with a subject size of the predetermined subject based on the size of the photographing target; a communication means for transmitting setting information including the size of the target and the speed information to the imaging device and receiving an image captured by the imaging device; Equipped with The generating means includes: determining a first range of object sizes within which the photographing angle of view is not changed based on a size of the photographing target; When a first difference between the subject size corresponding to the end of the first range and a subject size of a detection limit of the subject in the imaging device is smaller than a first predetermined value, the subject size corresponding to the end of the first range is changed so that the first difference becomes equal to or larger than the first predetermined value for the first range. The client device generates the speed information by (Item 13) The speed information is associated with the subject size for any one of a plurality of speeds including a first speed and a second speed; The client device described in item 12, characterized in that when a second difference between the subject size at the time of switching between the first speed and the second speed and the subject size at the detection limit is smaller than a second predetermined value, the generation means generates the speed information by changing the subject size at the time of the switching so that the second difference is equal to or greater than the second predetermined value. (Item 14) The generating means includes, in order to include in the setting information, a predetermined object size for determining the object size when the first difference is greater than a third predetermined value; a first speed table of the change speed of the photographing angle of view, which is selected when the moving speed of the predetermined subject is equal to or lower than a predetermined speed; a second speed table of the change speed of the photographing angle of view, which is selected when the moving speed is faster than a predetermined speed; Generate The client device according to item 12 or 13, characterized in that the first speed table is configured such that the change speed associated with the subject size of the detection limit is a third speed, and the second speed table is configured such that the change speed associated with the subject size of the detection limit is a fourth speed faster than the third speed. (Item 15) The second speed table includes: the change speeds associated with the respective detected object sizes in the second speed table are faster than the change speeds associated with the respective detected object sizes in the first speed table; a subject size when the change speed is switched in the second speed table is larger than a subject size when the change speed is switched in the first speed table; 15. The client device according to item 14, characterized in that it is configured to satisfy at least one of the above. (Item 16) A client device configured to be able to communicate with the imaging device according to item 11, a reception means for receiving a designation of a size of a target for photographing a predetermined subject to be photographed by the photographing means of the imaging device; a generating means for generating speed information that associates a speed at which the photographing angle of view of the photographing means is changed with a subject size of the predetermined subject based on the size of the photographing target; a communication means for transmitting setting information including the size of the target and the speed information to the imaging device and receiving an image captured by the imaging device; Equipped with the generating means determines a first range of subject sizes within which the photographing angle of view is not changed based on a size of the photographing target; When a first difference between the subject size corresponding to the end of the first range and a subject size of a detection limit of the subject in the imaging device is smaller than a first predetermined value, the accepting means further accepts a modification of the size of the specified shooting target so that the first difference is equal to or greater than the first predetermined value. (Item 17) A client device configured to be able to communicate with the imaging device according to item 11, a reception means for receiving a designation of a size of a target for photographing a predetermined subject to be photographed by the photographing means of the imaging device; a generating means for generating speed information that associates a speed at which the photographing angle of view of the photographing means is changed with a subject size of the predetermined subject based on the size of the photographing target; a communication means for transmitting setting information including the size of the target and the speed information to the imaging device and receiving an image captured by the imaging device; Equipped with the generating means determines a first range of subject sizes within which the photographing angle of view is not changed based on a size of the photographing target; The client device is characterized in that the receiving means receives the size of the target to be photographed such that a first difference between the subject size corresponding to an end of the first range and a subject size of a detection limit of the subject in the imaging device is equal to or greater than a first predetermined value. (Item 18) A detection means for detecting a predetermined subject from an image captured by the imaging means; a determination means for determining a speed at which the photographing angle of view of the photographing means is changed in accordance with the detected subject size of the predetermined subject; a control means for controlling a change of the photographing angle of view of the photographing means at the speed determined by the determination means; a detection means for detecting the predetermined subject having a detection limit subject size, determining the speed so as not to change the photographing angle of view while the detected subject size is within a first range determined based on a size of a photographing target; when a first difference between the detection limit object size and the object size associated with the end of the first range is smaller than a first predetermined value, the determining means changes the object size associated with the end of the first range so that the first difference becomes equal to or greater than the first predetermined value; 23. A method for controlling an information processing apparatus comprising: (Item 19) A method for controlling a client device configured to be able to communicate with the imaging device according to item 11, The client device includes: a reception means for receiving a designation of a size of a target for photographing a predetermined subject to be photographed by the photographing means of the imaging device; a generating means for generating speed information that associates a speed at which the photographing angle of view of the photographing means is changed with a subject size of the predetermined subject based on the size of the photographing target; a communication means for transmitting setting information including the size of the target and the speed information to the imaging device and receiving an image captured by the imaging device; Equipped with The control method includes: determining, by the generating means, a first range of subject sizes in which the photographing angle of view is not changed based on a size of the photographing target in the speed information; when a first difference between the subject size corresponding to an end of the first range and a subject size of a detection limit of the subject in the imaging device is smaller than a first predetermined value, the generating means changes the subject size associated with the end of the first range so that the first difference becomes equal to or larger than the first predetermined value for the first range; 13. A method for controlling a client device, comprising: (Item 20) A program for causing a computer to operate as the information processing device according to any one of items 1 to 10. (Item 21) A program for causing a computer to operate as the client device according to any one of items 12 to 17.

[0100] The invention is not limited to the above-described embodiments, and various modifications and variations are possible without departing from the spirit and scope of the invention. Accordingly, the following claims are appended to apprise the public of the scope of the invention.

[0101] (Other Examples) The present invention can also be realized by a process in which a program for implementing one or more of the functions of the above-described embodiments is supplied to a system or device via a network or a storage medium, and one or more processors in a computer of the system or device read and execute the program. The present invention can also be realized by a circuit (e.g., ASIC) that implements one or more of the functions. [Explanation of symbols]

[0102] Tracking system: 10, network camera: 100, client device: 140, network: 150

Claims

1. A detection means for detecting a predetermined subject from an image captured by the imaging means; a determination means for determining a speed at which the photographing angle of view of the photographing means is changed in accordance with the detected subject size of the predetermined subject; a control means for controlling a change of the photographing angle of view of the photographing means at the speed determined by the determination means; Equipped with the detection means has a detection limit object size capable of detecting the predetermined object, The determining means is determining the speed so as not to change the photographing angle of view while the detected subject size is within a first range determined based on a size of a photographing target; when a first difference between the subject size of the detection limit and the subject size associated with the end of the first range is smaller than a first predetermined value, changing the subject size associated with the end of the first range so that the first difference becomes equal to or greater than the first predetermined value; 23. An information processing apparatus comprising:

2. The determining means is determining the speed to be switched from among a plurality of speeds including a first speed and a second speed in accordance with the size of the subject; when a second difference between the object size at the time of switching between the first speed and the second speed and the object size at the detection limit is smaller than a second predetermined value, the object size at the time of the switching is changed so that the second difference becomes equal to or larger than the second predetermined value.

2. The information processing apparatus according to claim 1,

3. A calculation means for calculating a moving speed of the predetermined object is further provided, The determining means is The information processing apparatus according to claim 2 , wherein when the calculated moving speed is faster than a predetermined speed, the speed is switched at a larger subject size than when the moving speed is equal to or lower than the predetermined speed.

4. The determining means is a first speed table of a change speed of the photographing angle of view to be selected when the calculated moving speed is equal to or less than the predetermined speed; a second speed table of a change speed of the photographing angle of view to be selected when the calculated moving speed is faster than the predetermined speed; having 4. The information processing device according to claim 3, wherein the first speed table indicates that the change speed associated with the subject size of the detection limit is a third speed, and the second speed table indicates that the change speed associated with the subject size of the detection limit is a fourth speed faster than the third speed.

5. The second speed table includes: the change speeds associated with the respective detected object sizes in the second speed table are faster than the change speeds associated with the respective detected object sizes in the first speed table; a subject size when the speed is switched in the second speed table is larger than a subject size when the change speed is switched in the first speed table; 5. The information processing apparatus according to claim 4, characterized in that it is configured to satisfy at least one of the following.

6. 5. The information processing apparatus according to claim 4, wherein the second speed table is configured so that the change speed associated with the subject size of the detection limit is the fastest change speed in the second speed table.

7. The information processing apparatus according to claim 3 , wherein the calculation means calculates the moving speed when the subject size is smaller than a predetermined subject size.

8. The information processing apparatus according to claim 7 , wherein the predetermined subject size is included in the first range.

9. the determining means, when the first difference is equal to or greater than a third predetermined value, compares the subject size with the predetermined subject size, and when the subject size is smaller than the predetermined subject size, causes the calculating means to calculate the moving speed; The information processing apparatus according to claim 7 , wherein the third predetermined value is greater than the first predetermined value.

10. The information processing apparatus according to claim 1 , wherein the subject size is determined based on a ratio of a width of the predetermined subject to a width of the image captured by the image capture means.

11. An information processing device according to any one of claims 1 to 10; A photographing means; A communication means for communicating with an external client device; An imaging device comprising:

12. A client device configured to be able to communicate with the imaging device according to claim 11, a reception means for receiving a designation of a size of a target for photographing a predetermined subject to be photographed by the photographing means of the imaging device; a generating means for generating speed information that associates a speed at which the angle of view of the photographing means is changed with a subject size of the predetermined subject based on the size of the photographing target; a communication means for transmitting setting information including the size of the target and the speed information to the imaging device and receiving an image captured by the imaging device; Equipped with The generating means includes: determining a first range of subject sizes within which the photographing angle of view is not changed based on a size of the photographing target; When a first difference between the subject size corresponding to the end of the first range and a subject size of a detection limit of the subject in the imaging device is smaller than a first predetermined value, the subject size corresponding to the end of the first range is changed so that the first difference becomes equal to or greater than the first predetermined value for the first range. The client device generates the speed information by

13. The speed information is associated with the subject size for any one of a plurality of speeds including a first speed and a second speed; The client device according to claim 12, characterized in that, when a second difference between the subject size at the time of switching between the first speed and the second speed and the subject size at the detection limit is smaller than a second predetermined value, the generation means generates the speed information by changing the subject size at the time of the switching so that the second difference is equal to or greater than the second predetermined value.

14. The generating means includes, in order to include in the setting information, a predetermined object size for determining the object size when the first difference is greater than a third predetermined value; a first speed table of a change speed of the photographing angle of view, which is selected when the moving speed of the predetermined subject is equal to or lower than a predetermined speed; a second speed table of a change speed of the photographing angle of view, which is selected when the moving speed is faster than a predetermined speed; Generate 13. The client device of claim 12, wherein the first speed table is configured such that the speed of change associated with the subject size at the detection limit is a third speed, and the second speed table is configured such that the speed of change associated with the subject size at the detection limit is a fourth speed faster than the third speed.

15. The second speed table includes: the change speeds associated with the respective detected object sizes in the second speed table are faster than the change speeds associated with the respective detected object sizes in the first speed table; a subject size when the change speed is switched in the second speed table is larger than a subject size when the change speed is switched in the first speed table; 15. The client device according to claim 14, characterized in that it is configured to satisfy at least one of the following:

16. A client device configured to be able to communicate with the imaging device according to claim 11, a reception means for receiving a designation of a size of a target for photographing a predetermined subject to be photographed by the photographing means of the imaging device; a generating means for generating speed information that associates a speed at which the photographing angle of view of the photographing means is changed with a subject size of the predetermined subject based on the size of the photographing target; a communication means for transmitting setting information including the size of the target and the speed information to the imaging device and receiving an image captured by the imaging device; Equipped with the generating means determines a first range of subject sizes within which the photographing angle of view is not changed based on a size of the photographing target; When a first difference between the subject size corresponding to the end of the first range and a subject size of a detection limit of the subject in the imaging device is smaller than a first predetermined value, the accepting means further accepts a modification of the size of the specified shooting target so that the first difference is equal to or greater than the first predetermined value.

17. A client device configured to be able to communicate with the imaging device according to claim 11, a reception means for receiving a designation of a size of a target for photographing a predetermined subject to be photographed by the photographing means of the imaging device; a generating means for generating speed information that associates a speed at which the photographing angle of view of the photographing means is changed with a subject size of the predetermined subject based on the size of the photographing target; a communication means for transmitting setting information including the size of the target and the speed information to the imaging device and receiving an image captured by the imaging device; Equipped with the generating means determines a first range of subject sizes within which the photographing angle of view is not changed based on a size of the photographing target; The client device is characterized in that the receiving means receives the size of the target to be photographed such that a first difference between the subject size corresponding to the end of the first range and the subject size of a detection limit of the subject in the imaging device is equal to or greater than a first predetermined value.

18. A detection means for detecting a predetermined subject from an image captured by the imaging means; a determination means for determining a speed at which the photographing angle of view of the photographing means is changed in accordance with the detected subject size of the predetermined subject; a control means for controlling a change of the photographing angle of view of the photographing means at the speed determined by the determination means; a detection means for detecting the predetermined subject having a detection limit subject size, determining the speed so as not to change the photographing angle of view while the detected subject size is within a first range determined based on a size of a photographing target; when a first difference between the subject size of the detection limit and the subject size associated with the end of the first range is smaller than a first predetermined value, the determining means changes the subject size associated with the end of the first range so that the first difference becomes equal to or greater than the first predetermined value; 23. A method for controlling an information processing apparatus comprising:

19. A control method for a client device configured to be able to communicate with the imaging device according to claim 11, comprising: The client device includes: a reception means for receiving a designation of a size of a target for photographing a predetermined subject to be photographed by the photographing means of the imaging device; a generating means for generating speed information that associates a speed at which the angle of view of the photographing means is changed with a subject size of the predetermined subject based on the size of the photographing target; a communication means for transmitting setting information including the size of the target and the speed information to the imaging device and receiving an image captured by the imaging device; Equipped with The control method includes: determining, by the generating means, a first range of subject sizes in which the photographing angle of view is not changed based on a size of the photographing target, in the speed information; when a first difference between the subject size corresponding to an end of the first range and a subject size of a detection limit of the subject in the imaging device is smaller than a first predetermined value, the generating means changes the subject size associated with the end of the first range so that the first difference becomes equal to or larger than the first predetermined value for the first range; 13. A method for controlling a client device, comprising:

20. A program for causing a computer to operate as the information processing device according to any one of claims 1 to 10.

21. A program for causing a computer to operate as the client device according to any one of claims 12 to 17.

Images