Systems, information processing methods, and programs

Abstract

The aim is to provide technology that enables appropriate composition settings during automatic tracking. [Solution] A window corresponding to the shooting range of the shooting means is generated, which includes an icon used to determine the composition when tracking a subject to be tracked. When the window is displayed, if an icon specified by user operation is included in the tracking loss area calculated according to the size of the icon, the position of the icon is corrected so that the icon is not included in the tracking loss area.

Description

[Technical Field]

[0001] The present invention relates to an information processing technology. [Background Art]

[0002] Conventionally, there is an automatic tracking function that detects a subject included in an image captured by an imaging device, and controls the pan, tilt, and zoom (PTZ) of the imaging device such that the detected subject is always kept within the imaging range. In addition, for the automatic tracking function, there is a technology for setting the position and size of a subject within the imaging range.

[0003] In Patent Document 1, a user can set the position and size at which the subject is displayed during automatic tracking by operating an icon for composition / display size setting display. Patent Document 1 also describes that when setting the position at which the subject is displayed during automatic tracking, the position can only be set within a predetermined range in the screen. [Prior Art Literature] [Patent Document]

[0004] [Patent Document 1] Japanese Unexamined Patent Publication No. 2014-39166 [Summary of the Invention] [Problem to be Solved by the Invention]

[0005] However, in Patent Document 1, the range in which the position of the subject during automatic tracking can be set is uniformly fixed, and depending on the situation, this uniformly fixed range may not be appropriate.

[0006] Therefore, an object of the present invention is to provide a technology that enables appropriate setting of a composition during automatic tracking. [Means for Solving the Problem]

[0007] In order to solve the above problem, an information processing apparatus of the present invention includes, for example, the following configuration. In other words, the system includes a generation means that generates a window corresponding to the shooting range of the shooting means, which includes an icon used to determine the composition when tracking a subject to be tracked, and a correction means that, when the window is displayed, an icon specified by user operation is included in a tracking loss area calculated according to the size of the icon, corrects the position of the icon so that the icon is not included in the tracking loss area.

[0008] Furthermore, in order to solve the above problems, the information processing device of the present invention comprises, for example, the following configuration: an acquisition means for acquiring information on the position and size of an icon used to determine the composition when tracking a subject to be tracked, and a generation means for generating a window corresponding to the shooting range of a shooting means, which includes the icon. The generation means generates predetermined warning information when the icon is included in a tracking loss area calculated based on the size of the icon. [Effects of the Invention]

[0009] According to the present invention, it is possible to provide a technology that enables the appropriate setting of the composition during automatic tracking. [Brief explanation of the drawing]

[0010] [Figure 1] This diagram shows the system configuration. [Figure 2] This diagram shows the hardware configuration of the imaging device and information processing device. [Figure 3] This diagram shows the functional blocks of the imaging device and information processing device. [Figure 4] This is a diagram to explain UI windows. [Figure 5] This is a diagram to explain the automatic tracking function. [Figure 6] This is a diagram illustrating the control of PTZ (Post-Turn Zone). [Figure 7] This is a diagram to explain the tracking loss region. [Figure 8] This figure is for explaining correction of icon positions. [Figure 9] This flowchart shows the flow of icon position correction processing. [Figure 10] This flowchart shows the processing flow of the automatic tracking function. [Figure 11] This figure shows functional blocks of an imaging device and an information processing device. [Figure 12] This figure is for explaining warning display. [Figure 13] This flowchart shows the processing flow of warning display. MODE FOR CARRYING OUT THE INVENTION

[0011] Hereinafter, embodiments according to the present invention will be described with reference to the accompanying drawings. Note that the configurations shown in the following embodiments are merely examples, and the present invention is not limited to the illustrated configurations.

[0012] (Embodiment 1) FIG. 1 is a diagram showing the system configuration according to the present embodiment. The system according to the present embodiment includes an imaging device 100, a client device 110, and a network 120. The imaging device 100 and the client device 110 are mutually connected via the network 120. The network 120 is implemented by a plurality of routers, switches, cables and the like that comply with communication standards such as ETHERNET (registered trademark), for example. Note that the network 102 may be implemented by the Internet, a wired LAN (Local Area Network), a wireless LAN (Wireless LAN), a WAN (Wide Area Network) or the like.

[0013] The imaging device 100 is capable of capturing an image and distributing the image to the client device 110, and functions as an information processing device. The client device 110 is, for example, a personal computer having a processor such as a CPU.

[0014] Here, the hardware configuration of the imaging apparatus 100 will be described with reference to FIG. 2(a). The imaging apparatus 100 is an apparatus having a hardware configuration as shown in FIG. 2(a). The imaging apparatus 100 includes an imaging unit 200 configured to capture an image, and further includes a PTZ mechanism 201 which is a mechanical mechanism that drives panning, tilting, and zooming. The imaging apparatus 100 can control the pan, tilt, and zoom (PTZ) of the imaging apparatus 100 by controlling the PTZ mechanism 201, and as a result, can change the imaging range.

[0015] Further, an interface (I / F) 202 communicates with an external apparatus via a network 120 in accordance with TCP / IP, HTTP, or the like. A CPU (Central Processing Unit) 203 is a central processing unit that performs overall control of the imaging apparatus 100. A RAM (Random Access Memory) 204 temporarily stores computer programs executed by the CPU 203. Further, the RAM 204 provides a work area used when the CPU 203 executes processing. Furthermore, the RAM 204 can function as, for example, a frame memory or a buffer memory. A ROM (Read Only Memory) 205 stores programs and the like for the CPU 203 to control the imaging apparatus 100. An HDD 206 is a storage device that records image data and the like.

[0016] The information processing device 110 has the hardware configuration shown in Figure 2(b). The interface (I / F) 210 communicates with external devices via the network 120 according to TCP / IP, HTTP, etc. The CPU 211 is a central processing unit that provides overall control of the information processing device 110. The RAM 212 temporarily stores computer programs executed by the CPU 211. The RAM 212 also provides a work area used by the CPU 211 when executing processing. The RAM 212 can also function as, for example, a frame memory or a buffer memory. The ROM 213 stores programs for the CPU 211 to control the information processing device 100. The HDD 214 is a storage device that records image data, etc. The display 215 is made up of an LCD (Liquid Crystal Display) or the like and displays images transmitted from the imaging device 100 and UI windows, etc., which will be described later. In this embodiment, an example is described in which the information processing device 110 is equipped with a display 215, but it is not limited to this, and the information processing device 110 and the display 215 may be housed in separate enclosures.

[0017] Next, the functions of the imaging device 100 and the information processing device 110 will be described with reference to the functional blocks shown in Figure 3. Note that the functions of the image acquisition unit 301, generation unit 302, parameter acquisition unit 303, correction unit 304, detection unit 305, and control unit 306 shown in Figure 3 are realized, for example, by the CPU 203 executing a computer program stored in the ROM 205 of the imaging device 100. Furthermore, the functions of the control unit 302 and operation reception unit 312 shown in Figure 3 are realized, for example, by the CPU 211 executing a computer program stored in the ROM 213 of the information processing device 100.

[0018] The image acquisition unit 301 acquires images captured by the imaging unit 200. The image acquisition unit 301 also outputs the acquired images to the generation unit 302 and the detection unit 305.

[0019] The generation unit 302 generates a UI window to be displayed on the screen. The UI window generated by the generation unit 302 is used by the user to set parameters related to automatic tracking. A detailed explanation of the UI window will be given later. The generation unit 302 also transmits the information of the generated UI window to the client device 110 via the I / F 202. The I / F 202 also receives the tracking setting parameters transmitted from the client device 110 and outputs them to the parameter acquisition unit 303. The tracking setting parameters are parameters that determine the composition of the subject during automatic tracking, and include information on the position and size of icons used to determine the composition of the subject being tracked. A detailed explanation of the tracking setting parameters will be given later.

[0020] The parameter acquisition unit 303 acquires the icon position and size from the tracking setting parameters input from the I / F 202 and outputs them to the correction unit 304. If the setting values ​​for the icon position and size are values ​​that have a high probability of causing tracking loss, the correction unit 304 corrects them to values ​​that reduce the possibility of tracking loss and outputs them to the generation unit 302 and the control unit 306. If the setting values ​​for the icon position and size are not values ​​that have a high probability of causing tracking loss, the correction unit 304 outputs the setting values ​​to the generation unit 302 and the control unit 306 without correcting them. Details of the processing of the correction unit 304 will be described later.

[0021] The detection unit 305 detects the subject to be tracked from the image input from the image acquisition unit 301 and outputs the position information and size of the subject within the image to the control unit 306. For subject detection, for example, detection techniques using Deep Learning such as SSDs or detection techniques using pattern matching can be used. The position of the subject within the image is indicated by the X,Y coordinates of the upper left vertex of the bounding rectangle of the subject. The size of the subject within the image is indicated by the width and height of the bounding rectangle of the subject.

[0022] The control unit 306 calculates a PTZ control value based on the position and size of the icon input from the correction unit 304 and the position and size of the subject in the image input from the detection unit 305. The control unit 306 then controls the shooting range of the imaging device 100 by controlling the PTZ mechanism 201 according to the calculated PTZ control value.

[0023] Furthermore, the control unit 311, for example, displays UI windows and images received by the I / F 210 on the display 215. The operation reception unit 312 acquires information on user operations performed via input devices such as a mouse or keyboard.

[0024] Here, with reference to Figure 4, the UI window generated by the generation unit 302 in this embodiment will be described. The UI window 400 shown in Figure 4(a) is a GUI (Graphical User Interface) generated by the generation unit 302. The generation unit 302 generates the UI window 400 by superimposing an icon 401 corresponding to the subject being tracked onto an image acquired by the image acquisition unit 301. However, the generation unit 302 may also generate the UI window 400 by superimposing the icon 401 onto a predetermined image corresponding to the shooting range of the imaging unit 200, rather than an image acquired by the image acquisition unit 301. The predetermined image here is, for example, an image filled with a predetermined color, and is a rectangular image with the same aspect ratio as the shooting range of the imaging unit 200. In the example of Figure 4(a), the UI window 400 also includes the currently tracked subject 402. The UI window 400 generated by the generation unit 302 is transmitted to the client device 110 via the I / F 202. The control unit 311 of the client device 110 then displays the transmitted UI window 400 on the display. The user can change the position and size of the icon 401 in the UI window 400 displayed on the display. Figure 4(b) shows the UI window 401 after the position and size of the icon have been changed. The client device 110 transmits tracking setting parameters, including the information on the position and size of the changed icon 401 as shown in Figure 4(b), to the imaging device 100. The position of the icon 401 is indicated by coordinates (X, Y) (0≦X≦1920, 0≦Y≦1080) within the UI window 400, and the size of the icon 401 is indicated by an integer value such as S (1≦S≦10). The imaging device 100 then receives the tracking setting parameters, including the position and size information of the changed icon 401. If the position information and size settings of the modified icon 401 are not settings that are likely to cause tracking loss, the control unit 306 controls the pan-tilt-zoom to perform automatic tracking of the target based on these settings.Specifically, the control unit 306 controls the pan and tilt so that the position of the subject 402 to be tracked in the image is approximately the same as the position of the icon 401 relative to the UI window 400 in Figure 4(b). The control unit 306 also controls the zoom so that the size of the subject to be tracked in the image is approximately the same as the size of the icon 401 relative to the UI window in Figure 4(b). For example, as shown in Figure 5(a), we assume that the shooting device 100 is initially shooting a shooting range 501a in a certain shooting environment 501. Here, according to the modified position and size of the icon 401 shown in the UI window 400 in Figure 4(b), the control unit 306 controls the pan, tilt, and zoom so that the shooting range of the shooting device 100 becomes the shooting range 501b shown in Figure 5(b). Furthermore, even if the subject 402 being tracked moves in the shooting environment 501 as shown in Figure 5(c), the control unit 306 controls the shooting range in accordance with the movement of the subject 402 while maintaining the composition of the icons in the UI window 400. The shooting range after control is the shooting range 501c in Figure 5(c).

[0025] Here, the control of pan, tilt, and zoom (calculation of PTZ control values) when the automatic tracking function is executed will be explained in detail with reference to Figure 6. The position of the subject 601 to be tracked, as seen in the image 600 captured by the imaging unit 200, is taken as coordinate 602(X', Y'), which is the center of gravity of the subject 601's head. The position of the icon 603 operated by the user is taken as coordinate 604(X, Y). At this time, the control unit 306 calculates the pan control value by converting X - X' to the pan movement, and the tilt control value by converting Y - Y' to the tilt movement. Furthermore, if the size 605 of the subject 601 in the image is H', and the size 606 of the icon 603 is Hs, the control unit 306 calculates the zoom control value by converting Hs - H' to the zoom movement. In this way, the PTZ control values ​​(pan control value, tilt control value, and zoom control value) are calculated. Then, the control unit 306 controls the PTZ mechanism 301 according to the calculated PTZ control value, and controls the pan, tilt, and zoom of the imaging device 100 (in other words, controls the shooting range).

[0026] Next, with reference to Figure 7, the process of correcting the icon position by the correction unit 304 will be explained. Figure 7 shows a UI window 700 including the currently set icon 701. Here, the position of icon 701 is (X, Y) (0≦X≦1920, 0≦Y≦1080), the vertical size of icon 701 is S (1≦S≦10), the horizontal width 702 of the face portion of icon 701 is Ws, and the vertical width 703 of the face portion of icon 701 is Hs. Here, the correction unit 304 calculates the tracking loss area 704 based on the currently set icon size. In this embodiment, the correction unit 304 calculates the tracking loss area 704 based, for example, on the size of the face portion which is part of icon 701. Specifically, the correction unit 304 calculates the tracking loss area 704 as the combined area between the top and bottom edges of the UI window 700 at a distance Hs / 2, and the area between the left and right edges at a distance Ws / 2. The size of the tracking loss area 704 is changed according to the currently set size of the icon 701, as described above. For example, if a user in the client device 100 changes the size of the icon 701 to be larger, the parameter acquisition unit 303 acquires the changed size of the icon 701, and the correction unit 304 increases the size of the tracking loss area 704 based on that size. On the other hand, if a user in the client device 100 changes the size of the icon 701 to be smaller, the parameter acquisition unit 303 acquires the changed size of the icon 701, and the correction unit 304 decreases the size of the tracking loss area 704 based on that size.

[0027] Referring to Figure 8, we assume a scenario where the tracking loss region 704 is set by the correction unit 304, and then the icon's position is manipulated by the user. Figure 8(a) shows a UI window 800a including the tracking loss region 801a calculated by the correction unit 304 based on the current size of the icon 802a. The UI window 800 is generated by the generation unit 302 and sent to the client device 110, and the control unit 311 of the client device 110 displays the UI window 800a on the display 215. The slider 803 is a GUI generated by the generation unit 302, and the control unit 311 also displays the slider 803 on the display 215 along with the UI window 800a. The user can change the size of the icon 802a by manipulating the bar of the slider 803. Now, with the UI window 800a and the slider 803 displayed on the display, we assume a scenario where the user changes the size of the slider 803 from size "3" to size "8" as shown in Figure 8(b). At this time, tracking setting parameters including information on the changed size are transmitted from the client device 110 to the imaging device 100. The parameter acquisition unit 303 of the imaging device 100 then acquires the changed size of the icon 802, and the correction unit 304 updates the tracking loss area based on the changed size. The updated tracking loss area at this time is the tracking loss area 801b of the UI window 800b in Figure 8(b). Here, because the size of the icon 802 has increased, the tracking loss area has also been updated to increase accordingly. At this time, the correction unit 304 determines that the position 804 of the changed icon 802 is included in the tracking loss area 801b, as shown in Figure 8(b). In this case, the correction unit 304 moves the position of the icon 802 to the left horizontally of the UI window 800c so that the icon 802 is not included in the tracking loss area 801b. The UI window 802c in Figure 8(c) includes the icon 802 after its position has been moved by the correction unit 304. The generation unit 302 transmits the information of the UI window 800c to the client device 110, and the control unit 311 of the client device 110 may display the UI window 800c on the display 215.

[0028] Here, the process for correcting the position or size of the icon will be explained with reference to the flow chart in Figure 9. The process shown in Figure 9 is implemented by the CPU 203 of the imaging device 100 executing a computer program stored in the ROM 205 of the imaging device 100. The process shown in Figure 9 is assumed to start when the imaging device 100 receives tracking setting parameters from the information processing device 110.

[0029] First, in S901, the parameter acquisition unit 303 acquires information on the position and size of the icon specified by the user operation from the tracking setting parameters received from the client device 110 via I / F202.

[0030] Next, in S902, the correction unit 304 calculates the tracking loss area based on the size of the icon acquired by the parameter acquisition unit 303.

[0031] Next, in S903, the correction unit 304 determines whether the currently set icon's position is included in the calculated tracking loss region. Here, the correction unit 304 determines that the icon's position is included in the tracking loss region if, for example, the center of gravity of the icon's head is included in the tracking loss region, and determines that the icon's position is not included in the tracking loss region if the center of gravity is not included in the tracking loss region. If it is determined that the currently set icon's position is not included in the tracking loss region (No in S903), the process proceeds to S907. In this case, in S907, the generation unit 302 generates a UI window in which the display mode of the tracking loss region calculated in S902 is different from the display mode of the region other than the tracking loss region, and which includes the currently specified icon. Then, in S908, the generation unit 302 transmits information about the generated UI window to the information processing device 110 via the I / F 202. The control unit 311 of the information processing device 110 then displays the generated UI window on the display 215.

[0032] Returning to the explanation of S903, if it is determined that the currently set icon position is included in the tracking loss area (Yes in S903), the process transitions to S904. In S904, the correction unit 304 determines whether the icon position or size included in the tracking setting parameters acquired in S901 has been changed. At this time, the correction unit 304 compares, for example, the previously set icon position and size with the newly set icon position and size, and determines whether the position or size parameter has been changed. If the correction unit 304 determines that the icon size has been changed (Yes in S904), the process transitions to S905, and if the correction unit 304 determines that the icon position has been changed (No in S904), the process transitions to S906. In this embodiment, if it is determined that both the icon position and size have been changed compared to the previous icon position and size settings, the process transitions to S905, but it is not limited to this, and the process may transition to S906 instead of S905.

[0033] In S905, the correction unit 304 corrects the icon's position, not its size, so that the icon's position is not included in the tracking loss region calculated in S902, as explained with reference to Figure 8. At this time, the corrected icon's position is, for example, a position that is not included in the tracking loss region and is the position with the smallest change from the original icon's position. Also in S906, the correction unit 304 corrects the icon's size so that the icon's position is not included in the tracking loss region calculated in S902. At this time, the corrected icon's size is a size that is no longer included in the tracking loss region and is the size with the smallest change from the original icon's size. Furthermore, as a method of correcting the icon's size, the position of the leftmost vertex of the bounding rectangle of the icon is not changed, and the size of the icon is reduced to shrink it. As a result of the size change, the icon's position is also changed. After processing in S905 or S906, in S907, the generation unit 302 generates a UI window that includes the corrected icon. At this time, the generation unit 302 also superimposes the tracking loss area calculated in S902 onto the UI window. The tracking loss area superimposed on the UI window at this time has a different display pattern from the areas of the UI window other than the tracking loss area. In S908, the generation unit 302 transmits the generated UI window to the information processing device 110 via the I / F 202. The control unit 311 of the information processing device 110 displays the UI window on the display 215.

[0034] Next, the automatic tracking process by the imaging device 100 of this embodiment will be described with reference to the flow shown in Figure 10. The flow shown in Figure 10 is realized by the CPU 203 of the information generation device 100 executing a computer program stored in the ROM 205 of the imaging device 100.

[0035] First, in S1001, the image acquisition unit 301 acquires the image captured by the imaging unit 200. Next, in S1002, the detection unit 305 detects the subject to be tracked from the image acquired by the image acquisition unit 301. Next, in S1003, the control unit 306 calculates the PTZ control value based on the currently set icon's position and size and the position and size of the subject to be tracked detected by the detection unit 305 within the image. The calculation of the PTZ control value here is the same as described with reference to Figure 6, so the explanation is omitted. Next, in S1004, the control unit 306 controls the PTZ mechanism 301 according to the calculated PTZ control value, controlling the pan, tilt, and zoom of the imaging device 100 (in other words, controlling the shooting range). Next, in S1005, the control unit 306 determines whether to terminate the automatic tracking function, and if it determines to terminate (Yes in S1005), it terminates the processing of the flow shown in Figure 10. On the other hand, if it is determined that the automatic tracking function should not be terminated (No in S1005), the process proceeds to S1001, and the image acquisition unit 301 acquires the image of the next frame captured by the imaging unit 200.

[0036] As described above, the shooting device 100 in this embodiment calculates a tracking loss area according to the size of the icon used to determine the composition when automatically tracking a subject, and determines whether the currently set icon's position is included in the tracking loss area. If the shooting device 100 determines that the icon's position is included in the tracking loss area, it corrects the icon's position or size so that the icon's position is not included in the tracking loss area. In this way, it is possible to suppress the icon from being located at the edge of the shooting range, and consequently, to suppress the subject being located at the edge of the shooting range during automatic tracking. In other words, it is possible to suppress the subject's tracking loss. In addition, tracking loss is generally more likely to occur when the subject being tracked in the image is larger than when it is smaller. For this reason, in this embodiment, the tracking loss area is made larger when the icon's size is larger than when it is smaller than when it is smaller. In this way, when the icon's position is larger than when it is smaller, it is easier for the icon to be corrected to be inside the UI window so that it is not included in the tracking loss area, and as a result, the occurrence of tracking loss can be suppressed.

[0037] (Embodiment 2) In the first embodiment, an embodiment was described in which the position or size of an icon specified by user operation is corrected if the position of the icon falls within the tracking loss area. In this embodiment, if the position of an icon specified by user operation falls within the tracking loss area, a predetermined warning is displayed to prompt a change in the position or size of the icon. The following description will mainly focus on the parts that differ from Embodiment 1, and the same or equivalent components and processes as in the above embodiments will be denoted by the same reference numerals, while redundant explanations will be omitted.

[0038] Now, referring to Figure 11, the functional blocks of the imaging device 100 and the information processing device 110 in this embodiment will be described. Note that the functional blocks differ from those described with reference to Figure 3 in that the imaging device 100 has a calculation unit 1101 instead of a correction unit 304. The rest of the explanation is omitted as it is the same as in Figure 3. The calculation unit 1101 is realized, like the functions of the image acquisition unit 301, generation unit 302, parameter acquisition unit 303, correction unit 304, detection unit 305, and control unit 306, for example, by the CPU 203 executing a computer program stored in the ROM 205 of the imaging device 100.

[0039] In this embodiment, the calculation unit 1101 calculates the tracking loss area based on the icon size, similar to the processing of the correction unit 304. The method for calculating the tracking loss area is the same as the processing of the correction unit 304, as explained with reference to Figure 7, etc., so the explanation is omitted. The calculation unit 1101 then determines whether the currently set icon position is included in the calculated tracking loss area. If the calculation unit 1101 determines that the icon position is included in the tracking loss area, it displays a predetermined warning to prompt a change in the icon position or size.

[0040] The processing of the imaging device 100 in this embodiment will now be explained with reference to Figure 12. Figure 12(a) shows a UI window 1200 that includes the currently set icon 1202. The UI window 1200 also shows the tracking loss area 1201a calculated based on the size of the currently set icon 1202. The UI window 1200 shown in Figure 12(a) is generated by the generation unit 302 and then transmitted to the information processing device 110, where the control unit 311 displays the UI window 1200 on the display 215. The slider 1203 is a GUI generated by the generation unit 302, and the control unit 311 also displays the slider 1203 on the display 215 along with the UI window 1200. The user can change the size of the icon 1202 by operating the bar of the slider 1203. Here, we assume that while the UI window 1200 and slider 1203 are displayed on the display 215, the user changes the size of the slider 1203 from size "3" to size "8" as shown in Figure 12(b). At this time, tracking setting parameters including the information of the changed size are sent from the client device 110 to the imaging device 100. The parameter acquisition unit 303 of the imaging device 100 then acquires the size of the changed icon 1202, and the calculation unit 1101 updates the tracking loss area based on the changed size. The updated tracking loss area at this time is the tracking loss area 1201b shown in Figure 12(b). Here, since the size of the icon 1202 has increased, the tracking loss area has also been updated to increase accordingly. At this time, the calculation unit 1101 determines that the position 1204 of the changed icon 1202 is included in the tracking loss area 1201b, as shown in Figure 12(b). In this case, the generation unit 302 generates predetermined warning information to prompt a change in the position or size of the icon 1202 based on the determination result by the calculation unit 1101. In the example shown in Figure 12(c), the generation unit 302 generates a warning message 1208 as predetermined warning information to prompt a change in the position of the icon 1202, and sends the warning message 1208 together with the UI window 1200 to the information processing device 110.The control unit 311 of the information processing device 110 displays the UI window 1200 on the display 215 and also displays the warning message 1208 on the display 215. The predetermined warning information is not limited to the warning message 1208; for example, a warning symbol such as an exclamation mark may be used. In this case, the generation unit 302 generates the symbol and transmits it to the information processing device 110. The control unit 311 of the information processing device 110 displays the UI window 1200 on the display 215 and also displays the symbol on the display 215.

[0041] Next, we will explain the process flow for generating warning displays, referring to the flowchart in Figure 13. The processing shown in Figure 13 is realized by the CPU 203 of the imaging device 100 executing a computer program stored in the ROM 205 of the imaging device 100. The processing shown in Figure 13 is initiated when the imaging device 100 receives tracking setting parameters from the information processing device 110.

[0042] First, in S1301, the parameter acquisition unit 303 acquires information on the position and size of the icon specified by the user operation from the tracking setting parameters received from the client device 110 via the I / F 202.

[0043] Next, in S1302, the calculation unit 1101 calculates the tracking loss area based on the size of the icon acquired by the parameter acquisition unit 303.

[0044] Next, in S1303, the calculation unit 1101 determines whether the currently set icon's position is included in the calculated tracking loss area. Here, the calculation unit 1101 determines that the icon's position is included in the tracking loss area if, for example, the centroid of the icon's head is included in the tracking loss area, and determines that the icon's position is not included in the tracking loss area if the centroid is not included in the tracking loss area. If it is determined that the currently set icon's position is not included in the tracking loss area (No in S1303), the process proceeds to S1305. In this case, in S1305, the generation unit 302 generates a UI window in which the display mode of the tracking loss area calculated in S1302 is different from the display mode of the area other than the tracking loss area, and which includes the currently specified icon. Then, in S1306, the generation unit 302 transmits information about the generated UI window to the information processing device 110 via the I / F 202. The control unit 311 of the information processing device 110 then displays the generated UI window on the display 215.

[0045] Returning to the explanation of S1303, if it is determined that the tracking loss area includes the position of the currently set icon (Yes in S1303), the process proceeds to S1304. In S1304, the generation unit 302 generates predetermined display information (e.g., a warning message) prompting the user to reset the icon. Then, in S1305, the generation unit 302 generates a UI window containing the currently set icon. At this time, the generation unit 302 also superimposes the tracking loss area calculated in S1302 onto the UI window. The tracking loss area superimposed on the UI window has a different display pattern than the areas of the UI window other than the tracking loss area. In S1306, the generation unit 302 transmits the predetermined warning information generated in S1304 and the UI window generated in S1305 to the information processing device 110 via the I / F 202. The control unit 311 of the information processing device 110 displays the predetermined warning information and the UI window on the display 215.

[0046] As described above, in this embodiment, if the position of the currently set icon falls within the tracking loss area calculated according to the size of the icon, the imaging device 100 generates predetermined display information to prompt the user to change the icon setting. The imaging device 100 transmits the predetermined display information to the information processing device 110, and the information processing device 110 displays the predetermined information on the display 215. In this way, the user is alerted that tracking loss may occur with the current icon setting, and is also encouraged to change the setting.

[0047] (Other embodiments) The present invention can also be realized by a process in which one or more processors read and execute a program that implements one or more of the functions of the above-described embodiments. The program may be supplied to a system or device having a processor via a network or storage medium. Furthermore, the present invention can also be realized by a circuit (e.g., an ASIC) that implements one or more of the functions of the above-described embodiments.

[0048] Furthermore, although the present invention has been described with reference to embodiments, these embodiments are merely examples of concrete implementations of the present invention, and the technical scope of the present invention should not be interpreted as being limited by them. In other words, the present invention can be implemented in various forms without departing from its technical concept or its main features. For example, combinations of each embodiment are also included in the disclosure of this specification. [Explanation of Symbols]

[0049] 100 Imaging device 301 Image acquisition unit 302 Image Processing Unit 303 Metadata Generation Unit 304 Encoding section 305 Integrated coding unit 306 Output section 1101 Calculation Unit

Claims

1. A generating means that generates a window corresponding to the shooting range of a shooting means, which includes an icon used to determine the composition when tracking a subject to be tracked, An information processing apparatus characterized by having a correction means for correcting the position of an icon so that, when the aforementioned window is displayed and the icon specified by the user operation is included in a tracking loss region calculated according to the size of the icon, the icon is not included in the tracking loss region.

2. The information processing apparatus according to claim 1, characterized in that the size of the tracking loss area is calculated such that the size of the tracking loss area increases as the size of the icon increases.

3. The information processing apparatus according to claim 1, characterized in that the generation means generates the window on which the tracking loss region is superimposed.

4. The information processing apparatus according to claim 1, further comprising control means for controlling the shooting range of the shooting means so as to track a subject to be tracked included in an image captured by the shooting means, based on the position and size of the icon in the window.

5. The information processing apparatus according to claim 1, further comprising a means for capturing an image.

6. An acquisition means for obtaining information on the position and size of an icon used to determine the composition when tracking a subject, A window corresponding to the shooting range of a shooting means, comprising a generating means for generating a window including the aforementioned icon, The generation means is characterized in that it generates predetermined warning information when the icon is included in the tracking loss area calculated based on the size of the icon.

7. The information processing apparatus according to claim 6, characterized in that the size of the tracking loss area is calculated such that the size of the tracking loss area increases as the size of the icon increases.

8. The information processing apparatus according to claim 6, characterized in that the generation means generates the window on which the tracking loss region is superimposed.

9. The information processing apparatus according to claim 6, further comprising control means for controlling the shooting range of the shooting means so as to track a subject to be tracked included in an image captured by the shooting means, based on the position and size of the icon in the window.

10. The information processing apparatus according to claim 6, further comprising a means for capturing an image.

11. A generation step of generating a window that corresponds to the shooting range of a shooting means and includes an icon used to determine the composition when tracking a subject to be tracked, An information processing method characterized by comprising: a correction step of correcting the position of an icon so that, when the aforementioned window is displayed, the icon specified by user operation is included in a tracking loss region calculated according to the size of the icon.

12. An acquisition process to obtain information on the position and size of icons used to determine the composition when tracking a subject, A generation step is to generate a window corresponding to the shooting range of a shooting means, which includes the aforementioned icon. An information processing method characterized in that, in the generation step, if the icon is included in the tracking loss area calculated based on the size of the icon, predetermined warning information is generated.

13. A computer program for causing a computer to function as one of the means of the information processing device described in claim 1 or 6.

Images