Information processing apparatus, method for controlling information processing apparatus, and program
By employing image analysis and radio wave detection, the network camera efficiently resumes subject tracking post-standby, addressing the challenge of lost subject range and ensuring accurate, secure imaging direction control.
Patent Information
- Application Number
- JP2023073390
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-04-27
- Publication Date
- 2024-11-08
AI Technical Summary
Existing technologies struggle to efficiently resume subject tracking after a network camera transitions from a standby state, as the subject may not be within the control range, leading to the need for a new search.
The network camera utilizes a combination of image analysis and radio wave detection to specify the subject's relative position, allowing it to resume tracking by controlling the imaging direction based on these positions, even after a standby state.
This approach enables faster and more accurate resumption of subject tracking by utilizing both image analysis and radio wave detection to determine the subject's position, ensuring it remains within permissible imaging ranges and avoiding restricted areas.
Smart Images

Figure 2024158298000001_ABST
Abstract
Description
[Technical field]
[0001] The present disclosure relates to an information processing device, a control method for an information processing device, and a program. [Background technology]
[0002] In recent years, network cameras capable of controlling the imaging direction by PTZ (pan-tilt-zoom) control or the like are increasingly being used in video production sites. Some of these network cameras have been proposed to have a function of automatically controlling the imaging direction according to the position of a subject so that the subject can be continuously captured within the angle of view (in other words, a function of automatically tracking the subject) in order to reduce the number of people required for imaging work. In addition, some so-called imaging devices, including network cameras, have been proposed to have a function of transitioning from a normal imaging state to a so-called standby state, in which some functions such as output of captured images are limited (for example, stopped), in response to a user's instruction or the like.
[0003] In some cases, when the camera transitions to a standby state while automatically tracking a subject and then returns from the standby state, it may be desirable to control the camera to track the subject in the same manner as before the transition to the standby state, rather than simply transitioning to a normal imaging state. In such cases, it may be desirable to track a subject that was the target of automatic tracking before the transition to the standby state in the same manner even after the camera returns from the standby state. On the other hand, it may be assumed that the environment around the imaging device changes between before the transition to the standby state and after the return from the standby state. Therefore, in reality, when returning from the standby state, the imaging device searches for the subject by circulating around the imaging device through the setting of the subject to be tracked and the control of the imaging direction, so it may take some time to resume automatic tracking of the subject after returning from the standby state. In view of this situation, Patent Document 1 discloses a technology in which the pan / tilt movement range during tracking and feature amounts of the subject are stored before transitioning to a standby state, and when returning from the standby state, the stored information is used to search for the subject. [Prior art documents] [Patent documents]
[0004] [Patent Document 1] JP 2021-166368 A Summary of the Invention [Problem to be solved by the invention]
[0005] On the other hand, when subject tracking is resumed, such as when returning from a standby state, a situation may be assumed in which the target subject is not present within the control range of the imaging direction when the tracking is stopped. In such a situation, even if the technology disclosed in Patent Document 1 is applied, the target subject may not be found when the tracking of the subject is resumed, and as a result, the subject may have to be searched for again.
[0006] In view of the above problems, an object of the present invention is to make it possible to resume tracking of a subject in a more suitable manner even in a situation where tracking of the subject resumes after being stopped. [Means for solving the problem]
[0007] The information processing device of the present invention comprises a first identification means for identifying a relative position of the subject with respect to the imaging device by performing image analysis on an image corresponding to the imaging result of the subject by the imaging device, a second identification means for identifying the relative position of the subject with respect to the imaging device based on the reception result of radio waves from a wireless device held by the subject, and a control means for controlling the imaging direction of the imaging device to track the subject based on the identification result of the relative position of the subject with respect to the imaging device by at least one of the first identification means and the second identification means, wherein when the tracking is resumed from a state in which the tracking was stopped, the control means resumes tracking of the subject based on the identification result, by the second identification means, of the relative position of the subject with respect to the imaging device that was the tracking target when the tracking was stopped. Effect of the Invention
[0008] According to the present invention, it is possible to resume tracking of a subject in a more suitable manner even in a situation where tracking of a subject resumes after being stopped. [Brief description of the drawings]
[0009] [Figure 1] FIG. 1 illustrates an example of a configuration of a network system. [Diagram 2] FIG. 1 illustrates an example of the configuration of a network camera. [Diagram 3] 1 is a diagram for explaining the principle of a method for detecting a radio wave direction. FIG. [Figure 4] 11 is a flowchart showing an example of a process of the network camera. [Diagram 5] FIG. 13 is a diagram showing an example of a table that associates subjects with wireless devices. [Figure 6] FIG. 13 is a diagram showing an example of a setting screen related to resuming tracking of a subject. [Figure 7] 13A to 13C are diagrams illustrating position correction applied to control of the imaging direction. [Figure 8]FIG. 2 is a diagram showing an example of an image frame output by a network camera. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0010] Hereinafter, preferred embodiments of the present disclosure will be described in detail with reference to the accompanying drawings. In this specification and the drawings, components having substantially the same functional configurations are denoted by the same reference numerals, and redundant description will be omitted.
[0011] <System configuration> An example of a configuration of a network system 100 according to an embodiment of the present disclosure will be described with reference to Fig. 1. The network system 100 includes a network camera 101, a client device 102, and a wireless device 103. The network camera 101 and the client device 102 are connected to each other via a network 104 so that they can transmit and receive data to and from each other. The type of the network 104 is not particularly limited. As a specific example, the network 104 may be realized as a wired or wireless network. Also, the network 104 may be realized by a plurality of networks connected via other communication devices. The network camera 101 and the wireless device 103 are connected to each other via a wireless network 105 so that they can transmit and receive data to each other. The network 105 may be realized as a network conforming to the Bluetooth (registered trademark) 5.1 specification, for example. In this case, the wireless device 103 and the network camera 101 are provided with a wireless communication module conforming to the Bluetooth 5.1 specification. Of course, as long as the network camera 101 and the wireless device 103 can be connected by a wireless transmission path, the type of the network 105 is not particularly limited. As a specific example, a network conforming to a wireless communication standard such as Z-Wave (registered trademark), Zigbee (registered trademark), and Ultra Wide Band (UWB) may be applied as the network 105.
[0012] The network camera 101 corresponds to an example of an imaging device according to an embodiment of the present disclosure, and delivers images (e.g., still images and moving images) corresponding to imaging results to a device (e.g., client device 102) connected via a network. At least a part of the operation of the network camera 101 may be controlled based on an instruction from a device (e.g., client device 102) connected via the network. The client device 102 acquires various data from the network camera 101 via the network 104, and outputs the data to a predetermined output destination. This enables the client device 102 to present an image corresponding to the image capturing result by the network camera 101 to a user via a display device such as a display. The client device 102 may also control the operation of the network camera 101 via the network 104. Note that there is no particular limitation on the output of data transmitted from the network camera 101 and the UI (User Interface) related to the control of the operation of the network camera 101 exemplified above. For example, a so-called browser may be used as the UI. The wireless device 103 is a schematic representation of a terminal device held by a subject 106 that is to be imaged by the network camera 101 (and thus an automatic tracking target). The wireless device 103 is used by the network camera 101 to identify the position of the subject 106, as will be described in detail later. Note that in this embodiment, various explanations will be given assuming that the subject 106 is a person, but the object used as the subject 106 is not limited to a person. As a specific example, the subject 106 may be a living thing such as an animal, or a moving object such as an automobile or a robot. A network conforming to a wireless communication standard may be used as the network 105.
[0013] <Functional configuration> With reference to FIG. 2, an example of the configuration of the network camera 101 according to an embodiment of the present disclosure will be described. Note that some of the series of components shown in FIG. 2 can be realized by causing a CPU as a computer included in the network camera 101 to execute a computer program stored in a storage unit as a recording medium. Of course, this configuration is merely an example, and as long as it is possible to realize the processing of each of the series of components shown in FIG. 2, the configuration for that purpose is not particularly limited. As a specific example, the processing of at least some of the components may be realized by hardware incorporated in the network camera 101. For example, a dedicated circuit (ASIC) or a processor (reconfigurable processor, DSP), etc., may be applied as the hardware. In addition, the series of elements illustrated in FIG. 2 do not necessarily need to be built into the same housing. As a specific example, some of the components illustrated in FIG. 2 and other components may be realized by different devices connected to each other via a transmission path. In addition, the network camera 101 corresponds to an example of an information processing device according to an embodiment of the present disclosure.
[0014] The network camera 101 has an imaging unit 201 as an imaging means, a lens control unit 202, and a camera platform 203. The network camera 101 also has an A / D conversion unit 204, a camera signal processing unit 205, a storage unit 206, a bus 207, an image analysis unit 208, a compression / decompression unit 209, a wired communication processing unit 210, a wireless communication processing unit 211, and a CPU 212. The above-mentioned components of the network camera 101 are connected via the bus 207 so as to be able to transmit and receive data to and from each other.
[0015] The CPU 212 is a central processing unit, and controls the overall operation of the network camera 101. The CPU 212 also realizes various functions provided by the network camera 101 by executing various programs.
[0016] The imaging unit 201 includes an imaging optical system such as a zoom lens and a focus lens, an aperture, and an imaging element. The lens control unit 202 realizes zoom control and focus control by moving a zoom lens and a focus lens along the optical axis. The lens control unit 202 may also control the operation of an aperture. In the imaging unit 201, light transmitted through the zoom lens, focus lens, and aperture is guided to an imaging element, which performs photoelectric conversion to generate an electrical analog image signal. The imaging unit 201 performs amplification processing by sampling on the analog image signal (image signal of a subject image) generated by the imaging element, and outputs the analog image signal to the A / D conversion unit 204. The camera platform 203 has a pan drive unit and a tilt drive unit. The CPU 212 realizes pan and tilt drive (hereinafter, PT drive) for rotating the imaging unit 201 in the horizontal and vertical directions by controlling the camera platform 203 via an actuator (not shown). This makes it possible to control the imaging direction of the imaging unit 201. Note that the configuration of the camera platform 203 may be appropriately changed depending on the direction in which the imaging direction of the imaging unit 201 is controlled. As a specific example, the camera platform 203 may have only one of the pan drive unit and the tilt drive unit.
[0017] The A / D conversion unit 204 converts the analog image signal into a digital image signal, and outputs the converted digital image signal to a camera signal processing unit 205 . The camera signal processing unit 205 performs various types of image processing on the digital image signal converted by the A / D conversion unit 204. Examples of image processing that the camera signal processing unit 205 performs on the digital image signal include offset processing, gamma correction processing, gain processing, RGB interpolation processing, noise reduction processing, and color correction processing. Note that, hereinafter, the digital image signal after image processing by the camera signal processing unit 205 is also referred to as a video signal for convenience in order to distinguish it from the digital image signal before the image processing is performed.
[0018] The storage unit 206 is realized by a RAM (Random Access Memory), a ROM (Read Only Memory), an auxiliary storage device, etc. The RAM is a volatile memory, and may be, for example, an SRAM or a DRAM. The ROM is a non-volatile memory, and may be, for example, an EEPROM or a flash memory. The auxiliary storage device may be, for example, a HDD (Hard Disk Drive), an SSD (Solid State Drive), etc. Programs for implementing the functions of the network camera 101, the details of which will be described later, and data used when the programs are executed are stored in a ROM or an auxiliary storage device. As a specific example, information for associating a subject 106 to be tracked with a wireless device 103 held by the subject 106, which will be described later with reference to Fig. 5, is stored in a ROM or an auxiliary storage device and held therein. Moreover, the above-mentioned programs and data are appropriately loaded into a RAM via a bus 207 under the control of a CPU 212, and executed by the CPU 212. This causes each component of the network camera 101 to function.
[0019] The image analysis unit 208 analyzes the video signal and performs various detection processes such as human body detection, face detection, and moving object detection. For example, one example of image analysis for identifying the position of the subject 106 is human body detection for detecting a human body within an image frame. On the other hand, depending on the use scene, face detection or moving object detection may be used to identify the position of the subject 106. The image analysis unit 208 outputs the result of the image analysis to the CPU 212 via the bus 207. The compression / expansion unit 209 generates compressed data by performing a compression process on target data (e.g., a video signal). The compression / expansion unit 209 may also restore pre-compression data (e.g., a video signal) by performing an expansion process on the compressed data.
[0020] The wired communication processing unit 210 executes various processes related to realizing communication with an external device (e.g., the client device 102) via a wired network (e.g., the network 104). The configuration of the wired communication processing unit 210 may be appropriately changed depending on the type of the connected network, the communication method or communication standard applied, etc. The wireless communication processing unit 211 executes various processes related to realizing communication with an external device (e.g., wireless device 103) via a wireless network (e.g., network 105). The configuration of the wireless communication processing unit 211 may be changed as appropriate depending on the type of network to be connected and the communication method and communication standard applied. For convenience, in this embodiment, the wireless communication processing unit 211 is realized by a wireless communication module that complies with the Bluetooth (registered trademark) 5.1 specification. Of course, other communication standards such as UWB may be applied in addition to Bluetooth (registered trademark), and in that case, the wireless communication processing unit 211 only needs to include a module that can process a protocol defined in the target communication standard.
[0021] The CPU 212 as a computer functions as a control unit that controls the operation of each part of the entire device including the network camera 101 based on a computer program stored in the storage unit 206 as a storage medium. Specifically, the CPU 212 according to this embodiment functions as an image analysis position identification unit 212-1, a radio wave position identification unit 212-2, a position identification control unit 212-3, a standby control unit 212-4, a PTZ control unit 212-5, a position correction unit 212-6, and a tracking control unit 212-7.
[0022] The image analysis position identifying unit 212-1 identifies the position of the subject 106 in the image frame (hereinafter, also referred to as position identification) based on the result of the human body detection by the image analysis unit 208. Note that the image analysis position identifying unit 212-1 corresponds to an example of a first identifying means that identifies the position of the subject (the relative position of the subject with respect to the imaging device) based on an image corresponding to the imaging result by the imaging device. The radio wave position identifying unit 212-2 identifies the relative position of the wireless device 103 as seen from the network camera 101 (i.e., the relative position of the subject 106 holding the wireless device 103) based on the direction of arrival of the radio waves transmitted from the wireless device 103 (hereinafter also referred to as the radio wave direction). The radio wave position identifying unit 212-2 corresponds to an example of a second identifying means for identifying the position of the subject (the relative position of the subject with respect to the imaging device) based on the result of receiving the radio waves from the wireless device held by the subject. For convenience, in this embodiment, it is assumed that the radio wave position identifying unit 212-2 identifies the position of the subject 106 by applying a wireless communication direction detection function conforming to the Bluetooth (registered trademark) 5.1 specification, and details will be described separately below with reference to FIG. 3.
[0023] The position identification control unit 212-3 controls the operations of the image analysis position identifying unit 212-1 and the radio wave position identifying unit 212-2. In this embodiment, for convenience, the accuracy of identifying the position of the subject 106 by the radio wave position identifying unit 212-2 is assumed to be lower than the accuracy of identifying the position of the subject 106 by the image analysis position identifying unit 212-1. Details will be described later with reference to FIG. 3. In principle, the greater the distance between the antennas provided on the receiving device side, the more accurate the detection of the direction of radio waves. However, the greater the distance between the antennas, the larger the physical size of the receiving device tends to be. Since there are practical restrictions on the distance between the antennas (for example, restrictions on the size of the housing of the network camera 101), the accuracy of identifying the position of the subject based on the propagation direction is likely to be lower than the accuracy of identifying the position of the subject based on image analysis. Therefore, in this embodiment, the position identification control unit 212-3 maintains the accuracy of tracking by realizing tracking of the subject based on the result of identifying the position of the subject 106 by image analysis, as long as the position of the subject 106 can be identified by the image analysis position identification unit 212-1. The accuracy of identifying the subject's position based on the direction of radio waves may vary depending on the type of radio waves and communication method used. For example, when UWB using pulse waves is used instead of Bluetooth, it is expected to identify the subject's position more accurately because it is resistant to radio wave interference. Therefore, for example, the position identification control unit 212-3 may appropriately change the priority between the image analysis position identification unit 212-1 and the radio wave position identification unit 212-2 used to identify the subject's position according to the accuracy of each unit when automatically tracking the subject.
[0024] The standby control unit 212-4 performs various controls related to transition to a standby state and recovery from the standby state for the entire device including the network camera 101. The standby state corresponds to a state in which imaging processing is stopped and output of image data according to the imaging result is restricted from a normal imaging state (eventually, a state in which image data is controlled not to be output). Specifically, the standby control unit 212-4 mainly performs two types of control: control related to transition from a normal imaging state to a standby state, and control related to transition from the standby state to the normal imaging state. In this embodiment, when the camera is switched to the standby state while the control related to the automatic tracking of the subject is being performed, the control related to the automatic tracking of the subject is resumed after the camera is returned from the standby state to the normal imaging state. This control is intended to restore the state to the state immediately before the camera is switched to the standby state. The method of issuing an instruction to transition to the standby state or to return from the standby state is not particularly limited. As a specific example, the instruction may be accepted via a browser in the client device 102, although not shown in the figure. As another example, the instruction may be issued by pressing a predetermined button on an infrared remote controller or the like. In addition, the transition to the standby state is basically prioritized over other controls. In this embodiment, when an instruction to transition to the standby state is accepted at least during automatic tracking of a subject, the standby control unit 212-4 transitions to the standby state when an instruction to transition to the standby state is accepted.
[0025] The PTZ control unit 212-5 controls at least one of pan, tilt, and zoom driving (hereinafter also referred to as PTZ driving) based on the result of identification of the position of the subject 106 by the image analysis position identification unit 212-1 or the radio wave position identification unit 212-2. Note that zoom driving may be performed as necessary, and PTZ driving includes at least one of pan driving and tilt driving. The PTZ control unit 212-5 realizes PTZ driving by controlling, for example, the operation of the lens control unit 202 and the camera platform 203. The PTZ control unit 212-5 controls the PTZ driving so that the imaging direction of the network camera 101 is directed to the position of the subject 106, thereby enabling automatic tracking of the subject 106.
[0026] Based on the result of identifying the position of the subject 106 by the radio wave position identifying unit 212-2, the position correcting unit 212-6 corrects the result of identifying the position of the subject 106 (in other words, the position to which the imaging direction of the imaging device is directed) to be applied to the control of the imaging direction of the network camera 101. As a specific example, there are cases where a range in which imaging is restricted (hereinafter also referred to as an imaging restricted range) is set, such as when imaging is prohibited or permitted only under specific conditions at a filming site for video production. In such a case, the position correcting unit 212-6 corrects the position to which the imaging direction is directed, for example, so that the imaging direction of the network camera 101 is not directed within the imaging restricted range (in other words, so that the imaging restricted range is not included in the angle of view of the network camera 101). Details of the processing of the position correcting unit 212-6 will be described separately later with reference to FIG. 7.
[0027] The tracking control unit 212-7 controls processing related to automatic tracking of a subject (hereinafter also referred to as automatic tracking processing). As a specific example, the tracking control unit 212-7 controls the start and end of the self-tracking processing, and performs initial settings of the automatic tracking processing. In addition, the tracking control unit 212-7 controls the determination of whether the subject 106 to be tracked holds the wireless device 103 or not, and the storage of the device ID of the wireless device 103 held by the subject 106 when the network camera 101 transitions to a standby state.
[0028] <Radio wave direction detection> 3, an outline of the principle of the method by which the wireless communication processing unit 211 according to this embodiment detects the direction of radio waves from the wireless device 103 will be described. The wireless communication processing unit 211 of the network camera 101 according to this embodiment has a wireless communication direction detection function that complies with the Bluetooth (registered trademark) 5.1 specification. The wireless communication processing unit 211 detects the direction of radio waves by using an antenna array having multiple antennas 302 and utilizing a phase difference that occurs between the reception results of radio waves at each antenna 302 due to the different positions at which each antenna 302 is disposed. Methods for detecting the direction of radio waves include, for example, a method called Angle Of Arrival (AoA) and a method called Angle Of Departure (AoD). AoA is a method in which a receiving device calculates the reception angle of the radio waves to detect the direction of arrival of the radio waves. AoD is a method in which a transmitting device calculates the emission angle and then transmits the emission angle to the receiving device to detect the direction of arrival of the radio waves on the receiving device. For the sake of convenience, in this embodiment, the wireless device 103 is assumed to be a transmitting device and the wireless communication processing unit 211 is assumed to be a receiving device, and the wireless communication processing unit 211 detects the radio wave direction using AoA, but it is also possible to apply AoD.
[0029] As shown in Fig. 3, wireless communication processing unit 211, which is a receiving device, has receiver 301 and multiple antennas 302 arranged at equal intervals. Wireless device 103, which is a transmitting device, has transmitter 303 and antenna 304. In the example shown in Fig. 3, for simplicity of explanation, it is assumed that wireless device 103, which is a transmitting device, has one antenna 304.
[0030] On the wireless device 103 side, which is a transmitting device, a transmitter 303 transmits radio waves 305 including a predetermined direction detection signal from an antenna 304. On the wireless communication processing unit 211 side of the network camera 101, which is a receiving device, the radio waves 305 transmitted from the wireless device 103 are received by a plurality of antennas 302. At this time, each of the plurality of antennas 302 arranged at equal intervals receives the radio waves 305, but since the distances between the antenna 304 and each antenna 302 (for example, distances D1 and D2) are different, each antenna 302 detects a signal with a different phase. Under such a premise, the radio wave position identifying unit 212-2 acquires a modulated signal (IQ modulated signal) having an in-phase component and a quadrature phase component as phase information of the radio wave while switching the active antenna in the wireless communication processing unit 211. Then, the radio wave position identifying unit 212-2 calculates an incident angle θ, which is the relative direction of the signal, based on the acquired IQ modulated signal. The calculation of the incident angle θ is performed using information such as the wavelength of the radio wave, the distance between the antennas, and the phase difference, but the method is well known and therefore will not be described in detail.
[0031] Furthermore, the network camera 101 can know in advance its own current orientation in three-dimensional space (i.e., imaging direction) by calibration performed at the time of installation. Note that it is possible to imagine a situation in which the network camera 101 is not fixed and its position and orientation may change from time to time, such as when it is installed on a moving object. In such a case, for example, an encoder that detects a tilt angle, an electronic compass, a GPS, or the like may be used to know in advance the orientation (imaging direction) of the network camera 101.
[0032] By using the method described above, the radio wave position identifying unit 212-2 of the network camera 101 can identify the relative position of the wireless device 103 as seen from the network camera 101, based on the result of identifying the direction of the radio waves from the wireless device 103.
[0033] <Processing> An example of the processing of the network camera 101 according to this embodiment will be described with particular focus on processing related to automatic tracking of a subject with reference to Fig. 4. The series of processing shown in Fig. 4 can be realized, for example, by the CPU 212 as a computer deploying and executing a computer program stored in a storage unit.
[0034] In S401, the tracking control unit 212-7 reflects initial settings related to the operation of the automatic tracking process. Examples of contents reflected as the initial settings include association between the subject 106 and the wireless device 103, and a setting that the object to be tracked is the subject 106. 5 is a diagram showing an example of a table that associates subjects 106 with wireless devices 103. Management table 501 is a table for associating a detection ID for identifying a human body in a human body detection result, a device ID that is device-specific ID information of wireless device 103, and a flag indicating whether or not the object is a tracked object, and for managing the combination of these pieces of information by assigning a registration ID. Management table 501 is held, for example, by being stored in storage unit 206. In the following description of the process, for convenience, it is assumed that information to which a registration ID "1" is assigned, which associates the human body detection ID "1" of the subject 106 with the device ID "1" of the wireless device 103, is used. In the present embodiment, the subject 106 is associated as a tracking object holding the wireless device 103 by selecting a body frame of the subject 106 by a user operation from the client device 102, but the method of setting the tracking target is not limited. For example, a dedicated mode for performing a predetermined association may be provided, and the subject 106 may be associated as a tracking object holding the wireless device 103 by fitting the subject 106 at a predetermined position in the angle of view during operation in the mode. As another example, the subject 106 may be associated as a tracking object holding the wireless device 103 by recognizing a predetermined gesture operation of the subject 106.
[0035] In S402, the tracking control unit 212-7 starts executing the automatic tracking process. In this embodiment, the tracking control unit 212-7 tracks the subject using both the image analysis position identification unit 212-1 and the radio wave position identification unit 212-2, and basically uses the result of identifying the position of the subject 106 by the image analysis position identification unit 212-1 for the tracking process. On the other hand, as long as it is possible to realize tracking of the subject 106, the method is not necessarily limited to the example shown above. For example, when it becomes difficult to detect a human body and the subject 106 to be tracked is lost, the subject 106 may be tracked according to the position of the wireless device 103 held by the subject 106 captured by the radio wave position identification unit 212-2.
[0036] In S403, the standby control unit 212-4 determines whether or not an instruction to transition to the standby state has been accepted. The standby control unit 212-4 waits for an instruction to transition to the standby state unless the instruction is received in S403. Then, if the standby control unit 212-4 determines in S403 that an instruction to transition to the standby state has been accepted, it advances the process to S404.
[0037] In S404, tracking control unit 212-7 determines whether or not subject 106 is carrying wireless device 103. For example, tracking control unit 212-7 may determine whether or not subject 106 is carrying wireless device 103 by referring to management table 501 illustrated in FIG. If the tracking control unit 212-7 determines in S404 that the subject 106 is carrying the wireless device 103, the process proceeds to S405. On the other hand, if the tracking control unit 212-7 determines in S404 that the subject 106 does not carry the wireless device 103, the process proceeds to S406. In this case, the process of S405 is skipped.
[0038] In S405, the tracking control unit 212-7 stores the device ID of the wireless device 103 held by the subject 106 (in other words, the wireless device 103 held by the subject 106) in the storage unit 206. Even if the standby control unit 212-4 causes the network camera 101 to transition to the standby state, the tracking control unit 212-7 holds the management table 501 in which the correspondence was established in S401. If the management table 501 is not held immediately before the transition to the standby state, the tracking control unit 212-7 associates the subject 106 and the wireless device 103 at this point in time, and stores information indicating the result. This allows the tracking control unit 212-7 to specify the device ID of the wireless device 103 held by the subject 106 that was the target of tracking before the transition to the standby state by referring to the information when returning from the standby state.
[0039] In S406, the standby control unit 212-4 executes processing related to transition to the standby state. When transitioning to the standby state, the imaging process is stopped, and the automatic tracking process is also stopped. Then, the network camera 101 enters a state in which image output is restricted (for example, a state in which images corresponding to the imaging results are not output).
[0040] In S407, the standby control unit 212-4 determines whether or not an instruction to return from the standby state has been accepted. The standby control unit 212-4 waits for an instruction to return from the standby state unless the instruction is received in S404. In other words, the network camera 101 continues the standby state until an instruction to return from the standby state is received. Then, if the standby control unit 212-4 determines in S404 that an instruction to return from the standby state has been accepted, it advances the process to S408.
[0041] In S408, the standby control unit 212-4 determines whether or not to resume automatic tracking after recovery from the standby state. In this embodiment, for convenience, whether or not to resume automatic tracking after recovery from the standby state is set in advance as an initial setting, and is reflected in the processing of S401. Of course, the setting method of whether or not to resume automatic tracking after recovery from the standby state is not limited to the example shown above. As a specific example, a setting of whether or not to resume automatic tracking after recovery from the standby state may be specified when transitioning to the standby state or when recovering from the standby state. If the standby control unit 212-4 determines in S408 that the automatic tracking is to be resumed, the process proceeds to S409. On the other hand, if the standby control unit 212-4 determines in S408 not to resume automatic tracking, it ends the series of processes shown in Fig. 4. In this case, the network camera 101 transitions to a state in which it outputs a normal captured image after returning from the standby state, for example.
[0042] In S409, the tracking control unit 212-7 determines whether or not to resume tracking of the same subject as before the transition to the standby state when returning from the standby state. In this embodiment, it is mainly assumed that the same subject as before the transition to the standby state is resumed when returning from the standby state, but the behavior after returning from the standby state may be set in advance by a user's designation or the like. As a specific example, information indicating whether or not to resume tracking of the same subject as before the transition to the standby state when returning from the standby state may be designated as the setting information. Of course, the method of designating the setting information is merely an example, and the method of designating the setting information is not particularly limited.
[0043] For example, Fig. 6 is a diagram showing an example of a setting screen for receiving a designation from a user via the client device 102 as to whether or not to resume tracking of the same subject as before the transition to the standby state when returning from the standby state. The setting screen 601 shown in Fig. 6 presents an input interface for receiving a designation as to whether or not to resume tracking of the same subject as before the transition to the standby state when returning from the standby state. Also, the setting screen 601 shown in Fig. 6 presents an input interface for receiving a designation as to whether or not to follow the setting regarding the composition when capturing the subject in the captured image before the transition to the standby state when resuming tracking of the subject. In this disclosure, the composition corresponds to the so-called "composition" that indicates the configuration or arrangement of elements or components of an image, and in this disclosure, it particularly corresponds to the composition when capturing the subject 106 in a captured image. A specific example of the composition setting in this disclosure may be a setting regarding a body part (face, upper body, whole body, etc.) of the subject 106 to be used as a reference, a setting regarding the position where the subject 106 is to be captured in the captured image (left, center, right, etc.), etc.
[0044] If the tracking control unit 212-7 determines in S409 that tracking should be resumed for the same subject as before the transition to the standby state upon recovery from the standby state, the tracking control unit 212-7 advances the process to S410. On the other hand, if the tracking control unit 212-7 determines in S409 that tracking of the same subject as before the transition to the standby state will not be resumed upon recovery from the standby state, the process proceeds to S419.
[0045] In S410, tracking control unit 212-7 determines whether or not the device ID of wireless device 103 carried by subject 106 that was the tracking target immediately before transitioning to the standby state is stored. Specifically, tracking control unit 212-7 refers to the information stored in S405 and determines whether or not the device ID of wireless device 103 carried by subject 106 that was the tracking target immediately before transitioning to the standby state is held. If the tracking control unit 212-7 determines in S410 that the device ID of the wireless device 103 held by the subject that was the tracking target immediately before the transition to the standby state is stored, the tracking control unit 212-7 advances the process to S411. On the other hand, if the tracking control unit 212-7 determines in S410 that the device ID of the wireless device 103 held by the subject that was the tracking target immediately before the transition to the standby state is not stored, the tracking control unit 212-7 proceeds to S419.
[0046] In S411, the position identification control unit 212-3 sets a method of using the results of receiving radio waves from the wireless device 103 as a method to be applied for identifying the position of the subject. In S412, the radio wave position identifying unit 212-2 acquires the radio wave signal from the wireless device 103 via the wireless communication processing unit 211, and identifies the position of the subject 106 based on the radio wave direction. At this time, the target device ID is the device ID of the subject immediately before standby.
[0047] In S413, the position correction unit 212-6 determines whether or not the position of the wireless device 103 identified in S412 is within a preset range in which image capturing is permitted. Details of the image capturing permitted range will be described later with reference to FIG. 7 together with the description of S416. If the position correction unit 212-6 determines that the position of the wireless device 103 identified in S413 is within the image capturing permission range, the process proceeds to S414. On the other hand, if the position correction unit 212-6 determines that the position of the wireless device 103 identified in S413 is not within the image capturing permitted range (that is, within the range where image capturing is restricted), the process proceeds to S416.
[0048] In S414, the PTZ control unit 212-5 specifies the driving amount in the pan direction and tilt direction to be PT controlled in order to direct the imaging direction to the position of the wireless device 103 determined to be within the imaging permission range in S413, and outputs a PT drive instruction according to the driving amount. Note that a method for specifying the driving amount in the pan direction and tilt direction according to the position of the subject is omitted in detail because a known technology can be applied. In addition, in this embodiment, it is described that driving is performed in the pan direction and tilt direction, but the content of the control by the PTZ control unit 212-5 to direct the imaging direction to the position of the subject is not limited to this example. For example, the PTZ control unit 212-5 may estimate the distance to the wireless device 103 according to the value of the intensity of the radio wave from the wireless device 103, and perform zoom control according to the estimated result of the distance. In addition, as another example, when a communication technology with excellent distance measurement such as UWB is applied, the PTZ control unit 212-5 may perform zoom control based on the distance measurement result.
[0049] In S415, the tracking control unit 212-7 determines whether or not a subject exists within a predetermined range (for example, within an imaging range) as a result of the PT driving in S414. As a specific example, the tracking control unit 212-7 may use the human body detection function of the image analysis unit 208 to check whether or not a subject 106 exists around the target wireless device 103 (wireless device 103 whose position was identified in S412). In this manner, the tracking control unit 212-7 checks whether or not the subject 106 has moved while not carrying the wireless device 103 and leaving it on a desk or the like during the transition to the standby state (in other words, while tracking of the subject is stopped), and changes the process to be executed thereafter according to the result. In this embodiment, it is assumed that the subject around the wireless device 103 is the subject 106, which is the object to be tracked. Therefore, the tracking control unit 212-7 determines that the subject that is stably present near the wireless device 103 for a predetermined period of time is the subject 106, which is the object to be tracked. If the tracking control unit 212-7 determines in S415 that the subject 106 is present within the predetermined range, the process proceeds to S418. On the other hand, if the tracking control unit 212-7 determines in S415 that the subject 106 does not exist within the predetermined range, the process proceeds to S419. In this case, the tracking control unit 212-7 determines that it is difficult to obtain an effect related to tracking the subject 106, which is the tracking object, even if the wireless device 103 is tracked any further (it is practically difficult to realize tracking of the subject 106), and determines the subsequent process.
[0050] In S416, if the position correction unit 212-6 determines in S413 that the subject is not within the imaging permission range, i.e., that the subject is within the imaging prohibited range, the position correction unit 212-6 corrects the position to which the imaging direction is directed to be closest to the position before correction within the imaging permission range.
[0051] Now, with reference to FIG. 7, an overview will be given of correction of the position of the wireless device 103 (in other words, the position to which the imaging device is directed) that is applied to control of the imaging direction when returning from the standby state. 7(a) shows a schematic state in which the wireless device 103 captured after returning from a standby state is present within an image capture permitted range 701. In this case, since the wireless device 103 is present within the image capture permitted range, there is no problem if image capture is performed by performing PT driving so that the image capture direction faces the position of the wireless device 103. Therefore, the specified position 703 of the wireless device 103 is applied as a position 704 to which the image capture direction is directed by PT driving, and PT driving is performed. 7B is a schematic diagram showing a state in which the wireless device 103 captured after returning from the standby state is present within the image capture restricted range 702. In this case, since the wireless device 103 is present within the image capture restricted range, it is not preferable in terms of security to perform PT driving so that the image capture direction faces the position of the wireless device 103 and capture an image. Therefore, in this embodiment, instead of the position 703 of the wireless device 103 specified based on the incoming direction of the radio waves, a correction is performed so that a position closest to the position 703 in the image capture permitted range 701 is applied as the position 704 to which the image capture direction is directed by PT driving.
[0052] The method of calculating the distance between the positions before and after the correction may be, for example, a calculation method based on a comparison between a pan value indicating the position of the wireless device 103 and a pan value of a position within the image capturing permitted range. Of course, this calculation method is merely one example, and as long as it is possible to specify how close the distance between the positions before and after the correction is, the method of calculating the distance (in other words, the distance applied when correcting the position) is not particularly limited. As a specific example, the distance between the positions before and after the correction may be calculated based on a comparison between a tilt value indicating the position of the wireless device 103 and a tilt value of a position within the image capturing permitted range. In addition, in this embodiment, a position within the image capture range that is closer to the position of the wireless device 103 is applied as the corrected position, but the conditions related to the correction are not particularly limited as long as the correction is made to a position at least within the image capture range. As a specific example, when a route that the subject 106 frequently travels is known, a position on the route within the image capture range may be applied as the corrected position.
[0053] In S417, the PTZ control unit 212-5 specifies the driving amounts in the pan direction and tilt direction to be PT controlled in order to orient the imaging direction to the position corrected in S416, and outputs a PT driving instruction according to the driving amounts. Note that a method for specifying the driving amounts in the pan direction and tilt direction according to the subject position is not described in detail because known techniques can be applied. In S418, the position identification control unit 212-3 sets a method of using the results of image analysis as a method to be applied to identify the position of the subject. Then, the position identification control unit 212-3 advances the process to S402. In this case, tracking of the subject 106 based on the result of human body detection by the image analysis position identification unit 212-1 is resumed. As a result, since the network camera 101 identifies the position of the subject 106 based on the result of image analysis, it is expected to have an effect of improving the accuracy of identifying the position compared to the case where the position of the subject 106 is identified based on the result of receiving radio waves from the wireless device 103.
[0054] In S419, the PTZ control unit 212-5 specifies the driving amount in the pan direction and tilt direction to be PT controlled for the home position (position where the imaging direction is directed in a predetermined direction) which is a predetermined position set in advance, and outputs a PT driving instruction according to the driving amount. Note that in this embodiment, when returning to S401 and re-reflecting the initial settings and then restarting automatic tracking, the process of S419 is executed as a pre-processing.
[0055] As described above, the network camera 101, when returning from the standby state, specifies the position of the subject that was the target of tracking just before transitioning to the standby state based on the incoming direction of the radio waves from the wireless device 103 through the processes of S409 to S418. This makes it possible to turn the imaging direction toward the position of the subject and resume tracking of the subject more quickly than when the position of the subject is specified using the result of image analysis. Furthermore, the processes of S413 and S416 make it possible to control the imaging direction after considering whether the position specified based on the result of receiving the radio waves from the wireless device 103 is within a range in which imaging is permitted. This makes it possible to prevent, for example, the occurrence of a situation in which the network camera 101 captures an image of a range in which imaging is restricted due to security issues. Furthermore, the process of S415 makes it possible to control the imaging direction after considering whether the subject of interest actually exists at the position specified based on the result of receiving the radio waves from the wireless device 103.
[0056] Here, with reference to Fig. 8, an example of an image frame output from the network camera 101 according to the imaging result in a situation where a subject is automatically tracked by the series of processes illustrated in Fig. 4 will be described. Image frame 801 corresponds to an image frame output from the network camera 101 according to the imaging result. Hereinafter, an example of the image frame shown in each of Figs. 8(a) to 8(e) will be described in association with the process shown in Fig. 4.
[0057] Fig. 8(a) shows a state in which the network camera 101 captures a detection position 802 of the subject 106, which is a tracking object carrying the wireless device 103, using the result of human body detection. In the example shown in Fig. 4, when the network camera 101 reflects the initial settings of automatic tracking and starts executing automatic tracking, an image frame 801 as shown in Fig. 8(a) may be output. Although not shown, during this automatic tracking, PT driving is performed so that the imaging direction is directed to the position of the subject 106 identified by human body detection.
[0058] Fig. 8(b) shows an example of a state after the network camera 101 receives an instruction to transition to a standby state by a user operation or the like and transitions to the standby state. In the example shown in Fig. 4, when the network camera 101 receives an instruction to transition to the standby state in step S403, if the subject 106 is carrying the wireless device 103 in S404, the network camera 101 stores the device ID of the wireless device 103. At that time, as shown in Fig. 8(b), a message 803 or the like is displayed to the user indicating that the device is in the standby state.
[0059] 8(c) shows a state in which the network camera 101, after transitioning to the standby state, receives an instruction for returning from the standby state by a user operation or the like, receives radio waves from the wireless device 103, identifies the radio wave direction, and captures a radio wave position 804. In the example shown in FIG. 4, the network camera 101 determines in S409 to track the same subject as before the standby state, and captures the position of the radio wave including the device ID from the wireless device 103 in a state in which the device ID is stored in S410. In this state, the network camera 101 is in a state in which it has captured the radio wave position 804 of the wireless device 103.
[0060] FIG. 8(d) shows a state where the subject 106 exists within a predetermined range 805 (for example, a predetermined range with the radio wave position 804 as a base point) according to the radio wave position 804 captured by the network camera 101. For example, FIG. 8(d) corresponds to a state where, in the example shown in FIG. 4, the radio wave position information of the wireless device 103 is acquired in S412, and it is determined in S415 that the subject exists within a predetermined range for the radio wave position 804 according to the result of the PT drive in S414. In this case, since it becomes possible to track the subject using the result of the image analysis, the process proceeds to S402 via S418. That is, the state returns to the example shown in FIG. 8(a). Note that the predetermined range 805 according to the radio wave position 804 can be set, for example, as a range within a predetermined distance from the center point of the radio wave position 804. Also, the shape of the predetermined range 805 is not particularly limited, and may be a circle or a rectangle.
[0061] Fig. 8(e), unlike Fig. 8(d), shows a state in which the subject 106 does not exist within a predetermined range 805 corresponding to the radio wave position 804 captured by the network camera 101. For example, Fig. 8(e) corresponds to a state in the example shown in Fig. 4 in which the radio wave position information of the wireless device 103 is acquired in S412, and it is determined in S415 that the subject does not exist within the predetermined range for the radio wave position 804 corresponding to the result of the PT drive in S414. In this case, PT drive is performed in S419 to move to the home position.
[0062] As described above, according to the network camera 101 of this embodiment, when the camera transitions to a standby state during automatic tracking, when returning from the standby state, the position of the subject that was the target of tracking just before the transition to the standby state can be captured and the imaging direction can be changed. With this mechanism, it is possible to resume automatic tracking of the subject in a shorter time than when the subject is searched for based on the results of image analysis when returning from the standby state. In addition, since the position of the subject is identified based on the direction of arrival of the radio waves transmitted by the wireless device held by the subject, even in an imaging device that does not have a function such as face recognition, it is possible to resume tracking of the subject after identifying the position of the subject.
[0063] <Other embodiments> The present invention can also be realized by a process in which a program for implementing one or more of the functions of the above-described embodiments is supplied to a system or device via a network or a storage medium, and one or more processors in a computer of the system or device read and execute the program. The present invention can also be realized by a circuit (e.g., ASIC) that implements one or more of the functions.
[0064] Furthermore, various modifications may be made without departing from the basic technical concept of one embodiment of the present disclosure described above. For example, in the above embodiment, an example of a case where wireless communication based on the Bluetooth (registered trademark) version 5.1 standard is applied to identify the position of a subject based on the radio wave arrival direction has been described, but the type of wireless communication applied is not necessarily limited. That is, even if the version of Bluetooth (registered trademark) is 5.2 or later, as long as the direction detection function of version 5.1 is followed, it can be applied to identify the position of a subject based on the radio wave arrival direction in this embodiment. Also, as long as it is possible to identify (or estimate) the arrival direction of the radio wave transmitted from the wireless device 103, it is possible to apply wireless communication based on other communication standards (other wireless communication protocols) in addition to Bluetooth (registered trademark). As a specific example, a protocol such as UWB may be applied. Note that the hardware (wireless communication module) for realizing the wireless communication processing unit 211 may be appropriately changed according to the communication standard and wireless communication protocol to be applied.
[0065] In the above-described embodiment, the description has been given mainly focusing on the control when the network camera 101 returns from a standby state after transitioning to the standby state, but this does not necessarily limit the application of the technology according to an embodiment of the present disclosure. That is, the technology according to the present disclosure can be applied under a situation in which the control of the imaging direction of the imaging device related to tracking of a subject is temporarily stopped due to some factor, and then the control related to the tracking is resumed with the same subject as before the stoppage as the target. In the above embodiment, an example has been described in which the imaging direction of the network camera 101 is controlled by the network camera 101 itself. On the other hand, a situation may be assumed in which an external device different from the network camera 101 controls the imaging direction of the network camera 101. In such a case, the external device may be caused to execute processing related to the control of the imaging direction of the network camera 101 related to tracking of the subject described above. In the above embodiment, an example has been described in which the wireless device 103, the location of which is to be specified based on the radio wave reception result, is specified based on the device ID included in the radio wave. However, as long as it is possible to identify the wireless device 103, the method is not particularly limited. Also, in the above-described embodiment, an example of a case where so-called PTZ control is applied to the imaging direction of the network camera 101 has been described. On the other hand, as long as it is possible to control the imaging direction of the network camera 101, in other words, the range of the subject of imaging by the network camera 101, the method is not particularly limited. As a specific example, even in a situation where electronic control that cuts out a part of the angle of view of the network camera 101 as the range of the subject of imaging is applied to at least a part of the control of the imaging direction, it is also possible to apply the technology according to the present disclosure to the control.
[0066] The disclosure of the present embodiment also includes the following configurations, methods, and programs. (Configuration 1) An information processing device comprising: a first identification means for identifying a relative position of the subject with respect to an imaging device by performing image analysis on an image corresponding to the imaging result of the subject by the imaging device; a second identification means for identifying the relative position of the subject with respect to the imaging device based on the reception result of radio waves from a wireless device held by the subject; and a control means for controlling the imaging direction of the imaging device to track the subject based on the identification result of the relative position of the subject with respect to the imaging device by at least one of the first identification means and the second identification means, wherein when the tracking is resumed from a state in which the tracking was stopped, the control means resumes tracking of the subject based on the identification result by the second identification means of the relative position of the subject with respect to the imaging device that was the tracking target when the tracking was stopped. (Configuration 2) The information processing device described in configuration 1, characterized in that when the control means transitions to a state where the tracking is stopped, it retains identification information assigned to the wireless device that the second identification means identified as the target of radio waves when identifying the relative position of the subject relative to the imaging device, and when the control means resumes the tracking of the subject based on the result of the second identification means identifying the relative position of the subject relative to the imaging device based on the result of receiving radio waves from the wireless device corresponding to the identification information retained. (Configuration 3) An information processing device as described in configuration 1 or 2, further comprising a receiving means for receiving designation of setting information related to tracking of the subject when the tracking is resumed from a state in which the tracking was stopped, and the control means is characterized in that it resumes the tracking based on the setting accepted by the accepting means. (Configuration 4) The information processing device according to configuration 3, characterized in that the setting information related to the tracking includes setting information regarding whether or not a subject that was the target of the tracking just before the tracking transitioned to a stopped state is to be the target of the tracking when the tracking is resumed. (Configuration 5) The information processing device according to configuration 3 or 4, characterized in that the setting information related to the tracking includes setting information regarding whether or not to apply, when the tracking is resumed, a composition for capturing a target subject in an image that was applied immediately before the tracking was stopped. (Configuration 6) The information processing device according to any one of configurations 1 to 5, characterized in that, when tracking is resumed from a state in which the tracking was stopped, the information processing device further comprises a correction means for correcting a result of the determination of the relative position, which is applied to control of the imaging direction of the imaging device, depending on whether the relative position of the subject with respect to the imaging device determined by the second determination means is located within an imaging permitted range in which imaging is permitted or an imaging restricted range in which imaging is restricted. (Configuration 7) The information processing device described in configuration 6, characterized in that when the relative position of the subject with respect to the imaging device identified by the second identification means is located within the imaging permission range, the correction means limits the correction of the identification result of the relative position applied to control the imaging direction of the imaging device. (Configuration 8) The information processing device described in configuration 6 or 7, characterized in that, when the relative position of the subject with respect to the imaging device identified by the second identification means is located within the imaging restriction range, the correction means corrects the identification result of the relative position applied to control the imaging direction of the imaging device to a position closer to the relative position within the imaging permission range. (Configuration 9) The information processing device described in any one of configurations 6 to 8, characterized in that when the correction means does not correct the result of identifying the relative position of the subject with respect to the imaging device, which is applied to control of the imaging direction of the imaging device, and when it is determined that an object estimated to be the target subject does not exist within a predetermined range centered on the position identified by the second identification means, when resuming the tracking from a state in which the tracking was stopped, the control means controls the imaging direction to face a predetermined direction. (Configuration 10) The information processing device according to any one of configurations 1 to 9, wherein the information processing device is a control device built into the imaging device. (Configuration 11) The information processing device according to any one of configurations 1 to 9, wherein the information processing device is an external device connected to the imaging device via a network. (Method 1) A control method for an information processing device, comprising: a first identification step of identifying a relative position of the subject with respect to an imaging device by performing image analysis on an image corresponding to an imaging result of the subject by the imaging device; a second identification step of identifying a relative position of the subject with respect to the imaging device based on a reception result of radio waves from a wireless device held by the subject; and a control step of controlling an imaging direction of the imaging device to track the subject based on a result of identifying the relative position of the subject with respect to the imaging device in at least one of the first identification step and the second identification step, wherein the control step, when resuming tracking from a state in which the tracking was stopped, resumes tracking of the subject based on a result of identifying the relative position of the subject with respect to the imaging device in the second identification step that was the tracking target when the tracking was stopped. (Program 1) A program for causing a computer to function as an information processing device comprising: a first identification means for identifying a relative position of the subject with respect to an imaging device by performing image analysis on an image corresponding to the imaging result of the subject by the imaging device; a second identification means for identifying the relative position of the subject with respect to the imaging device based on the reception result of radio waves from a wireless device held by the subject; and a control means for controlling the imaging direction of the imaging device to track the subject based on the identification result of the relative position of the subject with respect to the imaging device by at least one of the first identification means and the second identification means, wherein when the tracking is resumed from a state in which the tracking was stopped, the control means resumes tracking of the subject based on the identification result, by the second identification means, of the relative position of the subject with respect to the imaging device that was the tracking target when the tracking was stopped. [Explanation of symbols]
[0067] 100 Network Systems 101 Network Camera 212-1 Image analysis position identification section 212-2 Radio wave position identification section 212-7 Tracking control section
Claims
1. a first specifying means for specifying a relative position of the subject with respect to the imaging device by performing image analysis on an image corresponding to an imaging result of the subject by the imaging device; a second identification means for identifying a relative position of the subject with respect to the imaging device based on a result of receiving radio waves from a wireless device held by the subject; a control means for controlling an imaging direction of the imaging device so as to track the subject, based on a result of identification of the relative position of the subject with respect to the imaging device by at least one of the first identification means and the second identification means; having When the control means resumes tracking from a state in which the tracking has been stopped, the control means resumes tracking of the subject based on a result of the second identification means identifying a relative position of the subject that was the tracking target when the tracking was stopped with respect to the imaging device. An information processing device comprising:
2. The control means When the tracking is stopped, the second specifying means holds identification information assigned to the wireless device that is a target for receiving radio waves when specifying the relative position of the subject with respect to the imaging device, When the tracking is resumed, the tracking of the subject is resumed based on a result of the second identification means identifying a relative position of the subject with respect to the imaging device based on a result of receiving a radio wave from the wireless device corresponding to the stored identification information.
2. The information processing device according to claim 1.
3. a receiving unit for receiving designation of setting information related to tracking of the subject when the tracking is resumed from a state in which the tracking has been stopped; The control means resumes the tracking based on the setting accepted by the acceptance means.
2. The information processing device according to claim 1.
4. The information processing device according to claim 3, characterized in that the setting information related to the tracking includes setting information regarding whether or not a subject that was the target of the tracking immediately before the tracking was stopped is to be the target of the tracking when the tracking is resumed.
5. The information processing device according to claim 3, characterized in that the setting information related to the tracking includes setting information regarding whether or not to apply, when the tracking is resumed, a composition for capturing a target subject in an image that was applied immediately before the tracking was stopped.
6. 2. The information processing device according to claim 1, further comprising a correction means for correcting a result of the determination of the relative position of the subject with respect to the imaging device specified by the second determination means when the tracking is resumed from a state in which the tracking was stopped, depending on whether the relative position of the subject with respect to the imaging device is located within an imaging permitted range in which imaging is permitted or an imaging restricted range in which imaging is restricted.
7. 7. The information processing device according to claim 6, wherein the correction means is characterized in that, when the relative position of the subject with respect to the imaging device identified by the second identification means is located within the imaging permission range, the correction means limits correction of the identification result of the relative position applied to control of the imaging direction of the imaging device.
8. 7. The information processing device according to claim 6, wherein, when the relative position of the subject with respect to the imaging device identified by the second identification means is located within the imaging restriction range, the correction means corrects the identification result of the relative position applied to control of the imaging direction of the imaging device to a position closer to the relative position within the imaging permission range.
9. 7. The information processing device according to claim 6, wherein when the correction means does not correct the result of identifying the relative position of the subject with respect to the imaging device, which is applied to control of the imaging direction of the imaging device, and when it is determined that an object estimated to be the target subject does not exist within a predetermined range centered on the position identified by the second identification means, when resuming the tracking from a state in which the tracking was stopped, the control means controls the imaging direction to face a preset direction.
10. The information processing device according to claim 1 , wherein the information processing device is a control device built into the imaging device.
11. The information processing apparatus according to claim 1 , wherein the information processing apparatus is an external apparatus connected to the imaging apparatus via a network.
12. A method for controlling an information processing device, comprising: a first specifying step of specifying a relative position of the subject with respect to the imaging device by performing image analysis on an image corresponding to an imaging result of the subject by the imaging device; a second specifying step of specifying a relative position of the subject with respect to the imaging device based on a result of receiving radio waves from a wireless device held by the subject; a control step of controlling an imaging direction of the imaging device so as to track the subject, based on a result of identifying the relative position of the subject with respect to the imaging device in at least one of the first identifying step and the second identifying step; Including, The control step includes, when resuming tracking from a state in which the tracking has been stopped, resuming tracking of the subject based on a result of specifying, in the second specifying step, a relative position of the subject that was set as a tracking target when the tracking was stopped with respect to the imaging device.
23. A method for controlling an information processing apparatus comprising:
13. Computer, a first specifying means for specifying a relative position of the subject with respect to the imaging device by performing image analysis on an image corresponding to an imaging result of the subject by the imaging device; a second identification means for identifying a relative position of the subject with respect to the imaging device based on a result of receiving radio waves from a wireless device held by the subject; a control means for controlling an imaging direction of the imaging device so as to track the subject, based on a result of identification of the relative position of the subject with respect to the imaging device by at least one of the first identification means and the second identification means; having When the control means resumes tracking from a state in which the tracking has been stopped, the control means resumes tracking of the subject based on a result of the second identification means identifying a relative position of the subject that was the tracking target when the tracking was stopped with respect to the imaging device. A program for causing the information processing device to function as the information processing device.
Citation Information
Patent Citations
Information processing apparatus, information processing method, and program
JP2021166368A
