Information processing apparatus and imaging system

Abstract

To install a plurality of imaging apparatuses when using the imaging apparatuses without caring about preset information set to the imaging apparatuses.SOLUTION: An information processing apparatus controls a plurality of imaging apparatuses, and has: acquisition means that acquires a plurality of reference images picked up by the plurality of imaging apparatuses, and a plurality of pieces of preset information used when the plurality of reference images are picked up; and control means that, when controlling the first imaging apparatus by using the first preset information acquired by the acquisition means, performs control of applying the first present information to the first imaging apparatus on the basis of an image picked up by the first imaging apparatus and the plurality of reference images.SELECTED DRAWING: Figure 5

Description

[Technical Field]

[0001] The present invention relates to an information processing device and an imaging system. [Background technology]

[0002] Conventionally, a live streaming camera that distributes captured video via a network has been used as a remotely operable imaging device. One of the functions related to driving the pan, tilt, and zoom of a live streaming camera is a preset function. The preset function refers to the following function: a user sets information about the imaging direction and zoom magnification (hereinafter referred to as preset information) in advance. Then, the set preset information is used to change the imaging direction and zoom magnification. Patent Document 1 discloses resetting the preset information of one camera to another camera. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2011-015040 Summary of the Invention [Problem to be solved by the invention]

[0004] In a distribution system in which multiple cameras are installed in different locations to distribute video, there is a demand for reducing the time required for setup. The technology disclosed in Patent Document 1 assumes that the camera to which preset information is to be set is already determined, and it is not possible to select a camera from multiple cameras to set the settings to. Therefore, in such a distribution system, a specific camera with specific preset information set must be installed in a specific location, which takes time and effort.

[0005] Therefore, an object of the present invention is to enable installation of multiple image capture devices without having to worry about preset information set in the image capture devices when using multiple image capture devices. [Means for solving the problem]

[0006] The present invention is an information processing device for controlling a plurality of imaging devices, characterized in that it comprises: an acquisition means for acquiring a plurality of reference images captured by each of the plurality of imaging devices and a plurality of preset information used when capturing the plurality of reference images; and a control means for controlling the application of the first preset information to the first imaging device based on an image captured by the first imaging device and the plurality of reference images when the first imaging device is controlled using the first preset information acquired by the acquisition means. [Effects of the Invention]

[0007] According to the present invention, when using a plurality of imaging devices, the imaging devices can be installed without having to worry about the preset information set in the imaging devices. [Brief explanation of the drawings]

[0008] [Figure 1] FIG. 1 is a diagram illustrating an example of the overall configuration of an imaging system. [Figure 2] FIG. 2 is a diagram illustrating an example of a hardware configuration of an imaging apparatus. [Figure 3] FIG. 2 illustrates an example of a hardware configuration of a server device. [Figure 4] FIG. 2 illustrates an example of a functional configuration of a server device. [Figure 5] 10 is a flowchart illustrating a process executed by the server device. [Figure 6] FIG. 2 is a diagram schematically illustrating the installation positions and imaging directions of a plurality of imaging devices. [Figure 7] FIG. 10 is a diagram showing transitions of displayed screens. DETAILED DESCRIPTION OF THE INVENTION

[0009] Hereinafter, embodiments of the present invention will be described with reference to the drawings.

[0010] 1 shows an example of the overall configuration of an imaging system including multiple imaging devices according to this embodiment. The imaging system 100 includes multiple imaging devices 101a to 101c, a server device 102, a network 103, and multiple client devices 104a to 104c. A display device 106 and an input device 107 are connected to the server device 102. Display devices 105a to 105c are connected to the client devices 104a to 104c, respectively. The imaging devices 101a to 101c may be collectively referred to as imaging devices 101. The client devices 104a to 104c may be collectively referred to as client devices 104.

[0011] The imaging devices 101a to 101c are fixed to tripods or the like and installed at different positions in a specific space such as a studio. FIG. 1 shows an example in which three imaging devices 101a to 101c are connected to the server device 102, but the number may be two, four, or more. The imaging device 101 transmits captured video to the server device 102. The imaging device 101 and the server device 102 are connected using a LAN (Local Area Network) cable, but other methods may also be used. For example, SDI (Serial Digital Interface), HDMI (High-Definition Multimedia Interface: registered trademark), or wireless LAN may also be used. When a LAN cable is used, up to approximately 100 devices can be connected. The imaging devices 101a to 101c may be connected to a network 103 and then connected to the server device 102 via the network 103.

[0012] The imaging device 101 changes the imaging direction and zoom magnification by changing the pan direction, tilt direction, and zoom position (hereinafter referred to as PTZ). The imaging device 101 only needs to be able to change at least one of the pan direction and tilt direction.

[0013] The server device 102 is an information processing device that controls the operations of the imaging devices 101a to 101c. The server device 102 is connected to a network 103, and transmits and receives data to and from external devices connected to the network 103. When the server device 102 receives a video distribution request from the client devices 104a to 104c via the network 103, the server device 102 distributes the video received from the imaging devices 101a to 101c to the client devices 104a to 104c. The server device 102 displays the video of the imaging devices 101a to 101c and information stored in the server device 102 on a display device 106. The display information of the display device 106 can be controlled according to input information input from an input device 107 to the server device 102.

[0014] Client devices 104a to 104c are terminal devices of viewers who watch videos. Client devices 104a to 104c can access server device 102 via network 103. While FIG. 1 shows an example in which three client devices 104a to 104c are connected to network 103, the number of clients may be two, four, or more. Client devices 104a to 104c make video distribution requests to server device 102 via network 103, and display the received videos on display devices 105a to 105c connected to client devices 104a to 104c, respectively.

[0015] FIG. 2 shows an example of the hardware configuration of the imaging device 101 according to this embodiment. The imaging device 101 includes an imaging unit 201, an encoder unit 202, an input / output I / F 203, a CPU 204, a RAM 205, and a ROM 206. These units are connected to each other via a bus 207. In addition, the imaging optical system 200 is detachably attached to the imaging device 101.

[0016] The imaging optical system 200 is a lens barrel that focuses light from a subject onto the imaging surface of an imaging element 211 (described later), and is composed of a zoom lens, a focus lens, a blur correction lens, etc. In this embodiment, the imaging optical system 200 is provided as a separate unit that is detachable from the imaging device 101, but it may also be configured to be built into the imaging device 101 like an integrated lens camera.

[0017] The imaging unit 201 captures an image of a subject using the imaging optical system 200 and generates image data. The imaging unit 201 includes an image sensor 211, an amplifier 212, and an image processing unit 213. The image sensor 211 is, for example, a charge coupled device (CCD) sensor or a complementary metal oxide semiconductor (CMOS) sensor. The image sensor 211 converts light from a subject focused on an imaging surface into an electrical signal for each pixel and outputs the electrical signal. The amplifier 212 amplifies the electrical signal output from the image sensor 211 and outputs the amplified signal. The image processing unit 213 performs A / D conversion on the analog electrical signal output from the amplifier 212 to convert it into a digital signal, and performs image processing including demosaicing processing, white balance processing, gamma processing, etc. to generate image data.

[0018] The encoder unit 202 performs encoding processing to convert the image data output from the image processing unit 213 into a predetermined file format such as Motion JPEG, H.264, or H.265. The input / output I / F 203 is an interface that is connected to the server device 102 to output video captured by the imaging unit 201 to the server device 102 and to input various control signals from the server device 102. The CPU 204 outputs the encoded image data from the encoder unit 202 as video to the server device 102 via the input / output I / F 203. The video output from the imaging device 101 to the server device 102 is transmitted to the client device 104 via the network 103. The encoded image data may be stored in an internal storage device such as a RAM 205 or a ROM 206, which will be described later, or in a removable storage medium (not shown), such as an SD card.

[0019] The CPU 204 controls the entire imaging device 101. The CPU 204 also controls a drive mechanism that moves the zoom lens, focus lens, etc. provided in the imaging optical system 200 along the optical axis, and a drive mechanism that rotates the imaging unit 201 in the pan direction and tilt direction, thereby changing the imaging direction and zoom magnification of the imaging unit 201. The RAM 205 temporarily stores various data such as image data output from the image processing unit 213. The RAM 205 also provides a work area used when the CPU 204 executes processing. The RAM 205 also functions as a frame memory and a buffer memory.

[0020] The ROM 206 stores programs and the like for the CPU 204 to control the imaging device 101. The ROM 206 also holds pre-registered preset information. In this embodiment, the preset information is setting information for PTZ (pan direction, tilt direction, and zoom position). The preset information may also include camera settings such as exposure settings. When the CPU 204 receives a control signal from the server device 102 via the input / output I / F 203 instructing the server device 102 to change or register preset information, the CPU 204 overwrites or adds to the preset information held in the ROM 206 in accordance with the received control signal. The CPU 204 can also change the imaging direction, zoom magnification, and camera settings of the imaging unit 201 in accordance with the preset information stored in the ROM 206.

[0021] FIG. 3 shows an example of the hardware configuration of the server device 102 according to this embodiment. The server device 102 includes a CPU 301, a RAM 302, a ROM 303, an input / output I / F 304, an input I / F 305, an output I / F 306, and a network I / F 307. These components are connected to each other via a bus 308. The CPU 301 controls the entire server device 102. The RAM 302 temporarily stores various types of data, such as image data received from the imaging device 101. The RAM 302 also provides a work area used by the CPU 301 when executing processing. The ROM 303 stores various programs, image data received from the imaging device 101, preset information for the imaging device 101, and the like. The CPU 301 loads programs stored in the ROM 303 or the like into the RAM 302 and executes them, thereby realizing the processing of the flowcharts described below.

[0022] The input / output I / F 304 is an interface that is connected to the image pickup devices 101a to 101c to input images from the image pickup devices 101a to 101c and output various control signals to the image pickup devices 101a to 101c.

[0023] The input I / F 305 is an interface that is connected to the input device 107 and that inputs input information for the input device 107. The input device 107 accepts operations from a user. The CPU 301 uses the input I / F 305 to input input information in accordance with the operation accepted by the input device 107.

[0024] The output I / F 306 is an interface for connecting to the display device 106 and outputting display information to the display device 106. The display device 106 presents the image of the imaging device 101 and information stored in the server device 102 to the user.

[0025] The network I / F 307 is an interface for connecting to the network 103. The connection to the network 103 may be a wired connection or a wireless connection. When the CPU 301 receives a video distribution request from the client device 104 via the network I / F 307, the CPU 301 transmits the video received from the imaging device 101 to the client device 104.

[0026] FIG. 4 shows an example of the functional configuration of the server device 102 according to this embodiment. 4, the server device 102 has a video selection unit 401, a reference image storage unit 402, a preset information storage unit 403, a preset setting management unit 404, a preset setting control unit 405, and an image comparison unit 406. In this embodiment, the CPU 301 reads out a program stored in the ROM 303 or the like into the RAM 302 and executes the program, thereby realizing the functions of the units shown in FIG.

[0027] The image selection unit 401 selects one image from the images from the image capture devices 101a to 101c in accordance with input information from the input device 107, and displays it on the display device 106. Hereinafter, the image capture device 101 currently capturing the image selected by the image selection unit 401 will be referred to as the target image capture device 101. The reference image storage unit 402 acquires from the imaging devices 101a to 101c images captured after the imaging direction is changed using preset information for positioning stored in the preset information storage unit 403 by installing the imaging devices 101a to 101c at different positions. The reference image storage unit 402 then stores the images acquired from the imaging devices 101a to 101c as reference images in the ROM 303 or the like. The reference images are used as correct images for positioning to be compared with the images captured by the imaging devices 101a to 101c. Each reference image is associated with preset information for positioning used when capturing the reference image.

[0028] The preset information storage unit 403 acquires preset settings from each of the imaging devices 101a to 101c and stores them in the ROM 303, etc. The preset information storage unit 403 stores preset settings for each of the imaging devices 101a to 101c. The preset settings are a set of preset information for positioning and preset information for imaging. The preset setting management unit 404 manages the association between the device numbers of the image capture devices 101a to 101c and the preset settings of the image capture devices with those device numbers.

[0029] The preset setting control unit 405 selects one of the alignment preset information stored in the preset information storage unit 403, and controls the target imaging device 101 to change the imaging direction using the selected alignment preset information. Then, it controls whether to apply the selected alignment preset information to the target imaging device 101. Here, the description will be given assuming that the image comparison unit 406 is used. The image comparison unit 406 compares the image captured by the target imaging device 101 after the imaging direction has been changed using the alignment preset information currently selected by the preset setting control unit 405 with multiple reference images stored in the reference image storage unit 402. Then, it outputs the degree of match between the images. Note that the image comparison unit 406 may compare with all reference images, or may compare only with the reference image associated with the alignment preset information currently selected.

[0030] If the degree of match output by the image comparison unit 406 is equal to or greater than a predetermined value, the preset setting control unit 405 determines that the selected alignment preset information is correct and performs control so as to apply the preset setting to which the selected alignment preset information belongs to the target image capture device 101. Furthermore, the preset setting management unit 404 stores information indicating the correspondence between the device number of the target image capture device 101 and the applied preset setting in the ROM 303 or the like.

[0031] 3 is a flowchart showing processing executed by the server device 102 according to this embodiment. The processing of this flowchart is processing for comparing a reference image stored in the server device 102 with images captured by the imaging devices 101a to 101c and applying appropriate preset settings to each of the imaging devices 101a to 101c. Here, the server device 102 stores preset settings for imaging device 1, preset settings for imaging device 2, and preset settings for imaging device 3, and an appropriate preset setting is selected from these. Below, each process (step) of the flowchart will be explained with an S (step) added to the beginning of the reference numeral.

[0032] In S501, the CPU 301 first sets integer variables i=j=1, and sets the number of image capture devices included in the image capture system 100 to an integer variable N (N≧2). In S502, the CPU 301 designates the i-th imaging device as the target imaging device. Then, the CPU 301 selects the preset settings of the imaging device j and transmits the positioning preset information of the imaging device j to the i-th imaging device. Having received the positioning preset information, the i-th imaging device changes settings such as the imaging direction using the preset information received from the server device 102, and transmits the changed video to the server device 102.

[0033] In S503, the CPU 301 compares the video received from the i-th imaging device with all reference images (correct images for alignment) stored in the ROM 303, etc. Here, the CPU 301 calculates the degree of match obtained by comparing the video with all reference images.

[0034] In S504, CPU 301 determines whether the degree of match with any of the reference images is equal to or greater than a threshold as a result of the comparison in S503. If CPU 301 determines that the degree of match with any of the reference images is equal to or greater than the threshold, it determines that the alignment preset information selected in S502 is correct, and the process proceeds to S508. If CPU 301 determines that the degree of match with all of the reference images is less than the threshold, it determines that the alignment preset information selected in S502 is incorrect, and the process proceeds to S505.

[0035] In addition, in S503 to S504, CPU 301 may display the image received from the i-th imaging device on display device 106, and determine whether there is a reference image that matches the image received from the i-th imaging device based on user input information obtained from input device 107.

[0036] In S505, the CPU 301 sets the integer variable j=j+1. In S506, the CPU 301 determines whether the integer variable j = N + 1. If j = N + 1, the CPU 301 proceeds with the process to S509, assuming that none of the preset settings of the imaging devices 1 to N is suitable as the preset setting to be applied to the i-th imaging device. On the other hand, if j < N + 1, the CPU 301 proceeds with the process to S502 in order to compare the video when the next alignment preset information is applied to the i-th imaging device with the reference image.

[0037] In S507, the CPU 301 controls to overwrite the preset information stored in the ROM 206 etc. of the i-th imaging device with the preset setting of the imaging device j read in S502, in order to apply the preset setting of the imaging device j to the i-th imaging device. The preset setting of the imaging device j is registered in the i-th imaging device. Then, the CPU 301 sets the variable type variables i = i + 1, j = 1 in order to target the next imaging device.

[0038] In S508, the CPU 301 determines whether the integer variable i = N + 1. If the integer variable i = N + 1, the CPU 301 ends the processing of the series of flowcharts, assuming that the preset settings have been correctly applied to the 1st to N-th imaging devices. If the integer variable i ≠ N + 1, the CPU 301 proceeds with the process to S502 in order to determine whether the preset setting has been correctly applied to the next imaging device.

[0039] In S509, the CPU 301 notifies the user by, for example, displaying on the display device 106 that the application of the preset setting to the imaging device has failed. Then, the processing of the series of flowcharts ends.

[0040] Subsequently, using FIG. 6, the procedure for correctly setting the preset information of three imaging devices according to the flowchart of FIG. 5 will be described. FIG. 6(a) schematically shows a state in which the image capturing devices 601, 602, and 603 are installed in predetermined positions, and alignment preset information is set for each of the image capturing devices 601, 602, and 603 as preset information desired by the user. As shown in FIG. 6(a), it is assumed that alignment preset information A is set for the image capturing device 601, alignment preset information B is set for the image capturing device 602, and alignment preset information C is set for the image capturing device 603. Here, an image captured by the image capturing device 601 for which alignment preset information A is set is referred to as reference image 1. An image captured by the image capturing device 602 for which alignment preset information B is set is referred to as reference image 2. An image captured by the image capturing device 603 for which alignment preset information C is set is referred to as reference image 3. These reference images 1 to 3 correspond to reference images 1 to 3 displayed in areas 702 to 704 in FIG. 7, which will be described later.

[0041] As described above, the server device 102 stores a set of alignment preset information and image capture preset information in the ROM 303 or the like. Therefore, once the alignment preset information to be applied to the target image capture device 101 is determined, the image capture preset information to be applied to the target image capture device 101 is also uniquely determined. Here, it is assumed that the server device 102 acquires and stores alignment preset information A to C, corresponding image capture preset information A to C, and corresponding reference images 1 to 3 from the image capture devices 601 to 603.

[0042] Fig. 6(b) schematically shows a state in which the positions of the image capturing devices 601 to 603, for which alignment preset information A to C are set in Fig. 6(a), are swapped. In Fig. 6(b), the image capturing device 604 corresponds to the image capturing device 602, the image capturing device 605 corresponds to the image capturing device 603, and the image capturing device 606 corresponds to the image capturing device 601. As shown in Fig. 6(b), alignment preset information B is set for the image capturing device 604, alignment preset information C is set for the image capturing device 605, and alignment preset information A is set for the image capturing device 606.

[0043] Conventionally, if a user wants to apply the imaging direction shown in Fig. 6(a), it is necessary to rearrange and set up each of the imaging devices 604 to 606 in accordance with the preset information for positioning set for each of them, which is time-consuming. In this embodiment, by rearranging only the preset information set for each of the imaging devices 604 to 606, it is possible to realize preset settings as desired by the user.

[0044] In the example shown in Fig. 6, the CPU 301 sequentially targets the imaging devices 604 to 606 according to the flowchart of Fig. 5, and applies the correct one of the alignment preset information A to C by comparing the image captured by the target imaging device with the reference image. Furthermore, the CPU 301 sets the alignment preset information originally set for the target imaging device to the imaging device to which the applied alignment preset information was originally set. In this way, the preset information can be exchanged.

[0045] FIG. 6C shows a state in which the positioning preset information set in the image capturing device 604 has been replaced with the positioning preset information set in the image capturing device 606 from the state shown in FIG. 6B. FIG. 6D shows a state in which the positioning preset information set in the image capturing device 604 has been replaced with the positioning preset information set in the image capturing device 606 from the state shown in FIG. 6C.

[0046] Next, a procedure for correctly applying preset information to three imaging devices will be described with reference to the flowchart of FIG. 5 and with reference to FIG. 7. FIG. 7 shows how the GUI screen displayed on the display device 106 transitions in accordance with changes in the preset information of FIGS. 6(b) to 6(d). The CPU 301 of the server device 102 performs display control processing to control the display content of the GUI screen. The CPU 301 of the server device 102 also stores, as preset management information, the correspondence between the device numbers of the imaging devices 604, 605, and 606 and the set alignment preset information A to C. In the state of FIG. 7(a), the preset management information stored corresponds to the imaging device 604 and alignment preset information B, the imaging device 605 and alignment preset information C, and the imaging device 606 and alignment preset information A, respectively. At the initial stage, the alignment preset information to be applied to the imaging devices 604 to 606 is not yet determined.

[0047] Fig. 7(a) shows a GUI screen when, as shown in Fig. 6(b), preset information for alignment is set for the image capturing devices 604, 605, and 606. The GUI shown in Fig. 7(a) has an area 701a in which one of the images output from the image capturing devices 604, 605, and 606 is selected and displayed, and areas 702 to 704 in which reference images 1 to 3 are displayed.

[0048] An area 701a in Fig. 7(a) displays an image from the initially targeted imaging device 604. The GUI shown in Fig. 7(a) also has an apply button 705 for applying the currently set preset information to the imaging device capturing the image displayed in the area 701a, and a change button 706 for changing the currently set preset information. The components of the GUIs shown in Figs. 7(b) to (e) are the same as those in the GUI shown in Fig. 7(a).

[0049] First, as shown in Fig. 6(b), alignment preset information B is set in the image capturing device 604. Here, the GUI screen shown in Fig. 7(a) is displayed on the display device 106.

[0050] Next, CPU 301 compares the image displayed in area 701a (image being captured by imaging device 604) with reference images 1 to 3, and determines whether the degree of match with any of the reference images is equal to or greater than a threshold. CPU 301 may store the threshold used in this determination in advance in ROM 303 or the like in accordance with input information from input device 107. It is assumed here that the comparison between the image displayed in area 701a and reference images 1 to 3 is performed visually by the user.

[0051] A method for visually comparing with the reference image will be described below. As shown in FIG. 7(a), the image displayed in area 701a does not match any of reference images 1 to 3, so the user presses change button 706 via input device 107. When change button 706 is pressed, CPU 301 sets preset information (positioning preset information C) of imaging device 605 for imaging device 604. In this case, the image displayed in area 701a is switched to an image whose imaging direction has been changed based on the newly set preset information. CPU 301 sequentially sets preset information for imaging device 604, such as preset information for imaging device 605 and preset information for imaging device 606. Each time new preset information is set, the image displayed in area 701a is visually compared with reference images 1 to 3.

[0052] FIG. 7(b) shows a GUI when preset information (positioning preset information A) of the imaging device 606 is set for the imaging device 604. For the first time, the degree of match between the image displayed in area 701b and the reference image 1 is equal to or greater than the threshold. In this case, when the user presses the apply button 705, the CPU 301 applies the preset information (positioning preset information A) of the imaging device 606 to the imaging device 604 and updates the preset management information. At this time, the CPU 301 finalizes the preset information of the imaging device 604 with the positioning preset information A. Furthermore, the CPU 301 sets the previous preset information of the imaging device 604 (positioning preset information B) for the imaging device 606 and updates the preset management information. As a result, the positioning preset information is set for the imaging devices 604, 605, and 606, as shown in FIG. 6(c).

[0053] When the preset information of the image capture devices 604 and 606 is updated, the CPU 301 may notify the display device 106 that the preset information has been updated.

[0054] Next, it is determined whether the preset information of the imaging device 605 has been correctly applied. FIG. 7(c) shows a GUI screen when alignment preset information has been set for the imaging devices 604, 605, and 606 as shown in FIG. 6(c). An area 701c in FIG. 7(c) displays an image from the target imaging device 605. As shown in FIG. 7(c), the image displayed in area 701c does not match any of the reference images 1 to 3, so the user presses the change button via the input device 107. By pressing the change button, the CPU 301 sets the preset information of the imaging device 606 (alignment preset information B) for the imaging device 605. Note that the preset information of the imaging device 604 has already been applied, so it is not subject to setting.

[0055] FIG. 7(d) shows a GUI screen when preset information (positioning preset information B) of the imaging device 606 is set for the imaging device 605. Here, the degree of match between the image displayed in area 701d and the reference image 2 is equal to or greater than a threshold. In this case, when the user presses the apply button 705, the CPU 301 applies the preset information of the imaging device 606 (positioning preset information B) to the imaging device 605 and updates the preset management information. At this time, the CPU 301 confirms the preset information of the imaging device 605 with the positioning preset information B. Furthermore, the CPU 301 sets the previous preset information of the imaging device 605 (positioning preset information C) for the imaging device 606 and updates the preset management information. As a result, the positioning preset information is set for the imaging devices 604, 605, and 606, as shown in FIG. 6(d).

[0056] Next, it is determined whether the preset information of the imaging device 606 has been correctly applied. FIG. 7(e) shows a GUI screen when alignment preset information has been set for the imaging devices 604, 605, and 606 as shown in FIG. 6(d). An area 701e in FIG. 7(e) displays the image of the target imaging device 606. As shown in FIG. 7(e), the degree of match between the image displayed in area 701e and the reference image 3 is equal to or greater than a threshold. In this case, when the user presses the apply button 705, the CPU 301 confirms the preset information of the imaging device 606 as alignment preset information C. As a result, the alignment preset information has all been confirmed for all of the imaging devices 604 to 606 in the preset management information, and the alignment preset information has been correctly applied.

[0057] Although the above description is based on the case where the alignment preset information is correctly applied to all of the image capture devices 604 to 606, it is possible that the preset information cannot be correctly applied to any of the image capture devices. In such a case, other preset information may be applied and the process may be restarted from the beginning.

[0058] According to the present embodiment as described above, when multiple imaging devices are installed and used at predetermined locations, the preset information set in the imaging devices can be correctly reapplied, allowing the imaging devices to be installed without having to worry about the preset information set in the imaging devices.

[0059] <Other embodiments> The present invention can also be realized by supplying a program that realizes one or more functions of the above-described embodiments to a system or device via a network or a storage medium, and having one or more processors in the computer of the system or device read and execute the program.The present invention can also be realized by a circuit (e.g., ASIC) that realizes one or more functions.

[0060] The disclosure of this embodiment includes the following configuration, method, and program. (Configuration 1) An information processing device that controls a plurality of imaging devices, an acquisition unit that acquires a plurality of reference images captured by the plurality of imaging devices and a plurality of pieces of preset information used when capturing the plurality of reference images; a control unit that, when a first imaging device is controlled using the first preset information acquired by the acquisition unit, performs control to apply the first preset information to the first imaging device based on an image captured by the first imaging device and the plurality of reference images; An information processing device comprising: (Configuration 2) 2. The information processing device according to configuration 1, wherein the preset information is information for changing an imaging direction. (Configuration 3) a display control unit configured to control, when the first imaging device is controlled using the first preset information, display a screen on which an image captured by the first imaging device and the plurality of reference images are arranged and on which a user can select whether to apply the first preset information to the first imaging device by a user operation; The information processing device according to configuration 1 or 2, characterized in that the control means controls the first imaging device to apply the first preset information when application of the first preset information is selected on the screen. (Configuration 4) The information processing device described in configuration 1 or 2, characterized in that when the control means controls the first imaging device using the first preset information, it calculates a degree of matching between an image captured by the first imaging device and each of the plurality of reference images, and if there is any reference image among the plurality of reference images whose degree of matching is equal to or greater than a threshold, it controls the first imaging device to apply the first preset information. (Configuration 5) 5. The information processing device according to any one of configurations 1 to 4, further comprising a setting unit that sets the first imaging device to change its imaging direction using the first preset information. (Configuration 6) The information processing device according to any one of configurations 1 to 5, further comprising a setting means for setting the first imaging device to change an imaging direction using second preset information different from the first preset information among the plurality of preset information when the first preset information is not applied to the first imaging device. (Configuration 7) further comprising a setting means for sequentially setting the first imaging device to change the imaging direction according to the plurality of pieces of preset information; The information processing device according to any one of configurations 1 to 6, characterized in that when the control means controls the first imaging device using the preset information set by the setting means, the control means selects preset information to be applied to the first imaging device from among the plurality of preset information based on an image captured by the first imaging device and the plurality of reference images. (Configuration 8) each of the plurality of reference images is associated with preset information used when the plurality of reference images were captured; The information processing device described in any one of configurations 1 to 7, characterized in that when the control means controls the first imaging device using the first preset information, it calculates a degree of match between an image captured by the first imaging device and a first reference image linked to the first preset information, and if the degree of match with the first reference image is equal to or greater than a threshold, it controls the first imaging device to apply the first preset information. (Configuration 9) When the setting unit sets the second preset information for the first imaging device and a second imaging device different from the first imaging device, the control means controls whether to apply the second preset information to the first imaging device based on an image captured by the first imaging device and the plurality of reference images; The information processing device according to configuration 6, wherein when the control means applies the second preset information to the first imaging device, the setting means sets the second imaging device to change the imaging direction using the first preset information. (Configuration 10) the imaging device further includes a storage unit that stores the plurality of reference images and the plurality of preset information; the storage means stores the first preset information acquired from the first imaging device and a second imaging device different from the first imaging device, a first reference image captured using the first preset information, second preset information different from the first preset information among the plurality of pieces of preset information, and a second reference image captured using the second preset information; The information processing device according to any one of configurations 1 to 9, characterized in that when the control means controls the first imaging device using the first preset information, it controls whether to apply the first preset information or the second preset information to the first imaging device based on an image captured by the first imaging device, the first reference image, and the second reference image. (Configuration 11) 11. The information processing device according to any one of configurations 1 to 10, wherein the control means issues a notification when the first preset information is to be applied to the first imaging device. (Configuration 12) each of the plurality of pieces of preset information is associated with preset information for imaging; The information processing device described in any one of configurations 1 to 11, characterized in that when the control means applies the first preset information to the first imaging device, it also controls the application of the imaging preset information linked to the first preset information. (Configuration 13) An imaging system including a plurality of imaging devices and an information processing device that controls the plurality of imaging devices, The information processing device includes: an acquisition unit that acquires a plurality of reference images captured by the plurality of imaging devices and a plurality of pieces of preset information used when the plurality of reference images are captured; a first imaging device that is one of the plurality of imaging devices, a transmitting means for transmitting a first image captured using the first preset information acquired by the acquiring means to the information processing device; The information processing device includes: an imaging system further comprising a control unit that controls application of the first preset information to the first imaging device based on the first image transmitted from the first imaging device and the plurality of reference images. (method) A control method for an information processing device that controls a plurality of imaging devices, comprising: an acquisition step of acquiring a plurality of reference images captured by the plurality of imaging devices and a plurality of pieces of preset information used when capturing the plurality of reference images; a control step of controlling a first imaging device to apply the first preset information to the first imaging device based on an image captured by the first imaging device and the plurality of reference images when the first imaging device is controlled using the first preset information acquired in the acquisition step; 10. A method for controlling an information processing device, comprising: (program) 13. A program for causing a computer of the information processing device according to any one of configurations 1 to 12 to function as each of the means. [Explanation of symbols]

[0061] 101a to 101c: imaging devices, 102: server device, 103: network, 106: input device, 107: display device

Claims

1. An information processing device that controls a plurality of imaging devices, an acquisition unit that acquires a plurality of reference images captured by the plurality of imaging devices and a plurality of pieces of preset information used when capturing the plurality of reference images; a control unit that, when the first imaging device is controlled using the first preset information acquired by the acquisition unit, performs control to apply the first preset information to the first imaging device based on an image captured by the first imaging device and the plurality of reference images; An information processing device comprising:

2. 2. The information processing apparatus according to claim 1, wherein the preset information is information for changing an imaging direction.

3. a display control unit configured to control, when the first imaging device is controlled using the first preset information, display a screen on which an image captured by the first imaging device and the plurality of reference images are arranged and on which a user can select whether to apply the first preset information to the first imaging device by a user operation; 2. The information processing apparatus according to claim 1, wherein the control means controls the first imaging device to apply the first preset information when application of the first preset information is selected on the screen.

4. The information processing device according to claim 1, characterized in that, when the control means controls the first imaging device using the first preset information, it calculates a degree of similarity between an image captured by the first imaging device and each of the plurality of reference images, and if there is any reference image among the plurality of images whose degree of similarity is equal to or greater than a threshold, it controls the first imaging device to apply the first preset information.

5. 2. The information processing apparatus according to claim 1, further comprising a setting unit for setting the first imaging device to change the imaging direction using the first preset information.

6. 2. The information processing apparatus according to claim 1, further comprising: a setting unit that sets the first imaging device to change an imaging direction using second preset information different from the first preset information among the plurality of pieces of preset information when the first preset information is not applied to the first imaging device.

7. a setting unit for sequentially setting the first imaging device to change the imaging direction according to the plurality of pieces of preset information; 2. The information processing device according to claim 1, wherein the control means, when controlling the first imaging device using the preset information set by the setting means, selects preset information to be applied to the first imaging device from among the plurality of preset information based on an image captured by the first imaging device and the plurality of reference images.

8. each of the plurality of reference images is associated with preset information used when the plurality of reference images were captured; The information processing device according to claim 1, characterized in that, when the control means controls the first imaging device using the first preset information, it calculates a degree of coincidence between an image captured by the first imaging device and a first reference image linked to the first preset information, and, if the degree of coincidence with the first reference image is equal to or greater than a threshold, controls the first imaging device to apply the first preset information.

9. When the setting unit sets the second preset information for the first imaging device and a second imaging device different from the first imaging device, the control means controls whether to apply the second preset information to the first imaging device based on an image captured by the first imaging device and the plurality of reference images; 7. The information processing device according to claim 6, wherein when the control means applies the second preset information to the first imaging device, the setting means sets the second imaging device to change the imaging direction using the first preset information.

10. the imaging device further includes a storage unit that stores the plurality of reference images and the plurality of preset information; the storage means stores the first preset information acquired from the first imaging device and a second imaging device different from the first imaging device, a first reference image captured using the first preset information, second preset information different from the first preset information among the plurality of pieces of preset information, and a second reference image captured using the second preset information; 2. The information processing device according to claim 1, wherein, when the control means controls the first imaging device using the first preset information, the control means controls whether to apply the first preset information or the second preset information to the first imaging device based on an image captured by the first imaging device, the first reference image, and the second reference image.

11. 2. The information processing apparatus according to claim 1, wherein the control means issues a notification when the first preset information is to be applied to the first imaging device.

12. each of the plurality of pieces of preset information is associated with preset information for imaging; The information processing device according to claim 1, wherein the control means controls the first image capturing device to also apply the first preset information associated with the first preset information when the first preset information is applied to the first image capturing device.

13. An imaging system including a plurality of imaging devices and an information processing device that controls the plurality of imaging devices, The information processing device includes: an acquisition unit that acquires a plurality of reference images captured by the plurality of imaging devices and a plurality of pieces of preset information used when the plurality of reference images are captured; a first imaging device that is one of the plurality of imaging devices; a transmitting means for transmitting a first image captured using the first preset information acquired by the acquiring means to the information processing device; The information processing device includes: an imaging system further comprising a control unit that controls application of the first preset information to the first imaging device based on the first image transmitted from the first imaging device and the plurality of reference images.

14. A control method for an information processing device that controls a plurality of imaging devices, comprising: an acquisition step of acquiring a plurality of reference images captured by the plurality of imaging devices and a plurality of pieces of preset information used when capturing the plurality of reference images; a control step of controlling a first imaging device to apply the first preset information to the first imaging device based on an image captured by the first imaging device and the plurality of reference images when the first imaging device is controlled using the first preset information acquired in the acquisition step; 10. A method for controlling an information processing device, comprising:

15. A program for causing a computer of the information processing device according to claim 1 to function as each of the means.

Images