Video output method, output method, imaging method, video output system, output device, and imaging device

Abstract

To make it easier to reduce the workload required to output a specific video. [Solution] In the video output method, output device 1 transmits a request signal to each imaging device 2 requesting the capture of a predetermined image (S101). Each imaging device 2 calculates the cost required to capture the predetermined image and transmits a cost signal indicating the calculated cost to output device 1 (S104). Output device 1 transmits an instruction signal to one or more imaging devices 2 among the plurality of imaging devices 2 whose costs meet predetermined conditions, instructing them to capture the predetermined image (S107). Each of the one or more imaging devices 2 attempts to capture the predetermined image by changing one or more imaging parameters (S109). Output device 1 selects one of the imaging devices 2 and outputs the image captured by the selected imaging device 2 (S113).

Description

Technical Field

[0001] The present disclosure relates to a video output method, an output method, an imaging method, a video output system, an output device, and an imaging device.

Background Art

[0002] Patent Document 1 discloses a video distribution system. This video distribution system selects M (a natural number smaller than N) cameras from N (a natural number of 2 or more) cameras that are shooting the same scene as the source of the video to be displayed.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] The present disclosure provides a video output method and the like that are easy to reduce the workload for outputting a predetermined video.

Means for Solving the Problems

[0005] In one aspect of the present disclosure, an output device transmits a request signal to each of a plurality of imaging devices requesting the imaging of a predetermined image. In the video output method, each of the plurality of imaging devices calculates the cost required to realize the imaging of the predetermined image and transmits a cost signal indicating the calculated cost to the output device. In the video output method, the output device transmits an instruction signal to one or more of the plurality of imaging devices whose cost satisfies a predetermined condition, instructing them to imaging the predetermined image. In the video output method, each of the one or more imaging devices attempts to image the predetermined image by changing one or more imaging parameters. In the video output method, the output device selects one of the one or more imaging devices and outputs the image captured by the selected imaging device. [Effects of the Invention]

[0006] This disclosure has the advantage of easily reducing the workload required to output a predetermined video. [Brief explanation of the drawing]

[0007] [Figure 1] Figure 1 is a schematic diagram showing the overall configuration, including the video output system according to the embodiment. [Figure 2] Figure 2 is a block diagram showing the overall configuration including the video output system according to the embodiment. [Figure 3] Figure 3 is a sequence diagram showing a first example of operation of the video output system according to the embodiment. [Figure 4] Figure 4 is a sequence diagram showing a third example of operation of the video output system according to the embodiment. [Figure 5] Figure 5 is a sequence diagram showing a fourth operation example of the video output system according to the embodiment. [Modes for carrying out the invention]

[0008] [1. Knowledge forming the basis of this disclosure] First, the inventor's perspective is explained below.

[0009] Traditionally, in the production of television, film, or video, or in live broadcasting, video producers manually switched the video output on display devices such as television receivers by using a switcher to select one of several cameras capturing the same scene.

[0010] In the method of manually switching images using a switcher as described above, if the goal is to output a specific image from the display device that captures the subject in the desired composition, the switcher operator (video producer) must check multiple images captured by multiple cameras and select the desired image from among them. Furthermore, if the desired image is not present among the multiple images, the switcher operator must instruct one of the multiple camera operators, each operating a different camera, to capture the desired image. Thus, the method of manually switching images using a switcher as described above has the problem that the workload for outputting the desired image tends to increase.

[0011] Furthermore, even when multiple cameras can autonomously capture images of a subject, the switcher operator must select one camera from among the multiple cameras and issue an instruction to the selected camera specifying one or more imaging parameters necessary to capture a predetermined image. In this case as well, there is a problem in that the workload for outputting the predetermined image tends to increase.

[0012] As mentioned above, in methods of switching between images using a switcher, there is a need for a method that can automatically select a camera that better satisfies the compositional requirements of the video producer, in order to automate the switching of images.

[0013] In light of the above, the inventor has created this disclosure.

[0014] The embodiments will be described below with reference to the drawings. The embodiments described below are all comprehensive or specific examples. The numerical values, shapes, materials, components, arrangement and connection configurations of components, steps, and the order of steps shown in the following embodiments are examples only and are not intended to limit the scope of this disclosure. Furthermore, any components in the following embodiments that are not described in an independent claim will be described as optional components.

[0015] Please note that each figure is a schematic diagram and not necessarily a strictly accurate representation. Furthermore, in each figure, substantially identical components are denoted by the same reference numerals, and redundant explanations may be omitted or simplified.

[0016] Furthermore, in this specification, ordinal numbers such as "first," "second," etc., do not mean the number or order of components unless otherwise specified, but are used to avoid confusion and to distinguish similar components.

[0017] (Embodiment) [2. Structure] The following describes the overall configuration including the video output system 100 according to the embodiment. Figure 1 is a schematic diagram showing the overall configuration including the video output system 100 according to the embodiment. Figure 2 is a block diagram showing the overall configuration including the video output system 100 according to the embodiment. As shown in Figures 1 and 2, the video output system 100 comprises an output device 1 and a plurality of imaging devices 2. Figure 2 also shows a display device 3, which is the output destination for the video output by the output device 1. The display device 3 is, for example, a television receiver, a projector, or a display used with a personal computer.

[0018] The output device 1 outputs the video captured by any one of the plurality of imaging devices 2. The output device 1 is configured to be communicable with each of the plurality of imaging devices 2 via a network N1 such as the Internet or a LAN (Local Area Network). The communication between the output device 1 and each of the plurality of imaging devices 2 is performed according to a known communication protocol such as MQTT (Message Queuing Telemetry Transport).

[0019] In the embodiment, as shown in FIG. 1, the output device 1 is realized by installing software dedicated to the video output system 100 in an existing switcher. Therefore, in Embodiment 1, the output device 1 also has the function as an existing switcher. Note that the output device 1 may be realized by installing software dedicated to the video output system 100 in a general-purpose information terminal such as a server device, a desktop-type or laptop-type personal computer, etc. Further, the output device 1 may be not limited to a general-purpose information terminal but may be an information terminal dedicated to the video output system 100. Also, the information terminal may be realized not only by a server device or a personal computer but also by, for example, a smartphone or a tablet terminal, etc.

[0020] Each imaging device 2 is an imaging device capable of autonomously changing one or more imaging parameters. In the embodiment, each imaging device 2 is a PTZ camera, and is configured to be able to change the position coordinates of pan, tilt, and zoom of an imaging unit 24 (described later) to perform imaging. The one or more imaging parameters may include parameters such as pan, tilt, and zoom. Also, the one or more imaging parameters may include parameters for specifying image quality (resolution). Each imaging device 2 is installed, for example, in a form fixed to a pedestal, wall, or ceiling at a video production site or a live broadcast site. In the embodiment, each imaging device 2 has a function of detecting a subject within the field of view by an appropriate image recognition algorithm and automatically tracking and imaging the detected subject. The subject may be a person, or may be a living thing other than a person such as an animal, for example. Also, the subject may be an object other than a living thing.

[0021] As shown in FIG. 2, the output device 1 includes a communication unit 11, a processing unit 12, an output unit 13, and a storage unit 14.

[0022] The communication unit 11 is a communication interface for communicating with each of a plurality of imaging devices 2 via a network N1. The communication between the communication unit 11 and each of the plurality of imaging devices 2 may be wired communication or wireless communication.

[0023] The processing unit 12 mainly executes the following first process to fourth process.

[0024] In the first process, the processing unit 12 executes a process of transmitting a request signal for requesting imaging of a predetermined video to each of the plurality of imaging devices 2. Here, the "predetermined video" is a video in which a subject is captured in a composition desired by a user of the video output system 100. As an example, when the subject is a person, the predetermined video may include a video captured by a close-up shot of the person, a video captured by a medium shot, a video captured by a waist shot, a video captured by a bust shot, a video captured by a knee shot, or a video captured by a full shot.

[0025] In this embodiment, when the user provides input indicating a predetermined image to the output device 1, the processing unit 12 transmits the request signal to each of the multiple imaging devices 2 by broadcasting or multicasting the request signal via the communication unit 11. User input is performed, for example, by the user operating an appropriate input interface such as a keyboard, software keyboard, or switch.

[0026] The request signal is a signal that includes a string of characters or the like that conceptually represents the image desired by the user, and is not a signal that includes one or more imaging parameters that are considered necessary to capture the image desired by the user. For example, the request signal only needs to include a string of characters or the like that that the imaging device 2 can interpret as representing what kind of image the predetermined image is, such as "image of a person captured in a close-up shot." Also, if multiple predetermined images are predefined by strings of characters such as "Pattern A" and "Pattern B," the request signal only needs to include a string of characters that indicates the pattern corresponding to the predetermined image.

[0027] When the communication unit 11 receives cost signals from each of the multiple imaging devices 2, the processing unit 12 executes a second process. Here, the cost signal is a signal that indicates the cost required to capture a predetermined image, as calculated by the imaging device 2. In other words, the cost is a parameter that indicates the burden on the imaging device 2 to capture a predetermined image. The calculation of the cost will be described later.

[0028] In the second process, the processing unit 12 transmits an instruction signal via the communication unit 11 to one or more imaging devices 2 among the multiple imaging devices 2 whose cost meets a predetermined condition, instructing them to capture a predetermined image. Here, the instruction signal is not a signal that specifies one or more imaging parameters, but simply a signal that instructs imaging. This is because, as will be described later, each imaging device 2 estimates one or more imaging parameters that can realize the predetermined image when it receives the request signal. Therefore, the output device 1 only needs to instruct the imaging devices 2 to capture using the estimated one or more imaging parameters, and does not need to specify one or more imaging parameters.

[0029] In this embodiment, the predetermined condition is that the imaging device 2 has the lowest cost among the multiple imaging devices 2. In other words, in this embodiment, the processing unit 12 compares the costs included in the cost signals received from each of the multiple imaging devices 2 and sends an instruction signal to the imaging device 2 with the minimum cost. Here, if there are two or more imaging devices 2 with the minimum cost, the processing unit 12 sends instruction signals to these two or more imaging devices 2.

[0030] Note that the predetermined conditions are not limited to those described above, and may be other conditions. For example, the predetermined condition may be that the cost is below a threshold. In this case, the processing unit 12 transmits an instruction signal to one or more imaging devices 2 among the plurality of imaging devices 2 whose cost is below the threshold.

[0031] When the processing unit 12 receives a confidence signal from each of the one or more imaging devices 2 to which the communication unit 11 has sent an instruction signal, it executes a third process. Here, the confidence signal is a signal indicating the confidence level calculated by the imaging device 2, which shows the degree to which the imaging of a predetermined image has been achieved. In other words, the confidence level is a parameter obtained by the imaging device 2's own judgment of how closely the image it captures approximates the predetermined image when it attempts to capture the predetermined image requested by the output device 1. The confidence level is represented by multiple bits (for example, 8 bits), with a larger number indicating higher confidence and a smaller number indicating lower confidence.

[0032] In the third process, the processing unit 12 selects the imaging device 2 with the highest reliability among the one or more imaging devices 2. That is, the processing unit 12 compares the reliability values ​​included in the reliability signals received from each of the one or more imaging devices 2 and selects the imaging device 2 that it determines has the highest reliability, in other words, the imaging device whose captured image is closest to the predetermined image. The processing unit 12 then outputs the image captured by the selected imaging device 2 to the output unit 13. If the reliability of any of the one or more imaging devices 2 to which the instruction signal is transmitted is lower than a predetermined value, the processing unit 12 does not select any imaging device 2 and maintains the output of the image captured by the currently selected imaging device 2. The predetermined value may be set as appropriate by the user, for example.

[0033] After executing the third process, the processing unit 12 executes the fourth process. In the fourth process, the processing unit 12 transmits a selection signal (a so-called tally signal) to the imaging device 2 selected in the third process via the communication unit 11, indicating that the image captured by that imaging device 2 is selected. Upon receiving the selection signal, the imaging device 2 illuminates an indicator light, such as a tally light, in a predetermined color (for example, green). This allows people on site to understand which imaging device 2's image is selected.

[0034] The output unit 13 outputs video captured by one of the multiple imaging devices 2. In this embodiment, video information (described later) is input to the output device 1 from each of the multiple imaging devices 2. The multiple input video information is decoded according to the format in which it was encoded. The output unit 13 then switches to the video captured by one imaging device 2 selected by the processing unit 12 from among the multiple input videos and outputs it to the display device 3.

[0035] The storage unit 14 is a non-volatile memory, such as a semiconductor memory like flash memory. The storage unit 14 stores various information necessary for processing in the output device 1, such as software programs executed by the processing unit 12. The storage unit 14 may be implemented using a memory device other than semiconductor memory.

[0036] As shown in Figure 2, the imaging device 2 comprises a communication unit 21, a control unit 22, a processing unit 23, an imaging unit 24, and a storage unit 25.

[0037] The communication unit 21 is a communication interface for communicating with the output device 1 via the network N1. Communication between the communication unit 21 and the output device 1 may be wired communication or wireless communication.

[0038] The control unit 22 controls the imaging unit 24 based on one or more imaging parameters. In this embodiment, the control unit 22 has a drive mechanism that moves the imaging unit 24 in the pan, tilt, and zoom directions. The drive mechanism is, for example, a motor, which allows the imaging unit 24 to move by a predetermined angle (e.g., ±175°) in the pan direction, by a predetermined angle (e.g., -30 to +90°) in the tilt direction, and by a predetermined lens focal length (e.g., 28 to 100 mm) in the zoom direction.

[0039] The processing unit 23 primarily executes the fourth to sixth processes shown below.

[0040] In the fourth process, when the processing unit 23 receives a request signal from the output device 1 via the communication unit 21 requesting the capture of a predetermined image, it calculates the cost required to capture the predetermined image and transmits a cost signal indicating the calculated cost to the output device 1 via the communication unit 21.

[0041] In this embodiment, the processing unit 23 (or, in other words, each of the multiple imaging devices 2) calculates the cost based on the time it takes to move from the current field of view to a field of view in which a predetermined image can be captured. For example, let's assume that the predetermined image is "an image of a subject captured in a bust shot." In this case, the processing unit 23 detects the subject in the current field of view using an appropriate image recognition algorithm and estimates the field of view in which the detected subject can be captured in a bust shot. The processing unit 23 then calculates the time required to move the imaging unit 24 from the current field of view to the estimated field of view, and calculates the cost by normalizing the calculated time. The cost is lower the shorter the time required for movement, and higher the longer the time required for movement. If the processing unit 23 cannot detect the subject in the current field of view, it attempts to change the field of view so that the subject can be captured, for example by zooming out the imaging unit 24. If the processing unit 23 is able to change the field of view so that the subject can be captured, it calculates the cost by adding an additional amount based on the time required to change the field of view. On the other hand, if the processing unit 23 cannot detect the subject even after changing the field of view, it calculates the cost as infinite.

[0042] Furthermore, the processing unit 23 (in other words, each of the multiple imaging devices 2) may calculate the cost based on the actual selection history by the output device 1. In this embodiment, as already described, the output device 1 transmits a selection signal (tally signal) to the selected imaging device 2. Here, the output device 1 selecting an imaging device 2 corresponds to evaluating that the image captured by the imaging device 2 is an image that approximates a predetermined image, that is, that the imaging device 2 is capturing an image with relatively good accuracy. Therefore, the processing unit 23 may weight the cost calculated based on the time taken for movement based on the actual selection history by the output device 1, that is, the reception history of the selection signal.

[0043] For example, the processing unit 23 calculates the cost in such a way that the more selection signals received in a unit period, the lower the cost becomes by multiplying the cost calculated based on the time taken for movement by a coefficient of less than 1 or by subtracting an offset value. Also, for example, the processing unit 23 calculates the cost in such a way that the fewer selection signals received in a unit period, the higher the cost becomes by multiplying the cost calculated based on the time taken for movement by a coefficient of greater than 1 or by adding an offset value.

[0044] Furthermore, the processing unit 23 (or, in other words, each of the multiple imaging devices 2) may calculate the cost based on its positional relationship with the subject. For example, the processing unit 23 detects the subject included in the image by analyzing the image captured by the imaging unit 24 using an appropriate image analysis algorithm. Then, if the request in the request signal is "an image of the subject captured in a bust shot" and the subject is not facing forward, the processing unit 23 calculates the cost such that, for example, the cost becomes infinite.

[0045] Furthermore, in the above case, and if the mobile body 2 itself is configured to be movable, the processing unit 23 may calculate the cost such that it is greater than the cost incurred if the imaging unit 24 were moved over the same amount of time, by multiplying the cost calculated based on the time required to move the mobile body 2 itself by a coefficient greater than 1 or by adding an offset value.

[0046] Furthermore, if the processing unit 23 can determine the positional relationship with the subject using a positioning system such as GPS (Global Positioning System), it may calculate the cost in the same way as above, for example, in a way that makes the cost infinite when the subject is not facing forward.

[0047] When the processing unit 23 receives an instruction signal from the communication unit 21 instructing the capture of a predetermined image, it executes the fifth process. In the fifth process, the processing unit 23 (or, in other words, each of the one or more imaging devices 2) attempts to capture the predetermined image by changing one or more imaging parameters. That is, the processing unit 23 changes one or more imaging parameters so that the field of view is such that it was estimated in the fourth process that the predetermined image can be captured. As a result, the control unit 22 controls the imaging unit 24 based on the changed one or more imaging parameters. The imaging unit 24 then captures the image at the field of view estimated that the predetermined image can be captured.

[0048] After executing the fifth process, the processing unit 23 executes the sixth process. In the sixth process, the processing unit 23 (or, in other words, each of the one or more imaging devices 2) calculates a confidence score indicating the degree to which a predetermined image has been captured, and transmits a confidence score signal indicating the calculated confidence score to the output device 1 via the communication unit 21. For example, the processing unit 23 calculates the confidence score by analyzing the image captured by the imaging unit 24 using an appropriate image analysis algorithm and calculating the degree of approximation to a predetermined image.

[0049] The imaging unit 24 is a detector for capturing images of landscapes and other objects, and detects visible light or near-infrared light. Imaging by the imaging unit 24 is performed continuously while the video output system 100 is in operation. The images captured by the imaging unit 24 are encoded in a predetermined format and output as video information to the output device 1 via the communication unit 21.

[0050] The storage unit 25 is a non-volatile memory, such as a semiconductor memory like flash memory. The storage unit 25 stores various information necessary for processing and control of the imaging device 2, such as a software program executed by the processing unit 23 and one or more imaging parameters. The storage unit 25 may be implemented using a memory device other than semiconductor memory.

[0051] [3. Operation] The operation of the video output system 100 according to this embodiment, that is, the video output method according to this embodiment, will be described below.

[0052] [3-1. Example of the first action] First, a first example of operation of the video output system 100 according to the embodiment will be explained using Figure 3. Figure 3 is a sequence diagram showing a first example of operation of the video output system 100 according to the embodiment. Hereafter, it will be assumed that there are n (n is a natural number of 2 or more) imaging devices 2. When distinguishing between each imaging device 2, the n imaging devices 2 will be referred to as "imaging device 201", ..., "imaging device 20n", respectively. Furthermore, the step in which the output device 1 transmits a selection signal (tally signal) will be omitted from the explanation below.

[0053] First, when output device 1 receives an input indicating a predetermined image, it transmits a request signal to each imaging device 2 (S101). The request signal may be transmitted to each imaging device 2 collectively by means of broadcast or multicast, or it may be transmitted sequentially to each imaging device 2. When each imaging device 2 receives (acquires) the request signal (S102), it calculates the cost required to capture the predetermined image (S103) and transmits a cost signal indicating the calculated cost to output device 1 (S104).

[0054] When output device 1 receives (acquires) a cost signal (S105), it selects one or more imaging devices 2 whose costs meet predetermined conditions (S106), and transmits an instruction signal to the selected one or more imaging devices 2 (S107). In the example shown in Figure 3, output device 1 receives cost signals from each of the imaging devices 201, ..., 20n, and transmits an instruction signal to imaging device 201, which has the minimum cost.

[0055] When one or more imaging devices 2 (here, imaging device 201) receive (acquire) an instruction signal (S108), they change one or more imaging parameters to achieve an estimated field of view in which a predetermined image can be captured, and control the imaging unit 24 based on the changed one or more imaging parameters (S109). As a result, one or more imaging devices 2 capture an image at the estimated field of view in which a predetermined image can be captured. Then, one or more imaging devices 2 calculate a confidence level indicating the degree to which the predetermined image can be captured (S110), and transmit a confidence level signal indicating the calculated confidence level to the output device 1 (S111).

[0056] When output device 1 receives (acquires) a reliability signal (S112), it selects the imaging device 2 with the highest reliability among the one or more imaging devices 2, and outputs the image captured by the selected imaging device 2 to display device 3 (S113). In this case, since there is only one imaging device 201 among the one or more imaging devices 2, output device 1 will output the image captured by imaging device 201 to display device 3, regardless of its reliability level.

[0057] As described above, the first operational example has the advantage that by requesting each of the multiple imaging devices 2 to capture a predetermined image and selecting one of the imaging devices 2 based on the cost required to capture the predetermined image, it becomes easier to output a predetermined image in the desired composition.

[0058] Furthermore, in the first operational example, the image captured by the imaging device 2 with the highest reliability, that is, the imaging device 2 that the system has determined to produce the image closest to the predetermined image, has the advantage of easily outputting an image that meets the requirements.

[0059] The following describes an example of the first operation of the video output system 100 according to the embodiment.

[0060] [3-1-1. First Embodiment] In the first embodiment, as shown in Table 1 below, the output device 1 transmits a request signal to three imaging devices 2, "Camera A," "Camera B," and "Camera C," requesting "an image of person α captured in a bust shot." In response to this request signal, "Camera A" transmits a cost signal with a cost of "200," "Camera B" transmits a cost signal with a cost of "100," and "Camera C" transmits a cost signal with a cost of "150" to the output device 1.

[0061] When output device 1 receives cost signals from each imaging device 2, it selects "camera B" as the imaging device 2 whose cost meets predetermined conditions and has the minimum cost, and sends an instruction signal to "camera B". When "camera B" receives the instruction signal, it sends a confidence signal with a confidence level of "140" to output device 1. Then, output device 1, finding that the confidence level of "camera B" exceeds the confidence threshold (for example, "100"), outputs the image captured by "camera B" to display device 3.

[0062] [Table 1]

[0063] [3-1-2. Second Example] In the second embodiment, as shown in Table 2 below, the output device 1 transmits a request signal to the three imaging devices 2, "Camera A," "Camera B," and "Camera C," requesting "an image of person α captured in a bust shot." In response to this request signal, "Camera A" transmits a cost signal with a cost of "200," "Camera B" transmits a cost signal with a cost of "100," and "Camera C" transmits a cost signal with a cost of "150" to the output device 1. Up to this point, it is the same as in the first embodiment.

[0064] In the second embodiment, when the output device 1 receives cost signals from each imaging device 2, it selects "Camera B" and "Camera C" as imaging devices 2 whose costs meet predetermined conditions and whose costs are below a cost threshold (e.g., "160"), and sends instruction signals to "Camera B" and "Camera C". In response to the instruction signals, "Camera B" sends a confidence signal with a confidence level of "128", and "Camera C" sends a confidence signal with a confidence level of "180" to the output device 1. The output device 1 then selects "Camera C", which has the highest confidence level and exceeds the confidence threshold, and outputs the image captured by "Camera C" to the display device 3.

[0065] [Table 2]

[0066] [3-1-3. Third Example] In the third embodiment, the output device 1 outputs the image captured by "camera C" to the display device 3. In the third embodiment, as shown in Table 3 below, the output device 1 sends a request signal to the two imaging devices 2, "camera A" and "camera B," requesting "an image of person α captured in a bust shot." In response to this request signal, "camera A" sends a cost signal with a cost of "200," and "camera B" sends a cost signal with a cost of "100" to the output device 1.

[0067] In the third embodiment, when the output device 1 receives a cost signal from each imaging device 2, it selects "camera B" as the imaging device 2 whose cost satisfies a predetermined condition and whose cost is below the cost threshold, and sends an instruction signal to "camera B". In response to this instruction signal, "camera B" sends a confidence signal with a confidence level of "128" to the output device 1. The output device 1 then outputs the image captured by "camera B" to the display device 3 because the confidence level of "camera B" exceeds the confidence threshold (for example, "100").

[0068] [Table 3]

[0069] [3-1-4. Fourth Example] In the fourth embodiment, the output device 1 outputs the image captured by "camera A" to the display device 3. In the fourth embodiment, as shown in Table 4 below, the output device 1 sends a request signal to the two imaging devices 2, "camera B" and "camera C," requesting "an image of person α captured in a bust shot." In response to this request signal, "camera B" sends a cost signal with a cost of "250," and "camera C" sends a cost signal with a cost of "220" to the output device 1.

[0070] In the fourth embodiment, when the output device 1 receives cost signals from each imaging device 2, it does not send an instruction signal to any of the imaging devices 2 because the cost of any of the imaging devices 2 is above the cost threshold and does not meet the predetermined conditions. The output device 1 then maintains the output of the image captured by "camera A".

[0071] [Table 4]

[0072] [3-1-5. Fifth Example] In the fifth embodiment, the output device 1 outputs the image captured by "camera A" to the display device 3. In the fifth embodiment, as shown in Table 5 below, the output device 1 sends a request signal to the two imaging devices 2, "camera B" and "camera C," requesting "an image of person α captured in a bust shot." In response to this request signal, "camera B" sends a cost signal with a cost of "100," and "camera C" sends a cost signal with a cost of "150" to the output device 1.

[0073] In the fifth embodiment, when the output device 1 receives cost signals from each imaging device 2, it selects "Camera B" and "Camera C" as imaging devices 2 whose costs meet predetermined conditions and whose costs are below the cost threshold, and sends instruction signals to "Camera B" and "Camera C". In response to the instruction signals, "Camera B" sends a confidence signal with a confidence level of "10", and "Camera C" sends a confidence signal with a confidence level of "20" to the output device 1. Then, since the confidence level of both imaging devices 2 is below the confidence threshold, the output device 1 maintains the output of the image captured by "Camera A".

[0074] [Table 5]

[0075] [3-2. Second example of operation] Next, a second example of operation of the video output system 100 according to the embodiment will be described. The second example of operation differs from the first example in that the predetermined video is video targeting a specific subject. In other words, in the first example of operation, if the subject is a person, it is sufficient that the video captured by the imaging device 2 includes the person. In contrast, in the second example of operation, the video captured by the imaging device 2 must include a specific person designated by the output device 1 (in other words, designated by the user). The second example of operation is executed when the user desires video tracking a specific subject. From here on, explanations of points common to the first example of operation will be omitted as appropriate.

[0076] In the second operational example, the request signal transmitted by output device 1 to each of the multiple imaging devices 2 includes identification information for identifying a specific subject. Here, the identification information may include, for example, an image of a person, or keywords indicating the person's characteristics, if the specific subject is a person. The image may be, for example, a facial image of the person or a full-body image of the person. The keywords may include, for example, characteristics of accessories such as glasses worn by the person, or physical characteristics of the person.

[0077] Each of the multiple imaging devices 2 identifies a specific subject based on identification information. Specifically, each imaging device 2 detects a specific subject with features included in the identification information within the current field of view using an appropriate image recognition algorithm. If an imaging device 2 cannot detect a specific subject within the current field of view, it may move the imaging unit 24 for a predetermined period of time to attempt to search for the specific subject. The search for a specific subject is performed only if the request signal contains information that permits such a search.

[0078] Furthermore, if each imaging device 2 and output device 1 have a common database for identifying subjects, the identification information may be an identifier for a specific subject. In this case, each imaging device 2 can refer to the characteristics of a specific subject associated with the identifier obtained from the output device 1 by comparing it with the database. Then, each imaging device 2 can detect a specific subject possessing those characteristics using an appropriate image recognition algorithm.

[0079] As described above, in the second example of operation, each imaging device 2 can be made to capture images that include a specific subject, which has the advantage of making it easier to output images that track a specific subject.

[0080] [3-3. Example of the third action] Next, a third operation example of the video output system 100 according to the embodiment will be described with reference to Figure 4. Figure 4 is a sequence diagram showing the third operation example of the video output system 100 according to the embodiment. The third operation example differs from the first operation example in that the predetermined video requested by the request signal is different for each of the multiple imaging devices 2. The third operation example is executed, for example, when the composition desired by the user has not been determined and no input indicating the predetermined video is provided. Hereafter, explanations of points common to the first operation example will be omitted as appropriate.

[0081] In the third operational example, as shown in Figure 4, the output device 1 individually transmits a request signal to each imaging device 2 (S201). For example, if there are three imaging devices 2, namely "imaging device 201," "imaging device 202," and "imaging device 203," the output device 1 ensures that the predetermined image requested in the request signal transmitted to imaging device 201 is different from the predetermined image requested in the request signal transmitted to imaging device 202 and the predetermined image requested in the request signal transmitted to imaging device 203. As an example, the predetermined image for the request signal transmitted to imaging device 201 is "a full-shot image of a person," the predetermined image for the request signal transmitted to imaging device 202 is "a waist-shot image of a person," and the predetermined image for the request signal transmitted to imaging device 203 is "a close-up shot image of a person."

[0082] Since steps S202 to S213 are the same as steps S102 to S113 in the first operation example (see Figure 3), the explanation of each step S202 to S213 will be omitted here.

[0083] As mentioned above, the third example of operation has the advantage of being able to autonomously output video even when, for example, the user has not yet determined the desired composition.

[0084] [3-4. Example of the fourth action] Next, a fourth operation example of the video output system 100 according to the embodiment will be described with reference to Figure 5. Figure 5 is a sequence diagram showing the fourth operation example of the video output system 100 according to the embodiment. The fourth operation example differs from the third operation example in that the output device 1 generates a request signal such that the predetermined video is different from the video captured by the master camera (predetermined imaging device) 4. Details common to the third operation example will be omitted as appropriate.

[0085] In the fourth operational example, the master camera 4 is, for example, a camera operated by a cameraman. In the fourth operational example, the master camera 4 outputs a video signal indicating the image being captured to the output device 1 (S301). When the output device 1 receives (acquires) the video signal from the master camera 4 (S302), it generates a request signal (S304). For example, the output device 1 analyzes the image indicated by the video signal using an appropriate image recognition algorithm and determines a predetermined image that is different from the current image. The output device 1 then generates a request signal requesting the determined predetermined image and transmits the generated request signal to each imaging device 2 (S304).

[0086] Steps S305 to S316 are the same as steps S202 to S213 in the third operation example (see Figure 4) (i.e., steps S102 to S113 in the first operation example (see Figure 3)), so the explanation of each step S305 to S316 is omitted here.

[0087] As described above, in the fourth operation example, a request signal is generated autonomously to request a predetermined image based on the image captured by the predetermined imaging device 4, which has the advantage of making it easier to output images with various compositions without the user having to specify a predetermined image. For example, if the master camera 4 is capturing a bust shot of a person, it is possible to request the imaging device 201 to capture a full shot of the person as the predetermined image, or to request the imaging device 202 to capture a close-up shot of the person as the predetermined image.

[0088] In the fourth example of operation, as in the third example of operation, the predetermined image requested by the request signal is different for each of the multiple imaging devices 2, but this is not limited to this. For example, as in the first and second examples of operation, the predetermined image requested by the request signal may be common for each of the multiple imaging devices 2.

[0089] [4. Advantages, etc.] The advantages of the video output system 100 (video output method) according to the embodiment will be described below. As described above, the video output system 100 according to the embodiment has the advantage that by requesting each of the multiple imaging devices 2 to capture a predetermined image and selecting any of the imaging devices 2 based on the cost required to capture the predetermined image, it becomes easier to output a predetermined image in which the subject is captured in the desired composition.

[0090] Therefore, the video output system 100 according to the embodiment has the advantage of reducing the workload for outputting a predetermined video, as it eliminates the need for the switcher operator to select a predetermined video from multiple videos or to give instructions to specify one or more imaging parameters necessary to capture a predetermined video, as described in [1. Findings on which this disclosure is based] of the conventional switcher method.

[0091] [5. Other Embodiments] Although embodiments have been described above, this disclosure is not limited to the embodiments described above.

[0092] For example, in the above embodiment, the output device 1 transmits a selection signal (tally signal) to the selected imaging device 2, but it is not necessary to transmit a selection signal.

[0093] For example, in the above embodiment, each of the one or more imaging devices 2 that receive the instruction signal calculates the reliability and transmits a reliability signal to the output device 1, but it is not necessary to calculate the reliability and transmit the reliability signal.

[0094] For example, in the above embodiment, the imaging device 2 may be any imaging device capable of autonomously changing one or more imaging parameters. For example, the imaging device 2 may be mounted on a mobile body such as a drone. Also, for example, the imaging device 2 may be configured to be mobile not only as an imaging unit 2, but as an entire imaging device 2.

[0095] For example, in the above embodiment, the video output system 100 is implemented by a single device, but it is not limited to this. For example, the video output system 100 may be implemented by multiple devices.

[0096] Furthermore, in the above embodiment, the processing performed by a specific processing unit may be performed by another processing unit. Also, the order of multiple processing units may be changed, or multiple processing units may be executed in parallel.

[0097] Furthermore, in the above embodiment, each component may be realized by executing a software program suitable for each component. Each component may also be realized by a program execution unit such as a CPU or processor reading and executing a software program recorded on a recording medium such as a hard disk or semiconductor memory.

[0098] Furthermore, each component may be implemented by hardware. Each component may also be a circuit (or integrated circuit). These circuits may form a single circuit as a whole, or they may be separate circuits. Also, each of these circuits may be a general-purpose circuit or a dedicated circuit.

[0099] Furthermore, the general or specific embodiments of this disclosure may be implemented as a system, apparatus, method, integrated circuit, computer program, or recording medium such as a computer-readable CD-ROM. They may also be implemented in any combination of systems, apparatus, methods, integrated circuits, computer programs, and recording media.

[0100] Furthermore, this disclosure may be implemented as a video output method executed by a computer, such as the video output system of the above embodiment. This disclosure may be implemented as a program (computer program product) for causing a computer to execute such a video output method, or as a computer-readable non-temporary recording medium on which such a program is recorded.

[0101] Furthermore, this disclosure also includes forms obtained by applying various modifications to each embodiment that a person skilled in the art could conceive, or forms realized by arbitrarily combining the components and functions of each embodiment without departing from the spirit of this disclosure.

[0102] (summary) As described above, in the first embodiment of the video output method, the output device 1 transmits a request signal to each of the multiple imaging devices 2 requesting the imaging of a predetermined image. In the video output method, each of the multiple imaging devices 2 calculates the cost required to realize the imaging of the predetermined image and transmits a cost signal indicating the calculated cost to the output device 1. In the video output method, the output device 1 transmits an instruction signal to one or more of the multiple imaging devices 2 whose costs meet predetermined conditions, instructing them to image the predetermined image. In the video output method, each of the one or more imaging devices 2 attempts to image the predetermined image by changing one or more imaging parameters. In the video output method, the output device 1 selects one of the one or more imaging devices 2 and outputs the image captured by the selected imaging device 2.

[0103] This video output method has the advantage of reducing the workload for outputting a predetermined video, as it makes it easier to output a predetermined video with the subject captured in the desired composition simply by requesting each of the multiple imaging devices 2 to capture a predetermined video and selecting one of the imaging devices 2 based on the cost required to capture the predetermined video.

[0104] Furthermore, for example, in the video output method according to the second embodiment, the predetermined condition in the first embodiment is that the imaging device 2 has the lowest cost among the multiple imaging devices 2.

[0105] This video output method has the advantage of easily outputting video that meets the requirements, because it outputs the video captured by the imaging device 2, which places the least burden on the system to capture the desired image.

[0106] Furthermore, for example, in the video output method according to the third embodiment, in the first or second embodiment, each of the multiple imaging devices 2 calculates the cost based on the time it takes to move from the current field of view to a field of view in which a predetermined image can be captured.

[0107] This type of video output method has the advantage of making it easier to estimate the load on the imaging device 2 in order to capture a predetermined image.

[0108] Furthermore, for example, in the video output method according to the fourth embodiment, in the third embodiment, each of the multiple imaging devices 2 calculates the cost based on the results selected by the output device 1.

[0109] This video output method has the advantage that it makes it easier for the output device 1 to select the imaging device 2 that is capturing images with relatively good accuracy for the requirements, thus making it easier to output images that meet the requirements.

[0110] Furthermore, for example, in the video output method according to the fifth embodiment, in any one of the first to fourth embodiments, each of the multiple imaging devices 2 calculates the cost based on the positional relationship between itself and the subject.

[0111] This type of video output method has the advantage of making it easier to estimate the load on the imaging device 2 in order to capture a predetermined image.

[0112] Furthermore, for example, in the video output method according to the sixth embodiment, in any one of the first to fifth embodiments, each of the one or more imaging devices 2 calculates a reliability score indicating the degree to which a predetermined image has been captured, and transmits a reliability signal indicating the calculated reliability score to the output device 1. The output device 1 selects the imaging device 2 with the highest reliability score among the one or more imaging devices 2.

[0113] This video output method has the advantage of easily outputting video that meets the requirements, because it outputs video captured by the imaging device 2 with the highest reliability, that is, the imaging device 2 that it has determined to have captured video that is closest to the predetermined video.

[0114] Furthermore, for example, in the video output method according to the seventh embodiment, in any one of the first to sixth embodiments, each of the one or more imaging devices 2 calculates a reliability score indicating the degree to which a predetermined image has been captured, and transmits a reliability signal indicating the calculated reliability score to the output device 1. If the reliability score of any of the one or more imaging devices 2 falls below a predetermined value, the output device 1 does not select any of the imaging devices 2 and maintains the output of the image captured by the imaging device 2 that is selected at that time.

[0115] This type of video output method has the advantage of avoiding the output of video that does not meet the requirements.

[0116] Furthermore, for example, in the video output method according to the eighth embodiment, in any one of the first to seventh embodiments, the predetermined video is a video targeting a specific subject. The request signal includes identification information for identifying a specific subject. Each of the plurality of imaging devices 2 identifies a specific subject based on the identification information.

[0117] This video output method has the advantage of making it easy to output video tracking a specific subject, as each imaging device 2 can be made to capture video containing a specific subject.

[0118] Furthermore, for example, in the video output method according to the ninth embodiment, in any one of the first to sixth embodiments, the predetermined video requested by the request signal is different for each of the multiple imaging devices 2.

[0119] This type of video output method has the advantage of being able to autonomously output video even when, for example, the user has not yet determined the desired composition.

[0120] Furthermore, for example, in the video output method according to the tenth embodiment, in any one of the first to ninth embodiments, the output device 1 generates a request signal such that the predetermined video is different from the video captured by the predetermined imaging device (master camera) 4.

[0121] This video output method has the advantage of making it easier to output videos with various compositions without the user having to specify a particular video, because it autonomously generates a request signal requesting a predetermined video based on the video captured by a predetermined imaging device 4.

[0122] Furthermore, in the output method according to the 11th embodiment, for example, a request signal requesting the capture of a predetermined image is transmitted to each of the multiple imaging devices 2. In addition, when the output method receives a cost signal from each of the multiple imaging devices 2 indicating the cost required to capture the predetermined image, an instruction signal is transmitted to one or more imaging devices 2 among the multiple imaging devices 2 whose cost satisfies a predetermined condition, instructing them to capture the predetermined image. In addition, the output method selects one of the one or more imaging devices 2 and outputs the image captured by the selected imaging device 2.

[0123] This output method has the advantage of reducing the workload for outputting a predetermined image, as it makes it easier to output a predetermined image with the subject captured in the desired composition simply by requesting each of the multiple imaging devices 2 to capture a predetermined image and selecting one of the imaging devices 2 based on the cost required to capture the predetermined image.

[0124] Furthermore, for example, in the imaging method according to the 12th embodiment, upon receiving a request signal requesting the imaging of a predetermined image, the cost required to achieve the imaging of the predetermined image is calculated and a cost signal indicating the calculated cost is transmitted to the output device 1. In addition, in the imaging method, upon receiving an instruction signal instructing the imaging of a predetermined image, one or more imaging parameters are changed to attempt to image the predetermined image.

[0125] In this imaging method, the cost required to capture the requested predetermined image is output to the output device 1, and the device attempts to capture the requested predetermined image according to the instructions. This has the advantage that it makes it easier for the output device 1 to output a predetermined image in the desired composition, and reduces the workload required to output the predetermined image.

[0126] Furthermore, for example, in the imaging method according to the 13th embodiment, a reliability score indicating the degree to which a predetermined image can be captured is calculated in the 12th embodiment, and a reliability signal indicating the calculated reliability score is transmitted to the output device 1.

[0127] This imaging method has the advantage that, for example, the output device 1 can output the image captured by the imaging device 2 with the highest reliability, that is, the imaging device 2 that it has determined to have captured the image closest to the predetermined image, making it easier to output an image that meets the requirements.

[0128] Furthermore, for example, the video output system 100 according to the 14th embodiment comprises a plurality of imaging devices 2 and an output device 1. Each of the plurality of imaging devices 2 is capable of autonomously changing one or more imaging parameters. The output device 1 outputs video captured by any one of the plurality of imaging devices 2. The output device 1 transmits a request signal to each of the plurality of imaging devices 2 requesting the capture of a predetermined video. When each of the plurality of imaging devices 2 receives the request signal, it calculates the cost required to capture the predetermined video and transmits a cost signal indicating the calculated cost to the output device 1. When the output device 1 receives the cost signal from each of the plurality of imaging devices 2, it transmits an instruction signal to one or more of the plurality of imaging devices 2 whose cost satisfies a predetermined condition, instructing them to capture the predetermined video. When each of the one or more imaging devices 2 receives the instruction signal, it attempts to capture the predetermined video by changing one or more imaging parameters. The output device 1 selects any one of the one or more imaging devices 2 and outputs the video captured by the selected imaging device 2.

[0129] Such a video output system 100 has the advantage of easily reducing the workload for outputting a predetermined video, as it can output a predetermined video capturing a subject in the desired composition simply by requesting each of the multiple imaging devices 2 to capture a predetermined video and selecting one of the imaging devices 2 based on the cost required to capture the predetermined video.

[0130] Furthermore, for example, the output device 1 according to the 15th embodiment comprises a communication unit 11, an output unit 13, and a processing unit 12. The communication unit 11 communicates with each of a plurality of imaging devices 2 capable of autonomously changing one or more imaging parameters. The output unit 13 outputs an image captured by any one of the plurality of imaging devices 2. The processing unit 12 transmits a request signal to each of the plurality of imaging devices 2 requesting the capture of a predetermined image. When the processing unit 12 receives a cost signal from each of the plurality of imaging devices 2 indicating the cost required to capture the predetermined image, it transmits an instruction signal to one or more imaging devices 2 among the plurality of imaging devices 2 whose cost satisfies a predetermined condition, instructing them to capture the predetermined image. The processing unit 12 selects one of the one or more imaging devices 2 and causes the image captured by the selected imaging device 2 to be output to the output unit 13.

[0131] Such an output device 1 has the advantage of easily reducing the workload for outputting a predetermined image, as it can request each of the multiple imaging devices 2 to capture a predetermined image and then select one of the imaging devices 2 based on the cost required to capture the predetermined image, thereby easily outputting a predetermined image that captures the subject in the desired composition.

[0132] Furthermore, for example, the imaging device 2 according to the 16th embodiment includes a communication unit 21, an imaging unit 24, a control unit 22, and a processing unit 23. The communication unit 21 communicates with the output device 1. The control unit 22 controls the imaging unit 24 based on one or more imaging parameters. When the processing unit 23 receives a request signal requesting the imaging of a predetermined image, it calculates the cost required to achieve the imaging of the predetermined image and transmits a cost signal indicating the calculated cost to the output device 1. Also, when the processing unit 23 receives an instruction signal instructing the imaging of a predetermined image, it attempts to image the predetermined image by changing one or more imaging parameters.

[0133] Such an imaging device 2 outputs the cost required to capture the requested predetermined image to the output device 1 and attempts to capture the requested predetermined image according to the instructions. This has the advantage that it makes it easier for the output device 1 to output a predetermined image in the desired composition, and reduces the workload required to output the predetermined image.

[0134] Furthermore, for example, in the imaging device 2 according to the 17th embodiment, in the 16th embodiment, the processing unit 23 calculates a reliability score indicating the degree to which a predetermined image has been captured, and transmits a reliability score signal indicating the calculated reliability score to the output device 1.

[0135] Such an imaging device 2 has the advantage that, for example, the output device 1 can output the image captured by the imaging device 2 with the highest reliability, that is, the imaging device 2 that it has determined to have captured an image that is closest to a predetermined image, making it easier to output an image that meets the requirements. [Industrial applicability]

[0136] The video output system, etc., disclosed herein can be used as a switcher, etc., for switching between video outputs. [Explanation of symbols]

[0137] 1. Output device 11 Communications Department 12 Processing Units 13 Output section 14 Storage section 2, 201, ..., 20n imaging device 21 Communications Department 22 Control Unit 23 Processing Unit 24 Imaging Department 25 Memory section 3 Display device 4. Master camera (designated imaging device) 100 Video Output Systems N1 Network

Claims

1. The output device sends a request signal to each of the multiple imaging devices requesting the capture of a predetermined image. Each of the plurality of imaging devices calculates the cost required to capture the predetermined image, and transmits a cost signal indicating the calculated cost to the output device. The output device transmits an instruction signal to one or more of the plurality of imaging devices whose cost meets the predetermined conditions, instructing them to capture the predetermined image. Each of the one or more imaging devices attempts to capture the predetermined image by changing one or more imaging parameters. The output device selects one of the one or more imaging devices and outputs the image captured by the selected imaging device. Video output method.

2. The aforementioned predetermined condition is that the cost is the lowest among the plurality of imaging devices. The video output method according to claim 1.

3. Each of the plurality of imaging devices calculates the cost based on the time it takes to move from the current field of view to a field of view that can capture the predetermined image. The video output method according to claim 1 or 2.

4. Each of the aforementioned imaging devices calculates the cost based on the results selected by the output device. The video output method according to claim 3.

5. Each of the aforementioned imaging devices calculates the cost based on the positional relationship between itself and the subject. The video output method according to claim 1 or 2.

6. Each of the one or more imaging devices calculates a reliability score indicating the degree to which the predetermined image has been captured, and transmits a reliability score signal indicating the calculated reliability score to the output device. The output device selects the imaging device with the highest reliability among the one or more imaging devices. The video output method according to claim 1 or 2.

7. Each of the one or more imaging devices calculates a reliability score indicating the degree to which the predetermined image has been captured, and transmits a reliability score signal indicating the calculated reliability score to the output device. If the reliability of any of the one or more imaging devices falls below a predetermined value, the output device will not select any imaging device and will maintain the output of the image captured by the imaging device currently selected. The video output method according to claim 1 or 2.

8. The aforementioned predetermined video is a video that targets a specific subject, The request signal includes identification information for identifying the specific subject, Each of the plurality of imaging devices identifies the specific subject based on the identification information. The video output method according to claim 1 or 2.

9. The predetermined image requested by the request signal is different from each of the plurality of imaging devices. The video output method according to claim 1 or 2.

10. The output device generates the request signal such that the predetermined image is different from the image captured by the predetermined imaging device. The video output method according to claim 1 or 2.

11. A request signal requesting the capture of a predetermined image is sent to each of the multiple imaging devices. When a cost signal indicating the cost required to capture the predetermined image is received from each of the plurality of imaging devices, an instruction signal is transmitted to one or more of the plurality of imaging devices whose costs satisfy the predetermined conditions, instructing them to capture the predetermined image. Select one of the one or more imaging devices and output the image captured by the selected imaging device. Output method.

12. When a request signal is received from an output device that outputs video, requesting the capture of a predetermined video, the cost required to capture the predetermined video is calculated, and a cost signal indicating the calculated cost is transmitted to the output device. When an instruction signal is received from the output device to instruct the imaging of the predetermined image, the device attempts to image the predetermined image by changing one or more imaging parameters. Imaging method.

13. The system calculates a confidence level indicating the degree to which the predetermined image has been captured, and transmits a confidence level signal indicating the calculated confidence level to the output device. The imaging method according to claim 12.

14. Multiple imaging devices capable of autonomously changing one or more imaging parameters, The system includes an output device that outputs an image captured by any one of the plurality of imaging devices, The output device transmits a request signal to each of the multiple imaging devices requesting the capture of a predetermined image. When each of the plurality of imaging devices receives the request signal, it calculates the cost required to capture the predetermined image and transmits a cost signal indicating the calculated cost to the output device. When the output device receives the cost signal from each of the plurality of imaging devices, it transmits an instruction signal to one or more of the plurality of imaging devices whose cost satisfies a predetermined condition, instructing them to capture the predetermined image. When each of the one or more imaging devices receives the instruction signal, it attempts to capture the predetermined image by changing the one or more imaging parameters. The output device selects one of the one or more imaging devices and outputs the image captured by the selected imaging device. Video output system.

15. A communication unit that communicates with each of a plurality of imaging devices capable of autonomously changing one or more imaging parameters, An output unit that outputs an image captured by any one of the plurality of imaging devices, A processing unit, and The aforementioned processing unit, A request signal requesting the capture of a predetermined image is transmitted to each of the multiple imaging devices. When a cost signal indicating the cost required to capture the predetermined image is received from each of the plurality of imaging devices, an instruction signal is transmitted to one or more of the plurality of imaging devices whose costs satisfy the predetermined conditions, instructing them to capture the predetermined image. Select one of the one or more imaging devices mentioned above, and output the image captured by the selected imaging device to the output unit. Output device.

16. A communication unit that communicates with the output device, Imaging unit, A control unit that controls the imaging unit based on one or more imaging parameters, A processing unit, and The aforementioned processing unit, Upon receiving a request signal requesting the capture of a predetermined image, the system calculates the cost required to capture the predetermined image and transmits a cost signal indicating the calculated cost to the output device. Upon receiving an instruction signal to capture the predetermined image, the system attempts to capture the predetermined image by changing one or more of the imaging parameters. Imaging device.

17. The processing unit calculates a confidence level indicating the degree to which the predetermined image has been captured, and transmits a confidence level signal indicating the calculated confidence level to the output device. The imaging device according to claim 16.

Images