Imaging apparatus, imaging signal processing apparatus, and imaging system
By introducing control units into the imaging and signal processing equipment and changing the signal processing procedure, the problem of insufficient signal processing capability was solved, high frame rate imaging was achieved, and the imaging capability of the system was improved.
Patent Information
- Application Number
- CN202480022206.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2023-04-04
- Filing Date
- 2024-03-22
- Publication Date
- 2025-11-21
AI Technical Summary
Existing imaging systems lack sufficient signal processing capabilities for high frame rate imaging, making it impossible to achieve high-magnification imaging.
By introducing control units into the imaging device and the imaging signal processing device, the signal processing process is changed, enabling the imaging device to output high-speed video signals at a specific resolution, and performing corresponding partial processing on the signal processing device side, thus achieving high-speed imaging.
High frame rate imaging was achieved without increasing the processing load of the imaging equipment, reducing the transmission bandwidth burden and improving the imaging capability of the system.
Smart Images

Figure CN121002891A_ABST
Abstract
Description
TECHNICAL FIELD
[0001] The present technology relates to the technical field of an imaging device, an imaging signal processing device, and an imaging system. BACKGROUND
[0002] An imaging system is known that performs high-speed imaging at a high resolution in an imaging device and transmits a video signal from the imaging device to a camera control unit.
[0003] The following Patent Literature 1 discloses a technology related to such an imaging system.
[0004] LIST OF CITATIONS
[0005] PATENT LITERATURE
[0006] Patent Literature 1: Japanese Patent No. 4475225 SUMMARY
[0007] PROBLEMS TO BE SOLVED BY THE INVENTION
[0008] Meanwhile, in a standard three-plate type image sensor 4K-RGB camera, a standard speed (a signal processing requirement of a frame rate of 59.94P, 50P (P is a progressive scan) x (16 bits) x (148M) x 4 x (3 channels (RGB)) ≈ 28 Gbps level of processing capability. Of course, when the imaging frame rate increases, a signal processing capability proportional to the imaging frame rate is required.
[0009] Then, for example, even if imaging can be performed at a speed four times the imaging capability of the image sensor, if the signal processing capability is not four times, four-times speed imaging cannot be performed.
[0010] Thus, the present disclosure proposes a technology that enables an imaging system using an imaging device having a standard signal processing capability to be compatible with high-speed imaging exceeding the signal processing capability.
[0011] SOLUTION TO THE PROBLEM
[0012] An imaging device according to the present technology includes: an imaging element unit capable of outputting a video signal at m-times speed at a certain resolution; a signal processing unit in which a part of processing is compatible with a video signal up to n-times speed at the certain resolution, the n-times speed being lower than the m-times speed; a transmission unit that transmits a video signal output from the signal processing unit to an imaging signal processing device; and a control unit that changes a processing procedure of the signal processing unit when imaging at the m-times speed at the certain resolution is performed.
[0013] An imaging signal processing apparatus according to the present technology includes a transmission unit that receives a video signal output from an imaging apparatus including an imaging element unit capable of outputting a video signal at m-times speed at a certain resolution, a partial process compatible with a video signal up to n-times speed at the certain resolution, the n-times speed being lower than the m-times speed, a signal processing unit capable of performing the partial process in the imaging apparatus corresponding to the video signal at the m-times speed at the certain resolution, and a control unit that, in a case where the imaging apparatus outputs the video signal at the m-times speed at the certain resolution, controls the signal processing unit to perform the partial process for the video signal at the m-times speed at the certain resolution.
[0014] In a case where the imaging apparatus and the processing of the video signal at m-times speed at the certain resolution are not compatible, the processing of the video signal at m-times speed is performed on the imaging signal processing apparatus side. The imaging apparatus side copes with it by changing a processing procedure.
[0015] Note that m and n are assumed to be natural numbers. However, m and n are not necessarily limited to natural numbers. At least m > n. BRIEF DESCRIPTION OF DRAWINGS
[0016] Figure 1 is a block diagram of a system camera according to an embodiment of the present technology.
[0017] Figure 2 is a block diagram of a 4K video processing unit of a camera control unit according to an embodiment.
[0018] Figure 3 is an explanatory diagram of processing in a 4K standard speed imaging case according to an embodiment.
[0019] Figure 4 is an explanatory diagram of processing in a 4K 2-times speed imaging case according to an embodiment.
[0020] Figure 5 is an explanatory diagram of processing in a 4K 4-times speed imaging case according to an embodiment.
[0021] Figure 6 is a flowchart of a processing example at power-on according to an embodiment.
[0022] Figure 7 is a flowchart of a processing example in a 4K 4-times speed imaging case according to an embodiment. DETAILED DESCRIPTION
[0023] Hereinafter, an embodiment will be described in the following order.
[0024] <1. System camera configuration>
[0025] <2. Processing of standard speed, 2-times speed, and 4-times speed imaging>
[0026] <3. Processing example>
[0027] <4. Summary and modification>
[0028] Note that, in the present disclosure, "4K" refers to a video having a resolution of 3840 x 2160 pixels, and this resolution is referred to as "4K resolution". In the present disclosure, a speed is indicated with "x". For example, "4K 4x" indicates 4-times speed imaging of 4K resolution, "4K 2x" indicates 2-times speed imaging of 4K resolution, and "4K lx" indicates 1-times speed (standard speed) imaging of 4K resolution.
[0029] <1. System camera configuration>
[0030] Figure 1 A configuration example of a system camera 1 according to an embodiment is illustrated. The system camera 1 includes a camera 10 and a camera control unit (hereinafter, CCU) 12.
[0031] The system camera 1 is an example of an imaging system of the present disclosure, the camera 10 is an example of an imaging device, and the CCU 12 is an example of an imaging signal processing device.
[0032] The camera 10 performs imaging to generate a video signal, and outputs the video signal to the CCU 12 via a hybrid fiber cable 16.
[0033] The CCU 12 processes the video signal input from the camera 10, and transmits the processed video signal to a recording device, a switcher, or the like (not shown) in a predetermined transmission format.
[0034] The hybrid fiber cable 16 is formed, for example, by combining optical fibers for transmission and reception, and a meta cable for power lines and control. As a result, the camera 10 and the CCU 12 can transmit video signals and control signals to each other.
[0035] For example, in the system camera 1, the camera 10 is arranged in a studio, and the CCU 12, the recording device, the switcher, or the like are arranged in a sub-control room.
[0036] For example, when the camera 10 of the studio records a program, a video signal and an audio signal are transmitted to the CCU 12 of the sub-control room via the hybrid fiber cable 16.
[0037] Then, the video signal and the audio signal processed by the CCU 12 are output to a recording device or a switcher via a cable (not shown). The recording device and the switcher perform signal processing such as recording, editing, and issuance of the video signal and the audio signal.
[0038] The configuration of the camera 10 will be described.
[0039] The camera 10 includes a central processing unit (CPU) 20, an imaging element unit 21, a signal processing unit 22, a transmission unit 23, and other systems 24.
[0040] The imaging element unit 21 is configured to include, for each of R, G, and B, a 3-plate image sensor of, for example, a complementary metal-oxide semiconductor (CMOS), a charge-coupled device (CCD), or the like. Then, R, G, and B video signals are output by line-sequential scanning. In the present embodiment, it is assumed that the imaging element unit 21 can perform not only 4K1x standard-speed imaging but also 4K2x or 4K4x high-frame-rate imaging.
[0041] The signal processing unit 22 includes one or more video processor chips or the like. As processing functions, the signal processing unit 22 includes a pre-processing unit 31, a 4K video processing unit 32, and a conversion processing unit 33. Note that although not shown, a buffer memory for temporarily storing a video signal in the process in which the signal processing unit 22 processes the video signal is provided in the signal processing unit 22 or the camera 10.
[0042] The pre-processing unit 31 performs A / D conversion processing, gain adjustment processing, defect correction processing, and the like of a video signal. The pre-processing unit 31 can perform processing corresponding to 4K4x imaging of the imaging element unit 21. For example, the pre-processing unit 31 can perform pre-processing that is 4-times speed processing or 1-times speed processing in parallel with 4 systems.
[0043] The 4K video processing unit 32 performs necessary luminance and color processing, including inflection point processing, gamma processing, color matrix processing, and the like, on a video signal after pre-processing. These processes are collectively referred to as video signal processing.
[0044] The 4K video processing unit 32 has processing capacity to perform video signal processing corresponding to 4K2x imaging. On the other hand, it is assumed that the processing capacity is insufficient for 4K4x imaging.
[0045] The conversion processing unit 33 performs conversion processing for generating a monitor video signal MV to be displayed on a viewfinder (not shown) of the camera 10. That is, the conversion processing unit 33 performs processing to convert, for example, a 1-times speed 4K video signal processed by the 4K video processing unit 32 into a high-definition (HD) video signal, and uses it as the monitor video signal MV.
[0046] Note that the other system 24 indicates other functional units not shown in the camera 10. These include a viewfinder, an audio circuit, and the like. The monitor video signal MV is supplied to the viewfinder and displayed so that a camera operator who operates the camera 10 can confirm the captured video.
[0047] The video signal that has passed through the 4K video processing unit 32 of the signal processing unit 22 is transmitted to the CCU 12 by the transmission unit 23. The transmission unit 23 transmits the video signal to the CCU 12 in an uncompressed manner. Further, the transmission unit 23 can also transmit the video signal to the CCU 12 after compressing the video signal.
[0048] The CPU 20 functions as a control unit of the camera 10. The CPU 20 sends a control signal CS1 to each unit to control the operation of each unit. For example, the CPU 20 instructs the read speed to the imaging element unit 21. In addition, the CPU 20 controls the processing procedure in the signal processing unit 22. In addition, the CPU 20 controls the transmission processing with respect to the transmission unit 23. In addition, the CPU 20 can perform information communication with the CPU 40 of the CCU 12 by communication via the transmission unit 23.
[0049] Next, the configuration of the CCU 12 will be described.
[0050] The CCU 12 includes a CPU 40, a transmission unit 41, a formatter / conversion unit 42, an input unit 43, a display unit 44, and an operation unit 45.
[0051] The transmission unit 41 sends and receives signals to and from the transmission unit 23 of the camera 10. The transmission unit 41 receives the video signal transmitted from the camera 10 and outputs the video signal to the formatter / conversion unit 42. In the case where the video signal undergoes compression processing, the transmission unit 41 can also perform decompression (expansion) processing.
[0052] The formatter / conversion unit 42 performs format processing for serial digital interface (SDI) transmission or Internet protocol (IP) transmission of the 4K video signal to, for example, a recording device, a switcher, and the like, and processing for conversion of the 4K video signal to an HD video signal. Then, the formatter / conversion unit 42 outputs the 4K video signal or the HD video signal.
[0053] The input unit 43 inputs various signals and delivers the signals to the transmission unit 41. For example, a return signal RT is input. The return signal RT is, for example, a video captured by another camera, transmitted from the transmission unit 41 to the camera 10, and used for display on a viewfinder, another display device, or the like.
[0054] The display unit 44 displays the operation state and the like in the CCU 12.
[0055] The operation unit 45 includes operation members with which an operator of the CCU 12 can perform various operations. The display unit 44 and the operation unit 45 can be integrated as a graphical user interface (GUI) device using a touch panel.
[0056] The CPU 40 functions as a control unit that controls each unit in the CCU 12. The CPU 40 sends a control signal CS2 to each unit to control the operation of each unit.
[0057] For example, the CPU 40 controls the transmission operation, decompression processing, and the like of the transmission unit 41 and the processing of the formatter / converter unit 42. In addition, the CPU 40 controls the display operation of the display unit 44. In addition, the CPU 40 can perform information communication with the CPU 20 of the camera 10 through communication via the transmission unit 41.
[0058] In the CCU 12, an option board 50 can be installed in the device housing, and the option board 50 is installed with a 4K video processing unit 51. The 4K video processing unit 51 has a processing capability capable of performing video signal processing similar to the 4K video processing unit 32 of the camera 10 corresponding to 4K4x imaging.
[0059] Figure 2 An example of the configuration of the 4K video processing unit 51 is illustrated. The 4K video processing unit 51 includes, for example, signal processing circuits 61, 62, 63, and 64 each having a processing capability of video signal processing corresponding to 4K1x. In a case where a 4K4x video signal is sent from the camera 10 to the transmission unit 41, the transmission unit 41 sequentially transmits the 4K4x video signal to the signal processing circuits 61, 62, 63, and 64, for example, for each frame, thereby realizing video signal processing corresponding to 4K4x in all of the signal processing circuits 61, 62, 63, and 64.
[0060] Then, the 4K video processing unit 51 outputs the 4K4x video signal as 4-system parallel output to a switch or the like of the next stage.
[0061] Further, the 4K video processing unit 51 includes an adding circuit 65 and a signal processing circuit 66. The adding circuit 65 adds the inputs of the signal processing circuits 61, 62, 63, and 64 to generate a 4K1x video signal. The signal processing circuit 66 has a processing capability of video signal processing corresponding to 4K1x similarly to the signal processing circuit 61. The 4K1x video signal output from the adding circuit 65 undergoes video signal processing of the signal processing circuit 66 and is supplied to the formatter / converter unit 42.
[0062] As described later, in the case where 4K4x video signal processing is performed, the processing is changed so that the transmission unit 41 does not output the video signal to the formatter / conversion unit 42 but outputs the video signal to the 4K video processing unit 51. Even in this case, the formatter / conversion unit 42 can output the 4K1x video signal and the HD video signal converted from the 4K1x video signal by receiving the 4K1x video signal from the 4K video processing unit 51.
[0063] With the above-described configuration, by adding the option board 50 to the standard camera 10 and the CCU 12 on the CCU 12 side, the system camera 1 can be switched to a system camera capable of high frame rate imaging at 4 times speed and operated.
[0064] <2. Processing of standard speed, 2 times speed, and 4 times speed imaging>
[0065] Hereinafter, an example in which the option board 50 is added to the CCU 12 side in the system camera 1 capable of imaging up to 4K2x and the CPUs 20 and 40 have necessary software options so that the system camera 1 can function as a 4 times speed super motion camera will be described.
[0066] Figure 3 、 Figure 4 and Figure 5 The processing and signal paths of each unit in the configuration of Figure 1 will be illustrated, and it is assumed that the changes in the processing and the changes in the signal paths of each unit can be seen by comparing the respective drawings.
[0067] First, Figure 3 The processing performed by each unit under the control of the CPUs 20 and 40 in the case where 4K1x imaging, that is, imaging of a general 4K video format (59.94P, 50P) is performed will be illustrated.
[0068] In the imaging element unit 21, imaging is performed at 1 times speed. In the signal processing unit 22, the processing of the preprocessing unit 31 and the 4K video processing unit 32 is performed at 1 times speed, and the uncompressed 4K1x video signal is transmitted from the transmission unit 23 to the CCU 12.
[0069] Further, in the conversion processing unit 33 of the signal processing unit 22, the 4K1x video signal that has undergone video signal processing in the 4K video processing unit 32 is converted to an HD video signal. The HD video signal is a monitor video signal MV provided to the viewfinder.
[0070] The 4K1x video signal output from the camera 10 is input to the transmission unit 41 of the CCU 12. The transmission unit 41 transmits the 4K1x video signal to the formatter / conversion unit 42. The formatter / conversion unit 42 performs necessary format processing on the 4K1x video signal for SDI transmission or the like, and outputs the 4K1x video signal. Further, the formatter / conversion unit 42 converts the 4K1x video signal into an HD video signal, and outputs the HD video signal.
[0071] In the case where 4K1x imaging is performed, the processing flow as illustrated in FIG. 6 is performed. In this case, the 4K video processing unit 51 is not used on the CCU 12 side. In other words, even in the case where the option board 50 is not attached, 4K1x imaging can be performed. Figure 3
[0072] Next, Figure 4 The processing performed by each unit under the control of the CPUs 20 and 40 in the case where 4K2x imaging, that is, imaging of a 2-times speed 4K video format (119.88P, 100P) is performed, is illustrated.
[0073] In the imaging element unit 21, imaging is performed at 2 times speed. In the signal processing unit 22, the processing of the preprocessing unit 31 and the 4K video processing unit 32 is performed at 2 times speed, and the 4K2x video signal is sent out from the transmission unit 23 to the CCU 12 in an uncompressed manner.
[0074] Further, in the conversion processing unit 33 of the signal processing unit 22, the 4K2x video signal that has undergone video signal processing in the 4K video processing unit 32 is converted into an HD video signal, and also converted from 2 times speed to 1 times speed. This HD video signal becomes a monitor video signal MV provided to the viewfinder.
[0075] The 4K2x video signal output from the camera 10 is input to the transmission unit 41 of the CCU 12. The transmission unit 41 transmits the 4K2x video signal to the formatter / conversion unit 42. The formatter / conversion unit 42 performs necessary format processing on the 4K2x video signal, and outputs the 4K2x video signal. Further, the formatter / conversion unit 42 converts the 4K2x video signal into 1 times speed (4K1x), further converts the video signal into an HD video signal, and outputs the HD video signal.
[0076] In the case where 4K2x imaging is performed, the processing flow as illustrated in FIG. 6 is performed. In this case, the 4K video processing unit 51 is not used on the CCU 12 side. In other words, even in the case where the option board 50 is not attached, 4K1x imaging can be performed. Figure 4
[0077] However, for this 4K2x imaging, the imaging, preprocessing, and video signal processing in the camera 10 require twice the processing capacity (processing speed or parallel processing capacity), and for transmission through the composite optical fiber cable 16, a broadband digital optical transmission of about 24 Gbps is also required.
[0078] Next, Figure 5 The processing performed by each unit under the control of the CPUs 20 and 40 in the case where 4K4x imaging, i.e., imaging of a 4-times speed 4K video format (59.94P x 4, 50P x 4), is performed, is illustrated.
[0079] In the imaging element unit 21, imaging is performed at 4-times speed. In the signal processing unit 22, the processing of the preprocessing unit 31 is performed at 4-times speed. However, the processing of the 4K video processing unit 32 is skipped. That is, video signal processing by the 4K video processing unit 32 is not performed on the camera 10 side.
[0080] The transmission unit 23 performs compression processing on the 4K4x video signal in a state where video signal processing is not performed. Then, the compressed video signal C4K is transmitted to the CCU 12.
[0081] Further, the conversion processing unit 33 of the signal processing unit 22 does not perform conversion processing in response to the fact that the processing of the 4K video processing unit 32 is not performed.
[0082] The compressed video signal C4K output from the camera 10 is input to the transmission unit 41 of the CCU 12. The transmission unit 41 performs decompression processing on the compression to obtain the 4K4x video signal before compression, and supplies the 4K4x video signal to the 4K video processing unit 51.
[0083] With the configuration illustrated in Figure 2 With the configuration illustrated in
[0084] Further, the 4K video processing unit 51 generates a 4K1x video signal using the configuration illustrated in Figure 2
[0085] Further, the HD video signal obtained by the formatter / conversion unit 42 is transmitted from the transmission unit 41 to the camera 10, and is supplied as a monitor video signal MV to the viewfinder from the transmission unit 23. That is, in this case, since the processing of the conversion processing unit 33 is not performed, the camera 10 receives the monitor video signal MV from the CCU 12 and performs the viewfinder display.
[0086] In the case of performing 4K4x imaging, the processing flow illustrated in FIG. 4 is performed. In this case, by using the 4K video processing unit 51 on the CCU 12 side, 4K4x imaging can be performed without providing the 4K video processing unit 32 having a processing speed or a 4-system parallel processing capability that is four times on the camera 10 side. Figure 5
[0087] Further, by performing the compression processing, an excessive band burden is not imposed in the transmission of the composite optical fiber cable 16.
[0088] Note that, for 4K4x imaging, the imaging and the preprocessing of the camera 10 require a processing capability (processing speed or parallel processing capability) that is four times, but the effect of the increase in the overall processing load of the camera 10 is less than that of the 4K video processing unit 32 compatible with four times speed.
[0089] <3. Processing Examples>
[0090] A processing example of the CPU 20 and the CPU 40 for realizing the operations illustrated in FIGS. 1, Figure 3 , Figure 4 and Figure 5 will be described. In the CPU 20 and the CPU 40, a program for performing the following processing is installed as a software option.
[0091] That is, when the option board 50 is attached to the CCU 12 and the corresponding option program is running in the CPU 20 and the CPU 40, the operations illustrated in FIGS. 1, Figure 3 , Figure 4 and Figure 5 can be performed.
[0092] Figure 6 is a processing example at the time of power-on.
[0093] After the power-on processing is performed in step S101, the CPU 20 of the camera 10 confirms that the software option is executable in step S102.
[0094] After the power-on processing is performed in step S201, the CPU 40 of the CCU 12 confirms that the software option is executable in step S202, and also confirms that the option board 50 has been attached.
[0095] With option board 50 removed, the aforementioned processing control cannot be performed, therefore CPU 40 terminates at step S203. Figure 6 In this case, 4K4x imaging cannot be performed.
[0096] Upon confirming the attachment of option plate 50, CPU 40 proceeds from step S203 to step S204 and notifies CPU 20 that CCU 12 is compatible with 4K4x. This notification also means that CPU 40 informs CPU 20 that CPU 40 itself is compatible with 4K4x and inquires whether CPU 20 (camera 10) is compatible with 4K4x imaging.
[0097] If, at some point after power-on processing, the CPU 20 receives a notification corresponding to 4K4x, the processing proceeds from step S110 to step S111, and the CPU 20 notifies itself of compatibility. Because... Figure 6 The diagram illustrates that through the processing of software options, CPU 20's notification to CPU 40 is also a compatible process.
[0098] CPU 40 receives a notification from CPU 20, thereby recognizing that camera 10 is also compatible with 4K4x imaging, and proceeds the processing from step S205 to step S206. In this case, CPU 20 performs 4K4x selectable settings.
[0099] For example, the display unit 44 shows that in addition to 4K1x and 4K2x, the 4K4x imaging mode is also selectable. Furthermore, via an operation device on the display unit 44 that functions as a GUI, a selection operation device for the 4K4x imaging mode is also provided, in addition to 4K1x and 4K2x.
[0100] Note that if a non-4K4x compatibility notification is received from CPU 20, or if no notification is received, CPU 40 terminates at step S205. Figure 6 In this case, 4K4x imaging is not an option.
[0101] Based on the above description Figure 6 The processing, for example, when the power is turned on, through... Figure 5 The method confirms whether the camera 10 side and CCU 12 side are compatible with 4K4x imaging. When both sides are compatible with 4K4x imaging, a display and operating device for 4K4x imaging are presented to the operator.
[0102] In the combination of the camera 10 and the CCU 12, there are cases where the option program is provided and cases where it is not provided, and there are cases where the option board 50 is installed in the CCU 12 and cases where it is not installed. That is, as the combination of the camera 10 and the CCU 12, those compatible with the 4K4x option are not always connected.
[0103] Thus, in order to confirm whether each of the camera 10 and the CCU 12 is compatible with the 4K4x, a process of confirming the state of each other (whether each of the camera 10 and the CCU 12 is compatible with the option) at power-on is required. In the present embodiment, in response to such a request, the process illustrated in Figure 6 is performed. Thus, an appropriate interface can be provided to the operator.
[0104] Note that Figure 6 The example of is an example in which the compatibility of the CPU 20 is confirmed from the CPU 40 side, but the CPU 20 with the software option can make an inquiry to the CPU 40 of the connected CCU 12, share the result, and perform the operation for 4K4x imaging.
[0105] Figure 7 The processing example in the case where the operator operates the 4K4x imaging as illustrated in Figure 5 will be illustrated.
[0106] When the 4K4x imaging operation of the operator is recognized, the CPU 40 proceeds from step S210 to step S211 and transmits a 4K4x execution notification to the CPU 20 of the camera 10.
[0107] Then, in step S212, the CPU 40 changes the internal process of the CCU 12. That is, as illustrated in Figure 3 or Figure 4 , the state in which the received 4K video signal is transmitted from the transmission unit 41 to the formatter / conversion unit 42 is changed to the state in which the received 4K video signal is transmitted from the transmission unit 41 to the 4K video processing unit 51 as illustrated in Figure 5 . In addition, the 4K1x video signal is input from the 4K video processing unit 51 to the formatter / conversion unit 42. Further, the HD signal is transmitted from the formatter / conversion unit 42 to the camera 10 through the transmission unit 41 for the viewfinder.
[0108] Further, in step S213, the CPU 40 instructs the transmission unit 41 to perform a decompression process on the received video signal, that is, the compressed video signal C4K.
[0109] In step S214, the CPU 40 causes the display unit 44 to perform a display instructing the operator to perform imaging and signal processing in 4K4x mode.
[0110] On the other hand, upon receiving a 4K4x execution notification from CPU 40, the CPU 20 of camera 10 proceeds from step S120 to step S121 and performs changes to the internal processes of camera 10. Specifically, CPU 20 instructs imaging element unit 21 to perform 4x speed imaging and instructs preprocessing unit 31 to perform 4x speed processing. Furthermore, CPU 20 instructs 4K video processing unit 32 to stop video signal processing and directly output the 4K4x video signal, and instructs conversion processing unit 33 to stop processing. The monitoring video signal MV for the viewfinder is also controlled to be an HD video signal received by transmission unit 23.
[0111] In addition, in step S122, the CPU 20 instruction transmission unit 23 compresses the 4K4x video signal and then transmits the 4K4x video signal to the CCU 12.
[0112] By conducting Figure 7 The above-described processing is performed by the camera 10 and CCU 12 in this embodiment as follows: Figure 5 The diagram shows a 4K 4x image.
[0113] <4. Summary and Variations>
[0114] According to the above embodiments, the following effects can be obtained.
[0115] The camera 10 (imaging device) according to an embodiment includes an imaging element unit 21 capable of outputting a 4x speed (mx speed) video signal at 4K resolution (a specific resolution), a signal processing unit 22 that partially processes video signals compatible with up to 2x speed (nx speed) at 4K resolution, a transmission unit 23 that transmits the video signal output from the signal processing unit 22 to a CCU 12 (imaging signal processing device), and a CPU 20 (control unit) that modifies the processing of the signal processing unit 22 when imaging at 4x speed at 4K resolution.
[0116] Furthermore, the CCU 12 (imaging signal processing device) according to the embodiment includes a transmission unit 41 that receives a video signal output from the camera 10, a 4K video processing unit 51 (signal processing unit) capable of performing partial processing of the video signal at 4x speed at 4K resolution in the camera 10, and a CPU 40 (control unit). When the camera 10 outputs a video signal at 4x speed at 4K resolution, the CPU 40 controls the 4K video processing unit 51 to perform processing of the video signal at 4x speed at 4K resolution.
[0117] As a result, for example, even in a case where 4K4x video signal processing cannot be performed in the camera 10, 4K4x video signal processing can be performed on the CCU 12 side, and high frame rate imaging can be performed. Thus, for example, 4K4x imaging can be realized by a 4K2x compatible camera 10 without imposing a processing load on the camera 10 side.
[0118] Note that, in the embodiment, an example of 4K is described as a specific resolution, and examples of 4-times speed (m = 4) and 2-times speed (n = 2) are described, but the present technology is not limited to this example. For example, the technology of the present disclosure is also applicable to a case where 8K resolution or 2K resolution is used as a specific resolution, and a case of other times speed.
[0119] In a case where 4K4x imaging is performed, the CPU 40 of the CCU 12 according to the embodiment performs processing of transmitting an execution notification of 4K4x imaging to the camera 10 (see step S211 in Figure 7 ).
[0120] In addition, the CPU 20 of the camera 10 according to the embodiment is described by giving an example in which the processing procedure of the signal processing unit 22 is changed in response to the execution notification of 4K4x imaging from the CCU 12 (see step S121 in Figure 7 ).
[0121] That is, the execution notification of 4K4x imaging is transmitted from the CCU 12 side to the camera 10, and the processing procedure of the signal processing unit 22 is changed in response to the execution notification on the camera 10 side. This allows the operator of the CCU 12 to instruct 4K4x imaging as one of the imaging options. Thus, high frame rate imaging can be performed by control from the CCU 12 side.
[0122] The CPU 40 of the CCU 12 according to the embodiment performs processing of transmitting the execution notification in response to an operation in which the user (operator) instructs 4K4x imaging (see steps S210 and S211 in Figure 7 ). When the CCU 12 transmits the 4K4x imaging execution notification to the camera 10 in response to an operation in which, for example, the operator selects 4K4x imaging, 4K4x imaging can be started by an arbitrary operation of the operator on the CCU 12 side.
[0123] Note that it is also possible to perform control so that the 4K4x execution notification is transmitted from the camera 10 side to the CCU 12 by an operation of the camera operator or the like. In this case, the CPU 20 and the CPU 40 can perform similar processing procedure changes and the like.
[0124] In the embodiment, an example in which the CPU 20 changes the processing procedure so that the signal processing unit 22 does not perform partial processing in the case where 4K4x imaging is performed is described (see step S121 in Figure 7
[0125] In the camera 10, the CPU 20, for example, skips processing that is not compatible with 4K4x. The video signal is transmitted to the CCU 12 in an unprocessed state. This prevents an increase in processing load.
[0126] The signal processing unit 22 according to the embodiment includes a preprocessing unit 31 capable of preprocessing a 4K4x video signal and a 4K video processing unit 32 capable of performing video signal processing of a high-to-4K2x video signal. Then, an example in which the CPU 20 changes the processing procedure so that the signal processing unit 22 does not perform video signal processing of the 4K video processing unit 32 in the case where 4K4x imaging is performed is described (see step S121 in Figure 7
[0127] The CPU 20 allows the signal processing unit 22 to skip processing of the 4K video processing unit 32 having the highest processing load. This makes it possible to perform high-frame-rate 4K4x imaging without increasing the processing load on the camera 10 side.
[0128] The signal processing unit 22 according to the embodiment includes a conversion processing unit 33 that performs conversion processing on a video signal that has undergone video signal processing of the 4K video processing unit 32 to generate a monitor video signal MV. Then, an example in which the CPU 20 changes the processing procedure so that the signal processing unit 22 does not perform conversion processing of the conversion processing unit 33 in the case where 4K4x imaging is performed is described (see step S121 in Figure 7
[0129] In addition, in the case where 4K4x imaging is performed, the CPU 40 of the CCU 12 performs control to transmit a monitor video signal MV based on 4K1x video signal processing by the 4K video processing unit 51 to the camera 10 (see step S212 in Figure 7
[0130] The CPU 20 also stops processing of the conversion processing unit 33 in response to processing of the 4K video processing unit 32 being skipped. This is because the monitor video signal MV displayed on the viewfinder is supplied from the CCU 12. As a result, it is possible to prevent unnecessary processing from being performed on the camera 10 side.
[0131] In the embodiment, in a case where the CPU 20 of the camera 10 performs 4K4x imaging, the transmission unit 23 performs control to transmit the compressed video signal C4K obtained by performing compression processing on the 4K video signal to the CCU 12 (see step S122 in Figure 7 ).
[0132] Further, in a case where 4K4x imaging is performed, the CPU 40 of the CCU 12 performs control to cause the transmission unit 41 to perform decompression processing on the received compressed video signal C4K (see step S213 in Figure 6 ).
[0133] As a result, in the case of 4K4x which requires wideband digital optical transmission, the transmission band burden can be reduced.
[0134] In the embodiment, an example is described in which the CPU 20 of the camera 10 performs processing to notify the CCU 12 side that the camera 10 side is also compatible with 4K4x imaging in response to a notification from the CCU 12 side of compatibility with 4K4x imaging (see Figure 2 ).
[0135] In the case of 4K4x, the camera 10 side becomes compatible with this by skipping the processing of the 4K video processing unit 32. The camera 10 according to the present embodiment includes a software option that allows the CPU 20 to skip the processing of the 4K video processing unit 32. That is, it is compatible with the video signal processing on the CCU 12 side corresponding to 4K4x. Then, the CPU 20 performs processing to notify the CCU 12 of compatibility with 4K4x. Through this notification, the CCU 12 side can be prepared as one imaging option capable of performing 4K4x imaging.
[0136] The 4K video processing unit 51 in the CCU 12 according to the embodiment is installed on a detachable option board 50, and the option board 50 is attached to the housing of the CCU 12, so that 4K4x video signals can be processed.
[0137] When the option board 50 is attached to the CCU 12, the 4K video processing unit 51 functions. As a result, the CCU 12 can have the function of the present embodiment in an extended manner, and 4K4x high frame rate imaging can be achieved with the camera 10 compatible with 4K2x.
[0138] Note that, as illustrated in Figure 6 , the 4K video processing unit 51 in the option board 50 of the embodiment includes four signal processing circuits 61, 62, 63, and 64 to achieve 4K4x video signal processing. In this case, by using three of the four signal processing circuits (for example, the signal processing circuits 61, 62, and 63), 4K3x video signal processing can be performed and output.
[0139] In an embodiment, an example in which the CPU 40 of the CCU 12 performs a process of transmitting a notification indicating that 4K4x imaging is compatible with the camera 10 side, and a process of enabling the user to select 4K4x imaging in response to receiving a notification indicating 4K4x imaging compatibility from the camera 10 side is described (see steps S204, S205, and S206 in Figure 7 ).
[0140] In a case where the camera 10 side is compatible with 4K4x imaging, that is, in a case where the CPU 20 includes a software option that allows skipping the processing of the 4K video processing unit 32, the CPU 40 sets 4K4x imaging as selectable. This allows the operator of the CCU 12 to instruct 4K4x imaging as one of the imaging options.
[0141] Note that it is also conceivable that the CPU 20 of the camera 10 side inquires the CPU 40 of the CCU 12 as to whether the camera 10 is compatible with 4K4x imaging, that is, whether the option board 50 is set and the video processing unit for 4K4x is compatible, in which case the CPU 40 sets 4K4x imaging as selectable.
[0142] In an embodiment, an example in which, in a case where 4K4x imaging is performed, the CPU 40 of the CCU 12 performs control so that the 4K video processing unit 51 performs 4-times speed video signal processing is described (see step S212 in Figure 7 ).
[0143] The CPU 40 causes the 4K video processing unit 51 to perform signal processing on the video signal received by the transmission unit 41. As a result, the processing skipped at the camera 10 side is performed at the CCU 12 side.
[0144] In an embodiment, an example in which, in a case where 4K4x imaging is performed, the CPU 40 of the CCU 12 performs control to present the fact to the user is described (see step S214 in ).
[0145] As a result, the user can recognize the state in which 4K4x imaging is performed.
[0146] Note that the effects described in this specification are merely examples and are not limiting, and other effects can be produced.
[0147] Note that the present technology can also adopt the following configurations.
[0148] (1) An imaging device including:
[0149] an imaging element unit capable of outputting a video signal of m-times speed at a certain resolution;
[0150] a signal processing unit in which a part of the processing is compatible with a video signal of up to n-times speed at the certain resolution, the n-times speed being lower than the m-times speed;
[0151] a transmission unit that transmits the video signal output from the signal processing unit to an imaging signal processing device; and
[0152] a control unit that changes a processing procedure of the signal processing unit when imaging of the m-times speed is performed at the certain resolution.
[0153] (2) The imaging device according to (1), wherein
[0154] the control unit
[0155] changes the processing procedure of the signal processing unit in response to a notification of execution of the imaging of the m-times speed at the certain resolution from the imaging signal processing device.
[0156] (3) The imaging device according to (1) or (2), wherein
[0157] the control unit changes the processing procedure so that the signal processing unit does not perform the part of the processing when the imaging of the m-times speed is performed at the certain resolution.
[0158] (4) The imaging device according to any one of (1) to (3), wherein
[0159] the signal processing unit includes:
[0160] a preprocessing unit capable of preprocessing the video signal of the m-times speed at the certain resolution; and
[0161] a video processing unit capable of performing video signal processing on a video signal of up to the n-times speed at the certain resolution, and
[0162] the control unit changes the processing procedure so that the signal processing unit does not perform the video signal processing of the video processing unit when the imaging of the m-times speed is performed at the certain resolution.
[0163] (5) The imaging device according to (4), wherein
[0164] the signal processing unit includes
[0165] a conversion processing unit that generates a monitoring video signal by performing conversion processing on a video signal that has undergone video signal processing by the video processing unit, and
[0166] the control unit
[0167] when the m-times speed imaging is performed at the specific resolution, the conversion processing by the conversion processing unit is not performed in the signal processing unit.
[0168] (6) The image forming apparatus according to any one of (1) to (5), wherein
[0169] the control unit
[0170] when the m-times speed imaging is performed at the specific resolution, the conversion processing by the conversion processing unit is not performed in the signal processing unit.
[0171] (7) The image forming apparatus according to any one of (1) to (6), wherein
[0172] the control unit
[0173] in response to a notification from the image signal processing apparatus indicating compatibility with the m-times speed imaging at the specific resolution, processing is performed to notify the image signal processing apparatus that the image forming apparatus is also compatible with the m-times speed imaging at the specific resolution.
[0174] (8) The image forming apparatus according to any one of (1) to (7), wherein
[0175] the specific resolution is a 4K resolution, the m-times speed is a 4-times speed, and the n-times speed is a 2-times speed.
[0176] (9) An image signal processing apparatus comprising:
[0177] a transmission unit that receives a video signal output from an image forming apparatus, the image forming apparatus including an image element unit capable of outputting a video signal at a specific resolution at an m-times speed, a partial processing compatible with a video signal at the specific resolution up to an n-times speed, the n-times speed being lower than the m-times speed;
[0178] a signal processing unit capable of performing the partial processing corresponding to the video signal at the m-times speed at the specific resolution in the image forming apparatus; and
[0179] a control unit that, in a case where the imaging device outputs the m-times speed video signal at the specific resolution, controls the signal processing unit to perform the partial processing for the m-times speed video signal at the specific resolution.
[0180] (10) The imaging signal processing apparatus according to (9), wherein
[0181] the signal processing unit is mounted on a detachable option board attached to a housing, so that the m-times speed video signal at the specific resolution output from the imaging device can be processed.
[0182] (11) The imaging signal processing apparatus according to (9) or (10), wherein
[0183] the control unit performs:
[0184] processing of sending a notification to the imaging device indicating that the imaging device is compatible with the m-times speed imaging at the specific resolution; and
[0185] processing of enabling a user to select the m-times speed imaging at the specific resolution in response to reception of the notification indicating that the imaging device is compatible with the m-times speed imaging.
[0186] (12) The imaging signal processing apparatus according to any one of (9) to (11), wherein
[0187] the control unit
[0188] when the m-times speed imaging at the specific resolution is performed, performs processing of sending an execution notification of the m-times speed imaging at the specific resolution to the imaging device.
[0189] (13) The imaging signal processing apparatus according to (12), wherein
[0190] the control unit
[0191] in response to an operation of the m-times speed imaging at the specific resolution by a user's instruction, performs the processing of sending the execution notification.
[0192] (14) The imaging signal processing apparatus according to any one of (9) to (13), wherein
[0193] the control unit
[0194] in a case where the imaging device performs the m-times speed imaging at the specific resolution, controls the signal processing unit to perform the video signal processing at the m-times speed at the specific resolution.
[0195] (15) The imaging signal processing apparatus according to any one of (9) to (14), wherein
[0196] the control unit
[0197] In a case where the imaging device performs the m-times speed imaging at the specific resolution, the control is performed to cause the transmission unit to perform a decompression process on the received video signal.
[0198] (16) The imaging signal processing apparatus according to any one of (9) to (15), wherein
[0199] the control unit
[0200] In a case where the imaging device performs the m-times speed imaging at the specific resolution, the control is performed to present to a user that the m-times speed imaging is performed at the specific resolution.
[0201] (17) The imaging signal processing apparatus according to any one of (9) to (16), wherein
[0202] the control unit
[0203] In a case where the imaging device performs the m-times speed imaging at the specific resolution, the control is performed so that a monitoring signal based on a video signal process by the signal processing unit is transmitted to the imaging device.
[0204] (18) An imaging system including: an imaging device; and an imaging signal processing apparatus, wherein
[0205] the imaging device includes:
[0206] an imaging element unit capable of outputting an m-times speed video signal at a specific resolution;
[0207] a first signal processing unit in which a part of a process is compatible with a video signal up to an n-times speed at the specific resolution, the n-times speed being lower than the m-times speed;
[0208] a first transmission unit that transmits a video signal output from the first signal processing unit to the imaging signal processing apparatus; and
[0209] a first control unit that changes a process of the first signal processing unit when the m-times speed imaging is performed at the specific resolution, and
[0210] the imaging signal processing apparatus includes:
[0211] a second transmission unit that receives a video signal output from the imaging device;
[0212] A second signal processing unit, capable of performing the partial processing in the imaging device corresponding to the video signal at m times the speed at the specific resolution; and
[0213] A second control unit controls the second signal processing unit to perform partial processing on the video signal at the specific resolution when the imaging device outputs the video signal at the m-fold speed at the specific resolution.
[0214] In addition, this technology can also adopt the following configurations (100) and (101).
[0215] In addition, (100) below can combine the technical elements (2) to (8) above, and (101) below can combine the technical elements (10) to (17) above.
[0216] (100) An imaging method, wherein
[0217] Imaging equipment includes:
[0218] An imaging element unit, which is capable of outputting a video signal at m times the speed at a specific resolution;
[0219] The signal processing unit, wherein a portion of the processing is compatible with video signals at the specific resolution at speeds up to n times faster than the m times faster; and
[0220] A transmission unit that transmits the video signal output from the signal processing unit to an imaging signal processing device; and
[0221] When performing the m-times imaging at the specific resolution, the imaging device modifies the processing procedure of the signal processing unit.
[0222] (101) An imaging signal processing method,
[0223] The imaging signal processing equipment includes:
[0224] A transmission unit receives a video signal output from an imaging device, the imaging device including an imaging element unit capable of outputting a video signal at m times the speed at a specific resolution, and partially processing video signals compatible with up to n times the speed at the specific resolution, where n times the speed is lower than m times the speed; and
[0225] The signal processing unit is capable of performing the partial processing in the imaging device corresponding to the video signal at the specific resolution and the m-times speed; and
[0226] In a case where the imaging device outputs the m-times video signal at the specific resolution, the imaging signal processing device causes the signal processing unit to perform the partial processing for the m-times video signal at the specific resolution.
[0227] List of Reference Signs
[0228] 1 System camera
[0229] 10 Camera
[0230] 12 CCU
[0231] 16 Composite fiber cable
[0232] 20 CPU
[0233] 21 Imaging element unit
[0234] 22 Signal processing unit
[0235] 23 Transmission unit
[0236] 31 Preprocessing unit
[0237] 32 4K video processing unit
[0238] 33 Conversion processing unit
[0239] 40 CPU
[0240] 41 Transmission unit
[0241] 42 Formatter / conversion unit
[0242] 43 Input unit
[0243] 44 Display unit
[0244] 45 Operation unit
[0245] 50 Option board
[0246] 51 4K video processing unit
Claims
1. An imaging device, comprising: An imaging element unit, which is capable of outputting a video signal at m times the speed at a specific resolution; A signal processing unit, wherein a portion of the processing is compatible with video signals at the specific resolution at speeds up to n times faster than the m times faster; A transmission unit that transmits the video signal output from the signal processing unit to an imaging signal processing device; as well as The control unit modifies the processing procedure of the signal processing unit when performing the m-times imaging at the specific resolution.
2. The imaging device according to claim 1, wherein The control unit In response to an execution notification from the imaging signal processing device regarding the m-times imaging at the specific resolution, the processing procedure of the signal processing unit is modified.
3. The imaging device according to claim 1, wherein When imaging at the specified resolution at m times the speed is performed, the control unit changes the processing procedure so that the signal processing unit does not perform the aforementioned part of the processing.
4. The imaging device according to claim 1, wherein The signal processing unit includes: A preprocessing unit is capable of preprocessing the video signal at the specific resolution and speed of m times. and A video processing unit, capable of processing video signals at the specific resolution up to n times the speed, and When imaging at the specified resolution at m times the speed is performed, the control unit changes the processing procedure so that the signal processing unit does not perform the video signal processing of the video processing unit.
5. The imaging device according to claim 4, wherein The signal processing unit includes A conversion processing unit generates a surveillance video signal by converting the video signal processed by the video processing unit. The control unit When imaging at the specified resolution at m times the speed is performed, the processing procedure is changed so that the conversion processing of the conversion processing unit is not performed in the signal processing unit.
6. The imaging device according to claim 1, wherein The control unit When imaging at the specified resolution at m times the speed is performed, control is applied to compress the video signal using the transmission unit, and then the video signal is transmitted to the imaging signal processing device.
7. The imaging device according to claim 1, wherein The control unit In response to a notification from the imaging signal processing device indicating compatibility with the m-times imaging at the specific resolution, a process is performed to notify the imaging signal processing device that the imaging device side is also compatible with the m-times imaging at the specific resolution.
8. The imaging device according to claim 1, wherein The specific resolution is 4K resolution, the m-times speed is 4x speed, and the n-times speed is 2x speed.
9. An imaging signal processing device, comprising: A transmission unit receives a video signal output from an imaging device, the imaging device including an imaging element unit capable of outputting a video signal at m times the speed at a specific resolution, and partially processing video signals at up to n times the speed at the specific resolution, wherein the n times speed is lower than the m times speed; A signal processing unit, the signal processing unit being capable of performing the partial processing in the imaging device corresponding to the video signal at m times the speed at the specific resolution; as well as A control unit, which controls the signal processing unit to perform the partial processing of the video signal at the specific resolution when the imaging device outputs the video signal at the m times speed at the specific resolution.
10. The imaging signal processing apparatus according to claim 9, wherein The signal processing unit is mounted on a removable option plate, which is attached to the housing, thereby enabling the processing of the video signal at the specific resolution and speed of m times output from the imaging device.
11. The imaging signal processing apparatus according to claim 9, wherein The control unit performs: The processing of sending a notification to the imaging device indicating that the imaging device is compatible with the mx speed imaging at the specific resolution; and Upon receiving a notification indicating that the imaging device is compatible with the mx speed imaging, the user is enabled to select the processing of the mx speed imaging at the specific resolution.
12. The imaging signal processing apparatus according to claim 9, wherein The control unit When performing the m-times imaging at the specific resolution, a process is performed to send an execution notification for the m-times imaging at the specific resolution to the imaging device.
13. The imaging signal processing apparatus according to claim 12, wherein The control unit In response to the user's instruction to perform the m-times imaging operation at a specific resolution, the process of sending the execution notification is performed.
14. The imaging signal processing apparatus according to claim 9, wherein... The control unit When the imaging device performs the m-times imaging at the specific resolution, the signal processing unit is controlled to perform the m-times video signal processing at the specific resolution.
15. The imaging signal processing apparatus according to claim 9, wherein... The control unit When the imaging device performs the m-times imaging at the specific resolution, control is performed to cause the transmission unit to perform decompression processing on the received video signal.
16. The imaging signal processing apparatus according to claim 9, wherein The control unit When the imaging device performs the m-times imaging at the specific resolution, control is performed to present the m-times imaging to the user at the specific resolution.
17. The imaging signal processing apparatus according to claim 9, wherein The control unit When the imaging device performs the m-times imaging at the specific resolution, control is performed such that a monitoring signal based on the video signal processed by the signal processing unit is sent to the imaging device.
18. An imaging system, comprising: Imaging equipment; And imaging signal processing equipment, among which The imaging device includes: An imaging element unit, which is capable of outputting a video signal at m times the speed at a specific resolution; A first signal processing unit, wherein a portion of the processing is compatible with video signals at the specific resolution at speeds up to n times the speed, where the n times the speed is less than the m times the speed. A first transmission unit, which transmits the video signal output from the first signal processing unit to the imaging signal processing device; and When performing the m-times imaging at the specific resolution, the first control unit modifies the processing procedure of the first signal processing unit, and The imaging signal processing device includes: A second transmission unit receives a video signal output from the imaging device; A second signal processing unit, capable of performing the partial processing in the imaging device corresponding to the video signal at m times the speed at the specific resolution; and The second control unit controls the second signal processing unit to perform the partial processing of the video signal at the specific resolution when the imaging device outputs the video signal at the m times speed at the specific resolution.