Electronic apparatus

Abstract

To provide a technique capable of adjusting the image quality of a picked-up image while preventing an increase in the processing load of an electronic apparatus, regardless of whether a camera (imaging apparatus) can be remotely controlled.SOLUTION: An electronic apparatus of the present invention can be connected with one or more imaging apparatuses, and the electronic apparatus has: instruction means that, in adjusting the image quality of a picked-up image obtained by the imaging apparatus connected to the electronic apparatus, when the imaging apparatus is an apparatus that can be controlled from the electronic apparatus, instructs the imaging apparatus to adjust the image quality of the picked-up image; and processing means that, in adjusting the image quality of the picked-up image obtained by the imaging apparatus connected to the electronic apparatus, when the imaging apparatus is not the apparatus that can be controlled from the electronic apparatus, performs image processing for adjusting the image quality of the picked-up image.SELECTED DRAWING: Figure 5A

Description

[Technical Field]

[0001] The present invention relates to electronic devices, and more particularly to adjusting the quality of captured images. [Background technology]

[0002] There are known techniques for displaying multiple captured images obtained by multiple cameras side by side, such as picture-in-picture (PinP), and techniques for switching the displayed image between the multiple captured images. For example, the technique for switching the displayed image between the multiple captured images is used to provide multi-angle video. When using these techniques, it is preferable to adjust the image quality to match the color and brightness of the multiple captured images.

[0003] Patent Document 1 discloses a technique for adjusting the image quality of a captured image by remotely controlling a camera. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Laid-Open No. 2007-266781 Summary of the Invention [Problem to be solved by the invention]

[0005] However, the technology disclosed in Patent Document 1 cannot adjust the image quality of captured images when a camera that cannot be remotely controlled is used. If an electronic device is configured to acquire multiple captured images corresponding to multiple cameras and adjust the image quality of each captured image through image processing, it can also adjust the image quality of images captured by a camera that cannot be remotely controlled. However, such a configuration increases the processing load on the electronic device. An increase in the processing load on the electronic device can result in a decrease in image quality, such as an inability to smoothly play back images on the electronic device and unstable movement in the image. Furthermore, the internal temperature of the electronic device can rise, causing image quality adjustment to stop.

[0006] The present invention aims to provide a technique that can adjust the image quality of a captured image while suppressing an increase in the processing load of an electronic device, regardless of whether the camera (image capture device) can be remotely controlled. [Means for solving the problem]

[0007] The electronic device of the present invention is an electronic device to which one or more imaging devices can be connected, and is characterized in that it has: an instruction means for instructing the imaging device to adjust the image quality of the captured image when adjusting the image quality of the captured image obtained by the imaging device connected to the electronic device, if the imaging device is a device that can be controlled from the electronic device; and a processing means for performing image processing to adjust the image quality of the captured image when adjusting the image quality of the captured image obtained by the imaging device connected to the electronic device, if the imaging device is not a device that can be controlled from the electronic device. [Effects of the Invention]

[0008] According to the present invention, it is possible to adjust the image quality of a captured image while suppressing an increase in the processing load of an electronic device, regardless of whether or not the camera (image capture device) can be remotely controlled. [Brief explanation of the drawings]

[0009] [Figure 1] FIG. 1 is a schematic diagram illustrating an example of a system configuration. [Figure 2] FIG. 2 is a block diagram showing an example of the configuration of an imaging control device. [Figure 3] FIG. 2 is a block diagram showing an example of the configuration of a camera. [Figure 4] FIG. 2 is a schematic diagram showing an example of a data flow in an imaging control device. [Figure 5A] 10 is a flowchart illustrating an example of the operation of the imaging control device. [Figure 5B] 10 is a flowchart illustrating an example of image quality adjustment processing. [Figure 6] FIG. 10 is a schematic diagram illustrating an example of a GUI screen. [Figure 7] 10 is a flowchart showing an example of the operation of the camera. DETAILED DESCRIPTION OF THE INVENTION

[0010] Hereinafter, an embodiment of the present invention will be described with reference to the drawings.

[0011] FIG. 1 is a schematic diagram showing an example of the configuration of a system according to this embodiment. The system according to this embodiment includes an imaging control device as an example of an electronic device to which the present invention is applied, and one or more imaging devices (cameras). One or more imaging devices can be connected to the imaging control device. In FIG. 1, three cameras 310, 320, and 330 are connected to the imaging control device 200 via wired or wireless connections. The wireless connection may be a direct connection via P2P or a connection via an IP network. Each of the cameras 310, 320, and 330 transmits video data of captured images to the imaging control device 200. The video data includes image data representing the captured images, which may be moving images or still images. The video data may further include audio data, audio analysis data, subtitle data, etc.

[0012] The imaging control device 200 is also connected to a distribution system 250. The distribution system may or may not be considered part of the system according to this embodiment (a system including the cameras 310, 320, and 330 and the imaging control device 200). The distribution system 250 is a system that simultaneously distributes video to multiple viewers. The distribution system 250 is used for a variety of services, and simultaneously distributes video for a variety of purposes and uses, such as entertainment, promotion, and training.

[0013] The imaging control device 200 transmits the video data received from the cameras 310, 320, and 330 to the distribution system 250. The imaging control device 200 may or may not transmit the video data received from the cameras 310, 320, and 330 to the distribution system 250 as is. The imaging control device 200 may apply image processing to the video data received from the cameras 310, 320, and 330 and transmit the processed video data to the distribution system 250. Image processing includes, for example, conversion processing that converts the data format of the video data into a data format suitable for distribution. The imaging control device 200 also has a function of selecting at least one of the three pieces of video data received from the cameras 310, 320, and 330. For example, the imaging control device 200 transmits the selected video data to the distribution system 250. The process of selecting video data may be interpreted as a process of selecting at least one of the cameras 310, 320, and 330.

[0014] 2 is a block diagram showing an example of the configuration of the imaging control device 200. The imaging control device 200 may be, for example, a smartphone, a tablet device, or a personal computer.

[0015] The nonvolatile memory 205 is an electrically erasable and recordable memory, such as a Flash-ROM. The nonvolatile memory 205 stores constants and programs for the operation of the system control unit 202. The programs referred to here refer to programs for executing various flowcharts described later in this embodiment. The nonvolatile memory 205 can also store various information, such as various setting information and video data acquired from a camera.

[0016] The system control unit 202 is a control unit made up of at least one processor or circuit, and controls the entire imaging control device 200. Each process of this embodiment, which will be described later, is realized by executing a program recorded in the nonvolatile memory 205. The system memory 206, for example, is a RAM, and stores constants and variables for the operation of the system control unit 202, programs read from the nonvolatile memory 205, and the like.

[0017] The system control unit 202 has an image quality adjustment determination unit 202A, an image processing unit 202B, a remote control unit 202C, and an image creation unit 202D. The image quality adjustment determination unit 202A determines whether the camera connected to the communication I / F unit 207 is a remotely controllable camera (a device controllable from the imaging control device 200) and determines (determines) the device that will perform image quality adjustment of the captured image. When the image quality adjustment determination unit 202A determines that image quality adjustment will be performed by the imaging control device 200, the image processing unit 202B performs image processing for adjusting the image quality of the captured image. When the image quality adjustment determination unit 202A determines that image quality adjustment will be performed by the camera, the remote control unit 202C instructs the camera to adjust the image quality of the captured image. The image creation unit 202D selects the image data described above and creates (generates) image data to be displayed on the display unit 209 or output externally. For example, the video creation unit 202D determines the video data of the captured image after image quality adjustment as the video data to be output to the outside (for example, the distribution system 250).

[0018] The system timer 208 is a timekeeping unit that measures the time used for various controls and the time of a built-in clock.

[0019] The power button 203 is an operating member for switching the power supply to the imaging control device 200 on and off. The power supply control unit 204 includes a DC-DC converter, a switch circuit for switching between blocks to which electricity is applied, and the like. The power supply control unit 204 controls the DC-DC converter based on instructions from the system control unit 202, and supplies the required voltage for the required period to the required parts in the imaging control device 200. The power supply control unit 204 may also include primary batteries such as alkaline batteries or lithium batteries, secondary batteries such as NiCd batteries, NiMH batteries, or Li batteries, an AC adapter, and the like.

[0020] The display unit 209 is, for example, a liquid crystal display, and displays images, characters, etc. The display unit 209 may be a touch screen having a touch input function.

[0021] The communication I / F unit 207 is an interface that connects to an external device wirelessly or via a wire and transmits and receives data to and from the external device. All data transmission and reception with the outside when receiving video data from the camera, displaying the video data on the display unit 209, or transmitting the video data to the distribution system 250 is performed via the communication I / F unit 207.

[0022] The automatic image quality adjustment button 210 is an operating member for setting whether or not to automatically adjust the image quality of a captured image. Hereinafter, automatically adjusting the image quality of a captured image will be referred to as automatic image quality adjustment. When the automatic image quality adjustment button 210 is in the OFF state, automatic image quality adjustment is not performed, and when it is in the ON state, automatic image quality adjustment is performed. Note that the imaging control device 200 does not necessarily have to have the automatic image quality adjustment button 210. The system control unit 202 may always perform automatic image quality adjustment.

[0023] The reference button 211 is an operation member for selecting a camera (reference camera) that serves as a reference when adjusting the image quality of a captured image. The selection of the reference camera may be interpreted as the selection of another captured image (reference image) that serves as a reference when adjusting the image quality of the captured image.

[0024] The cameras 310, 320, and 330 are connected to the communication I / F unit 207. The system control unit 202 may store the video streams and video files created by the video creation unit 202D as recorded data in a storage medium (for example, the nonvolatile memory 205 or an external storage device).

[0025] 3 is a block diagram showing an example of the configuration of a camera 310 (digital camera) as an example of an imaging device. The camera 310 is a camera that can be remotely controlled. Note that the imaging device is not limited to a camera and may be, for example, a smartphone, a tablet device, a personal computer, or the like.

[0026] Control unit 301 controls each unit of camera 310 in accordance with input signals and programs described below. Control unit 301 has setting value management unit 301A and image quality adjustment unit 301B. Setting value management unit 301A transmits current setting values ​​to the outside via communication I / F unit 308 in response to a setting value transmission request from the outside. Image quality adjustment unit 301B changes setting values ​​(performs image quality adjustment) in response to a setting value change request (image quality adjustment request) from the outside.

[0027] The imaging unit 302 converts the subject light imaged by the lens included in the imaging unit 302 into an electrical signal, performs noise reduction processing, etc., and outputs video data as digital data. The captured video data is stored in a buffer memory, then undergoes predetermined processing by the control unit 301, and is recorded on a recording medium 307.

[0028] The nonvolatile memory 303 is an electrically erasable and recordable nonvolatile memory, and stores the programs executed by the control unit 301 and the like.

[0029] The system memory 304 is used as a buffer memory for temporarily storing video data captured by the imaging unit 302, as an image display memory for the display unit 306, as a work area for the control unit 301, and the like.

[0030] The operation unit 305 is used to receive instructions for the camera 310 from the user. The operation unit 305 includes, for example, operation members such as a power button used by the user to turn the power of the camera 310 on / off, a release switch used to instruct shooting, and a playback button used to instruct playback of video data. The operation unit 305 also includes a touch panel formed on the display unit 306. The release switch includes switches SW1 and SW2. When the release switch is pressed halfway, switch SW1 turns ON. This allows instructions to perform shooting preparations such as AF (autofocus) processing, AE (auto exposure) processing, AWB (auto white balance) processing, and EF (pre-flash) processing to be received. When the release switch is pressed fully, switch SW2 turns ON. This allows instructions to perform shooting preparations.

[0031] The display unit 306 displays live view images that show the subject in almost real time, captured (recorded) captured images, characters for interactive operation, etc. The camera 310 does not necessarily have to incorporate the display unit 306. The camera 310 can be connected to an internal or external display unit 306, and it is sufficient that the camera 310 has at least a display control function for controlling the display on the display unit 306.

[0032] The recording medium 307 can store the video data output from the imaging unit 302. The recording medium 307 may be detachable from the camera 310, or may be internal to the camera 310. The camera 310 may have at least the function of accessing the recording medium 307.

[0033] The communication I / F unit 308 is an interface for connecting to an external device (for example, the imaging control device 200). The camera 310 can exchange data with the external device via the communication I / F unit 308. The communication I / F unit 308 includes, for example, an interface for communicating with the external device via wireless LAN. The control unit 301 controls the communication I / F unit 308 to achieve wireless communication with the external device. Note that the communication method is not limited to wireless LAN.

[0034] Camera 320 is also a remotely controllable camera and has the same configuration as camera 310. Camera 330 is a non-remotely controllable camera and has the same configuration as camera 310, but does not have setting value management unit 301A and image quality adjustment unit 301B.

[0035] FIG. 4 is a schematic diagram showing an example of a data flow in the imaging control device 200. As shown in FIG.

[0036] The system control unit 202 performs video data reception processing 402. In the reception processing 402, the system control unit 202 receives video data from a camera connected to the imaging control device 200 via the communication I / F unit 207, and stores the received video data in the system memory 206. In the reception processing 402, for example, the system control unit 202 receives video data in RTMP format, converts the received video data in RTMP format into video data in FLV format, and stores the resulting video data in the system memory 206.

[0037] System control unit 202 performs DEMUX processing 403 on the FLV format video data stored in system memory 206. DEMUX processing 403 separates the FLV format video data into image data (data representing only images (video) and no audio) and audio data (data representing audio). For example, FLV format video data is separated into H.264 or H.265 format image data and AAC format audio data.

[0038] The system control unit 202 performs image decoding processing 404 on the image data obtained by the DEMUX processing 403, and performs audio decoding processing 405 on the audio data obtained by the DEMUX processing 403. The image data and audio data obtained by the DEMUX processing 403 have been subjected to advanced encoding processing, and the image data and audio data are decoded into data in a general-purpose data format by the image decoding processing 404 and audio decoding processing 405. Decoding the image data and audio data into data in a general-purpose data format makes it possible to process the data (processing processing 406) and play it back (playback processing 407).

[0039] In the processing 406, the system control unit 202 processes the image data and audio data (data in a general-purpose data format) obtained by the image decoding process 404 and audio decoding process 405. The processing 406 includes the image processing for adjusting the image quality of the captured image described above.

[0040] In the playback process 407, the system control unit 202 displays an image (video) on the display unit 209 based on the image data obtained by the image decoding process 404 or the image data after the processing process 406 (both of which are data in a general-purpose data format). Also, in the playback process 407, the system control unit 202 outputs audio from a speaker (not shown) or the like based on the audio data obtained by the audio decoding process 405 or the audio data after the processing process 406 (both of which are data in a general-purpose data format).

[0041] The system control unit 202 outputs the video data to an external device (for example, a distribution system 250). In this case, image encoding processing 408, audio encoding processing 409, MUX processing 410, and transmission processing 411 are performed.

[0042] The image encoding process 408 and the audio encoding process 409 are advanced encoding processes. In the image encoding process 408, for example, the image data obtained by the image decoding process 404 or the image data after the processing process 406 (both of which are data in a general-purpose data format) is converted into image data in the H.264 format or the H.265 format. In the audio encoding process 409, for example, the audio data obtained by the audio decoding process 405 or the audio data after the processing process 406 (both of which are data in a general-purpose data format) is converted into audio data in the AAC format.

[0043] In the MUX process 410, the image data and audio data obtained by the image decoding process 404 and audio decoding process 405 are integrated to obtain video data representing images (video) and audio. For example, video data in FLV format is obtained.

[0044] In transmission processing 411, the video data obtained by MUX processing 410 is output to the outside. For example, system control unit 202 converts the video data obtained by MUX processing 410 into data in a data format for streaming and transmits it to distribution system 250. Note that the data format of the video data to be output to the outside is not particularly limited, and for example, system control unit 202 determines a data format that can be received by distribution system 250 as the data format of the video data to be output to the outside. The data formats at each of the other stages are also not particularly limited.

[0045] Fig. 5A is a flowchart showing an example of the operation of the imaging control device 200. The operation of Fig. 5A is realized by the system control unit 202 expanding a program (for example, a camera control application program) recorded in the non-volatile memory 205 into the system memory 206 and executing the program. For example, when a user issues an instruction to start the camera control application, the system control unit 202 starts the operation of Fig. 5A. The operation of Fig. 5A may be performed repeatedly at a predetermined cycle, or may be performed each time a new camera is connected to the imaging control device 200 or a camera is disconnected from the imaging control device 200.

[0046] In S501, the system control unit 202 receives video data (captured images) from the cameras (cameras 310, 320, 330) connected to the imaging control device 200 via the communication I / F unit 207.

[0047] In S502, the system control unit 202 (image quality adjustment determination unit 202A) determines whether or not to perform image quality adjustment on the captured image. If the system control unit 202 determines that image quality adjustment should be performed, the process proceeds to S503; otherwise, the operation of Fig. 5A ends. Note that S502 may be omitted, and the process may always proceed from S501 to S503.

[0048] For example, the user can instruct whether to perform image quality adjustment (automatic image quality adjustment) by operating the automatic image quality adjustment button 210 or by touching the display unit 209 (touch screen). The setting value for performing / not performing image quality adjustment is stored in the nonvolatile memory 205, and the system control unit 202 updates the setting value for performing / not performing image quality adjustment in response to the above operation by the user. In S502, the system control unit 202 refers to the setting value for performing / not performing image quality adjustment and determines whether to perform image quality adjustment.

[0049] In S503, the system control unit 202 (image quality adjustment determination unit 202A) selects a camera (reference camera) that will be the reference for image quality adjustment. For example, the user can specify (change) the reference camera by operating the reference button 211 or by touching the display unit 209 (touch screen). The setting values ​​for the reference camera are stored in the nonvolatile memory 205. The system control unit 202 updates the setting values ​​of the reference camera in response to the above operation by the user. In S503, the system control unit 202 refers to the setting values ​​of the reference camera and selects a reference camera. Note that the system control unit 202 may select (determine) as the reference camera the camera that is the output source of the video data that was first received, or may select the reference camera according to other rules.

[0050] The processes of S504 to S513 are performed individually for each camera (cameras 310, 320, and 330) connected to the imaging control device 200. Here, it is assumed that camera 310 is the reference camera. It is also assumed that cameras 310 and 320 are remotely controllable cameras, and camera 330 is not remotely controllable.

[0051] In S504, system control unit 202 (image quality adjustment determination unit 202A) determines whether the camera (target camera) that is the processing target of S504 to S513 is the reference camera selected in S503. If system control unit 202 determines that the target camera is the reference camera, it ends the processing of S504 to S513 for the target camera, and if not, it proceeds to S505. If the target camera is camera 310, camera 310 is the reference camera, and so the processing of S504 to S513 for camera 310 ends.

[0052] In S505, the system control unit 202 (image quality adjustment determination unit 202A) determines whether the target camera is a remotely controllable camera. If the system control unit 202 determines that the target camera is a remotely controllable camera, the process proceeds to S507; otherwise, the process proceeds to S506. If the target camera is camera 320, camera 320 is a remotely controllable camera, so the process proceeds to S507. If the target camera is camera 330, camera 330 is not a remotely controllable camera, so the process proceeds to S506. The determination of whether remote control is possible is, for example, a determination of whether two-way communication of a specific communication protocol (e.g., HTTP) is possible.

[0053] (If the target camera cannot be remotely controlled) In S506, the system control unit 202 performs image quality adjustment processing.

[0054] FIG. 5B is a flowchart showing an example of the image quality adjustment process performed in S506.

[0055] In S515, the system control unit 202 (image quality adjustment determination unit 202A) determines whether the value of the processing load of the imaging control device 200 or the internal temperature of the imaging control device 200 is higher than a threshold value. If the system control unit 202 determines that the value of the processing load of the imaging control device 200 or the internal temperature of the imaging control device 200 is higher than the threshold value, the process proceeds to S518; otherwise, the process proceeds to S516. Note that only one of the determination of the processing load and the determination of the temperature may be performed.

[0056] In S516, the system control unit 202 (image processing unit 202B) determines parameters (image quality adjustment values) for adjusting the image quality of the image data (target image) received from the target camera.

[0057] For example, the system control unit 202 detects a specific subject (the same subject) from both an image captured by the reference camera (reference image) and an image captured by the target camera (target image). The system control unit 202 determines the area of ​​the specific subject in the reference image and the area of ​​the specific subject in the target image as evaluation areas.

[0058] Then, the system control unit 202 determines an image quality adjustment value according to the difference between the color tone and brightness of the evaluation area of ​​the reference image and the color tone and brightness of the evaluation area of ​​the target image. The system control unit 202 calculates parameters Y, Wb, and Wr for each of the evaluation areas of the reference image and the target image using the following equations: Parameter Y indicates the brightness of the evaluation area, and parameters Wb and Wr indicate the color of the evaluation area. Parameter R is a representative value (average, maximum, minimum, mode, median, etc.) of the R value (red gradation value) of each pixel in the evaluation area. Similarly, parameter G is a representative value of the G value (green gradation value) of each pixel in the evaluation area, and parameter B is a representative value of the B value (blue gradation value) of each pixel in the evaluation area. Then, the system control unit 202 calculates the difference between the parameters Y, Wb, and Wr of the evaluation area of ​​the reference image and the parameters Y, Wb, and Wr of the evaluation area of ​​the target image as the image quality adjustment value. Y = 3 × R + 6 × G + 1 × B Wb=G / B Wr=G / R

[0059] In S517, the system control unit 202 (image processing unit 202B) adjusts the image quality of the target image by image processing using the image quality adjustment value determined in S516. For example, the system control unit 202 performs image processing to match (bring closer) the color and brightness of the evaluation area of ​​the target image to the color and brightness of the evaluation area of ​​the reference image. Note that if the color and brightness of the evaluation area of ​​the reference image and the color and brightness of the evaluation area of ​​the target image approximately match, image processing for image quality adjustment does not need to be performed. "Approximate match" includes "perfect match."

[0060] Since the processing load of S516 and S517 is large, if the processing load value of the imaging control device 200 or the internal temperature of the imaging control device 200 is higher than the threshold, the process proceeds from S515 to S518.

[0061] In S518, the system control unit 202 (video processing unit 202B) switches processing in accordance with the user settings (user setting values ​​stored in the nonvolatile memory 205). Here, it is assumed that there are four types of user settings: "continue," "stop," "only when displayed," and "only when output to an external device."

[0062] "Continue" is a user setting that performs image quality adjustment even when the processing load value of the imaging control device 200 or the internal temperature of the imaging control device 200 is higher than a threshold value. If the system control unit 202 determines that "Continue" is set, the process proceeds to S516.

[0063] "Stop" is a user setting that does not perform image quality adjustment when the processing load value of the imaging control device 200 or the internal temperature of the imaging control device 200 is higher than a threshold. If the system control unit 202 determines that "Stop" is set, it ends the image quality adjustment process of Fig. 5B.

[0064] "Only when displayed" is a user setting that adjusts image quality only in a specific situation where the target image is displayed on the display unit 209 when the processing load value of the imaging control device 200 or the internal temperature of the imaging control device 200 is higher than a threshold. If the system control unit 202 determines that "Only when displayed" is set, the process proceeds to S519.

[0065] "Only when outputting to external devices" is a user setting that adjusts image quality only in specific situations where the target image is output externally from the imaging control device 200 when the processing load value of the imaging control device 200 or the internal temperature of the imaging control device 200 is higher than a threshold. If the system control unit 202 determines that "Only when outputting to external devices" is set, the process proceeds to S522.

[0066] 6 is a schematic diagram showing an example of a GUI screen for selecting a captured image to be displayed on the display unit 209 or a captured image to be output to an external device (for example, the distribution system 250). A GUI screen 600 in FIG. 6 is displayed on the display unit 209 by the system control unit 202. GUI screen In the image 600, captured images (thumbnail images) 601, 602, and 603 of the cameras 310, 320, and 330 are displayed side by side. The user can specify one of the captured images 601, 602, and 603 by touching the display unit 209 (touch screen) or by operating other buttons. The system control unit 202 selects the captured image specified by the user as the captured image to be displayed on the display unit 209 or the captured image to be output to an external device. A selection frame 604 is displayed around the selected captured image. Note that the system control unit 202 may select the captured image to be displayed on the display unit 209 or the captured image to be output to an external device in response to a user operation or may automatically select it. The system control unit 202 may select one captured image or multiple captured images.

[0067] Returning to the explanation of Fig. 5B, in S519, system control unit 202 (image quality adjustment determination unit 202A) determines whether or not the target image has been selected as an image to be displayed on display unit 209. If system control unit 202 determines that the target image has been selected as an image to be displayed on display unit 209, it proceeds to S520; otherwise, it ends the image quality adjustment process of Fig. 5B.

[0068] S520 is the same as S516, and S521 is the same as S517.

[0069] In S522, the system control unit 202 (image quality adjustment determination unit 202A) determines whether the target image has been selected as an image to be output to the outside. If the system control unit 202 determines that the target image has been selected as an image to be output to the outside, the process proceeds to S523; if not, the image quality adjustment process of FIG. 5B ends.

[0070] S523 is the same as S516, and S524 is the same as S517.

[0071] Note that the user settings are not limited to the above four types of user settings. For example, there may be a user setting that combines "only when displayed" and "only when output to an external device." In the case of such a user setting, for example, if the processing load value of the imaging control device 200 or the internal temperature of the imaging control device 200 is higher than a threshold, image quality adjustment is performed only when the target image is displayed on the display unit 209 and when the target image is output to an external device.

[0072] Alternatively, S515 and S518 to S524 may be omitted, and the processes of S516 and S517 may always be performed. Similarly, S515 to S518 and S522 to S524 may be omitted, and the processes of S519 to S521 may always be performed. S515 to S521 may be omitted, and the processes of S522 to S524 may always be performed. S518 may be omitted, and the image quality adjustment process of FIG. 5B may always be terminated if the processing load value of the imaging control device 200 or the internal temperature of the imaging control device 200 is higher than a threshold. Similarly, if the processing load value of the imaging control device 200 or the internal temperature of the imaging control device 200 is higher than a threshold, the process may always proceed from S515 to S519. If the processing load value of the imaging control device 200 or the internal temperature of the imaging control device 200 is higher than a threshold, the process may always proceed from S515 to S522.

[0073] (If the target camera can be remotely controlled) Returning to the description of Figure 5A, in S507, the system control unit 202 (image quality adjustment determination unit 202A) determines whether the reference camera is a remotely controllable camera. If the system control unit 202 determines that the reference camera is a remotely controllable camera, the process proceeds to S511; otherwise, the process proceeds to S508.

[0074] (When the target camera can be remotely controlled but the reference camera cannot be remotely controlled) In S508, the system control unit 202 (remote control unit 202C) The camera setting values ​​are requested from the target camera via the communication I / F unit 207, and the current camera setting values ​​are received from the target camera via the communication I / F unit 207. The camera setting values ​​include, for example, an exposure compensation value, white balance (such as a coefficient used in white balance processing), and ISO sensitivity.

[0075] 5B, and determines the camera setting values ​​after the image quality adjustment based on the determined image quality adjustment values ​​and the camera setting values ​​received in S508. For example, the system control unit 202 determines the camera setting values ​​after the image quality adjustment so that the color and brightness of the evaluation area of ​​the target image (image captured by the target camera) match (approach) the color and brightness of the evaluation area of ​​the reference image (image captured by the reference camera).

[0076] In S510, the system control unit 202 (remote control unit 202C) instructs the target camera to change to the camera setting values ​​determined in S509 (image quality adjustment) via the communication I / F unit 207. This instruction may include the camera setting values ​​determined in S509. Note that if the color and brightness of the evaluation area of ​​the reference image and the color and brightness of the evaluation area of ​​the target image approximately match, it is not necessary to instruct image quality adjustment.

[0077] (When both the target camera and the reference camera can be remotely controlled) In S511, similarly to S508, the system control unit 202 (remote control unit 202C) requests the camera setting values ​​from the target camera via the communication I / F unit 207, and receives the current camera setting values ​​from the target camera via the communication I / F unit 207. Similarly, the system control unit 202 (remote control unit 202C) also receives the camera setting values ​​of the reference camera.

[0078] In S512, the system control unit 202 (remote control unit 202C) compares the two camera setting values ​​(the camera setting values ​​of the target camera and the camera setting values ​​of the reference camera) received in S511 and determines the camera setting values ​​after the image quality adjustment. For example, the system control unit 202 determines the camera setting values ​​after the image quality adjustment so that the camera setting values ​​of the target camera match (approach) the camera setting values ​​of the reference camera.

[0079] In S513, the system control unit 202 (remote control unit 202C) instructs the target camera via the communication I / F unit 207 to change the camera setting values ​​to those determined in S512 (adjust image quality). This instruction may include the camera setting values ​​determined in S512. The instruction for image quality adjustment may include the difference between the camera setting values ​​of the target camera and the camera setting values ​​of the reference camera, rather than the camera setting values ​​after image quality adjustment. Note that if the camera setting values ​​of the target camera and the camera setting values ​​of the reference camera are approximately the same, it is not necessary to instruct the image quality adjustment. S512 may be omitted, and the camera setting values ​​of the reference camera may be notified to the target camera in S513.

[0080] Fig. 7 is a flowchart showing an example of the operation of a camera that is remotely controllable and is not the reference camera. The operation of Fig. 7 is realized by the control unit 301 loading a program recorded in the nonvolatile memory 303 into the system memory 304 and executing it. For example, when the camera is connected to the imaging control device 200, the control unit 301 starts the operation of Fig. 7.

[0081] In S701, the control unit 301 starts transmitting video data (captured image). The control unit 301 transmits the video data to the imaging control device 200 via the communication I / F unit 308.

[0082] In S702, the control unit 301 (setting value management unit 301A) receives a request for camera setting values ​​from the imaging control device 200 via the communication I / F unit 308, and transmits the current camera setting values ​​to the imaging control device 200 via the communication I / F unit 308.

[0083] In S703, the control unit 301 (setting value management unit 301A) receives a notification from the imaging control device 200. A request for image quality adjustment (changing camera setting values) is received via the communication I / F unit 308 .

[0084] In S704, the control unit 301 (image quality adjustment unit 301B) changes the camera setting values ​​in response to the request received in S703.

[0085] As described above, the electronic device (imaging control device 200) adjusts the image quality of a camera that can be remotely controlled by remote control, and adjusts the image quality of a camera that cannot be remotely controlled by the electronic device. In this way, regardless of whether the camera (imaging device) can be remotely controlled or not, it is possible to adjust the image quality of a captured image while suppressing an increase in the processing load of the electronic device.

[0086] It should be noted that a camera (imaging device) may be used as the imaging control device 200. In this case, the imaging control device 200 may be regarded as a remotely controllable camera (imaging device).

[0087] The various controls described above may or may not be performed by a single piece of hardware (e.g., a processor or circuit). The entire device may be controlled by multiple pieces of hardware (e.g., multiple processors, multiple circuits, or a combination of one or more processors and one or more circuits) sharing the processing.

[0088] The above processor is a processor in the broad sense, and includes general-purpose processors and dedicated processors. General-purpose processors include, for example, CPUs (Central Processing Units), MPUs (Micro Processing Units), and DSPs (Digital Signal Processors). Dedicated processors include, for example, GPUs (Graphics Processing Units), ASICs (Application Specific Integrated Circuits), and PLDs (Programmable Logic Devices). Programmable logic devices include, for example, FPGAs (Field Programmable Gate Arrays) and CPLDs (Complex Programmable Logic Devices).

[0089] Although the embodiments of the present invention have been described in detail, the present invention is not limited to these specific embodiments, and various forms within the scope of the gist of the present invention are also included in the present invention. Furthermore, each of the above-described embodiments merely represents one embodiment of the present invention, and each embodiment can be combined as appropriate.

[0090] The present invention is also applicable to various electronic devices capable of remotely controlling an imaging device and controlling the image quality of captured images (image processing). For example, the present invention is applicable to personal computers, PDAs, mobile phone terminals, portable image viewers, printers, digital photo frames, music players, game consoles, e-book readers, etc. The present invention is also applicable to video players, display devices (including projectors), tablet terminals, smartphones, AI speakers, home appliances, in-vehicle devices, etc.

[0091] (Other embodiments) The present invention can also be realized by a process in which a program that realizes one or more functions of the above-described embodiments is supplied to a system or device via a network or a storage medium, and one or more processors in the computer of the system or device read and execute the program, or by a circuit that realizes one or more functions.

[0092] The disclosure of this embodiment includes the following configuration, method, and program. (Configuration 1) An electronic device to which one or more imaging devices can be connected, an instruction means for instructing the imaging device to adjust the image quality of the captured image when adjusting the image quality of the captured image obtained by the imaging device connected to the electronic device, if the imaging device is a device that can be controlled from the electronic device; a processing means for performing image processing for adjusting the image quality of a captured image obtained by an imaging device connected to the electronic device if the imaging device is not a device that can be controlled from the electronic device when adjusting the image quality of the captured image; An electronic device comprising: (Configuration 2) A determination means for determining whether or not an imaging device connected to the electronic device is a device that can be controlled from the electronic device. Further having 2. The electronic device according to configuration 1. (Configuration 3) A determination means for determining whether or not to adjust the image quality of an image captured by an imaging device connected to the electronic device. Further having 3. The electronic device according to configuration 1 or 2. (Configuration 4) The instruction means instructs a change in at least one of an exposure compensation value, a white balance, and an ISO sensitivity. 4. The electronic device according to any one of configurations 1 to 3. (Configuration 5) When adjusting the image quality of an image captured by an imaging device connected to the electronic device, if the imaging device is not a device that can be controlled from the electronic device, the processing means performs the image processing only in a specific situation. 5. The electronic device according to any one of configurations 1 to 4. (Configuration 6) When adjusting the image quality of an image captured by an imaging device connected to the electronic device, if the imaging device is not a device that can be controlled from the electronic device, the processing means performs the image processing only under specific circumstances if the processing load value of the electronic device or the internal temperature of the electronic device is higher than a threshold value. 5. The electronic device according to any one of configurations 1 to 4. (Configuration 7) When adjusting the image quality of an image captured by an imaging device connected to the electronic device, if the imaging device is not a device that can be controlled from the electronic device, the processing means does not perform the image processing if the processing load value of the electronic device or the internal temperature of the electronic device is higher than a threshold value. 5. The electronic device according to any one of configurations 1 to 4. (Configuration 8) When adjusting the image quality of an image captured by an imaging device connected to the electronic device, if the imaging device is not a device that can be controlled from the electronic device, the processing means performs the image processing if the processing load value of the electronic device or the internal temperature of the electronic device is lower than the threshold value. 8. The electronic device according to configuration 6 or 7. (Configuration 9) The specific situation is a situation in which the captured image is displayed on a display unit of the electronic device. 7. The electronic device according to configuration 5 or 6. (Configuration 10) The specific situation is a situation in which the captured image is output from the electronic device to an external device. 7. The electronic device according to configuration 5 or 6. (method) A control method for an electronic device to which one or more imaging devices can be connected, comprising: a step of instructing the imaging device to adjust the image quality of the captured image when adjusting the image quality of the captured image obtained by the imaging device connected to the electronic device, if the imaging device is a device that can be controlled from the electronic device; a step of performing image processing for adjusting the image quality of a captured image obtained by an imaging device connected to the electronic device if the imaging device is not a device that can be controlled from the electronic device; A control method comprising: (program) A program for causing a computer to function as each means of the electronic device according to any one of configurations 1 to 10. [Explanation of symbols]

[0093] 200: Imaging control device 202: System control unit

Claims

1. An electronic device to which one or more imaging devices can be connected, an instruction means for instructing the imaging device to adjust the image quality of the captured image when adjusting the image quality of the captured image obtained by the imaging device connected to the electronic device, if the imaging device is a device that can be controlled from the electronic device; a processing means for performing image processing for adjusting the image quality of a captured image obtained by an imaging device connected to the electronic device if the imaging device is not a device that can be controlled from the electronic device when adjusting the image quality of the captured image; An electronic device comprising:

2. A determination means for determining whether or not an imaging device connected to the electronic device is a device that can be controlled from the electronic device. Further having 2. The electronic device according to claim 1, wherein the electronic device is a semiconductor device.

3. A determination means for determining whether or not to adjust the image quality of an image captured by an imaging device connected to the electronic device. Further having 2. The electronic device according to claim 1, wherein the electronic device is a semiconductor device.

4. The instruction means instructs a change in at least one of an exposure compensation value, a white balance, and an ISO sensitivity.

2. The electronic device according to claim 1, wherein the electronic device is a semiconductor device.

5. When adjusting the image quality of an image captured by an imaging device connected to the electronic device, if the imaging device is not a device that can be controlled from the electronic device, the processing means performs the image processing only in a specific situation.

2. The electronic device according to claim 1, wherein the electronic device is a semiconductor device.

6. When adjusting the image quality of an image captured by an imaging device connected to the electronic device, if the imaging device is not a device that can be controlled from the electronic device, the processing means performs the image processing only under specific circumstances if the processing load value of the electronic device or the internal temperature of the electronic device is higher than a threshold value.

2. The electronic device according to claim 1, wherein the electronic device is a semiconductor device.

7. When adjusting the image quality of an image captured by an imaging device connected to the electronic device, if the imaging device is not a device that can be controlled from the electronic device, the processing means does not perform the image processing if the processing load value of the electronic device or the internal temperature of the electronic device is higher than a threshold value.

2. The electronic device according to claim 1, wherein the electronic device is a semiconductor device.

8. When adjusting the image quality of an image captured by an imaging device connected to the electronic device, if the imaging device is not a device that can be controlled from the electronic device, the processing means performs the image processing if the processing load value of the electronic device or the internal temperature of the electronic device is lower than the threshold value.

7. The electronic device according to claim 6, wherein the electronic device is a semiconductor device.

9. The specific situation is a situation in which the captured image is displayed on a display unit of the electronic device.

6. The electronic device according to claim 5,

10. The specific situation is a situation in which the captured image is output from the electronic device to an external device.

6. The electronic device according to claim 5,

11. A method for controlling an electronic device to which one or more imaging devices can be connected, comprising: a step of instructing the imaging device to adjust the image quality of the captured image when adjusting the image quality of the captured image obtained by the imaging device connected to the electronic device, if the imaging device is a device that can be controlled from the electronic device; a step of performing image processing for adjusting the image quality of a captured image obtained by an imaging device connected to the electronic device if the imaging device is not a device that can be controlled from the electronic device; A control method comprising:

12. A program for causing a computer to function as each of the means of the electronic device according to any one of claims 1 to 10.

Images