Imaging device, operation device, control method, and program

Abstract

To realize techniques for selectively displaying different operation screens and operation units in an external apparatus which remotely operates an image capture apparatus.SOLUTION: An image capture apparatus includes: communication means configured to communicate with an external apparatus; image capturing means configured to generate a captured image by capturing a subject; first generation means configured to generate a first operation screen which displays first information relating to the image capture apparatus; second generation means configured to generate a second operation screen which is different from the first operation screen and displays second information relating to the image capture apparatus; first display means configured to display the first operation screen; second display means configured to display the second operation screen; and control means configured to control the image capture apparatus on the basis of an operation request for the image capture apparatus received from the external apparatus. It controls to transmit the first operation screen or the second operation screen superimposed on the capture image, or the captured image with the second operation screen, to the external apparatus, on the basis of a display mode of a screen of the external apparatus.SELECTED DRAWING: Figure 4

Description

[Technical field]

[0001] The present invention relates to a system capable of remotely operating an imaging device using an external device. [Background technology]

[0002] Systems are known that allow remote operation of imaging devices such as video cameras using an operation terminal such as a tablet device. Some video cameras are configured to display not only a live view image and an OSD (On Screen Display) in a viewfinder, but also a GUI (Graphical User Interface) different from the OSD on a display unit outside the viewfinder. In such cameras, the cameraman can perform operations such as focusing and framing while looking at the live view image and OSD in the viewfinder, and an assistant can perform operations such as other settings by looking at the GUI on the display unit outside the viewfinder.

[0003] Patent Document 1 describes a system in which images of the operation screen and operation section of an image processing device are sent from the image processing device to an operation terminal such as a PC, and the image processing device performs control in response to an operation request received from the PC. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2016-100828 A Summary of the Invention [Problem to be solved by the invention]

[0005] In cameras equipped with a viewfinder and a display unit outside the viewfinder, the OSD in the viewfinder is suitable when operating the camera while checking the live view image on the operation terminal. On the other hand, the GUI on the display unit outside the viewfinder is suitable when it is necessary to check the camera settings, status, etc. When displaying the GUI on the display unit outside the viewfinder on the operation terminal, it is necessary to change the operating members of the GUI displayed on the operation terminal to those compatible with the display unit outside the viewfinder. For this reason, it would be more convenient if the user could selectively display on the operation terminal the OSD and GUI that are displayed simultaneously on different display units of the camera.

[0006] The present invention has been made in view of the above-mentioned problems, and has as its object to realize a technique that allows different operation screens to be selectively displayed on an external device that remotely operates an imaging device. [Means for solving the problem]

[0007] In order to solve the above problems and achieve the object, the present invention provides an imaging device that can be remotely controlled by an external device, the imaging device including a communication unit that communicates with the external device, an imaging unit that captures an image of a subject and generates a captured image, and a display unit that displays first information about the imaging device. and includes the captured image. a first generating means for generating a first operation screen and a second generating means for displaying second information related to the imaging device; and does not include the captured image; a second generating means for generating a second operation screen different from the first operation screen, a first display means for displaying the first operation screen, a second display means different from the first display means for displaying the second operation screen, and a control means for controlling the imaging device based on an operation request for the imaging device received from the external device, Instructions from Based on the above, the external device Record number Operation screen 1 or The second operation screen Selectively Control to send.

[0008] The present invention also provides an operating device capable of remotely controlling an image pickup device, the operating device comprising: a communication unit for communicating with the image pickup device; Includes the display mode of the screena display means for displaying a first operation screen including a captured image and operably displaying first information related to the imaging device, which is received from the imaging device based on an instruction, or a second operation screen not including the captured image and operably displaying second information related to the imaging device, which is received based on an instruction, an operation means for accepting a user operation on the first operation screen or the second operation screen displayed on the display means, and a control means for controlling the imaging device to transmit an operation request for the imaging device corresponding to the operation on the first operation screen or the second operation screen to the imaging device. the operation device is switchable between a first display mode for displaying the second operation screen and the captured image, a second display mode for displaying the second operation screen, and a third display mode for displaying the first operation screen; and the control means controls to receive, when the operation device is in the first display mode, image data obtained by compressing the second operation screen and image data obtained by compressing the captured image from the imaging device, when the operation device is in the second display mode, to receive, when the operation device is in the second display mode, image data obtained by compressing the second operation screen from the imaging device, and to receive, when the operation device is in the third display mode, composite image data obtained by superimposing the first operation screen on the captured image and compressing it from the imaging device. . Effect of the Invention

[0009] According to the present invention, it becomes possible to selectively display different operation screens on an external device that remotely operates an imaging device. [Brief description of the drawings]

[0010] [Figure 1] 1A is a system configuration diagram of the present embodiment, and FIG. 1B is an external view of a video camera 100 of the present embodiment. [Diagram 2] 1A is a block diagram showing the internal configuration of a video camera 100 of the present embodiment, and FIG. 1B is a block diagram showing the internal configuration of a tablet device 101 of the present embodiment. [Diagram 3] 4 is a flowchart showing the operation of the video camera 100 of the present embodiment. [Figure 4] 4 is a flowchart showing the operation of the video camera 100 of the present embodiment. [Diagram 5] 4 is a flowchart showing the operation of the video camera 100 of the present embodiment. [Figure 6] 4 is a flowchart showing the operation of the tablet device 101 of the present embodiment. [Figure 7] 3A to 3C are diagrams illustrating examples of operation screens for each display mode of the tablet device 101. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] Hereinafter, the embodiments will be described in detail with reference to the attached drawings. Note that the following embodiments do not limit the invention according to the claims. Although the embodiments describe a number of features, not all of these features are essential to the invention, and the features may be combined in any manner. Furthermore, in the attached drawings, the same reference numbers are used for the same or similar configurations, and duplicated descriptions are omitted.

[0012] [Embodiment 1] Hereinafter, an embodiment in which the imaging device of the present invention is applied to a digital video camera and the operation device of the present invention is applied to a tablet device will be described in detail with reference to the accompanying drawings. Note that the operation device of the present invention is not limited to a tablet device, and may be a smartphone, which is a type of mobile phone, a personal computer (PC), or the like.

[0013] <System Configuration> First, the system configuration of this embodiment will be described with reference to FIG.

[0014] FIG. 1A illustrates an example of a system configuration in which a video camera 100 of this embodiment and a tablet device 101 are communicably connected, and the video camera 100 can be remotely controlled by the tablet device 101.

[0015] The video camera 100 and the tablet device 101 of this embodiment are communicatively connected via a communication network 102, and transmit and receive captured images such as an OSD (On Screen Display) screen superimposed on a live view image, a GUI screen different from the OSD screen, or a live view image. In this embodiment, the communication network 102 uses a wireless LAN, but is not limited to this, and other communication methods capable of transmitting and receiving an OSD screen, a GUI screen, or a live view image may be applied. Examples of other communication methods include wireless communication modules such as infrared communication, Bluetooth (registered trademark), and Wireless USB. Wired connection means such as RS-232C, RS-422A, USB, Ethernet (registered trademark), HDMI (registered trademark), and IEEE1394 may also be used.

[0016] In the system of this embodiment, in a scene where multiple people are shooting a video production, the cameraman operates the video camera 100, such as focusing and framing, and the assistant operates other camera settings, so that the roles can be shared. Also, the tablet device 101 displays an OSD screen superimposed on a live view image received from the video camera 100. As a result, operation members equivalent to the operation unit of the video camera 100 are displayed as the operation unit of the OSD screen. A user who operates the video camera 100 with the tablet device 101 can operate the video camera 100 with the operation unit of the OSD screen while checking the live view image and the OSD screen. When a user operates the operation unit of the OSD screen of the tablet device 101, the tablet device 101 transmits an operation event of the OSD screen as an operation request for the video camera 100. Also, in the system of this embodiment, the same screen as the OSD screen displayed on the first display unit 200 of the video camera 100 and the GUI screen displayed on the second display unit 202 is also displayed on the tablet device 101 together with the operation members. This allows the user to operate the video camera 100 while viewing the same screen as the video camera 100. Also, from a development perspective, there is an advantage in that development man-hours can be reduced because there is no need to separately implement menu screens corresponding to the OSD screen and GUI screen of the video camera 100 on the tablet device 101.

[0017] <Configuration of Video Camera 100> Next, the configuration and functions of the video camera 100 of this embodiment will be described with reference to FIG. 1(B) and FIG. 2(A).

[0018] FIG. 1B is a side view showing the external configuration of the video camera 100 of this embodiment.

[0019] The first display unit 200 is an in-finder display unit that functions as an electronic viewfinder (EVF) of the video camera 100, and is composed of a display device such as a liquid crystal panel or an organic EL panel that can be viewed by a user by peering into it. The first display unit 200 displays an OSD screen superimposed on a live view image so that the user can operate it. The first operation unit 201 is an operation member such as a push button or a rotary dial for operating the OSD screen displayed on the first display unit 200.

[0020] 7, the OSD screen displays numerical values, character strings, and the like indicating information related to the shooting processing of video camera 100. The OSD screen also displays numerical values, character strings, and the like indicating information related to image quality such as brightness and contrast of a captured image, numerical values, character strings, and frames indicating information related to focus and zoom, as well as other icons, markers, menus, and the like that can be operated by first operation unit 201.

[0021] The second display unit 202 is an outside-finder display unit provided at a different position (on the side of the camera body) from the first display unit 200 that displays camera setting information, setting menus, etc. The second display unit 200 is composed of a display device such as a liquid crystal panel or an organic EL panel that can be viewed by the user without peering into it. The second display unit 202 displays a GUI screen that is different from the OSD screen displayed on the first display unit 200 and can be operated by the user. The second operation unit 203 is an operation member such as a push button or a rotary dial for operating the GUI screen displayed on the second display unit 202.

[0022] As will be described later with reference to FIG. 7, the GUI screen displays numerical values, character strings, cursors, and the like indicating information related to shooting processing such as the aperture, shutter speed, ISO sensitivity, and the like of the video camera 100, so as to be operable by the second operation unit 203.

[0023] FIG. 2A is a block diagram showing the internal configuration of the video camera 100 of this embodiment.

[0024] The first control unit 310 and the second control unit 318 are arithmetic processing units consisting of at least one processor or circuit, and control each component of the video camera 100 by reading and executing a program stored in a non-volatile memory 306 (described later). The first control unit 310 and the second control unit 318 transmit and receive data to and from each other via a data bus 317.

[0025] The first display unit 200, the first operation unit 201, the second operation unit 203, the optical system 300, the imaging unit 301, the camera signal processing unit 302, and the recording medium 303 are components controlled by the first control unit 310, and transmit and receive data to and from each other via a data bus 317. The power supply unit 304, the first input interface (I / F) 305, the first work memory 307, the codec 308, and the first output I / F 309 are components controlled by the first control unit 310, and transmit and receive data to and from each other via the data bus 317. The communication control unit 311, the external output terminal 314, the third operation unit 319, and the first screen generating unit 321 are components controlled by the first control unit 310, and transmit and receive data to and from each other via the data bus 317.

[0026] The second display unit 202, the second operation unit 203, the second input I / F 315, the second work memory 316, the second output I / F 320, and the second screen generation unit 322 are components controlled by a second control unit 318, and send and receive data between them via a data bus 317.

[0027] The optical system 300 includes photographing lenses such as a focus lens and a zoom lens, an aperture, and the like, and forms an optical image of a subject.

[0028] The imaging unit 301 includes an image sensor composed of imaging elements such as a CCD or CMOS that photoelectrically converts an optical image of a subject that passes through the optical system 300 and outputs an analog signal, and an A / D converter that converts the analog signal output from the image sensor into a digital signal.

[0029] The camera signal processing unit 302 performs predetermined pixel interpolation, resizing such as reduction, color conversion, and the like, on the digital signal generated by the imaging unit 301. Furthermore, the image data processed by the camera signal processing unit 302 is compressed and encoded by a codec 308 (described later) at a predetermined format and bit rate, and recorded as a video file on a recording medium 303. The recording medium 303 is a memory card, a hard disk, or the like, and records the video file and metadata associated with the video.

[0030] The power supply unit 304 is made up of a primary battery such as an alkaline battery or a lithium battery, a secondary battery such as a NiCd battery, a NiMH battery, or a Li-ion battery, an AC adapter, or the like, and supplies the necessary power to each of the components of the video camera 100 .

[0031] The first operation unit 201 is an operation member for operating an OSD screen displayed on the first display unit 200, and includes a menu button, a cross key, and a BACK button. The third operation unit 319 is an operation member provided on the camera body other than the first operation unit 201. Input information received by the first operation unit 201 and the third operation unit 319 is input to the first control unit 310 via the first input I / F 305 and the data bus 317.

[0032] The non-volatile memory 306 is an electrically erasable and recordable memory, and may be, for example, a flash ROM. The non-volatile memory 306 stores constants, programs, and the like for the operation of the first control unit 310 and the second control unit 318. The programs referred to here are programs for executing flowcharts described below. The non-volatile memory 306 also stores a server program that enables the video camera 100 operating as an HTTP server to communicate with the tablet device 101 operating as an HTTP client. The non-volatile memory 306 also stores a Web application executed by a Web browser operating on the tablet device 101 as an HTTP client.

[0033] The first work memory 307 is a volatile memory such as a RAM, and is used as a work area for expanding constants and variables for the operation of the first control unit 310, programs read from the nonvolatile memory 306, and the like. The first work memory 307 also stores event information received from the tablet device 101 by the communication control unit 311, which will be described later. Furthermore, the first work memory 307 also plays a role in relaying OSD data generated by the first screen generation unit 321 when the communication control unit 311 transmits the data.

[0034] The codec 308 compresses and encodes the image data written to the first work memory 307 in a predetermined format and bit rate, such as JPEG, MPEG, or H.264, to generate a video file, and records the video file in the recording medium 303. The codec 308 also decodes the video file recorded in the recording medium 303 in a predetermined format and bit rate, and stores the video file in the first work memory 307. The image data decoded by the codec 308 and the live view image data obtained by the camera signal processing unit 302 are converted into a display signal by the first output I / F 309, and displayed on the first display unit 200 and / or an external monitor connected to the external output terminal 314.

[0035] First screen generating unit 321 renders OSD screen data of video camera 100 onto the VRAM of first work memory 307. The menu has a screen configuration that can be operated by first operation unit 201. Other numerical values, character strings, icons, etc. are stored in non-volatile memory 306, and first screen generating unit 321 reads them out and renders them onto the VRAM.

[0036] The first output I / F 309 converts the OSD screen data generated by the first screen generating unit 321 into a display signal for displaying on the first display unit 200 or an external monitor connected to the external output terminal 314. The first output I / F 309 also includes a mixer circuit, and generates composite image data by superimposing the OSD screen data on the image data decoded by the codec 308 or the live view image data obtained by the camera signal processing unit 302. The first output I / F 309 also converts the composite image data into a display signal for displaying on the first display unit 200 or an external monitor connected to the external output terminal 314.

[0037] The second operation unit 203 is an operation member for operating a GUI screen displayed on the second display unit 202, and includes six function buttons arranged on both sides of the screen of the second display unit 202, including a power button, a HOME button, a BACK button, a rotary dial, and others. Input information received by the second operation unit 203 is input to the second control unit 318 via the second input I / F 315 and the data bus 317. Note that the second operation unit 203 may include a touch panel integrally configured with the second display unit 202, and the GUI screen displayed on the second display unit 202 may be touch-operable.

[0038] The second work memory 316 is a volatile memory such as a RAM, and is used as a work area for expanding constants and variables for the operation of the second control unit 318, programs read from the nonvolatile memory 306, and the like. The second work memory 316 also stores event information received from the first control unit 310. Furthermore, the second work memory 316 also plays a role in relaying GUI screen data generated by the second screen generating unit 322 when the communication control unit 311 transmits it.

[0039] Second screen generating unit 322 renders the GUI screen data of video camera 100 onto the VRAM of second work memory 316. The menu has a screen configuration that can be operated by second operation unit 203. Other numerical values, character strings, icons, etc. are stored in non-volatile memory 306, and second screen generating unit 322 reads them out and renders them onto the VRAM.

[0040] A DMA (Direct Memory Access) controller 323 transfers data directly between the first work memory 307 and the second work memory 316. When GUI screen data generated by the second screen generating unit 322 is to be transmitted to the tablet device 101, the DMA controller 323 transfers data from the second work memory 316 to the first work memory 307 based on an instruction from the first control unit 310, and the data is then transmitted from the first control unit 310 to the communication control unit 311.

[0041] The second output I / F 320 converts the GUI screen data generated by the second screen generating unit 322 into a display signal for displaying on the second display unit 202 .

[0042] The communication control unit 311 receives event information such as operation input and setting change from the tablet device 101 to the video camera 100 via the wireless communication unit 312, and transmits a response to a request from the tablet device 101. The event information received from the tablet device 101 is notified to the first control unit 310, and after determining whether the first control unit 310 or the second control unit 318 processes the event, the second control unit 318 is notified of the event to be processed by the second control unit 318. The communication control unit 311 also transmits video data, Web applications, and OSD screen data generated by the first screen generation unit 321 to the tablet device 101. The live view image data and OSD data constituting the OSD screen data may be transmitted separately to display a composite image superimposed on the tablet device 101, or may be transmitted as composite image data. The communication control unit 311 may also transmit GUI screen data generated by the second screen generation unit 322 instead of the OSD data generated by the first screen generation unit 321.

[0043] The wireless communication unit 312 is a wireless communication module that transmits and receives radio signals to and from the tablet device 101 via the antenna 313. The wireless communication unit 312 receives a request from the tablet device 101 as a wireless signal from the antenna 313, the communication control unit 311 demodulates the wireless signal received from the antenna 313, and the first control unit 310 acquires packet data. In addition, the wireless communication unit 312 transmits, as a response to the request received from the tablet device 101, a wireless signal obtained by modulating the packet data generated by the first control unit 310 into a carrier frequency band by the communication control unit 311 from the antenna 313 to the tablet device 101.

[0044] <Configuration of the Tablet Device 101> Next, the internal configuration of the tablet device 101 of this embodiment will be described with reference to FIG. 2(B).

[0045] FIG. 2B is a block diagram showing the internal configuration of the tablet device 101 of this embodiment.

[0046] The fourth control unit 411 is an arithmetic processing unit consisting of at least one processor or circuit, and controls each component of the tablet device 101 by reading and executing a program stored in the non-volatile memory 403 described later.

[0047] The power supply unit 400, the fourth operation unit 401, the fourth input I / F 402, the non-volatile memory 403, the fourth work memory 404, the recording medium 405, the codec 406, the fourth output I / F 407, the fourth display unit 408, and the wireless communication unit 409 are components controlled by a fourth control unit 411, and transmit and receive data to and from each other via a data bus 412.

[0048] The power supply unit 400 includes a primary battery such as an alkaline battery or a lithium battery, a secondary battery such as a NiCd battery, a NiMH battery, or a Li-ion battery, an AC adapter, or the like, and supplies the necessary power to each component of the tablet device 101 .

[0049] The fourth operation unit 401 is an operation member such as various switches and buttons that accept various operations from a user and notify the fourth control unit 411. The fourth operation unit 401 includes a power button, a HOME button, and the like. The fourth operation unit 401 also includes a touch panel that is integrally configured with the fourth display unit 408 and can detect a touch operation on the display screen of the fourth display unit 408. Then, in an application or the like that runs on the tablet device 101, by associating input coordinates on the touch panel with display coordinates on the fourth display unit 408, it is possible to configure a GUI in which the user can directly operate the screen displayed on the fourth display unit 408. The touch panel may be a device that can acquire contact strength (pressure).

[0050] Input information received by the fourth operation unit 401 is input to a fourth control unit 411 via a fourth input I / F 402 and a data bus 412 .

[0051] The non-volatile memory 403 is an electrically erasable and recordable memory, and may be, for example, a flash ROM. The non-volatile memory 403 stores constants, programs, and the like for the operation of the fourth control unit 411. The programs referred to here are programs for executing the flowcharts described below. Furthermore, the non-volatile memory 403 stores a server program for the tablet device 101 operating as an HTTP client to communicate with the video camera 100 operating as an HTTP server. The non-volatile memory 403 also stores a server program for the tablet device 101 operating as an HTTP client to communicate with the video camera 100 operating as an HTTP server. 3 Some of the Web applications received from video camera 100 operating as an HTTP server are stored in fourth work memory 404. Note that the server program and Web applications may be stored in recording medium 405, which will be described later, instead of nonvolatile memory 403. Note that an auxiliary storage device such as a hard disk may be used instead of nonvolatile memory 403 or to supplement the storage area of ​​fourth work memory 404.

[0052] The fourth control unit 411 can execute a Web application received from the video camera 100. The Web application includes OSD screen data and GUI screen data generated by the video camera 100. The live view image data, OSD screen data, and GUI screen data included in the Web application can be received from the video camera 100 via the wireless communication unit 409.

[0053] The fourth work memory 404 is a volatile memory such as a RAM, and is used as a work area for expanding constants and variables for the operation of the fourth control unit 411, programs read from the nonvolatile memory 403, etc. The fourth work memory 404 also stores requests and event information to be transmitted to the video camera 100 via the wireless communication unit 409.

[0055] The recording medium 405 is a memory card, a hard disk, or the like, and records video files received from the video camera 100, OSD screen data, GUI screen data, and the like.

[0056] The codec 406 compresses and encodes the image data written to the fourth work memory 404 in a predetermined format and bit rate such as JPEG, MPEG, or H.264 to generate a video file, and records it on the recording medium 405. The codec 406 also decodes the video file recorded on the recording medium 405 in a predetermined format and bit rate, and stores it in the fourth work memory 404. The image data decoded by the codec 406 is also converted into a display signal by the fourth output I / F 407, and displayed on the fourth display unit 408.

[0057] The fourth output I / F 407 converts the live view image data, OSD screen data, or GUI screen data received from the video camera 100 and decoded by the codec 406 into a display signal for displaying on the fourth display unit 408. The fourth output I / F 407 also converts the data of the operation section of the OSD screen or GUI screen generated by the tablet device 101 into a display signal for displaying on the fourth display unit 408.

[0058] The fourth display unit 408 is configured with a display device such as a liquid crystal panel, an organic EL panel, etc. The fourth display unit 408 displays live view image data, OSD screen data, and GUI screen data received from the video camera 100. The fourth display unit 408 also displays data of the operation section of the OSD screen or GUI screen generated by the tablet device 101.

[0059] The wireless communication unit 409 is a wireless communication module that transmits and receives radio signals to and from the video camera 100 via the antenna 410. The wireless communication unit 409 transmits requests, responses, event information, and the like to the video camera 100 as wireless signals from the antenna 410. The wireless communication unit 409 also receives live view image data, OSD screen data, and GUI screen data generated by the video camera 100 as responses received from the video camera 100. The wireless communication unit 409 also receives live view image data, OSD screen data, and GUI screen data included in a Web application from the video camera 100. The wireless communication unit 409 can also transmit to the video camera 100 input information operated by a user on a first operation screen (to be described later in FIG. 7C) including an OSD screen and an operation unit displayed on the fourth display unit 408, and a second operation screen (to be described later in FIG. 7A and FIG. 7B) including a GUI screen and an operation unit. The input information includes an operation event as a menu display request.

[0060] In the system of this embodiment, it is assumed that the video camera 100 operates as an HTTP server, and the tablet device 101 operates as an HTTP client, and performs wireless communication with the video camera 100. The tablet device 101 converts a wireless signal received from the video camera 100 via the antenna 410 into packet data by the wireless communication unit 409, and outputs the packet data to the fourth control unit 411 via a buffer area of ​​the fourth work memory 404. Furthermore, a response to a request to be transmitted to the video camera 100 is converted into packet data by the fourth control unit 411, and transmitted from the antenna 410 to the video camera 100 as a wireless signal modulated by the wireless communication unit 409 to a carrier frequency band.

[0061] <Control Processing> Next, the cooperative operation of the video camera 100 and the tablet device 101 of this embodiment will be described with reference to FIGS.

[0062] 3 to 5 are flowcharts showing the operation of the video camera 100. The processes of FIGS. 3 to 5 are realized by the first control unit 310 or the second control unit 318 executing a program stored in the nonvolatile memory 306 or the recording medium 303 and controlling each component of the video camera 100. Alternatively, the processes of FIGS. 3 to 5 are realized by the first control unit 310 or the second control unit 318 executing a program acquired from the video camera 100 via the wireless communication unit 312 and controlling each component of the video camera 100. FIG. 6 is a flowchart showing the operation of the tablet device 101. The process of FIG. 6 is realized by the fourth control unit 411 executing a program acquired from the video camera 100 via the nonvolatile memory 403 or the wireless communication unit 409 and controlling each component of the tablet device 101. FIG. 7 illustrates an example of a live view image, an OSD screen, a GUI screen, and an operation screen including operation units thereof, for each display mode displayed on the tablet device 101.

[0063] First, the operation of first control unit 310 of video camera 100 will be described with reference to FIG.

[0064] In step S301, the first control unit 310 controls the imaging unit 301 and the camera signal processing unit 302 to capture a live view image.

[0065] In step S302, first control unit 310 causes first screen generating unit 321 to generate OSD screen data to be displayed on first display unit 200, and renders the OSD screen data in the VRAM of first work memory 307.

[0066] In step S303, the first control unit 310 1 The image generating unit 202 outputs to the first display unit 200 a composite image obtained by superimposing the OSD screen data generated in step S302 on the live view image generated in step S302.

[0067] In step S304, the first control unit 310 transfers information about the GUI screen to be displayed on the second display unit 202 to the second control unit 318 via the DMA controller 323.

[0068] In step S305, the first control unit 310 performs communication processing with the tablet device 101 through the processing in FIG.

[0069] In step S306, the first control unit 310 determines whether or not an operation has been performed on the first operation unit 201. If the first control unit 310 determines that an operation has been performed on the first operation unit 201, the process proceeds to step S307; otherwise, the process proceeds to step S308.

[0070] In step S307, the first control unit 310 generates a state transition event based on the operation of the first operation unit 201. The state transition event includes input information corresponding to a user operation, such as a request to display a menu screen, a request to change a menu item, or a request to change an exposure parameter.

[0071] In step S308, first control unit 310 determines whether or not a state transition event of video camera 100 has occurred due to operation of first operation unit 201 or third operation unit 319. If first control unit 310 determines that a state transition event of video camera 100 has occurred due to operation of first operation unit 201 or third operation unit 319, it proceeds to step S309, and otherwise proceeds to step S310.

[0072] In step S309, the first control unit 310 controls the video camera 100 in accordance with the state transition event that occurred in step S308.

[0073] In step S310, first control unit 310 determines whether or not a state transition event has been received from second control unit 318 via DMA controller 323. If first control unit 310 determines that a state transition event has been received from second control unit 318, it proceeds to step S309, and if not, it proceeds to step S311.

[0074] In step S311, the first control unit 310 determines whether or not a state transition event has occurred in the communication process. If the first control unit 310 determines that a state transition event has occurred in the communication process, the process proceeds to step S309, otherwise the process proceeds to step S312.

[0075] In step S312, the first control unit 310 determines whether or not a state transition event other than the state transition events that occurred in steps S308 to S311 has occurred. The state transition events determined here include events that do not involve user operations, such as a voltage drop in the power supply unit or insufficient capacity of the recording medium, and other events of the tablet device 101 in the processing of Fig. 6 described below. If the first control unit 310 determines that a state transition event other than the state transition events that occurred in steps S308 to S311 has occurred, the process proceeds to step S309; ​​otherwise, the process returns to step S301.

[0076] Next, the communication process in step S305 in FIG. 3 will be described with reference to FIG.

[0077] In step S401, the first control unit 310 reads the setting of the communication function from the first work memory 307, and determines whether or not the communication function is set to ON (enabled) and communication with the tablet device 101 is established. If the first control unit 310 determines that the communication function is set to ON (enabled) and communication with the tablet device 101 is established, the process proceeds to step S402. 4 Go to 02, otherwise end the process.

[0078] In step S402, the first control unit 310 determines whether or not the Web application has been sent to the tablet device 101. If the first control unit 310 determines that the Web application has been sent to the tablet device 101, the process proceeds to step S404; otherwise, the process proceeds to step S403.

[0079] In step S403, the first control unit 310 transmits the Web application read from the non-volatile memory 306 to the tablet device 101 via the wireless communication unit 312 by the communication control unit 311. The Web application transmitted in step S403 includes information on a live view image, an OSD screen, a GUI screen, an operation unit, and their display layout for each display mode of the tablet device 101. The display modes of the tablet device 101 include a first display mode, a second display mode, and a third display mode. The first display mode is a display mode in which a live view image, a GUI screen, and an operation unit are displayed. The second display mode is a display mode in which a live view image is not displayed, but a GUI screen and an operation unit are displayed. The third display mode is a display mode in which a composite image in which an OSD screen is superimposed on a live view image, and an operation unit are displayed. FIGS. 7A to 7C show examples of operation screens for each display mode of the tablet device 101. FIG. 7A shows an example of a second operation screen displayed in the first display mode. FIG. 7(B) is an example of a second operation screen displayed in the second display mode. FIG. 7(C) is an example of a first operation screen displayed in the third display mode. An image 700 in FIG. 7(A) is a live view image. An image 701 in FIG. 7(A) and FIG. 7(B) is a GUI screen. An operation unit 702 in FIG. 7(A) and FIG. 7(B) is an operation unit of a GUI screen corresponding to the second operation unit 203. An operation unit 703 in FIG. 7(A) to FIG. 7(C) is an operation unit used in common in all display modes of the tablet device 101 to switch the display mode. An image 704 in FIG. 7(C) is a live view image. An operation unit 705 in FIG. 7(C) is an operation unit of an OSD screen superimposed on the live view image 704, and corresponds to the first operation unit 201 of the video camera 100.

[0080] The second operation screen shown in Fig. 7(A) includes a GUI screen 701, images of operation units 702 and 703, and a live view image. The second operation screen shown in Fig. 7(B) includes a GUI screen 701 and images of operation units 702 and 703. The first operation screen shown in Fig. 7(C) includes an OSD screen superimposed on a live view image 704 and images of operation units 703 and 705.

[0081] In step S404 , the first control unit 310 causes the communication control unit 311 to transmit the status information of the video camera 100 read from the first work memory 307 to the tablet device 101 via the wireless communication unit 312 .

[0082] In step S405, the first control unit 310 determines whether or not the display mode of the tablet device 101 is the first display mode (live view image+GUI screen) based on the display mode setting information stored in the first work memory 307 in step S420 described below. If the first control unit 310 determines that the display mode of the tablet device 101 is the first display mode (live view image+GUI screen), the process proceeds to step S406; otherwise, the process proceeds to step S409.

[0083] In step S406, the first control unit 310 performs a process of compressing the live view image read from the first work memory 307 by the codec 308. By performing the compression process in this manner, it is possible to reduce the communication bandwidth occupied when transmitting the live view image.

[0084] In step S 407 , the first control unit 310 performs a process of compressing the GUI screen data read from the second work memory 316 by the codec 308 .

[0085] In step S408, the first control unit 310 causes the communication control unit 311 to transmit the live view image data and GUI screen data compressed in steps S407 and S408 to the tablet device 101 via the wireless communication unit 312.

[0086] When the user selects the first display mode on the tablet device 101 through the processing of steps S405 to S408, data of an image or GUI screen corresponding to the first display mode can be transmitted to the tablet device 101.

[0087] In step S409, the first control unit 310 determines whether or not the display mode of the tablet device 101 is the third display mode. If the first control unit 310 determines that the display mode of the tablet device 101 is the third display mode, the process proceeds to step S410; otherwise, the process proceeds to step S415.

[0088] In step S410, the first control unit 310 performs a process of compressing the live view image read from the first work memory 307 by the codec 308. Note that the processes of steps S410 and S411 can be replaced by a process of compressing a composite image in which an OSD screen is superimposed on the live view image.

[0089] In step S 411 , the first control unit 310 causes the codec 308 to perform a process of compressing the OSD screen read from the first work memory 307 .

[0090] In step S412, the first control unit 310 transmits the live view image and the OSD screen compressed in steps S410 and S411 to the tablet device 101 via the communication control unit 311 and the wireless communication unit 312. Note that, if a composite image in which the OSD screen is superimposed on the live view image is compressed in step S410, the composite image is the subject of transmission.

[0091] When the user selects the third display mode on the tablet device 101 through the processing of steps S409 to S412, data of an image or an OSD screen corresponding to the third display mode can be transmitted to the tablet device 101.

[0092] In step S413, the first control unit 310 determines whether or not an operation event of the operation units 703, 705 of the OSD screen has been received from the tablet device 101. If the first control unit 310 determines that an operation event of the operation units 703, 705 of the OSD screen has been received from the tablet device 101, the process proceeds to step S414; otherwise, the process proceeds to step S419.

[0093] In step S414, the first control unit 310 generates a state transition event from the operation event of the OSD screen received in step S413.

[0094] In step S 415 , the first control unit 310 causes the codec 308 to perform a process of compressing the GUI screen read from the second work memory 316 .

[0095] In step S416, the first control unit 310 causes the communication control unit 311 to transmit the GUI screen compressed in step S415 to the tablet device 101 via the wireless communication unit 312.

[0096] In step S417, the first control unit 310 determines whether or not an operation event of the operation units 702 and 703 of the GUI screen has been received from the tablet device 101. If the first control unit 310 determines that an operation event of the operation units 702 and 703 of the GUI screen has been received from the tablet device 101, the process proceeds to step S418; otherwise, the process proceeds to step S419.

[0097] In step S418, the first control unit 310 notifies the second control unit 318 of the operation event on the GUI screen received in step S417.

[0098] Through the above processing, when the first display mode is selected on the tablet device 101, an image including a live view image, a GUI screen, and an operation unit can be displayed on the tablet device 101. Furthermore, when the second display mode is selected on the tablet device 101, a GUI screen and an operation unit can be displayed on the tablet device 101. Furthermore, when the third display mode is selected on the tablet device 101, an image including a live view image, an OSD screen, and an operation unit can be displayed on the tablet device 101. In this way, since the same OSD screen and GUI screen as those on the video camera 100 can be displayed on the tablet device 101, the user can view the same screens on both the video camera 100 and the tablet device 101.

[0099] In step S419, the first control unit 310 determines whether or not an event for changing the display mode has been received from the tablet device 101. If the first control unit 310 determines that an event for changing the display mode has been received from the tablet device 101, the process proceeds to step S420; otherwise, the process proceeds to step S421. The display mode change event received by the video camera 100 from the tablet device 101 includes a transmission request for an image or operation screen that differs for each display mode. This makes it possible to transmit an image or operation screen that differs for each display mode, and the tablet device 101 can display the image or operation screen received from the video camera 100 in an optimal layout according to the image or operation screen received from the video camera 100.

[0100] In step S420, the first control unit 310 performs processing to change the display mode of the tablet device 101, and stores the setting of the changed display mode in the first work memory 307.

[0101] In step S421, the first control unit 310 determines whether or not another event has been received from the tablet device 101. The other events include, for example, events such as changes in focus and zoom other than operation events on the OSD screen or GUI screen. If the first control unit 310 determines that another event has been received from the tablet device 101, the process proceeds to step S422; otherwise, the process ends.

[0102] In step S422, the first control unit 310 performs a process of generating another event, and returns the process to step S401.

[0103] Through the above processing, the video camera 100 transmits an OSD screen or a GUI screen to the tablet device 101 in accordance with the display mode of the tablet device 101, and the tablet device 101 can selectively display an OSD screen or a GUI screen for each display mode. Furthermore, the video camera 100 transmits to the tablet device 101 a live view image, an OSD screen, a GUI screen, and display layout information of the operation unit when displayed on the tablet device 101. Therefore, the tablet device 101 does not need to store such information in advance. Furthermore, in terms of development, since it is not necessary to individually implement the OSD screen, GUI screen, and corresponding menu screens of the video camera 100 on the tablet device 101, the development man-hours can be reduced.

[0104] FIG. 5 is a flowchart showing the operation of second control unit 318 of video camera 100.

[0105] In step S501, the second control unit 318 receives from the first control unit 310 the information relating to the GUI screen to be displayed on the second display unit 202, which has been transferred via the DMA controller 323 in step S304 of FIG.

[0106] In step S502, the second control unit 318 causes the second screen generating unit 322 to generate a GUI screen based on the information related to the GUI screen received in step S501, and renders the GUI screen in the VRAM of the second work memory 316.

[0107] In step S503, the second control unit 318 outputs GUI screen data to the second display unit 202.

[0108] In step S504, the second control unit 318 determines whether or not a GUI screen operation has been performed. If the second control unit 318 determines that a GUI screen operation has been performed, the process proceeds to step S506, otherwise the process proceeds to step S505.

[0109] In step S505, the second control unit 318 determines whether or not an operation event of the operation units 702, 703 of the GUI screen has been received from the first control unit 310 in step S418 of Fig. 4. If the second control unit 318 determines that an operation event of the operation units 702, 703 of the GUI screen has been received from the first control unit 310 in step S418 of Fig. 4, the second control unit 318 proceeds to the process of step S506, and if not, the process proceeds to step S507.

[0110] In step S506, the second control unit 318 generates a state transition event based on the operation detected in step S504 or the operation event received in step S505.

[0111] In step S507, the second control unit 318 determines whether or not a state transition event occurred in step S505 or S506. If the second control unit 318 determines that a state transition event occurred in step S505 or S506, the process proceeds to step S508, and if not, the process returns to step S501.

[0112] In step S 508 , the second control unit 318 transmits a state transition event to the first control unit 310 via the DMA controller 323 .

[0113] Next, the operation of the tablet device 101 will be described with reference to FIG.

[0114] In step S601, the fourth control unit 411 determines whether or not communication has been established with the video camera 100. If the fourth control unit 411 determines that communication has been established with the video camera 100, the process proceeds to step S602, and if not, the process returns to step S601.

[0115] In step S602, the fourth control unit 411 determines whether or not the Web application has been received from the video camera 100. If the fourth control unit 411 determines that the Web application has been received from the video camera 100, the process proceeds to step S604; otherwise, the process proceeds to step S603.

[0116] In step S603, the fourth control unit 411 receives the Web application transmitted from the video camera 100 in step S403 of Fig. 4 via the antenna 410 through the wireless communication unit 409. Note that the Web application received in step S603 includes information related to the live view image, OSD screen, GUI screen, operation unit, and display layout thereof for each display mode of the tablet device 101.

[0117] In step S604, the fourth control unit 411 receives, via the antenna 410 and the wireless communication unit 409, the status information of the video camera 100 transmitted from the video camera 100 in step S404 of FIG.

[0118] In step S605, the fourth control unit 411 determines whether or not the display mode of the tablet device 101 is the first display mode (live view image+GUI screen). If the fourth control unit 411 determines that the display mode of the tablet device 101 is the first display mode (live view image+GUI screen), the process proceeds to step S606; otherwise, the process proceeds to step S610.

[0119] In step S606, the fourth control unit 411 receives the live view image data and GUI screen data transmitted from the video camera 100 in step S408 of FIG.

[0120] In step S607, the fourth control unit 411 displays the operation sections 702 and 703 of the GUI screen on the fourth display unit 408 in the display layout of the first display mode shown in FIG.

[0121] In step S608, the fourth control unit 411 displays a live view image on the fourth display unit 408.

[0122] In step S609, the fourth control unit 411 displays a GUI screen on the fourth display unit 408. Note that the GUI screen in Fig. 7(A) is displayed independently without being superimposed on other images such as a live view image, and therefore has a layout more suitable for displaying information.

[0123] By the processing of steps S607 to S609, it is possible to display a live view image, a GUI screen, and an operation unit in accordance with the display mode selected by the user on the tablet device 101.

[0124] In step S610, the fourth control unit 411 determines whether or not the display mode of the tablet device 101 is the third display mode (live view image+OSD screen). If the fourth control unit 411 determines that the display mode of the tablet device 101 is the third display mode (live view image+OSD screen), the process proceeds to step S611; otherwise, the process proceeds to step S618.

[0125] In step S611, the fourth control unit 411 receives, via the antenna 410, the live view image data and the OSD screen data transmitted from the video camera 100 in step S412 of FIG.

[0126] In step S612, the fourth control unit 411 performsC In the display layout of the third display mode shown in FIG.

[0127] In step S613, the fourth control unit 411 displays a live view image on the fourth display unit 408.

[0128] In step S614, the fourth control unit 411 determines whether or not the display function of the OSD screen is set to ON (enabled). If the fourth control unit 411 determines that the display function of the OSD screen is set to ON (enabled), the process proceeds to step S615, otherwise the process proceeds to step S616.

[0129] In step S615, the fourth control unit 411 displays an OSD screen on the fourth display unit 408. The OSD screen in Fig. 7(B) is displayed superimposed on a live view image, and therefore has an optimal layout for simultaneously viewing the live view image and checking the menu and the status of the video camera 100.

[0130] Through the processing of steps S613 to S615, it is possible to display a live view image, a GUI screen, and an operation section in accordance with the display mode selected by the user on the tablet device 101.

[0131] In step S616, the fourth control unit 411 determines whether or not the operation units 703, 705 of the OSD screen have been operated. If the fourth control unit 411 determines that the operation units 703, 705 of the OSD screen have been operated, the process proceeds to step S617; otherwise, the process proceeds to step S623.

[0132] In step S617, the fourth control unit 411 transmits the operation event on the OSD screen detected in step S616 to the video camera 100 via the wireless communication unit 409 and the antenna 410.

[0133] In step S618, the fourth control unit 411 receives the GUI screen data transmitted from the video camera 100 in step S416 of FIG.

[0134] In step S619, the fourth control unit 411 performs the process shown in FIG. B ) is displayed on the fourth display unit 408. In the display layout of the second display mode shown in FIG.

[0135] In step S620, the fourth control unit 411 displays a GUI screen on the fourth display unit 408.

[0136] By the process of step S620, it is possible to display a GUI screen and an operation section in accordance with the display mode selected by the user on the tablet device 101.

[0137] In step S621, the fourth control unit 411 determines whether or not the operation units 702, 703 on the GUI screen have been operated. If the fourth control unit 411 determines that the operation units 702, 703 on the GUI screen have been operated, the process proceeds to step S622; otherwise, the process proceeds to step S623.

[0138] In step S622, the fourth control unit 411 transmits the operation event on the GUI screen detected in step S621 to the video camera 100 via the wireless communication unit 409 and the antenna 410.

[0139] In step S623, the fourth control unit 411 determines whether or not a display mode change operation has been performed on the tablet device 101. If the fourth control unit 411 determines that a display mode change operation has been performed on the tablet device 101, the process proceeds to step S624; otherwise, the process proceeds to step S625. Note that in this embodiment, three display modes are assumed: a first display mode (live view image+GUI screen), a second display mode (GUI screen), and a third display mode (live view image+OSD screen); however, the display mode may be switched under other conditions. For example, a live view image and an OSD screen may be displayed in a mode in which a live view image is displayed large, a live view image and a GUI screen may be displayed in a mode in which a live view image is displayed small, and a GUI screen may be displayed in a live view image non-display mode.

[0140] In step S624, the fourth control unit 411 transmits a display mode change event of the tablet device 101 to the video camera 100 via the wireless communication unit 409 and the antenna 410. The video camera 100 determines that it has received the display mode change event from the tablet device 101 in step S419 of FIG.

[0141] In step S625, the fourth control unit 411 determines whether or not other operations have been performed. The other operations include, for example, operations other than operations on the OSD screen or GUI screen, such as changing the focus or zoom. If the fourth control unit 411 determines that other operations have been performed, the process proceeds to step S626. If not, the process proceeds to step S60. 2 Return to.

[0142] In step S626, the fourth control unit 411 transmits the other operation event to the video camera 100 via the wireless communication unit 409 through the antenna 410.

[0143] According to this embodiment, in the case of a video camera 100 in which each display unit has a different operation screen and operation unit, the user can selectively display different operation screens and operation units on the tablet device 101.

[0144] When the user selects a mode in which both a live view image and an OSD screen are displayed, the tablet device 101 can display a live view image, an OSD screen, and an operation unit. This allows the user to remotely operate the video camera 100 from the tablet device 101 at a distance from the video camera 100 without an external monitor, allowing the user to check the live view image enlarged and also to operate the video camera 100.

[0145] Furthermore, when the user selects a mode that displays a GUI screen, the tablet device 101 can display the GUI screen and an operation unit. This allows the user to more comfortably operate the GUI to perform shooting when a live view image can be viewed on a separate monitor or when an assistant only performs setting operations.

[0146] Furthermore, when the user selects a mode in which a live view image and an OSD screen are displayed, the tablet device 101 can display a live view image, an OSD screen, and operation members. This allows the user to more comfortably operate the GUI while viewing the live view image when the screen size of the tablet device 101 is large.

[0147] Furthermore, the user can view the same screen on both the video camera 100 and the tablet device 101.

[0148] From the perspective of development, the video camera 100 transmits to the tablet device 101 a live view image, an operation screen, and display layout information of the operation unit when displayed on the tablet device 101, so there is no need for the tablet device 101 to store such information in advance. Also, from the perspective of development, there is no need to separately implement a menu screen corresponding to the operation screen of the video camera 100 on the tablet device 101, so development man-hours can be shortened.

[0149] Furthermore, the display mode change event that the video camera 100 receives from the tablet device 101 includes a request to send a different image for each display mode. This makes it possible to send different images and operation screens for each display mode, and the tablet device 101 can display the images and operations received from the video camera 100 in an optimal layout.

[0150] Furthermore, the OSD screen displayed on the tablet device 101 is superimposed on a live view image, making it ideal for both viewing the live view image and checking the menu and the status of the video camera 100. Furthermore, the GUI screen displayed on the tablet device 101 is displayed independently without being superimposed on other images such as a live view image, making it a layout more suitable for displaying information.

[0151] [Other embodiments] The present invention can also be realized by a process in which a program for implementing one or more of the functions of the above-described embodiments is supplied to a system or device via a network or a storage medium, and one or more processors in a computer of the system or device read and execute the program. The present invention can also be realized by a circuit (e.g., ASIC) that implements one or more of the functions.

[0152] The invention is not limited to the above-described embodiments, and various modifications and variations are possible without departing from the spirit and scope of the invention. Accordingly, the following claims are appended to apprise the public of the scope of the invention. [Explanation of symbols]

[0153] 100...video camera (imaging device), 101...tablet device (operation device), 200...first display section, 201...first operation section, 202...second display section, 203...second operation section, 310...first control section, 318...second control section, 321...first screen generating section, 322...second screen generating section, 401...fourth operation section, 408...fourth display section, 411...fourth control section

Claims

1. An imaging device that can be remotely controlled by an external device, A communication means for communicating with the external device; An imaging means for capturing an image of a subject and generating a captured image; a first generating means for generating a first operation screen that displays first information related to the imaging device and includes the captured image; a second generation means for generating a second operation screen that displays second information related to the imaging device and does not include the captured image and is different from the first operation screen; a first display means for displaying the first operation screen; a second display means different from the first display means for displaying the second operation screen; a control unit that controls the imaging device based on an operation request for the imaging device received from the external device, The imaging device, wherein the control means performs control so as to selectively transmit the first operation screen or the second operation screen to the external device based on an instruction from the external device.

2. The instruction includes a display mode of a screen of the external device; the external device is switchable between a first display mode in which the second operation screen and the captured image are displayed, a second display mode in which the second operation screen is displayed, and a third display mode in which the first operation screen is displayed; The imaging device according to claim 1, characterized in that the control means controls the external device to transmit the second operation screen and the captured image, the second operation screen, or the first operation screen depending on a display mode of the external device.

3. 3. The imaging device according to claim 2, wherein the control means transmits to the external device layout information for displaying the first operation screen, the second operation screen, and the captured image on the external device.

4. The imaging device according to claim 2 or 3, characterized in that when the external device is in the first display mode, the control means transmits compressed image data of the second operation screen and compressed image data of the captured image to the external device, when the external device is in the second display mode, transmits compressed image data of the second operation screen to the external device, and when the external device is in the third display mode, transmits composite image data obtained by superimposing the first operation screen on the captured image and compressing it to the external device.

5. the first operation screen includes an on-screen display (OSD) that displays the first information and an operation unit for operating the OSD, 5. The imaging device according to claim 1, wherein the second operation screen includes a GUI (Graphical User Interface) different from the OSD that displays the second information, and an operation section for operating the GUI.

6. An operation device capable of remotely controlling an imaging device, A communication means for communicating with the imaging device; a display means for displaying a first operation screen including a captured image and operably displaying first information related to the imaging device, which is received from the imaging device based on an instruction including a display mode of the screen of the operation device, or a second operation screen not including the captured image and operably displaying second information related to the imaging device; an operation means for receiving a user operation on the first operation screen or the second operation screen displayed on the display means; a control unit that controls the image capture device to transmit an operation request for the image capture device in response to an operation of the first operation screen or the second operation screen to the image capture device, the operation device is switchable between a first display mode in which the second operation screen and the captured image are displayed, a second display mode in which the second operation screen is displayed, and a third display mode in which the first operation screen is displayed; The control means an operation device characterized by being controlled so that, when the operation device is in the first display mode, compressed image data of the second operation screen and compressed image data of the captured image are received from the imaging device, when the operation device is in the second display mode, compressed image data of the second operation screen is received from the imaging device, and when the operation device is in the third display mode, composite image data obtained by superimposing the first operation screen on the captured image and compressing it is received from the imaging device.

7. 7. The operation device according to claim 6, wherein the control means receives, from the imaging device, layout information for displaying the first operation screen, the second operation screen, and the captured image on the operation device.

8. the first operation screen includes an on-screen display (OSD) that displays the first information and an operation unit for operating the OSD, 8. The operating device according to claim 6, wherein the second operation screen includes a GUI (Graphical User Interface) different from the OSD that displays the second information, and an operation section for operating the GUI.

9. A method for controlling an imaging device that can be remotely controlled by an external device, comprising: The imaging device includes: A communication means for communicating with the external device; An imaging means for capturing an image of a subject and generating a captured image; a first generating means for generating a first operation screen that displays first information related to the imaging device and includes the captured image; a second generation means for generating a second operation screen that displays second information related to the imaging device and does not include the captured image and is different from the first operation screen; a first display means for displaying the first operation screen; a second display means different from the first display means for displaying the second operation screen, The control method includes: controlling the imaging device based on an operation request for the imaging device received from the external device; A control method characterized in that, in the controlling step, the first operation screen or the second operation screen is selectively transmitted to the external device based on an instruction from the external device.

10. A control method for an operation device capable of remotely controlling an imaging device, comprising: The operating device is A communication means for communicating with the imaging device; a display means for displaying a first operation screen including a captured image and operably displaying first information related to the imaging device, which is received from the imaging device based on an instruction including a display mode of a screen of the operation device, or a second operation screen not including the captured image and operably displaying second information related to the imaging device, the operation device is switchable between a first display mode in which the second operation screen and the captured image are displayed, a second display mode in which the second operation screen is displayed, and a third display mode in which the first operation screen is displayed; The control method includes: receiving, when the operation device is in the first display mode, compressed image data of the second operation screen and compressed image data of the captured image from the imaging device, when the operation device is in the second display mode, receiving, when the operation device is in the second display mode, compressed image data of the second operation screen from the imaging device, when the operation device is in the third display mode, receiving, when the operation device is in the third display mode, composite image data obtained by superimposing the first operation screen on the captured image and compressing it, from the imaging device; receiving a user operation on the first operation screen or the second operation screen displayed on the display means; transmitting to the imaging device an operation request for the imaging device corresponding to an operation on the first operation screen or the second operation screen.

11. 10. A computer-readable program for causing a computer to execute the method for controlling an image pickup apparatus according to claim 9.

12. A computer-readable program for causing a computer to execute the control method for an operating device according to claim 10.

Images