Imaging device, operating device, control method, and storage medium

By introducing communication and display units into the camera device, the problem of selective display of operation screens in remote operations is solved, and the user experience is improved.

CN114866684BActive Publication Date: 2025-08-05CANON KK
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
CN202210112371.3
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Priority Date
2021-02-04
Filing Date
2022-01-29
Publication Date
2025-08-05
Estimated Expiration
2042-01-29

AI Technical Summary

Technical Problem

When existing camera devices operate remotely, it is difficult to selectively display different operation screens on external devices, resulting in poor user experience.

Method used

The imaging device is equipped with a communication unit, a first and second generation unit, a first and second display unit, and a control unit, and can communicate with an external device and selectively transmit an operation screen including or not including a captured image.

Benefits of technology

It realizes selective display of different operation screens on external devices that remotely operate the camera device, improving the user experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114866684B_ABST
    Figure CN114866684B_ABST
Patent Text Reader

Abstract

The present invention provides an imaging device, an operating device, a control method, and a storage medium. The imaging device can be remotely controlled by an external device. The imaging device communicates with the external device, generates a first operating screen for displaying first information related to the imaging device and including a captured image, generates a second operating screen, different from the first operating screen, for displaying second information related to the imaging device and not including the captured image, and controls the imaging device based on an operation request for the imaging device received from the external device. Based on an instruction from the external device, the imaging device selectively transmits the first operating screen or the second operating screen to the external device.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to an imaging device, an operating device, a control method and a storage medium, and in particular to a system capable of remotely operating the imaging device through an external device. Background Art

[0002] Systems are known that enable remote control of imaging devices such as video cameras via an operating device such as a tablet device. Furthermore, some cameras feature a configuration in which not only a viewfinder displaying a live view image and an on-screen display (OSD) is displayed, but also a graphical user interface (GUI) separate from the OSD is displayed on a display unit outside the viewfinder. In such cameras, the camera operator can perform operations such as focusing and framing while viewing the live view image or the OSD on the viewfinder, while an assistant can perform other settings by viewing the GUI on the display unit outside the viewfinder.

[0003] Japanese Patent Laid-Open No. 2016-100828 describes a system in which an operation screen of an image processing apparatus and an image of an operation unit are transmitted from the image processing apparatus to an operation apparatus such as a PC, and the image processing apparatus performs control according to an operation request received from the PC.

[0004] For cameras with a viewfinder and an off-viewfinder display unit, the viewfinder's OSD is suitable for operating the camera while simultaneously checking the live view image on the operating device. On the other hand, the off-viewfinder display unit's GUI is suitable for confirming camera settings and status. When the off-viewfinder display unit's GUI is displayed on the operating device, the operating elements of the GUI displayed on the operating device need to be changed to those corresponding to the off-viewfinder display unit. Therefore, it is more convenient for users to selectively display the OSD and GUI displayed simultaneously on different camera display units on the operating device. Summary of the Invention

[0005] The present invention has been made in view of the above-mentioned problems, and realizes a technology for selectively displaying different operation screens in an external device that remotely operates an imaging device.

[0006] In order to solve the above problems, the present invention provides a camera device that can be remotely controlled by an external device, and the camera device includes: a communication unit, which is configured to communicate with the external device; a camera unit, which is configured to generate a captured image; a first generation unit, which is configured to generate a first operation screen, the first operation screen is used to display first information related to the camera device and includes the captured image; a second generation unit, which is configured to generate a second operation screen different from the first operation screen, the second operation screen is used to display second information related to the camera device and does not include the captured image; a first display unit, which is configured to display the first operation screen; a second display unit, which is different from the first display unit and is configured to display the second operation screen; and a control unit, which is configured to control the camera device based on an operation request for the camera device received from the external device, wherein the control unit is configured to selectively send the first operation screen or the second operation screen to the external device based on an instruction from the external device.

[0007] In order to solve the above problems, the present invention provides an operating device that can remotely control a camera device, the operating device including: a communication unit configured to communicate with the camera device; a display unit configured to display a first operating screen or a second operating screen received from the camera device based on an instruction of the operating device, the first operating screen being used to operably display first information related to the camera device and including a captured image, and the second operating screen being used to operably display second information related to the camera device and not including the captured image; an operating unit configured to accept user operations on the first operating screen or the second operating screen displayed on the display unit; and a control unit configured to control so as to send an operation request for the camera device based on the operation of the first operating screen or the second operating screen to the camera device.

[0008] In order to solve the above problems, the present invention provides a control method for a camera device, which can be remotely controlled by an external device, wherein the camera device includes: a communication unit, which is configured to communicate with the external device; a camera unit, which is configured to generate a captured image; a first generation unit, which is configured to generate a first operation screen, the first operation screen is used to display first information related to the camera device and includes the captured image; a second generation unit, which is configured to generate a second operation screen different from the first operation screen, the second operation screen is used to display second information related to the camera device and does not include the captured image; a first display unit, which is configured to display the first operation screen; and a second display unit, which is different from the first display unit and is configured to display the second operation screen, wherein the control method includes: controlling the camera device based on an instruction received from the external device to selectively send the first operation screen or the second operation screen to the external device.

[0009] In order to solve the above problems, the present invention provides a control method for an operating device, wherein the operating device is capable of remotely controlling a camera device, wherein the operating device includes: a communication unit, which is configured to communicate with the camera device; and a display unit, wherein the control method includes: receiving a first operating screen including a captured image or a second operating screen not including the captured image based on an instruction of the operating device; displaying the first operating screen for operable displaying first information related to the camera device, or the second operating screen for operable displaying second information related to the camera device on the display unit; accepting user operations on the first operating screen or the second operating screen displayed on the display unit; and controlling to send an operation request for the camera device according to the operation of the first operating screen or the second operating screen to the camera device.

[0010] In order to solve the above problem, the present invention provides a computer-readable storage medium storing a program for causing a computer to execute the above method.

[0011] According to the present invention, different operation screens can be selectively displayed on an external device that remotely operates an imaging device.

[0012] Further features of the present invention will become apparent from the following description of exemplary embodiments (with reference to the attached drawings). BRIEF DESCRIPTION OF THE DRAWINGS

[0013] Figure 1A is a diagram showing a system configuration according to this embodiment.

[0014] Figure 1Bis an external view of the video camera 100 according to the present embodiment.

[0015] Figure 2A is a block diagram showing the internal structure of the video camera 100 according to the present embodiment.

[0016] Figure 2B is a block diagram showing the internal structure of the tablet device 101 according to the present embodiment.

[0017] Figure 3 is a flowchart showing the operation of the video camera 100 according to the present embodiment.

[0018] Figure 4A and Figure 4B is a flowchart showing the operation of the video camera 100 according to the present embodiment.

[0019] Figure 5 is a flowchart showing the operation of the video camera 100 according to the present embodiment.

[0020] Figure 6A and Figure 6B is a flowchart showing the operation of the tablet device 101 according to the present embodiment.

[0021] 7A to 7C 1 and 2 are examples of operation screens for each display mode of the tablet device 101 . DETAILED DESCRIPTION

[0022] Hereinafter, embodiments will be described in detail with reference to the accompanying drawings. Note that the following embodiments are not intended to limit the scope of the claimed invention. Although multiple features are described in the embodiments, the invention is not limited to requiring all such features, and multiple such features may be appropriately combined. In addition, in the drawings, the same reference numerals are assigned to the same or similar structures, and redundant descriptions thereof are omitted.

[0023] [First embodiment]

[0024] Hereinafter, an embodiment will be described in detail with reference to the accompanying drawings. In this embodiment, the imaging device of the present invention is applied to a digital camera, and the operating device of the present invention is applied to a tablet device. The operating device of the present invention is not limited to a tablet device and may be a smartphone, a personal computer (PC), or the like, which is a type of mobile phone.

[0025] <System Structure>

[0026] First, refer to Figure 1A The system configuration according to the present embodiment is described. Figure 1A A system configuration is shown in which the camera 100 and the tablet device 101 are communicably connected to each other and the camera 100 can be remotely controlled via the tablet device 101 according to this embodiment.

[0027] The camera 100 and the tablet device 101 according to the present embodiment are communicably connected via the communication network 102, and transmit and receive an OSD (On Screen Display) screen superimposed on a live view image, a GUI (Graphical User Interface) screen different from the OSD screen, or a captured image such as a live view image. In the present embodiment, a wireless LAN is used for the communication network 102, but the present invention is not limited thereto, and other communication methods that can transmit and receive an OSD screen, a GUI screen, or a live view image can be applied. Other communication methods include, for example, infrared communication, Bluetooth, and the like. Wireless communication modules such as RS-232C, RS-422A, USB, Ethernet, etc. can also be used. And wired connection such as IEEE1394.

[0028] In the system according to this embodiment, in areas such as video production where multiple people are involved in filming, it is possible to share some of the responsibilities, allowing the camera operator to perform camera 100 operations such as focusing and framing, while an assistant performs other camera settings. The tablet device 101 displays an OSD screen superimposed on the live view image received from the camera 100. Therefore, operating elements corresponding to the operating elements of the camera 100 are displayed as the operating elements of the OSD screen. A user operating the camera 100 using the tablet device 101 can operate the camera 100 using the operating elements of the OSD screen while viewing the live view image and the OSD screen. When a user operates the operating elements of the OSD screen on the tablet device 101, the tablet device 101 transmits an OSD screen operation event as an operation request to the camera 100. In the system according to this embodiment, a screen similar to the OSD screen displayed on the first display unit 200 or the GUI screen displayed on the second display unit 202 of the camera 100 is also displayed on the tablet device 101 along with the operating elements. Thus, the user can operate the camera 100 while viewing the same screen as the camera 100. In addition, in terms of development, since there is no need to separately implement screens such as menu screens corresponding to the OSD screen or GUI screen of the camera 100 on the tablet device 101, there is an advantage that development time can be shortened.

[0029] Next, we will refer to Figure 1B and Figure 2A The structure and function of the camera 100 will be described.

[0030] Figure 1B is a side view showing the external structure of the video camera 100 according to the present embodiment.

[0031] The first display unit 200 is a viewfinder display unit serving as the electronic viewfinder (EVF) of the video camera 100. This viewfinder display unit is composed of a display device, such as a liquid crystal panel or an organic EL panel, that is viewable by the user looking at the display device. An OSD screen is displayed on the first display unit 200 in a user-operable manner, superimposed on the live view image. A first operating unit 201 is an operating member, such as a push button or a rotary dial, for operating the OSD screen displayed on the first display unit 200.

[0032] like 7A to 7C As will be described in the following, numerical values and character strings indicating information related to the photographic processing of the camera 100 are displayed on the OSD screen. In addition, numerical values and character strings indicating information related to image quality, such as brightness or contrast of a captured image; numerical values, character strings, and boxes indicating information related to focus and zoom; and other icons, marks, and / or menus are displayed on the OSD screen in a manner operable by the first operating unit 201.

[0033] The second display unit 202 is a viewfinder-external display unit provided at a different location (on the side of the camera body) than the first display unit 200, and displays camera setting information and / or setting menus. The second display unit 202 is comprised of a display device, such as a liquid crystal panel or an organic EL panel, that can be viewed without the user observing the display device. A user-operable GUI screen, different from the OSD screen displayed on the first display unit 200, is displayed on the second display unit 202. The second operating unit 203 is an operating member, such as a push button or a rotary dial, for operating the GUI screen displayed on the second display unit 202.

[0034] like 7A to 7C As will be described in , numerical values, character strings, a cursor, and the like indicating information related to photographing processing such as aperture, shutter speed, and ISO sensitivity are displayed on the GUI screen so that the GUI screen can be operated by the second operation unit 203.

[0035] Figure 2A is a block diagram showing the internal structure of the video camera 100 according to the present embodiment.

[0036] The first control unit 310 and the second control unit 318 are arithmetic processing units composed of at least one processor or circuit, and control the various components of the video camera 100 by reading and executing a program stored in the nonvolatile memory 306, which will be described later. The first control unit 310 and the second control unit 318 transmit and receive data to and from each other via the data bus 317.

[0037] The first display unit 200, the first operation unit 201, the second operation unit 203, the optical system 300, the imaging unit 301, the camera signal processing unit 302, and the recording medium 303 are components controlled by the first control unit 310, and transmit and receive data to and from one another via the data bus 317. The power supply unit 304, the first input interface (I / F) 305, the first working memory 307, the codec 308, and the first output I / F 309 are components controlled by the first control unit 310, and transmit and receive data to and from one another via the data bus 317. The communication control unit 311, the external output terminal 314, the third operation unit 319, and the first screen generation unit 321 are components controlled by the first control unit 310, and transmit and receive data to and from one another via the data bus 317.

[0038] The second display unit 202 , the second operation unit 203 , the second input I / F 315 , the second work memory 316 , the second output I / F 320 , and the second screen generation unit 322 are components controlled by the second control unit 318 , and transmit and receive data to and from each other via the data bus 317 .

[0039] The optical system 300 includes a photographic lens such as a focus lens or a zoom lens, and / or an aperture, etc., to form an optical image of a subject.

[0040] The imaging unit 301 includes an image sensor composed of an imaging element such as a CCD or a CMOS, and an A / D converter, wherein the image sensor is used to output an analog signal by photoelectrically converting an optical image of a subject transmitted through the optical system 300, and the A / D converter is used to convert the analog signal output from the image sensor into a digital signal.

[0041] The camera signal processing unit 302 performs resizing processing such as predetermined pixel interpolation and reduction and / or color conversion processing on the digital signal generated by the imaging unit 301. Furthermore, the image data processed by the camera signal processing unit 302 is compressed and encoded in a predetermined format and bit rate by a codec 308, which will be described later, and is recorded as a video file in a recording medium 303. The recording medium 303 is a memory card, a hard disk, or the like, and records the video file and metadata associated with the video.

[0042] The power supply unit 304 includes a primary battery such as an alkaline battery or a lithium battery, a secondary battery such as a NiCd battery, a NiMH battery, or a lithium ion battery, or an AC adapter, and supplies power required by the various components of the video camera 100 .

[0043] The first operation unit 201 is an operation member for operating the OSD screen displayed on the first display unit 200, and includes a menu button, a cross key, and a back (BACK) button. The third operation unit 319 is an operation member provided in the camera body in addition to the first operation unit 201. Input information received by the first operation unit 201 and the third operation unit 319 is input to the first control unit 310 via the first input I / F 305 and the data bus 317.

[0044] The non-volatile memory 306 is an electrically erasable / recordable memory, and a flash ROM or the like is used, for example. The non-volatile memory 306 stores constants and computer programs used for the operations of the first control unit 310 and the second control unit 318. These programs are used to execute the flowcharts described later. Furthermore, the non-volatile memory 306 stores a server program that enables the camera 100, operating as an HTTP server, to communicate with the tablet device 101, operating as an HTTP client. The non-volatile memory 306 also stores a web application that is executed by the web browser running on the tablet device 101, which operates as an HTTP client.

[0045] The first working memory 307 is a volatile memory such as RAM, and is used as a work area for developing constants and variables used for the operation of the first control unit 310, as well as programs read from the non-volatile memory 306. The first working memory 307 also stores event information received from the tablet device 101 by the communication control unit 311, which will be described later. The first working memory 307 also functions as a repeater for relaying OSD data generated by the first screen generation unit 321 when the communication control unit 311 transmits the OSD data.

[0046] The codec 308 compresses and encodes the image data written in the first working memory 307 in a predetermined format such as JPEG, MPEG, or H.264 at a bit rate to generate a video file, and records the video file on the recording medium 303. The codec 308 decodes the video file recorded on the recording medium 303 in a predetermined format and bit rate, and stores the decoded video file in the first working memory 307. In addition, the image data decoded by the codec 308 and the live view image data obtained by the camera signal processing unit 302 are converted into display signals by the first output I / F 309 and displayed on the first display unit 200 and / or an external monitor connected to the external output terminal 314.

[0047] The first screen generation unit 321 draws the OSD screen data of the camera 100 to the VRAM of the first working memory 307. The menu has a screen structure that can be operated by the first operation unit 201. Other numerical values, character strings, icons, etc. are stored in the non-volatile memory 306 and drawn by the first screen generation unit 321 to read the VRAM.

[0048] The first output I / F 309 converts the OSD screen data generated by the first screen generation unit 321 into a display signal for displaying the OSD screen data on the first display unit 200 or an external monitor connected to the external output terminal 314. The first output I / F 309 includes a mixer circuit and generates composite image data obtained by superimposing the OSD screen data on the image data decoded by the codec 308 and the live view image data obtained by the camera signal processing unit 302. Furthermore, the first output I / F 309 converts the composite image data into a display signal for display on the first display unit 200 and an external monitor connected to the external output terminal 314.

[0049] The second operation unit 203 is an operation member for operating the GUI screen displayed on the second display unit 202, a power button, a home button, a back button, a rotary dial, or other six function buttons arranged on both sides of the screen of the second display unit 202. Input data accepted by the second operation unit 203 is input to the second control unit 318 via the second input I / F 315 and the data bus 317. Note that the second operation unit 203 may include a touch panel formed integrally with the second display unit 202, and allows touch operation of the GUI screen displayed on the second display unit 202.

[0050] The second working memory 316 is a volatile memory such as a RAM, and is used as a work area for developing constants and variables used for the operation of the second control unit 318, and computer programs read from the non-volatile memory 306. In addition, the second working memory 316 also stores event information received from the first control unit 310. The second working memory 316 also functions as a repeater for relaying OSD screen data generated by the second screen generation unit 322 when the communication control unit 311 transmits the OSD screen data.

[0051] The second screen generation unit 322 draws the GUI screen data of the video camera 100 to the VRAM of the second working memory 316. The menu has a screen structure that can be operated by the second operation unit 203. Other numerical values, character strings, icons, etc. are stored in the non-volatile memory 306 and drawn by the second screen generation unit 322 to read the VRAM.

[0052] The DMA (Direct Memory Access) controller 323 performs direct data transfer between the first working memory 307 and the second working memory 316. When the GUI screen data generated by the second screen generation unit 322 is transmitted to the tablet device 101, the DMA controller 323 transfers the data from the second working memory 316 to the first working memory 307 based on an instruction from the first control unit 310, and transmits the data from the first control unit 310 to the communication control unit 311.

[0053] The second output I / F 320 converts the GUI screen data generated by the second screen generating unit 322 into a display signal for displaying the GUI screen data on the second display unit 202 .

[0054] The communication control unit 311 receives event information, such as operational inputs or setting changes, from the tablet device 101 to the camera 100 via the wireless communication unit 312 and transmits responses to requests from the tablet device 101. The communication control unit 311 notifies the first control unit 310 of the event information received from the tablet device 101 and, after determining which of the first control unit 310 and the second control unit 318 is to handle the event, notifies the second control unit 318 of the event to be handled by the second control unit 318. The communication control unit 311 also transmits video data, web applications, and OSD screen data generated by the first screen generation unit 321 to the tablet device 101. The live view image data and OSD data that constitute the OSD screen data can be transmitted separately to display a composite image superimposed on the tablet device 101, or they can be transmitted as composite image data. Furthermore, the communication control unit 311 can transmit GUI screen data generated by the second screen generation unit 322 instead of the OSD data generated by the first screen generation unit 321.

[0055] The wireless communication unit 312 is a wireless communication module that transmits and receives radio signals to and from the tablet device 101 via the antenna 313. The wireless communication module 312 receives a request from the tablet device 101 as a wireless signal from the antenna 313. The communication control unit 311 demodulates the wireless signal received from the antenna 313. The first control unit 310 obtains packet data. In addition, in response to the request received from the tablet device 101, the wireless communication unit 312 transmits a wireless signal from the antenna 313 to the tablet device 101, in which the communication control unit 311 modulates the packet data generated by the first control unit 310 into a carrier frequency band.

[0056] <Structure of Tablet Device 101>

[0057] Below, we will refer to Figure 2BThe internal structure of the tablet device 101 according to this embodiment will be described.

[0058] Figure 2B is a block diagram showing the internal structure of the tablet device 101 according to the present embodiment.

[0059] The fourth control unit 411 is an arithmetic processing unit composed of at least one processor or circuit, and controls the respective components of the tablet device 101 by reading and executing a program stored in the nonvolatile memory 403 to be described later.

[0060] The power supply unit 400, the fourth operating unit 401, the fourth input I / F 402, the non-volatile memory 403, the fourth working memory 404, the recording medium 405, the codec 406, the fourth output I / F 407, the fourth display unit 408 and the wireless communication unit 409 are components controlled by the fourth control unit 411, and send and receive data to and from each other via the data bus 412.

[0061] The power supply unit 400 includes a primary battery such as an alkaline battery or a lithium battery, a secondary battery such as a NiCd battery, a NiMH battery, or a lithium-ion battery, or an AC adapter, and supplies power required by the various components of the tablet device 101 .

[0062] The fourth operating unit 401 is an operating member such as various switches and buttons that accepts various operations from the user and notifies the fourth control unit 411. The fourth operating unit 401 includes a power button and a home button. The fourth operating unit 401 is formed integrally with the fourth display unit 408 and includes a touch panel capable of detecting touch operations on the display screen of the fourth display unit 408. By associating input coordinates on the touch panel with display coordinates on the fourth display unit 408 in an application or the like operated on the tablet device 101, a GUI can be formed as if the user can directly operate the screen displayed on the fourth display unit 408. The touch panel can be a device capable of detecting contact strength (pressing force).

[0063] Input data accepted by the fourth operation unit 401 is input to the fourth control unit 411 via the fourth input I / F 402 and the data bus 412 .

[0064] The non-volatile memory 403 is an electrically erasable / recordable memory, and a flash ROM or the like is used, for example. The non-volatile memory 403 stores constants and computer programs used for the operation of the fourth control unit 411. Here, the program is a program for executing the flowchart described later. In addition, the non-volatile memory 403 stores a server program for enabling the tablet device 101 operating as an HTTP client to communicate with the camera 100 operating as an HTTP server. The non-volatile memory 403 stores a portion of a web application received from the camera 100 operating as an HTTP server. Instead of the non-volatile memory 403, the server program or web application may be stored in the recording medium 405 described later. An auxiliary storage device such as a hard disk may be used instead of the non-volatile memory 403 or to supplement the storage area of the fourth working memory 404.

[0065] The fourth control unit 411 may execute a web application received from the camera 100. The web application includes OSD screen data and GUI screen data generated by the camera 100. The live view image data, OSD screen data, and GUI screen data included in the web application may be received from the camera 100 via the wireless communication unit 409.

[0066] The fourth working memory 404 is a volatile memory such as a RAM and is used as a work area for developing constants and variables used for the operation of the fourth control unit 411 and computer programs read from the nonvolatile memory 403. The fourth working memory 404 also stores requests and event information transmitted to the camera 100 via the wireless communication unit 409.

[0067] The codec 406 compresses and encodes the image data written in the fourth working memory 404 in a predetermined format such as JPEG, MPEG, or H.264 at a bit rate to generate a video file, and records the video file on the recording medium 405. The codec 406 decodes the video file recorded on the recording medium 405 in a predetermined format and bit rate, and stores the decoded video file in the fourth working memory 404. The image data decoded by the codec 406 is converted into a display signal by the fourth output I / F 407, and the display signal is displayed on the fourth display unit 408.

[0068] The recording medium 405 is a memory card, a hard disk, or the like, and records video files, OSD screen data, GUI screen data, and the like received from the video camera 100 .

[0069] The codec 406 compresses and encodes the image data written in the fourth working memory 404 in a predetermined format such as JPEG, MPEG, or H.264 at a bit rate to generate a video file, and records the video file on the recording medium 405. The codec 406 decodes the video file recorded on the recording medium 405 in a predetermined format and bit rate, and stores the decoded video file in the fourth working memory 404. The image data decoded by the codec 406 is converted into a display signal by the fourth output I / F 407, and the display signal is displayed on the fourth display unit 408.

[0070] The fourth output I / F 407 converts live view image data, OSD screen data, or GUI screen data received from the camera 100 and decoded by the codec 406 into a display signal for display on the fourth display unit 408. The fourth output I / F 407 converts data of the operating unit of the OSD screen or GUI screen generated by the tablet device 101 into a display signal for displaying the data on the fourth display unit 408.

[0071] The fourth display unit 408 is composed of a display device such as a liquid crystal panel or an organic EL panel. The fourth display unit 408 displays live view image data, OSD screen data, and GUI screen data received from the camera 100. The fourth display unit 408 displays data of the operating unit of the OSD screen or GUI screen generated by the tablet device 101.

[0072] The wireless communication unit 409 is a wireless communication module that transmits and receives radio signals to and from the camera 100 via the antenna 410. The wireless communication module 409 transmits requests, responses, event information, and the like from the antenna 410 to the camera 100 as wireless signals. In addition, the wireless communication unit 409 receives live view image data, OSD screen data, and GUI screen data generated by the camera 100 as responses received from the camera 100. The wireless communication unit 409 receives live view image data, OSD screen data, and GUI screen data included in the WEB application from the camera 100. In addition, the wireless communication unit 409 can transmit input information of the user's operations on the first operation screen and the second operation screen displayed on the fourth display unit 408 to the camera 100, which will be described later. Figure 7C The first operation screen is described in the following and includes an OSD screen and an operation unit. Figure 7A and Figure 7B The second operation screen is described in the embodiment and includes a GUI screen and an operation unit. The input information includes an operation event as a display request for a menu.

[0073] In the system according to the present embodiment, it is assumed that the camera 100 functions as an HTTP server and the tablet device 101 functions as an HTTP client, and wireless communication with the camera 100 is performed. In the tablet device 101, the wireless communication unit 409 converts a wireless signal received from the camera 100 into packet data via the antenna 410, and outputs the packet data to the fourth control unit 411 via the buffer area of the fourth working memory 404. The response to be sent to the camera 100 in response to the request is converted into packet data by the fourth control unit 411, and is sent from the antenna 410 to the camera 100 as a wireless signal modulated in a carrier frequency band by the wireless communication unit 409.

[0074] <Control Processing>

[0075] Below, we will refer to Figures 3 to 7C The cooperative operation of the video camera 100 and the tablet device 101 according to this embodiment will be described.

[0076] Figures 3 to 5 1 is a flowchart showing the operation of the video camera 100. The first control unit 310 or the second control unit 318 executes a program stored in the nonvolatile memory 306 or the recording medium 303 and controls each component of the video camera 100. Figures 3 to 5 Optionally, the first control unit 310 or the second control unit 318 executes the program acquired from the camera 100 via the wireless communication unit 312 and controls the various components of the camera 100 to achieve Figures 3 to 5 processing. Figure 6A and Figure 6B is a flowchart illustrating the operation of the tablet device 101 .

[0077] The fourth control unit 411 executes the program acquired from the camera 100 via the non-volatile memory 403 or the wireless communication unit 409 and controls the various components of the tablet device 101. Figure 6A and Figure 6B processing. 7A to 7C This is an example of an operation screen including live view image data, an OSD screen, a GUI screen, and an operation unit thereof for each display mode displayed on the tablet device 101 .

[0078] First, refer to Figure 3 , the operation of the first control unit 310 of the camera 100 will be described.

[0079] In step S301 , the first control unit 310 captures a live view image by controlling the imaging unit 301 and the camera signal processing unit 302 .

[0080] In step S302 , the first control unit 310 causes the first screen generating unit 321 to generate OSD screen data to be displayed on the first display unit 200 , and draws the OSD screen data in the VRAM of the first working memory 307 .

[0081] In step S303 , the first control unit 310 outputs a composite image obtained by superimposing the OSD screen data generated in step S302 on the live view image generated in step S301 to the first display unit 200 .

[0082] In step S304 , the first control unit 310 transmits information related to the GUI screen to be displayed on the second display unit 202 to the second control unit 318 via the DMA controller 323 .

[0083] In step S305, the first control unit 310 performs the following steps: Figure 4A and Figure 4B The communication process with the tablet device 101 is performed through the processing.

[0084] In step S306, the first control unit 310 determines whether the first operating unit 201 has been operated. If the first control unit 310 determines that the first operating unit 201 has been operated, the first control unit 310 advances the process to step S307; otherwise, the first control unit 310 advances the process to step S308.

[0085] In step S307, the first control unit 310 generates a state transition event based on the operation of the first operation unit 201. The state transition event includes input information corresponding to a user operation such as a display request of a menu screen, a request to change a menu item, or a request to change an exposure parameter.

[0086] In step S308, the first control unit 310 determines whether a state transition event of the video camera 100 caused by an operation of the first operation unit 201 or the third operation unit 319 has occurred. If the first control unit 310 determines that a state transition event of the video camera 100 caused by an operation of the first operation unit 201 or the third operation unit 319 has occurred, the first control unit 310 advances the process to step S309; otherwise, the first control unit 310 advances the process to step S310.

[0087] In step S309 , the first control unit 310 controls the video camera 100 according to the state transition event generated in step S308 .

[0088] In step S310, the first control unit 310 determines whether a state transition event has been received from the second control unit 318 via the DMA controller 323. If the first control unit 310 determines that the first control unit 310 has received a state transition event from the second control unit 318, the first control unit 310 advances the process to step S309; otherwise, the first control unit 310 advances the process to step S311.

[0089] In step S311, the first control unit 310 determines whether a state transition event has occurred during the communication process. If the first control unit 310 determines that a state transition event has occurred during the communication process, the first control unit 310 advances the process to step S309. Otherwise, the first control unit 310 advances the process to step S312.

[0090] In step S312, the first control unit 310 determines whether a state transition event other than the state transition event generated in steps S308 to S311 has occurred. The state transition events determined here include events not accompanied by user operations such as a voltage drop of a power supply unit or a capacity drop of a recording medium, and the like, as will be described later. Figure 6A and Figure 6B When the first control unit 310 determines that a state transition event other than the state transition event generated in steps S308 to S311 has occurred, the first control unit 310 advances the process to step S309; otherwise, the first control unit 310 returns the process to step S301.

[0091] Below, we will refer to Figure 4A and Figure 4B To describe Figure 3 The communication process of step S305 is performed.

[0092] In step S401, the first control unit 310 reads the setting of the communication function from the first working memory 307 and determines whether the communication function is set to ON (enabled) and whether communication with the tablet device 101 is established. If the first control unit 310 determines that the communication function is set to ON (enabled) and communication with the tablet device 101 is established, the first control unit 310 advances the process to S402; otherwise, the first control unit 310 terminates the process.

[0093] In step S402, the first control unit 310 determines whether the web application has been sent to the tablet device 101. If the first control unit 310 determines that the web application has been sent to the tablet device 101, the first control unit 310 advances the process to step S404; otherwise, the first control unit 310 advances the process to step S403.

[0094] In step S403, the first control unit 310 causes the communication control unit 311 to transmit the web application read from the non-volatile memory 306 to the tablet device 101 via the wireless communication unit 312. The web application transmitted in step S403 includes information related to the live view image, OSD screen, GUI screen, operation unit, and their display layout for each display mode of the tablet device 101. The display modes of the tablet device 101 include a first display mode, a second display mode, and a third display mode. The first display mode is a display mode for displaying a live view image, a GUI screen, and an operation unit. The second display mode is a display mode for displaying a GUI screen and an operation unit without displaying a live view image. The third display mode is a display mode for displaying a composite image of the OSD screen superimposed on the live view image and the operation unit. 7A to 7C Examples of operation screens for each display mode of the tablet device 101 are shown. Figure 7A is an example of the second operation screen displayed in the first display mode. Figure 7B is an example of the second operation screen displayed in the second display mode. Figure 7C is an example of the first operation screen displayed in the third display mode. Figure 7A The image 700 in FIG. 7 is a live view image. Figure 7A and Figure 7B The image 701 in FIG. 7 is a GUI screen. Figure 7A and Figure 7B The operation unit 702 in FIG. 7 is an operation unit of the GUI screen corresponding to the second operation unit 203 . 7A to 7C The operation unit 703 in FIG. 1 is an operation unit commonly used in all display modes of the tablet device 101 to change the display mode. Figure 7C The image 704 in FIG. 7 is a live view image. Figure 7C The operation unit 705 in FIG. 7 is an operation unit of the OSD screen superimposed on the live view image 704 , and corresponds to the first operation unit 201 of the video camera 100 .

[0095] Figure 7A The second operation screen shown in FIG. 7 includes a GUI screen 701 , an operation unit 702 , an image of an operation unit 703 , and a live view image. Figure 7B The second operation screen shown in FIG. 7 includes a GUI screen 701 and images of an operation unit 702 and an operation unit 703 . Figure 7C The first operation screen shown in FIG. 7 includes an OSD screen superimposed on a live view image 704 and images of the operation unit 703 and the operation unit 705 .

[0096] In step S404 , the first control unit 310 causes the communication control unit 311 to transmit the status information of the camera 100 read from the first work memory 307 to the tablet device 101 via the wireless communication unit 312 .

[0097] In step S405, the first control unit 310 determines whether the display mode of the tablet device 101 is the first display mode (live view image and GUI screen) based on the display mode setting information stored in the first working memory 307 in step S420, which will be described later. If the first control unit 310 determines that the display mode of the tablet device 101 is the first display mode (live view image and GUI screen), the first control unit 310 advances the process to step S406. Otherwise, the first control unit 310 advances the process to step S409.

[0098] In step S406, the first control unit 310 compresses the live view image read from the first working memory 307 through the codec 308. By performing compression processing in this manner, the communication bandwidth occupied when transmitting the live view image can be reduced.

[0099] In step S407 , the first control unit 310 compresses the GUI screen data read from the second working memory 316 through the codec 308 .

[0100] In step S408 , the first control unit 310 transmits the live view image data and GUI screen data compressed in steps S407 and S408 to the tablet device 101 via the wireless communication unit 312 through the communication control unit 311 .

[0101] When the user selects the first display mode in the tablet device 101 through the process from step S405 to step S408 , data of an image or GUI screen corresponding to the first display mode may be transmitted to the tablet device 101 .

[0102] In step S409, the first control unit 310 determines whether the display mode of the tablet device 101 is the third display mode. If the first control unit 310 determines that the display mode of the tablet device 101 is the third display mode, the first control unit 310 advances the process to step S410; otherwise, the first control unit 310 advances the process to step S415.

[0103] In step S410, the first control unit 310 compresses the live view image read from the first working memory 307 through the codec 308. Note that the compression process of the synthesized image in which the OSD screen is superimposed on the live view image may replace the process of step S410 and the process of step S411.

[0104] In step S411 , the first control unit 310 compresses the OSD screen read from the first working memory 307 using the codec 308 .

[0105] In step S412, the first control unit 310 causes the communication control unit 311 to transmit the live view image and OSD compressed in steps S410 and S411 to the tablet device 101 via the wireless communication unit 312. In step S410, the composite image in which the OSD screen is superimposed on the live view image is transmitted while being compressed.

[0106] When the user selects the third display mode in the tablet device 101 through the process from step S409 to step S412 , data of an image or OSD screen corresponding to the third display mode may be transmitted to the tablet device 101 .

[0107] In step S413, the first control unit 310 determines whether operation events of the operation unit 703 and the operation unit 705 of the OSD screen have been received from the tablet device 101. If the first control unit 310 determines that operation events of the operation unit 703 and the operation unit 705 of the OSD screen have been received from the tablet device 101, the first control unit 310 advances the process to step S414; otherwise, the first control unit 310 advances the process to step S419.

[0108] In step S414 , the first control unit 310 generates a state transition event from the operation event of the OSD screen received in step S413 .

[0109] In step S415 , the first control unit 310 compresses the GUI screen read from the second work memory 316 using the codec 308 .

[0110] In step S416 , the first control unit 310 transmits the GUI screen compressed in step S415 to the tablet device 101 via the wireless communication unit 312 through the communication control unit 311 .

[0111] In step S417, the first control unit 310 determines whether operation events of the operation unit 702 and the operation unit 703 of the GUI screen have been received from the tablet device 101. If the first control unit 310 determines that operation events of the operation unit 702 and the operation unit 703 of the GUI screen have been received from the tablet device 101, the first control unit 310 advances the process to step S418; otherwise, the first control unit 310 advances the process to step S419.

[0112] In step S418 , the first control unit 310 notifies the second control unit 318 of the operation event of the GUI screen received in step S417 .

[0113] According to the above-described processing, when the first display mode is selected in the tablet device 101, an image including a live view image, a GUI screen, and an operation unit can be displayed on the tablet device 101. When the second display mode is selected in the tablet device 101, a GUI screen and an operation unit can be displayed on the tablet device 101. When the third display mode is selected in the tablet device 101, an image including a live view image, an OSD screen, and an operation unit can be displayed on the tablet device 101. In this way, since the tablet device 101 can display the same OSD screen or the same GUI screen as the camera 100, the user can view the same screen on both the camera 100 and the tablet device 101.

[0114] In step S419, the first control unit 310 determines whether an event for changing the display mode has been received from the tablet device 101. When the first control unit 310 determines that an event for changing the display mode has been received from the tablet device 101, the first control unit 310 advances the process to step S420; otherwise, the first control unit 310 advances the process to step S421. The display mode change event received by the camera 100 from the tablet device 101 includes a request to send an image or operation screen that is different for each display mode. As a result, different images and operation screens can be sent for each display mode, and the tablet device 101 can display the images and operation screens in an optimal layout based on the images and operation screens received from the camera 100.

[0115] In step S420 , the first control unit 310 performs a process for changing the display mode of the tablet device 101 and stores the setting of the changed display mode in the first working memory 307 .

[0116] In step S421, the first control unit 310 determines whether other events have been received from the tablet device 101. Other events include, for example, events such as changes in focus or zoom, in addition to operating events of the OSD screen and the GUI screen. If the first control unit 310 determines that other events have been received from the tablet device 101, the first control unit 310 advances the process to step S422; otherwise, the first control unit 310 terminates the process.

[0117] In step S422 , the first control unit 310 performs processing for generating another event, and returns the processing to step S401 .

[0118] According to the above-mentioned processing, the camera 100 sends the OSD screen and the GUI screen to the tablet device 101 according to the display mode of the tablet device 101, and the tablet device 101 can selectively display the OSD screen and the GUI screen for each display mode. In addition, when displaying the live view image, the OSD screen, the GUI screen, and the display layout information of the operation unit on the tablet device 101, the camera 100 sends them to the tablet device 101. Therefore, the tablet device 101 does not need to store this information in advance. In addition, in terms of development, since it is not necessary to separately implement screens such as the OSD screen, the GUI screen, the menu screen corresponding to the OSD screen or the GUI screen of the camera 100 on the tablet device 101, the development time can be shortened.

[0119] Figure 5 : is a flowchart showing the operation of the second control unit 318 of the video camera 100 .

[0120] In step S501, the second control unit 318 receives information related to the GUI screen displayed on the second display unit 202 from the first control unit 310. Figure 3 In step S304 , the data is transmitted via the DMA controller 323 .

[0121] In step S502 , the second control unit 318 generates a GUI screen through the second screen generation unit 322 based on the information related to the GUI screen received in step S501 , and draws the GUI screen into the VRAM of the second work memory 316 .

[0122] In step S503 , the second control unit 318 outputs the GUI screen data to the second display unit 202 .

[0123] In step S504, the second control unit 318 determines whether the GUI screen has been operated. If the second control unit 318 determines that the GUI screen has been operated, the second control unit 318 advances the process to step S506. Otherwise, if the second control unit 318 does not operate the GUI screen, the second control unit 318 advances the process to step S505.

[0124] In step S505, Figure 4B In step S418, the second control unit 318 determines whether an operation event of the operation unit 702 and the operation unit 703 of the GUI screen has been received from the first control unit 310. Figure 4BWhen it is determined in step S418 that the operation unit 702 of the GUI screen and the operation event of the operation unit 702 have been received from the first control unit 310, the second control unit 318 advances the processing to step S506; otherwise, the second control unit 318 advances the processing to step S507.

[0125] In step S506 , the second control unit 318 generates a state transition event based on the operation detected in step S504 or the operation event received in step S505 .

[0126] In step S507, the second control unit 318 determines whether a state transition event has occurred in step S505 or S506. If the second control unit 318 determines that a state transition event has occurred in step S505 or S506, the second control unit 318 advances the process to step S508. Otherwise, the second control unit 318 returns the process to step S501.

[0127] In step S508 , the second control unit 318 sends the state transition event to the first control unit 310 via the DMA controller 323 .

[0128] Below, reference Figure 6A and Figure 6B , the operation of the tablet device 101 will be described.

[0129] In step S601, the fourth control unit 411 determines whether communication with the camera 100 has been established. If the fourth control unit 411 determines that communication with the camera 100 has been established, the fourth control unit 411 advances the process to step S602, otherwise the fourth control unit 411 returns the process to step S601.

[0130] In step S602, the fourth control unit 411 determines whether a web application has been received from the camera 100. If the fourth control unit 411 determines that a web application has been received from the camera 100, the fourth control unit advances the process to step S604; otherwise, the fourth control unit advances the process to step S603.

[0131] In step S603, the fourth control unit 411 receives the signal through the wireless communication unit 409 via the antenna 410. Figure 4A The web application received in step S403 includes information related to a live view image, an OSD screen, a GUI screen, an operation unit, and a display layout thereof for each display mode of the tablet device 101.

[0132] In step S604, the fourth control unit 411 receives the signal through the wireless communication unit 409 via the antenna 410. Figure 4A The status information of the camera 100 is sent from the camera 100 in step S404.

[0133] In step S605, the fourth control unit 411 determines whether the display mode of the tablet device 101 is the first display mode (live view image and GUI screen). If the fourth control unit 411 determines that the display mode of the tablet device 101 is the first display mode (live view image and GUI screen), the fourth control unit 411 advances the process to step S606; otherwise, the fourth control unit 411 advances the process to step S610.

[0134] In step S606, the fourth control unit 411 receives the signal through the wireless communication unit 409 via the antenna 410. Figure 4A The live view image data and GUI screen data are sent from the camera 100 in step S408.

[0135] In step S607, the fourth control unit 411 Figure 7A The operation unit 702 and the operation unit 703 of the GUI screen are displayed on the fourth display unit 408 according to the display layout of the first display mode shown in FIG.

[0136] In step S608 , the fourth control unit 411 displays the live view image on the fourth display unit 408 .

[0137] In step S609, the fourth control unit 411 displays the GUI screen on the fourth display unit 408. Note that Figure 7A The GUI screen in is displayed alone without being superimposed on other images such as a live view image, so the GUI screen is more suitable for displaying information.

[0138] According to the processing of steps S607 to S609 , a live view image, a GUI screen, and an operation unit corresponding to the display mode selected by the user on the tablet device 101 can be displayed.

[0139] In step S610, the fourth control unit 411 determines whether the display mode of the tablet device 101 is the third display mode (live view image and OSD screen). If the fourth control unit 411 determines that the display mode of the tablet device 101 is the third display mode (live view image and OSD screen), the fourth control unit 411 advances the process to step S611; otherwise, the fourth control unit 411 advances the process to step S618.

[0140] In step S611, the fourth control unit 411 receives the signal through the wireless communication unit 409 via the antenna 410. Figure 4B The live view image data and OSD screen data are sent from the camera 100 in step S412.

[0141] In step S612, the fourth control unit 411 Figure 7C The operation unit 703 and the operation unit 705 of the OSD screen are displayed on the fourth display unit 408 according to the display layout of the third display mode shown in FIG.

[0142] In step S613 , the fourth control unit 411 displays the live view image on the fourth display unit 408 .

[0143] In step S614, the fourth control unit 411 determines whether the display function of the OSD screen is set to ON (enabled). If the fourth control unit 411 determines that the display function of the OSD screen is set to ON (enabled), the fourth control unit 411 advances the process to step S615. Otherwise, the fourth control unit 411 advances the process to step S616.

[0144] In step S615, the fourth control unit 411 displays an OSD screen on the fourth display unit 408. Figure 7B The OSD screen in FIG is superimposed and displayed on the live view image, so the OSD screen is an optimal layout for satisfying the following two requirements: viewing the live view image, and confirming the menu and / or the status of the camera 100.

[0145] The processing of steps S613 to S615 allows the tablet device 101 to display a live view image, a GUI screen, and an operation unit according to the display mode selected by the user.

[0146] In step S616, the fourth control unit 411 determines whether the operation unit 703 and the operation unit 705 of the OSD screen have been operated. If the fourth control unit 411 determines that the operation unit 703 and the operation unit 705 of the OSD screen have been operated, the fourth control unit 411 advances the process to step S617; otherwise, the fourth control unit 411 advances the process to step S623.

[0147] In step S617 , the fourth control unit 411 transmits the operation event of the OSD screen detected in step S616 to the video camera 100 via the wireless communication unit 409 and the antenna 410 .

[0148] In step S618, the fourth control unit 411 receives the signal through the wireless communication unit 409 via the antenna 410. Figure 4A GUI screen data sent from the camera 100 in step S416.

[0149] In step S619, the fourth control unit 411 Figure 7B The operation unit 702 and the operation unit 703 of the GUI screen are displayed on the fourth display unit 408 according to the display layout of the second display mode shown in FIG.

[0150] In step S620 , the fourth control unit 411 displays a GUI screen on the fourth display unit 408 .

[0151] According to the process of step S620 , a GUI screen and an operation unit corresponding to the display mode selected by the user may be displayed on the tablet device 101 .

[0152] In step S621, the fourth control unit 411 determines whether the operation unit 702 and the operation unit 703 of the GUI screen have been operated. If the fourth control unit 411 determines that the operation unit 702 and the operation unit 703 of the GUI screen have been operated, the fourth control unit 411 advances the process to step S622; otherwise, the fourth control unit 411 advances the process to step S623.

[0153] In step S622 , the fourth control unit 411 transmits the operation event of the GUI screen detected in step S621 to the video camera 100 via the wireless communication unit 409 via the antenna 410 .

[0154] In step S623, the fourth control unit 411 determines whether the tablet device 101 has been operated to change the display mode. If the fourth control unit 411 determines that an operation for changing the display mode of the tablet device 101 has been performed, the fourth control unit 411 advances the processing to step S624. Otherwise, the fourth control unit 411 advances the processing to step S625. In this embodiment, three modes are assumed: a first display mode (live view image and GUI screen), a second display mode (GUI screen), and a third display mode (live view image and OSD screen). However, the display mode can be switched under other conditions. For example, the live view image and OSD screen can be displayed in a mode for displaying a large live view image, the live view image and GUI screen can be displayed in a mode for displaying a small live view image, and the GUI screen can be displayed in a mode where the live view image is not displayed.

[0155] In step S624, the fourth control unit 411 transmits the display mode change event of the tablet device 101 to the camera 100 via the antenna 410 through the wireless communication unit 409. Figure 4B In step S419 , the camera 100 determines that a display mode change event has been received from the tablet device 101 .

[0156] In step S625, the fourth control unit 411 determines whether another operation has been performed. Other operations include, for example, operations other than operating the OSD screen or the GUI screen, such as changing the focus or zoom. If the fourth control unit 411 determines that another operation has been performed, the fourth control unit 411 advances the process to step S626. Otherwise, the fourth control unit 411 returns the process to step S602.

[0157] In step S626 , the fourth control unit 411 transmits other operation events to the camera 100 via the antenna 410 through the wireless communication unit 409 .

[0158] According to this embodiment, when different operation screens or operation units are provided for each display unit as in the video camera 100 , the user can selectively display different operation screens and operation units on the tablet device 101 .

[0159] When the user selects a mode for displaying both a live view image and an OSD screen, the tablet device 101 can display the live view image, the OSD screen, and the operation unit. As a result, when the user remotely operates the camera 100 from the tablet device 101 without requiring an external monitor away from the location of the camera 100, the user can display and confirm the live view image in a large size and also operate the camera 100.

[0160] In addition, when the user selects a mode for displaying a GUI screen, the tablet device 101 can display the GUI screen and the operation unit. As a result, the user can more comfortably operate the GUI for shooting while the live view image is visible through another monitor or while the assistant is only performing setting operations.

[0161] Furthermore, when the user selects a mode for displaying a live view image and an OSD screen, the tablet device 101 can display the live view image, the OSD screen, and the operating components. Therefore, when the screen size of the tablet device 101 is large, the user can more comfortably operate the GUI while viewing the live view image.

[0162] Additionally, the user can view the same screen on both the camera 100 and the tablet device 101 .

[0163] In terms of development, since the camera 100 transmits the live view image, the operation screen, and the display layout information of the operation unit to the tablet device 101 when displaying them on the tablet device 101, the tablet device 101 does not need to store this information in advance. In addition, in terms of development, there is no need to separately implement a menu screen corresponding to the operation screen of the camera 100 on the tablet device 101, thereby reducing development time.

[0164] The display mode change event received by the camera 100 from the tablet device 101 includes a request to send different images for each display mode. As a result, different images and operation screens can be sent for each display mode, and the tablet device 101 can display the images and operations in an optimal layout based on the images and operations received from the camera 100.

[0165] Furthermore, since the OSD screen displayed on the tablet device 101 is superimposed on the live view image, the OSD screen is optimal for both viewing the live view image and confirming the menu and / or the status of the camera 100. Furthermore, since the GUI screen displayed on the tablet device 101 is displayed independently without being superimposed on other images such as the live view image, this layout is more suitable for displaying information.

[0166] [Other embodiments]

[0167] The embodiments of the present invention can also be implemented by the following method, that is, providing software (program) that performs the functions of the above-mentioned embodiments to a system or device through a network or various storage media, and the computer or central processing unit (CPU) or microprocessing unit (MPU) of the system or device reads and executes the program.

[0168] While the present invention has been described with reference to exemplary embodiments, it is to be understood that the invention is not limited to the disclosed exemplary embodiments. The scope of the following claims is to be accorded the broadest interpretation so as to encompass all such modifications and equivalent structures and functions.

Claims

1. A camera device capable of being remotely controlled by an external device, the camera device comprising: a communication unit configured to communicate with the external device; a camera unit configured to generate a captured image; a first generating unit configured to generate a first operation screen for displaying first information related to the imaging device and including the captured image; a second generating unit configured to generate a second operation screen different from the first operation screen, the second operation screen being used to display second information related to the imaging device and not including the captured image; a first display unit configured to display the first operation screen in a viewfinder; a second display unit that is different from the first display unit and is configured to display the second operation screen in a display different from the viewfinder; a first operating unit configured to operate the first information in a viewfinder; as well as a control unit configured to control the imaging apparatus based on an operation request for the imaging apparatus received from the external apparatus, The control unit is configured to selectively send the first operation screen or the second operation screen to the external device based on an instruction from the external device. Here, when the control unit transmits the first operation screen to the external device, the control unit is configured to receive an operation request corresponding to the operation of the first operation unit from the external device.

2. The imaging device according to claim 1, wherein The instruction includes a display mode of a screen of the external device, The external device is capable of switching to any one of the following display modes: a first display mode for displaying the second operation screen and the captured image, a second display mode for displaying the second operation screen, and a third display mode for displaying the first operation screen, and The control unit is configured to perform control to transmit the second operation screen and the captured image, the second operation screen, or the first operation screen to the external device according to a display mode of the external device.

3. The imaging device according to claim 2, wherein The control unit is configured to transmit layout information to the external device.

4. The imaging device according to claim 2, wherein The control unit is configured to send image data obtained by compressing the second operation screen and image data obtained by compressing the captured image to the external device when the external device is in the first display mode, send image data obtained by compressing the second operation screen to the external device when the external device is in the second display mode, and send composite image data obtained by superimposing the first operation screen on the captured image and compressing the first operation screen superimposed on the captured image to the external device when the external device is in the third display mode. The imaging device according to claim 1 , wherein The first operation screen includes an on-screen display (OSD) for displaying the first information and an operation unit for operating the OSD, and The second operation screen includes a graphical user interface (GUI) different from the OSD for displaying the second information and an operation unit for operating the GUI.

6. A method for controlling a camera device, wherein the camera device can be remotely controlled by an external device. in, The camera device comprises: a communication unit configured to communicate with the external device; a camera unit configured to generate a captured image; a first generating unit configured to generate a first operation screen for displaying first information related to the imaging device and including the captured image; a second generating unit configured to generate a second operation screen different from the first operation screen, the second operation screen being used to display second information related to the imaging device and not including the captured image; a first display unit configured to display the first operation screen in a viewfinder; a second display unit that is different from the first display unit and is configured to display the second operation screen in a display different from the viewfinder; and a first operating unit configured to operate the first information in the viewfinder, Wherein, the control method includes: controlling the imaging device based on an instruction received from the external device to selectively transmit the first operation screen or the second operation screen to the external device, Here, when the first operation screen is transmitted to the external device, the imaging device is controlled to receive an operation request corresponding to the operation of the first operation unit from the external device.

7. A computer-readable storage medium storing a program for causing a computer to execute the method according to claim 6.

8. A computer program product comprising a program for causing a computer to execute the method according to claim 6.

Citation Information

Patent Citations

  • Information processing apparatus, information processing system, control method, and control program

    JP2016100828A

  • Imaging control device and control method therefor

    JP2017103567A

  • Image processing apparatus, method of controlling the apparatus and communication system

    US20110037865A1