Control device, imaging system, control method, and program
Patent Information
- Application Number
- JP2022196018
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2022-12-08
- Publication Date
- 2025-12-02
AI Technical Summary
Existing imaging systems fail to optimally display necessary information on various display devices connected to a camera system, leading to reduced operability due to inconsistent and inappropriate display formats across different user interfaces.
A control device that communicates with imaging units to identify user roles and display capabilities, allowing it to generate and transmit display data tailored to the specific display format and capabilities of each connected device.
Enhances operability by ensuring that each display device receives relevant information in an optimal format, improving the efficiency of camera operations and video production.
Smart Images

Figure 00000000_0000_ABST
Abstract
Description
[Technical Field]
[0001] The present invention relates to a control device, an imaging system, a control method, and a program. [Background technology]
[0002] Patent Document 1 discloses a camera device (control device) that identifies its own role based on its own identified shooting conditions. Patent Document 2 discloses a camera device (control device) that measures its own position and displays an image based on information about the surroundings of its own position superimposed on a through (live view) image. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] Japanese Patent Application Publication No. 2016-012832 [Patent Document 2] Japanese Patent Application Laid-Open No. 2012-094955 Summary of the Invention [Problem to be solved by the invention]
[0004] A display device constituting an imaging system may not display information necessary for a user observing the display device. This is undesirable in terms of the operability of the imaging unit operated by the user. An object of the present invention is to provide, for example, a control device that is advantageous in terms of the operability of the imaging unit. [Means for solving the problem]
[0005] A control device as one aspect of the present invention is a control device capable of communicating with an imaging unit including a display unit, and has a communication unit that communicates with the unit, and a processing unit that causes the communication unit to transmit display data from the display unit to the unit, and the processing unit generates the display data based on information regarding the operation of the unit obtained by the communication unit.
[0006] Other objects and features of the present invention are illustrated in the following examples. [Effects of the Invention]
[0007] According to the present invention, for example, it is possible to provide a control device that is advantageous in terms of the operability of the imaging unit. [Brief explanation of the drawings]
[0008] [Figure 1] 1 is a block diagram of an imaging system according to a first embodiment. [Figure 2] FIG. 2 is a block diagram of an L role identification unit according to the first embodiment. [Figure 3] 10 is a flowchart illustrating a role identification process according to the first embodiment. [Figure 4] 10 is a flowchart showing a display specification process in the first embodiment. [Figure 5] 10 is a flowchart showing a display content determination process in the first embodiment. [Figure 6] 10 is a flowchart showing a display information creation process in the first embodiment. [Figure 7] 3 is an example of identification information according to the first embodiment. [Figure 8] 4 is an example of a role table and role information according to the first embodiment. [Figure 9] 10 is a diagram illustrating an example of roles and display item candidates according to the first embodiment. [Figure 10] 10 is an example of a table for specifying a display unit and specified display unit information in the first embodiment. [Figure 11] 10 is an example of a table for determining display item candidates from a display unit in the first embodiment. [Figure 12] 10 is an example of display content determined from display item candidates and display performance in the first embodiment. [Figure 13] 10 is an example of a UI according to the first embodiment. [Figure 14] FIG. 10 is a block diagram of an L role identification unit in the second embodiment. [Figure 15]10 is a flowchart illustrating a role priority determination process according to the second embodiment. [Figure 16] 10 is an example of role priority in the second embodiment. DETAILED DESCRIPTION OF THE INVENTION
[0009] Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.
[0010] First, we will explain the challenges of conventional imaging systems consisting of a control device such as a lens device and at least one display device capable of communicating with the control device. The information exchanged between devices constituting an imaging system is image and video information, and since it is assumed that common video information transmission and communication protocols can be used, menu information such as device status and settings may not be applicable. Furthermore, imaging systems may be connected to multiple display devices (external UIs) with displays other than lenses, such as accessories for operating the camera VF and lens, and dedicated display devices such as monitors and tablets. In recent years, as the variety of photography applications has increased, the variety of devices connected to lenses has also increased. Therefore, simply displaying predetermined information on a display device connected to the communication network often does not necessarily provide the information necessary for the photographer, for example.
[0011] In an imaging system, operators such as a cameraman who operates the camera and lenses, a video engineer (VE) who adjusts the camera and various video equipment, and a switcher who switches screens during video production operate various devices while checking display devices corresponding to them.
[0012] In addition, in a shooting environment, various UIs may be configured in various locations (devices), such as camera VFs and camera accessories, lenses and lens accessories, VE (Video Engineering) equipment, and the periphery of switcher equipment. In particular, in recent years, the number of devices that can be connected to PCs and tablets has increased, and these devices may also be used as UIs for the imaging system.
[0013] The optimal display items for each of these various display devices are different. For example, a cameraman needs information related to shooting operations, while VEs and switchers need information that provides an overview of the entire system. Also, the display format and information that is best suited to each type of UI differs. For example, a large display is suitable for displaying a list, while a VF displays images, so overlaying too much information on it can affect shooting.
[0014] Also, depending on the camera and other interfaces, some information can be sent and received, while others cannot. Whether or not information can be sent and received may also depend on the product generation and firmware version. In any case, it is necessary to make it possible to display the necessary information while avoiding duplication of information displayed between devices that are connected for communication.
[0015] To improve operability and increase the efficiency of photography, the display of the external UI must always provide the necessary information for the person viewing the UI. The UI should have a display format that matches the display capabilities of the UI, and the information should match the person viewing the UI and the type of UI itself in the entire imaging system. Therefore, it is desirable for an information storage device that stores information to be able to identify the display unit of the device with which it is connected for communication and determine the content to be displayed on the external UI based on the identified information.
[0016] Each example will be described in detail below. [Example]
[0017] First, an imaging system 10 according to a first embodiment of the present invention will be described with reference to FIG. 1. FIG. 1 is a block diagram of the imaging system 10. The imaging system 10 includes a lens apparatus 100, a camera apparatus (imaging apparatus) 200, and an operation apparatus 300. However, the present embodiment is not limited to this, and other units such as a display-only device or a VE (video engineer) system may be connected to the lens apparatus 100. In this embodiment, the lens apparatus 100 is described as an information holding device (control device), and the camera apparatus 200 and the operation apparatus 300 are each external UIs (units including a display device (display unit)). In this embodiment, the operation apparatus 300 is, for example, an accessory that operates the zoom lens of the lens apparatus 100, but is not limited to this.
[0018] First, the lens device 100 will be described. The lens device 100 has an L communication unit 101, an L calculation unit (processing unit) 102, and an L display unit 107. The lens device 100 also has a group of lenses (zoom lens, focus lens), an aperture, and an operation unit (none of which are shown). The L communication unit 101 is a communication unit that communicates with other communication-connected devices such as the camera device 200 or the operation device 300. The L communication unit 101 transmits data input from the L calculation unit 102 to other communication-connected devices with which it is connected, and also outputs data received from other communication-connected devices to the L calculation unit 102. In this embodiment, the L communication unit 101 outputs at least identification information received from other communication-connected devices to the L calculation unit 102. The L communication unit 101 also outputs C display data (described later) to the camera device 200, and D display data to the operation device 300.
[0019] The L calculation unit 102 is a control unit such as a CPU, and has at least an L role specification unit 103, an L display specification unit 104, an L display content determination unit 105, and an L display information creation unit 106. The L calculation unit 102 also outputs L display data, which will be described later, to the L display unit 107, and outputs display data other than the L display data (C display data, D display data) to the L communication unit 101 (causing the L communication unit 101 to transmit the display data to the camera device or the operation device 300).
[0020] The L role identification unit 103 performs a role identification process to identify the role (type of user) of a user (operator or photographer) operating each device in the imaging system 10 including the lens apparatus 100. More specifically, the L role identification unit 103 identifies the role (role information) of the operator based on the identification information of each device (each unit) input from the L communication unit 101. The identification information includes information related to operations by the operator. The identified role information is handled by the L display content determination unit 105. Note that the detailed processing flow of the role identification process will be described later with reference to FIG. 3. Also, the term "role" and role information will be described later with reference to FIGS. 8(a) to 8(c).
[0021] In the imaging system 10 including the lens apparatus 100, the L display specification unit 104 performs a display specification process to specify display information such as whether or not each device has a display unit and the display capabilities of the display unit, based on the identification information of each device input from the L communication unit 101. The specified display information is handled by the L display content determination unit 105. Note that the detailed processing flow of the display specification process will be described later with reference to FIG. 4.
[0022] The L display content determination unit 105 determines what to display on which display unit of the imaging system 10, based on either only the display unit identified by the L display identification unit 104, or on combined information that includes role information identified by the L role identification unit 103. Specifically, a display content determination process is performed to determine the content to be displayed on the target external UI and its own UI (L display unit 107). The determined display content information is handled by the L display information creation unit 106. A detailed processing flow of the display content determination process will be described later with reference to FIG. 4.
[0023] The L display information creation unit 106 performs a display information creation process that creates display data to be displayed on an external UI based on the display content information determined by the L display content determination unit 105. The L display information creation unit 106 creates, for example, C display data to be displayed on the camera device 200 and D display data to be displayed on the operation device 300, and outputs these to the L communication unit 101. A detailed processing flow of the display information creation process will be described later with reference to FIG. 5. The L display information creation unit 106 not only creates display data for the external UI, but also L display data to be displayed on the L display unit 107, which will be described later. The created L display data is output to the L display unit 107.
[0024] The L display unit 107 is a display device and is at least a UI that is visible to the user. It displays L display data input from the L calculation unit 102. The display device may be an LCD or an organic EL display, but is not limited to these. In this embodiment, the lens device 100 does not necessarily have to have the L display unit 107.
[0025] Next, the camera device 200 will be described. The camera device 200 is an imaging device equipped with an imaging unit, and is configured to include a C communication unit 201, a C calculation unit 202, and a C display unit 207. The C communication unit 201 is a communication unit that communicates with other communication-connected devices such as the lens device 100. The C communication unit 201 transmits data input from the C calculation unit 202 to other communication-connected devices with which it is connected, and also outputs data received from other communication-connected devices to the C calculation unit 202. In this embodiment, the C communication unit 201 outputs at least C display data received from the lens device 100 to the C calculation unit 202. Furthermore, the C communication unit 201 outputs identification information input from the C calculation unit 202 to the lens device 100.
[0026] The C calculation unit 202 is a control unit such as a CPU, and has at least a C display information creation unit 206. The C calculation unit 202 also outputs C display data input from the C communication unit 201 to the C display unit 207, and outputs its own identification information to the C communication unit 201. The C display information creation unit 206 converts the C display data input from the C communication unit 201 into display data that matches the display format of the C display unit 207, and outputs the data to the C display unit 207. The C display unit 207 is a display device, and is at least a UI that is visible to the user, such as a camera VF. The C display unit 207 displays the display data converted by the C display information creation unit 206. The display device may be an LCD or an organic EL, but is not limited to these.
[0027] Next, the operation device 300 will be described. The operation device 300 is a device for operating the lens device 100, and is used to operate, for example, a zoom lens and a focus lens (not shown) configured in the lens device 100. The operation device 300 is configured with a D communication unit 301, a D calculation unit 302, and a D display unit 307. Note that in this embodiment, the operation device 300 is an operation device that can operate the focus lens in the lens device 100, but is not limited to this, and may be an operation device that can operate other members such as a zoom lens.
[0028] The D communication unit 301 is a communication unit that communicates with other communication-connected devices such as the lens device 100. The D communication unit 301 transmits data input from the D calculation unit 302 to other communication-connected devices with which it is communicatively connected, and also outputs data received from other communication-connected devices to the D calculation unit 302. In this embodiment, the D communication unit 301 outputs at least D display data received from the lens device 100 to the D calculation unit 302. The D communication unit 301 also outputs identification information input from the D calculation unit 302 to the lens device 100.
[0029] The D calculation unit 302 is a control unit such as a CPU. The D calculation unit 302 outputs D display data input from the D communication unit 301 to the D display unit 307, and outputs its own identification information to the D communication unit 301. The D calculation unit 302 also has a D display information creation unit 306, which converts the data into display data suited to the D display unit 307, which will be described later. The D display unit 307 is a display device, and is at least a UI that is visible to the user. The D display unit 307 displays the display data converted by the D display information creation unit 306. The display device may be an LCD or an organic EL, but is not limited to these.
[0030] Next, the L-role identification unit 103 will be described with reference to Fig. 2. Fig. 2 is a block diagram of the L-role identification unit 103. The L-role identification unit 103 includes a connected unit detection unit 1031, an operator identification unit 1032, and a role management unit 1033.
[0031] The connected unit detection unit 1031 detects units (units constituting the imaging system 10) connected to the lens apparatus 100 based on the identification information acquired from the L communication unit 101. The connected unit detection unit 1031 transmits identification information of units (operation members) connected to the lens apparatus 100 to the operator identification unit 1032. The identification information is information for identifying "which" operation member the lens apparatus 100 is connected to. For example, if the identification information indicates the camera apparatus 200, it is a camera apparatus, and if the identification information indicates the operation apparatus 300, it is an operation apparatus. Details of the identification information will be described later with reference to FIG. 7. A method may also be used in which the L role identification unit 103 holds identification information of various information holding devices, identifies the type of connected information holding device based on information on terminal voltages between the devices and information on communication, and identifies the identification information from the identified type of information holding device.
[0032] The operator identification unit 1032 identifies the positional relationship between the operation device 300 and the lens apparatus 100 based on the connected operation members (units) using a role table, which will be described later. For example, it determines that an operation member located close to the lens apparatus 100 is operated by one operator, and that an operation member located farther away is operated by another operator than the operator located near the lens apparatus 100. As described above, the operator and operation member are identified as a group, and the operation member, location, and operator are registered in role information. The role information is also transmitted to the role management unit 1033. The role table is stored in a non-volatile memory (not shown) and can be referenced from anywhere by the role identification unit 103. The details will be described later with reference to FIGS. 8(a) to 8(c). The role table is a list of information holding devices to which the connected unit detection unit 1031 may be connected in advance. The role table also indicates, for each information holding device, information on the positional relationship with the lens apparatus and information indicating the role of the person operating the information holding device in shooting.
[0033] The role management unit 1033 uses a role table, which will be described later, to identify the role of the operator from the function of the operating member. For example, if a zoom demand or focus demand is connected, the role of the operator is set to be angle of view adjustment or focus adjustment. The identified role is registered in role information. The registered role information is also sent to the L display content determination unit 105.
[0034] Next, the role identification process performed by the L role identification unit 103 in this embodiment will be described with reference to Fig. 3. Fig. 3 is a flowchart showing the role identification process. First, after the lens device 100 is powered on, when the lens device 100 establishes a communication connection with the camera device 200 or the operation device 300, the process proceeds to step S101. Hereinafter, the case where the lens device 100 establishes a communication connection with the operation device 300 will be described.
[0035] First, in step S101, the connection unit detection unit 1031 determines whether or not identification information has been received from the communication connection partner (operation device 300). If identification information has been received, the process proceeds to step S102. On the other hand, if identification information has not been received, that is, if the communication connection partner does not hold identification information, the process ends.
[0036] In step S102, the connected unit detection unit 1031 registers the operating member in role information based on the identification information, and transmits the role information to the operator identification unit 1032. The role management unit 1033 identifies the role of the operator based on the information registered in the role information by the connected unit detection unit 1031 and the operator identification unit 1032.
[0037] Next, in step S103, the operator identification unit 1032 determines whether the location of the communication connection partner (operation device 300) has been identified. If it is determined that the location of the communication connection partner has been identified, the process proceeds to step S104. On the other hand, if it is determined that the location of the communication connection partner cannot be identified, the process ends. The location may be, for example, the distance between the lens apparatus 100 and the communication connection partner, or the connection type, such as wired or wireless. However, this embodiment is not limited to this, and any information indicating the positional relationship with the lens apparatus 100 within the imaging system 10 may be used. The location is identified using a role table that shows the relationship between the operation member, the location, and the role. Details of this identification method will be described later with reference to FIGS. 8(a) to 8(c). Note that if there is no connected operation member in the role table, the role cannot be identified, and the process ends.
[0038] In step S104, the operator identification unit 1032 registers the location in the role information and transmits the role information with the registered location to the role management unit 1033. Subsequently, in step S105, the role management unit 1033 identifies the role of the operator based on the operating member and the location (information related to the operator's operation). Details of the identified role will be described later with reference to FIG. 7, but an example of the role is "angle of view adjustment." Subsequently, in step S106, the role management unit 1033 registers the role identified in step S105 in the role information and ends this processing. Note that a similar processing can be performed for the camera device 200.
[0039] Next, the display specification process performed by the L display specification unit 104 in this embodiment will be described with reference to Fig. 4. Fig. 4 is a flowchart showing the display specification process. First, after the lens device 100 is powered on and communication is connected to the camera device 200 or the operation device 300, the process proceeds to step S201. Hereinafter, the case where communication is connected to the camera device 200 will be described.
[0040] First, in step S201, the display specification unit 104 determines whether or not identification information has been input (whether or not identification information has been received) from the communication connection partner (camera device 200). If it is determined that identification information has been input, the process proceeds to step S202. On the other hand, if it is determined that identification information has not been input, step S201 is repeated. The identification information is information about the camera device if it is the camera device 200, or information about the operation device if it is the operation device 300, and includes information that can identify a display unit that can be used by the lens device 100 and information that specifies the display format or display range of the display unit. Specifically, as will be described later, this information is, for example, "operation members," "presence or absence of a display unit," "display format," or "display range" shown in FIG. 7, and is information that can identify the display capabilities of the display unit. However, in this embodiment, the identification information is not limited to these, and other information may be used.
[0041] In step S202, the display identification unit 104 determines from the identification information whether the communication connection partner (camera device 200) has a display unit, and registers the result in the specified display unit information. Note that if it is possible to determine from the identification information that a display unit is present, the determination is made from the identification information; if not, the determination may be made from pre-set conditions or settings. The specified display unit information includes information (parameters) on the type, display format, or display capabilities of the specified display unit. Specifically, as will be described later, for example, there is the "display unit," "display format," or "display range" shown in FIG. 10(b), which is information that can identify the location and display capabilities of the display unit, but is not limited to these.
[0042] Next, in step S203, the L display specification unit 104 specifies the display format and display capabilities of the display unit of the communication connection partner (camera device 200) from the identification information and registers it in the specified display unit information (the display unit is specified from a correspondence table between parameters and display units).The L display specification unit 104 then outputs the specified display unit information to the L display content determination unit 105 and ends this processing. Note that similar processing can be performed for the operation device 300.
[0043] Next, the display content determination process (display target determination process) performed by the L display content determination unit 105 in this embodiment will be described with reference to Fig. 5. Fig. 5 is a flowchart showing the display content determination process (display target determination process). Hereinafter, a case where the content of the C display data to be transmitted to the camera device 200 is determined will be described.
[0044] First, in step S301, the L display content determination unit 105 determines whether or not specific display unit information has been input. If specific display unit information has been input, the process proceeds to step S302. On the other hand, if specific display unit information has not been input, step S301 is repeated.
[0045] In step S302, the L display content determination unit 105 determines whether role information has been input. If it is determined that role information has been input, the process proceeds to step S303. On the other hand, if it is determined that role information has not been input, the process proceeds to step S304. In step S303, the L display content determination unit 105 determines display item candidates based on a correspondence table between role information and display items. Note that a method for determining display item candidates based on role information will be described later. In step S304, the L display content determination unit 105 determines display item candidates based on a correspondence table between specific display unit information and display items (for example, a table that associates information related to the display capabilities of the display unit with the content of display data). Note that a method for determining display item candidates based on specific display unit information will be described later.
[0046] In step S305, the display content determination unit 105 determines and creates display content SInfo_c based on the display item candidates and the specific display unit information. The method for determining display content based on the display item candidates and the specific display unit information will be described later. The display content SInfo_c is information that represents the display content for the camera device 200 in this embodiment.
[0047] Subsequently, in step S306, the L display content determination unit 105 performs a display target determination process to determine and generate a display target St_c for displaying the display content SInfo_c. In the display target determination process, the L display content determination unit 105 references the specific display unit information and determines the display target St_c according to the information holding device ID. The display target St_c is information indicating that the camera device 200 in this embodiment is to be the display target. Subsequently, in step S307, the L display content determination unit 105 outputs the display content SInfo_c and the display target St_c, and ends this process.
[0048] For the operation device 300, processing is performed in the flow of steps S301 to S304 described above. However, in step S305, the display content SInfo_d is determined, and in step S306, the display target St_d is determined. For example, the display information SInfo_d created for the operation device 300 may be different from or the same as the display information SInfo_d created for the camera device 200.
[0049] Next, the display information creation process performed by the L display information creation unit 106 in this embodiment will be described with reference to Fig. 6. Fig. 6 is a flowchart showing the display information creation process. Hereinafter, a case where C display data to be transmitted to the camera device 200 is created will be described. When the display content determination process in Fig. 5 is completed and a display information creation request is made to the L display information creation unit 106, this process starts and proceeds to step S401.
[0050] First, in step S401, the L display information creation unit 106 determines whether the display content SInfo_c determined in the display content determination process has been input. If it is determined that the display content SInfo_c has been input, the process proceeds to step S402. On the other hand, if it is determined that the display content SInfo_c has not been input, step S401 is repeated.
[0051] In step S402, the L display information creation unit 106 determines whether the display object St_c determined in the display content determination process has been input. If it is determined that the display object St_c has been input, the process proceeds to step S403. On the other hand, if it is determined that the display object St_c has not been input, step S402 is repeated.
[0052] In step S403, the L display information creation unit 106 creates C display data by converting data into a format displayable on the display target St_c based on the display content SInfo_c acquired in step S401 and the display target St_c acquired in step S402. Specifically, the type of data required by the destination display unit can be determined using information on the display target St_c from information on the display device stored in a storage unit (not shown). The display target St_c identifies the camera device 200, and the camera device 200 identifies that the display unit can display ASCII data. Note that, although ASCII data is used in this embodiment, this is not limiting. For example, if the display device is the same as the lens device 100, the data may be converted into output data tailored to the display device. If information on the number of display pixels can be acquired, information such as the on / off status of each display pixel may be output. Information that can identify the display data may be transmitted and received as identification information, and the display identification unit may include this information in the display information creation process to convert the display data.
[0053] Subsequently, in step S404, the L display information generating unit 106 outputs the C display data generated in step S403 to the L communication unit 101, and this process ends.
[0054] Note that the processing for the operation device 300 is performed in the flow of steps S401 to S404 described above. However, in step S403, D display data is created, and in step S404, the D display data is output to the L communication unit 101. In the camera device 200, the C display data received from the lens device 100 is displayed on the C display unit 207. In addition, in the operation device 300, the D display data received from the lens device 100 is displayed on the D display unit 307. The actual display by this processing will be described later with reference to FIG. 13.
[0055] Next, the identification information will be described in detail with reference to Fig. 7. Fig. 7 is an example of the identification information. Fig. 7 is an example of the identification information. In Fig. 7, information in columns (A) to (E) indicates examples of the identification information held by the information holding device.
[0056] Column (A) is an identifier for identifying a device as a unique information storage device. Column (B) indicates the operating components connected to the imaging system 10. Column (C) indicates the presence or absence of a display unit. "Yes" indicates that the information storage device has a display unit, and "No" indicates that it does not. Column (D) indicates the display format when the user device uses the display unit. "Occupied" indicates that the entire display screen of the display unit can be occupied, while "Overlapped" indicates that a portion of the display screen of the display unit can be used. Column (E) indicates the display area of the display unit that can be used. For example, "96 dots vertically / 384 dots horizontally" indicates that the vertical and horizontal dimensions of the screen are measured in units of dots, and "16 characters / 2 lines" indicates that two lines of 16 characters can be displayed per line. For example, if identification information can be acquired via communication from an information storage device called Zoom Demand A, it can be determined that the device has an operating component called a Zoom Operation Device (wired), which can be used for role identification in the role identification process described below. Furthermore, columns (C) to (E) indicate the presence or absence of a display unit and its display performance, which can be used to identify the display unit in the display identification process described later.
[0057] Next, an example of the role identification process in this embodiment will be described with reference to Fig. 8(a) to (c). Fig. 8(a) is a role table, and Fig. 8(b) is an example of role information. The role identification process is a process performed by the L role identification unit 103 to identify the role of the operator who operates the operation member.
[0058] First, the role table shown in FIG. 8(a) will be described. The role table is a table for identifying the role of an operator from an operating member. Column (A) in FIG. 8(a) represents the operating members connected to the imaging system 10. Column (B) in FIG. 8(a) represents the location relative to the lens apparatus 100. Those connected to the lens apparatus 100 via a wire are considered to be located close to the lens, while those connected wirelessly are considered to be located remotely. The VE remote control is considered to be located remotely, assuming that the lens focus and brightness are adjusted from a position distant from the lens apparatus 100. In this embodiment, a method for determining the location in advance in association with the operating member will be described as an example. However, a method for automatically identifying the location of the operating member using a GPS or the like, or a method for the user to set the location using a setting means (not shown), may also be used. Furthermore, in this embodiment, there are two types of locations: close to the lens and far from the lens. However, multiple types of locations may be defined to identify the number of operators and their respective locations.
[0059] Next, we will explain the roles of column (C) in Figure 8(a). Shooting is performed by various people with their own roles, such as the cameraman who drives the lens to adjust the angle of view and focus, and the VE who moves the focus to fine-tune the focus. Column (C) in Figure 8(a) shows the roles of operators that can be considered from the functions of the operating members used in shooting. Roles are not limited to these, and may differ depending on the shooting format, so users may be able to register them.
[0060] Next, the role identification process will be described using the role information shown in FIG. 8(b). Here, as shown in FIG. 8(c), the role identification process will be described for the case where a camera L1, a lens, a zoom operation device (wired) D1, and a VE remote control D2 are connected to the imaging system 10, and operators P1 and P2 are present. The role information is information about the role of the operator identified from the connection unit. First, the camera, lens, zoom operation device (wired), and VE remote control connected to the operation members of the role information are registered. In this case, referring to column (B) in FIG. 8(a), it is identified that the camera, lens, and zoom operation device (wired) are located near the lens, and the VE remote control is located far from the lens. The lens near and lens far are registered in the location of the role information.
[0061] Next, column (C) in FIG. 8(a) is referenced, and the roles corresponding to the operating members are registered in the role information. Next, by reference to the locations of the registered role information in FIG. 8(b), it is possible to identify that one operator (operator A) is located near the lens and another operator (operator B) is located far from the lens. Operator A and operator B are registered as operators in the role information. Therefore, by performing the role identification process described above, the roles of the operators can be identified.
[0062] Next, with reference to Fig. 9, we will explain how to determine display item candidates using a correspondence table between role information and corresponding items. Fig. 9 shows an example of roles and display item candidates, and shows a correspondence table for determining, from the role in the role information, display item candidates that are optimal for the operator who plays that role. The purpose is to determine display item candidates that are optimal for the role of the operator included in the role information.
[0063] Column (A) shows the role played by the operator, and column (B) shows candidate display items corresponding to column (A). For example, if the role is to adjust the angle of view, the candidate display items can be determined from the correspondence table to be the zoom position and zoom command value. For example, if the role is to adjust focus, the candidate display items will be information related to the system's focus adjustment, such as the focus position and focus command value, and depth of field. If the role is to adjust brightness, the candidate display items will be information related to the system's brightness, such as the iris position and iris command value, camera gain, exposure time, and filter setting.
[0064] The correspondence table between role information and corresponding items may be stored in advance in a storage unit (not shown), or may be changeable by providing a changing means (not shown). For example, a display unit and an operation unit (not shown) may be provided so that the user can directly edit the correspondence table.
[0065] Next, an example of the display specification process in this embodiment will be described with reference to FIGS. 10(a) and 10(b). The purpose of the display specification process is to specify the display unit of the information holding device from information related to the display unit among the identification information acquired from the information holding device, and to create specified display unit information to be used in the display content determination process. FIG. 10(a) is a correspondence table for specifying the display unit from part of the identification information described with reference to FIG. 7. Columns (A) to (D) in FIG. 10(a) are the same as columns (B) to (E) in FIG. 7, respectively. Column (E) indicates the type of display unit specified from the information in columns (A) to (D). FIG. 10(b) is an example of specified display unit information specified by the display specification process. Column (A) in FIG. 10(b) indicates the type of display unit specified by the display specification process. Columns (B) and (C) in FIG. 10(b) are the same as columns (D) and (E) in FIG. 7, respectively. Column (D) in Fig. 10(b) is the same as column (A) in Fig. 7. These are acquired as information relating to display performance from the identification information in the display specification process.
[0066] Next, an example of the display specification process of the L display specification unit 104 when a camera, a lens, a zoom operation device (wired), and a VE remote control are connected to the imaging system 10 will be described. First, identification information is acquired, and a matching combination of operation members, presence or absence of a display unit, display format, and display range included therein is identified by referring to columns (A) to (D) in FIG. 10(a). Next, the display unit is identified by referring to column (E) of the identified combination. For example, if the acquired identification information is a combination of lens, presence of display unit, occupied, and 96 dots vertically / 384 dots horizontally, it can be seen that the matching columns (A) to (D) are in row (1) in FIG. 10(a). Therefore, the display unit can be identified from column (E) of the correspondence table, "External Lens Display." Next, the specified display unit information shown in FIG. 10(b) is created from the identified display unit and information related to display performance included in the identification information.
[0067] As described above, the correspondence table can be used to identify a display unit from the identification information of a connected device, and specific display unit information can be created by adding information related to the display performance of the identification information. By creating the specific display unit information in this manner, the lens device 100 of this embodiment can determine display item candidates and display content using the specific display unit information, which will be described later.
[0068] Next, a process for determining display item candidates using the correspondence table between specific display unit information and corresponding items will be described with reference to Fig. 11. The purpose of the process for determining display item candidates is to determine appropriate (preferably optimal) display item candidates for each specified display unit included in the specific display unit information. Fig. 11 is a correspondence table for determining optimal display item candidates for a display unit from the display unit items included in the specific display unit information.
[0069] In Figure 11, column (A) indicates the identified display unit, and column (B) indicates the candidate display items corresponding to column (A). For example, if the display unit is an "external lens display," a matching row is searched for among rows (1) to (5) of the display unit in column A of the correspondence table, and it is found to match row (1). By referring to the corresponding candidate display items (B), the candidate display items can be determined to be "error message," "zoom position," "focus position," "iris position," and "zoom speed."
[0070] The correspondence table between the specific display unit information and the corresponding items may be stored in advance in a storage unit (not shown), or may be changeable by providing a changing means (not shown). For example, a display unit and an operation unit (not shown) may be provided so that the user can directly edit the correspondence table.
[0071] Next, a process for determining display content based on display item candidates and specific display unit information will be described with reference to Fig. 12. The process for determining display content includes a display item determination process for selecting items to actually display from the display item candidates based on the specific display unit information, depending on the display format or display capacity of the display unit, and a display configuration determination process for determining where on the screen of the display unit the display items should be displayed, depending on the display format or display capacity of the display unit.
[0072] FIG. 12 is an example of display content determined from display item candidates and display performance. Column (A) shows display item candidates determined by display content determination unit 105. Columns (B) and (C) are the same as columns (D) and (E) in FIG. 7, respectively. Column (D) shows display items determined from display item candidates by the display content determination process. Column (E) shows the display configuration determined according to the display format and display capabilities of the display unit. Column (F) is the same as column (A) in FIG. 7.
[0073] 12, (1) to (3) indicate cases where the display content is determined from different display unit information. For example, the (1) line is information when the display content is determined from the display unit information of the L display unit 107 provided in the lens device 100. The (2) line corresponds to the C display unit 207 provided in the camera device 200, and the (3) line corresponds to the D display unit 307 provided in the operation device 300 as a demand device.
[0074] Here, we will provide additional information about the notation in columns (A) and (D) of row (1). The notation in the table is originally expressed as the item name to be displayed as written in rows (2) and (3), but to make the explanation easier to understand, we have deliberately used the character string that is actually displayed on the display. For example, in rows (2) and (3), "Err00" is displayed where "Error message" should be displayed. Below, we will explain the contents of row (1) as an example.
[0075] The display item candidate "Err00" in column (A) in Figure 12 corresponds to the "Error Message" in the other rows and indicates whether or not there is an error in the information storage device. "Err00" indicates that there is no error in the imaging system 10 of this embodiment. Next, "IrisFol: 2.8" corresponds to the "iris position" and indicates how wide the iris of the imaging system 10 is open. "ZoomFol: 150" corresponds to the "zoom position" and indicates how many millimeters the angle of view of the imaging system 10 is. "FocusFol: 300" corresponds to the "focus position" and indicates how many meters the subject distance of the imaging system 10 is. "ZoomSp: 80" corresponds to the "zoom speed" and indicates what percentage of maximum the zoom change speed of the imaging system 10 is.
[0076] First, we will explain how to determine the display items. The display item candidates for column (A) in Figure 12 are determined using the method described with reference to Figure 11. When a display device has a display range, there is a limit to the number of display items that can be displayed. Therefore, the number of characters required to display the display item candidates and the display items that can be displayed based on the display range are determined. Generally, display devices express the horizontal and vertical display range in units of dots (also called pixels), and an image is displayed by turning on or off one dot. Below, we will explain using row (1) as an example. For example, assume that the display item candidate "Error Message" is actually displayed as five characters, "Err00." One character is 20 x 20 dots, and with spaces between each character, it can be displayed as 21 x 21 dots. Therefore, we can see that 5 characters x 21 x 21 dots = 105 x 105 dots are required. Next, if the display range is 96 dots vertically and 384 dots horizontally, 96 ÷ 21 ≒ 4, and it can be determined that four characters vertically can be displayed. The width is 384 ÷ 21 ≒ 18, so it can be determined that 18 characters can be displayed horizontally.
[0077] As a result of these, if one item is simply displayed per line on a display area that can display 4 characters vertically and 18 characters horizontally, it is clear that only 4 of the 5 candidate display items can be displayed.In this way, the display range information can be used to adjust the items from the candidate display items to the number of items that can be displayed, and the display items can be determined.
[0078] Next, the determination of the display configuration will be explained. The display configuration may be any way to display the determined display items within the display range, but in this embodiment, it is determined so that one item per line is listed from the top of the display item candidates, as in the first line of FIG. 13(b). Also, if there are items and corresponding values, they may be displayed in separate columns, as in the fourth line of FIG. 13(b). In this way, the determination of how the determined display items are to be displayed on the display unit is shown in the display configuration of column (E) in FIG. 12. However, the display configuration may be such that the determined display items are enlarged to fill the screen, or simply the items are displayed consecutively from the top of the screen. The content described in this section is merely an example and is not limited thereto.
[0079] With the above configuration, it is possible to determine display items from the corresponding item candidates based on the specific display unit information and the display range, and to determine how the display items are to be displayed in the display range.
[0080] Next, an example of a UI displayed on the external UI of this embodiment will be described with reference to FIGS. 13(a) and 13(b). FIG. 13(a) shows an example of the C display unit 207, and FIG. 13(b) shows an example of the D display unit 307. The dotted lines in FIG. 13(a) indicate C display data, and the dotted lines in FIG. 13(b) indicate D display data. These are added for illustrative purposes and are not actually displayed. In this embodiment, the information within the dotted lines is added as shown. The C display data displays information necessary for "focus adjustment," "angle of view adjustment," and "brightness adjustment." For example, zoom speed information and subject distance are used. Furthermore, the display data is limited to two lines so as not to interfere with confirmation of the image display. The D display data displays information necessary for the "focus operator." For example, focus position information and focus operation authority information are used.
[0081] With the above configuration, the role and display unit of the device connected for communication can be identified, and the content to be displayed on the external UI can be determined based on the identified information, so that the display on the external UI always provides necessary information for the person viewing the UI. Even if the display capabilities of the display unit of the operation device 300 change, the display on the external UI can be changed according to the display capabilities as long as the information on the display unit can be identified. By performing the above processing, it becomes possible to display information on the external UI according to the role and display unit of the device connected for communication.
[0082] In this embodiment, the role information is shown in FIG. 8, but this is merely an example and is not limited thereto. Furthermore, the display information is described as identification information such as the presence or absence of a display unit and its display capabilities, but is not limited thereto. For example, it may be information such as whether or not transmission and reception of C display data is supported, or it may be setting information for the display unit of each device. By acquiring setting information for the display unit, display may be possible depending on the settings, but it is possible to change the display information output from the lens device 100 depending on whether or not the display is actually being performed.
[0083] In addition, in the display content determination process, communication information with the communication connection partner is monitored, and information that is not actually being communicated is set as the display content, but this is not limited to this. For example, information such as an abnormal state is information that the user should be aware of even if it is redundant, and the display content may be determined taking into account the above-mentioned display settings.
[0084] Furthermore, the role and display unit are automatically determined based on information acquired from each device, but are not limited to this. For example, the operator may directly set the role. Furthermore, the role may be determined in relation to the operator's lens settings (based on information related to the operator's unit settings). For example, when the focus drive range is limited, focus adjustment may be set as the role. Alternatively, the role or the display unit itself may be settable, or a priority for determining the display content may be settable. In this embodiment, the role is determined based on the functions of all connected operating members, but a single role may also be determined based on the operating status of the operating members. For example, if a state in which the zoom demand is being operated is detected as the operating status, the role is set as angle of view adjustment.
[0085] In addition, in this embodiment, the trigger for starting the role specification process, display specification process, display content determination process, and display information creation process is a communication connection with another communication connection device, but this is not limited to this. For example, a switch operation within the imaging system 10 may be used as the trigger, and all of these processes do not necessarily have to be performed in conjunction with each other. Also, while the display of the C display data is always displayed, this is not limited to this. For example, it may be displayed only when a switch to which the additional information display function is assigned is operated.
[0086] Furthermore, although the display information created in the display information creation process is primarily output to an external UI, it may also be output to the L display unit 107 provided within the device itself. In this embodiment, the role specification process, display specification process, display content determination process, and display information creation process are executed by the lens device 100, but this is not limitative. At least a part of each process may be executed by the camera device 200 or the operation device 300, for example.
[0087] According to this embodiment, it is possible to display necessary information in the most suitable location for the photographer, depending on the role of the photographer and the specified display unit. [Example]
[0088] Next, a second embodiment of the present invention will be described. In the first embodiment, an example was described in which all identified roles were equally assigned to operators. On the other hand, in this embodiment, an example is described in which, when multiple roles exist, priorities are assigned to the roles. Note that in this embodiment, descriptions of configurations or operations similar to those in the first embodiment will be omitted.
[0089] First, the L role identification unit 103a in this embodiment will be described with reference to Fig. 14. Fig. 14 is a block diagram of the L role identification unit 103a. The L role identification unit 103a in this embodiment differs from the L role identification unit 103 in the first embodiment in that it has an operation state detection unit 1034 and a role priority determination unit 1035. Note that other configurations of the L role identification unit 103a are similar to those of the L role identification unit 103, and therefore descriptions thereof will be omitted.
[0090] The role management unit 1033 manages the priority of roles in addition to the role information of the first embodiment. More specifically, the role management unit 1033 dynamically manages the priority of roles based on information from the role priority determination unit 1035. Details regarding the priority of roles will be described later with reference to FIG. 16.
[0091] The operation state detection unit 1034 detects that an operation member is being operated by the operator, and notifies the role priority determination unit 1035 of operation member information indicating which operation member has been operated. The operation state detection unit 1034 detects that an operation is being performed from a command value for driving a lens (not shown) of the lens device 100 received from the D communication unit 301, or from operation of an operation unit (not shown) of the lens device 100. Upon receiving a notification from the operation state detection unit 1034, the role priority determination unit 1035 notifies the role management unit 1033 that the priority of the operation member and the corresponding role has increased.
[0092] Next, with reference to Fig. 15, a process (role priority determination process) will be described in which the role priority determination unit 1035 notifies the role management unit 1033 of the priority when an operator has multiple roles. Fig. 15 is a flowchart showing the role priority determination process.
[0093] First, in step S501, the operation state detection unit 1034 determines whether or not operation member information has been detected. If it is determined that operation member information has been detected, the process proceeds to step S502. On the other hand, if it is determined that operation member information has not been detected, the process ends. Note that step S501 is executed every time an operation member is connected to the lens device 100.
[0094] In step S502, the operation state detection unit 1034 notifies the role priority determination unit 1035 of the operation member information. Then, in step S503, the role priority determination unit 1035 notifies the role management unit 1033 of the operation member information and that the role priority has changed (that the allocation priority has increased). Then, in step S504, the role management unit 1033 updates the priority of the role corresponding to the operation member information in the role information, and ends this processing.
[0095] Next, an example of the role priority determination process of the role management unit 1033 will be described with reference to Figs. 16(a) and 16(b). The role priority determination process is a process for determining the priority of a role. Fig. 16(a) shows role information before the role priority is changed, and Fig. 16(b) shows role information after the role priority is changed. The role management unit 1033 manages prioritized role information in which priorities are assigned to roles.
[0096] In this embodiment, the role management unit 1033 identifies roles from the role table as shown in Fig. 16(a) and shows an example where the priorities are held. As described with reference to Fig. 15, when the role management unit 1033 receives a notification from the role priority determination unit 1035 that the priority of the zoom operation device (wired) has increased, for example, the role management unit 1033 increases the priority of the angle of view adjustment, which was priority 3, to 1, and decreases the priorities of the focus adjustment and brightness adjustment by 1 each. Therefore, the role priorities are changed to the order shown in Fig. 16(b).
[0097] As described above, the role management unit 1033 dynamically manages the priority of roles. By dynamically managing the priority of roles, it is possible to perform optimal display according to the priority of the roles. For example, by displaying only the information necessary for roles with high priority or by displaying it in an emphasized manner, it is possible to display the information necessary for the operator in an easy-to-see manner.
[0098] In this embodiment, an example in which the priority is determined based on the operation state of the operation members has been shown, but the present invention is not limited to this, and the priority may be determined based on other information. For example, the priority may be determined based on the connection state of the operation members, such as increasing the priority of angle of view adjustment when a zoom operation device (wired) is connected. Furthermore, the priority may be determined based on the shooting state of the operator, such as increasing the priority of focus adjustment when AF does not focus. Additionally, the priority may be determined based on whether a predetermined time has passed, such as decreasing the priority of a role that has temporarily increased priority over time.
[0099] Although the present embodiment has been described with respect to an example in which priority is dynamically managed within the scope of a single operator's role, the present invention is not limited to this example. Priorities may also be influenced by the roles of multiple operators (multiple units). For example, when two operators are operating the focus, the priority of the focus adjustment of the other unit may be increased depending on the operation of the other operator. In other words, when multiple operators share roles, priorities may be determined based on the operation status of the multiple operators. Furthermore, the present embodiment has been described with respect to an example in which priority is determined automatically, but the present invention is not limited to this example. For example, priorities may be set by the user. Furthermore, in the present embodiment, the lens device 100 performs the role priority determination process, but the present invention is not limited to this example. For example, the camera device 200 or the operation device 300 may perform the role priority determination process. (Other Examples) The present invention can also be realized by supplying a program that realizes one or more functions of the above-described embodiments to a system or device via a network or a storage medium, and having one or more processors in the computer of the system or device read and execute the program. It can also be realized by a circuit (e.g., ASIC) that realizes one or more functions.
[0100] According to each embodiment, necessary information can be displayed on a display unit appropriate for the operator depending on the role of the operator. Therefore, according to each embodiment, it is possible to provide a control device, an imaging system, a control method, and a program that are advantageous in terms of operability of the imaging unit, for example.
[0101] The disclosure of each embodiment includes the following configurations and methods.
[0102] (Configuration 1) A control device capable of communicating with an imaging unit including a display unit, a communication unit that communicates with the unit; a processing unit that causes the unit to transmit display data of the display unit to the communication unit, The control device is characterized in that the processing unit generates the display data based on information regarding the operation of the unit acquired by the communication unit. (Configuration 2) 2. The control device according to configuration 1, wherein the information relating to the operation is information indicating the position of the unit. (Configuration 3) 2. The control device according to configuration 1, wherein the information relating to the operation is information relating to the function of the unit. (Configuration 4) 2. The control device according to configuration 1, wherein the information relating to the operation is information relating to the operational state of the unit. (Configuration 5) 2. The control device according to configuration 1, wherein the information relating to the operation is information relating to the role of the unit. (Configuration 6) 2. The control device according to configuration 1, wherein the information relating to the operation is information relating to the setting of the unit. (Configuration 7) 7. The control device according to any one of configurations 1 to 6, wherein the processing unit generates the display data based on the role of the operation corresponding to the information about the operation. (Configuration 8) 8. The control device according to configuration 7, wherein the processing unit determines the priority of the role based on the operation state of the unit, and generates the display data based on the priority. (Configuration 9) 8. The control device according to configuration 7, wherein the processing unit determines the priority of the role based on the connection state of the unit, and generates the display data based on the priority. (Configuration 10) 8. The control device according to configuration 7, wherein the processing unit determines the priority of the role based on the shooting state, and generates the display data based on the priority. (Configuration 11) A control device according to any one of configurations 1 to 10; an imaging system comprising the unit; (Configuration 12) the control device is included in one of a lens device, an imaging device, an operation device, a display device, and a VE device; 12. The imaging system according to claim 11, wherein the unit is included in another one of the lens device, the imaging device, the operation device, the display device, and the VE device. (Method 1) A control method for a control device capable of communicating with an imaging unit including a display unit, comprising: communicating with said unit to obtain information relating to the operation of said unit; generating display data for the display unit based on information about the operation; and transmitting the display data to the unit. (Configuration 13) A program that causes a computer to execute the control method described in Method 1.
[0103] Although the preferred embodiments of the present invention have been described above, the present invention is not limited to these embodiments, and various modifications and changes are possible within the scope of the gist of the present invention. [Explanation of symbols]
[0104] 100 Lens device (control device) 101 L Communications Department (Communications Department) 102 L calculation unit (processing unit)
Claims
1. A control device capable of communicating with an imaging unit including a display unit, a communication unit that communicates with the imaging unit; a processing unit that causes the communication unit to transmit display data from the display unit to the imaging unit, The control device, wherein the processing unit generates the display data based on information relating to the operation of the imaging unit acquired by the communication unit.
2. 2. The control device according to claim 1, wherein the information relating to the operation is information indicating a position of the imaging unit.
3. 2. The control device according to claim 1, wherein the information relating to the operation is information relating to the function of the imaging unit.
4. 2. The control device according to claim 1, wherein the information relating to the operation is information relating to an operational state of the imaging unit.
5. 2. The control device according to claim 1, wherein the information relating to the operation is information relating to a role of the imaging unit.
6. 2. The control device according to claim 1, wherein the information relating to the operation is information relating to settings of the imaging unit.
7. The control device according to claim 1 , wherein the processing unit generates the display data based on the role of the operation corresponding to the information about the operation.
8. The control device according to claim 7 , wherein the processing unit determines the priority of the role based on an operation state of the imaging unit, and generates the display data based on the priority.
9. The control device according to claim 7 , wherein the processing unit determines the priority of the role based on a connection state of the imaging unit, and generates the display data based on the priority.
10. The control device according to claim 7 , wherein the processing unit determines the priority of the role based on a shooting state, and generates the display data based on the priority.
11. A control device according to any one of claims 1 to 10; An imaging system comprising the imaging unit.
12. the control device is included in one of a lens device, an imaging device, an operation device, a display device, and a VE device; 12. The imaging system according to claim 11, wherein the imaging unit is included in another one of the lens device, the imaging device, the operation device, the display device, and the VE device.
13. A control method for a control device capable of communicating with an imaging unit including a display unit, comprising: acquiring information regarding operation of the imaging unit through communication with the imaging unit; generating display data for the display unit based on information about the operation; and transmitting the display data to the imaging unit.
14. A program causing a computer to execute the control method according to claim 13.