Control device, control method, and program

Abstract

To select an image appropriately representing control information for a trace function for controlling an imaging direction.SOLUTION: Control means executes controls of at least any one of zoom control, panning control and tilting control. Recording control means records control information indicating control by the control means during a first period. Determination means determines whether to record a still picture, which is imaged by imaging means, on the basis of the control by the control means during the first period. On the basis of the determination by the determination means, the recording control means records one or more still pictures imaged by the imaging means in association with the control information.SELECTED DRAWING: Figure 2

Description

[Technical field]

[0001] The present invention relates to a control technique for imaging. [Background technology]

[0002] In recent years, video production and distribution systems using IP (Internet Protocol) networks such as the Internet have come into use.

[0003] In such a system, video streams of video and audio output from cameras connected to an IP network are received by video editing equipment such as a switcher, and are edited as necessary as video for broadcast before being output.

[0004] Furthermore, among the imaging devices used in such systems, the number of imaging devices that can perform remote control of pan, tilt, zoom, and the like is increasing.

[0005] In such a system, a function called "preset" is used, which allows the setting of the imaging angle of view and imaging conditions to be performed all at once, and a function called "trace" is also used, which allows the operations such as panning, tilting, and zooming performed when moving the imaging direction from a specific imaging angle of view to another imaging angle of view to be recorded and then reproduced later.

[0006] Patent Document 1 proposes a technique for displaying an image corresponding to a preset recorded in a preset function, and enabling a desired preset to be selected based on the displayed image. [Prior art documents] [Patent documents]

[0007] [Patent Document 1] Japanese Patent Publication No. 11-242523 Summary of the Invention [Problem to be solved by the invention]

[0008] However, in the case of the trace function, unlike the preset function described in Patent Document 1, when reproducing operations such as pan, tilt, and zoom using the trace function, the pan, tilt, and zoom often change continuously, making it difficult to record an appropriate image.

[0009] Therefore, an object of the present invention is to make it possible to select an image that appropriately represents control information for a trace function for controlling an imaging direction. [Means for solving the problem]

[0010] In order to solve the above problems, the control device of the present invention has the following configuration: That is, the control device has a control means for executing at least one of zoom control for changing a zoom value of an imaging means that captures an image, pan control for changing an imaging direction of the imaging means in a pan direction, and tilt control for changing the imaging direction in a tilt direction, a recording control means for recording control information indicating control by the control means in a first period, and a determination means for determining whether to record a still image captured by the imaging means based on the control by the control means in the first period, and the recording control means causes one or more still images captured by the imaging means to be recorded in association with the control information based on the determination by the determination means. Effect of the Invention

[0011] According to the present invention, it is possible to select an image that appropriately represents control information for a trace function for controlling an imaging direction. [Brief description of the drawings]

[0012] [Figure 1] FIG. 1 is a diagram illustrating an example of the configuration of an imaging system according to each embodiment. [Diagram 2] FIG. 2 is a block diagram showing an example of the configuration of an imaging device (control device) in each embodiment. [Diagram 3]5 is a flowchart showing a process of recording image data in the first embodiment. [Figure 4] 4A to 4C are diagrams illustrating an example of angle of view control (imaging direction control) in the first embodiment. [Diagram 5] 10 is a flowchart showing another example of the process of recording image data in the first embodiment. [Figure 6] 6A to 6C are diagrams illustrating another example of the angle of view control (imaging direction control) in the first embodiment. [Figure 7] FIG. 4 is a diagram showing trace information (control information) according to each embodiment. [Figure 8] 10 is a flowchart showing a process for determining whether to record image data in the second embodiment. [Figure 9] 13 is a flowchart showing another example of the process of determining whether to record image data in the modified example of the second embodiment. [Figure 10] 13 is a flowchart showing another example of the process of determining whether or not to record image data in the modified example of the second embodiment. [Figure 11] FIG. 2 is a diagram illustrating an example of a hardware configuration according to each embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0013] Hereinafter, an embodiment of the present invention will be described in detail with reference to the attached drawings. Note that the embodiment described below is one example of a means for realizing the present invention. The present invention should be appropriately modified or changed depending on the configuration of the device to which the present invention is applied and various conditions, and the present invention is not necessarily limited to the following embodiment. Furthermore, not all combinations of configurations described in the embodiments are necessarily essential to the solution of the present invention. Furthermore, the term "image" below does not necessarily mean a moving image, but may also mean a still image.

[0014] First Embodiment A first embodiment of the present invention will be described below. Fig. 1 is a diagram showing an example of the configuration of an imaging system according to the first embodiment.

[0015] This imaging system includes an imaging device 1 that captures an image of a subject, and a client device 2 that is connected to the imaging device 1 via a network 3 in a state in which they can communicate with each other.

[0016] The client device 2 is a device such as a controller, and is an external device to the imaging device 1. The client device 2 transmits camera control commands to the imaging device 1 to perform control such as field angle control (including control to change the imaging direction) and image quality control, etc. The imaging device 1 executes processing according to the camera control command from the client device 2, and transmits a response indicating the execution result to the client device 2.

[0017] 2 is a block diagram showing an example of the configuration of the imaging device 1 of this embodiment. As an example, the imaging device 1 is provided with a function as a control device inside, but the function as the control device may be provided separately from the imaging device.

[0018] This imaging device 1 has a system control unit 11, an imaging unit 12, an image processing unit 13, a lens driving unit 14, a zoom control unit 15, a focus control unit 16, a pan driving unit 17, a tilt driving unit 18, and a pan / tilt control unit 19.

[0019] The imaging device 1 also has a recording unit 20 that records imaging condition settings, video data, presets, trace information (control information), thumbnails, etc. The imaging device 1 also has a program memory 21 that stores a control program, and a communication unit 30 that communicates with the client device 2 via the network 3.

[0020] The recording unit 20 records the angle of view setting value (pan value, tilt value, or zoom value) in the internal storage or external storage. The recording unit 20 also records parameters indicating imaging conditions such as image quality setting values, video data, thumbnails, etc. The recording unit 20 has a non-volatile memory 20a such as a flash memory or an EEPROM (Electrically Erasable Programmable Read-Only Memory). Parameters indicating imaging conditions such as the angle of view setting value and image quality setting value can be saved in the non-volatile memory 20a.

[0021] The program memory 21 is a memory that stores a camera control program. The system control unit 11 may execute various processes based on the camera control program recorded in the program memory 21.

[0022] The system control unit 11 controls the entire imaging device 1, and issues processing instructions to each unit other than the system control unit 11, from the imaging unit 12 to the communication unit 30. The system control unit 11 also analyzes a camera control command received from the client device 2 via the communication unit 30, and causes each unit to execute processing according to the camera control command.

[0023] Here, the camera control commands include angle of view control (imaging direction control) commands that control pan, tilt, zoom, etc., image quality control commands that control imaging conditions such as gamma and color matrix, and request commands to obtain video data and setting values.

[0024] When video data is requested by the client device 2, the system control unit 11 transmits the video data generated by the image processing unit 13 to the client device 2 via the communication unit 30. Furthermore, the system control unit 11 receives a request command from the client device 2 requesting information indicating setting values ​​of the imaging device 1, such as zoom, focus, pan / tilt, etc. Upon receiving the request command, the system control unit 11 reads the requested setting values ​​(pan value, tilt value, zoom value) from the image processing unit 13, zoom control unit 15, focus control unit 16, and pan / tilt control unit 19, and transmits them to the client device 2 via the communication unit 30. Note that the setting values ​​of zoom, focus, pan / tilt, etc. include not only the current values, but also related information such as the range of values ​​that can be set in the imaging device 1.

[0025] When the system control unit 11 receives an angle of view control command for setting or changing zoom, focus, or pan / tilt, it controls the image processing unit 13, zoom control unit 15, focus control unit 16, and pan / tilt control unit 19 according to the setting value specified by the command. In this way, the system control unit 11 functions as a control means that performs zoom control that changes the zoom value in the imaging device 1. The system control unit 11 also functions as a control means that executes pan control that changes the imaging direction in the imaging means in the pan direction, and tilt control that changes the imaging direction in the tilt direction.

[0026] The image processing unit 13, the zoom control unit 15, the focus control unit 16, and the pan / tilt control unit 19 control the operations of the imaging unit 12, the lens driving unit 14, the pan driving unit 17, and the tilt driving unit 18, respectively, under control of the system control unit. As a result, the setting values ​​related to zoom, focus, and pan / tilt set in the client device 2 are reflected in the imaging device 1.

[0027] Furthermore, when the system control unit 11 receives an image quality control command for setting gamma, it controls the operation of the image processing unit 13 according to the setting value instructed by the command. The image processing unit 13 controls the operation of the imaging unit 12 according to the control from the system control unit 11. As a result, the gamma setting value set in the client device 2 is reflected in the imaging device 1.

[0028] The imaging unit 12 includes a lens and an image sensor, and captures an image of a subject and converts it into an electrical signal.

[0029] The image processing unit 13 performs predetermined image processing, resolution conversion processing, and compression encoding processing on the electric signal obtained by photoelectric conversion of the image captured by the imaging unit 12, thereby generating video data. The video data generated by the image processing unit 13 is transmitted to the client device 2 via the network 3 by the communication unit 30.

[0030] The lens driving unit 14 includes a driving system for the focus lens and zoom lens of the imaging unit 12 and a motor as a driving source thereof, and is controlled by a zoom control unit 15 and a focus control unit 16 .

[0031] The zoom control unit 15 instructs the lens driving unit 14 to change the zoom lens position based on the zoom setting value instructed by the system control unit 11. Here, the zoom control unit 15 manages, for example, the focal length as the zoom setting value.

[0032] The focus control unit 16 instructs the lens driving unit 14 to change the focus lens position based on the focus setting value instructed by the system control unit 11. The focus position is changed by changing the position of the focus lens.

[0033] The pan driving unit 17 includes a mechanical driving system that performs panning and a motor that serves as a driving source, and performs panning under control of the pan / tilt control unit 19. That is, the pan driving unit 17 changes the imaging direction in the pan direction.

[0034] Tilt driving unit 18 includes a mechanical driving system that performs tilt operation and a motor that serves as a driving source, and performs tilt operation according to control from pan / tilt control unit 19. That is, tilt driving unit 18 changes the imaging direction in the pan direction.

[0035] The pan / tilt control unit 19 controls the operation of the pan driving unit 17 and the tilt driving unit 18 based on the pan / tilt setting values ​​instructed by the system control unit 11, and changes the imaging direction in the pan direction or tilt direction.

[0036] The operation of the imaging system will be described below with reference to FIGS.

[0037] FIG. 3 is a flowchart showing an example of recording thumbnail images when recording trace information in this embodiment.

[0038] The process in Fig. 3 is executed when a user operates the client device 2 to perform camera control to instruct the imaging device 1 to start recording trace information. Fig. 4 is a diagram showing an example of angle of view control in this embodiment. Trace recording is started from the state of imaging angle of view 201 shown in Fig. 4. Then, by controlling pan driving and tilt driving along the trajectory shown by the dashed line, the imaging device 1 is controlled from imaging angle of view 201 to imaging angle of view 202, and then to imaging angle of view 203, and trace recording is ended at imaging angle of view 203.

[0039] FIG. 5, which will be described later, is a flow chart showing an example of recording thumbnails during trace recording in a modified example of this embodiment. The process in FIG. 5 is executed when a user operates the client device 2 and performs camera control to instruct the start of trace recording of the imaging device 1. FIG. 6 is a diagram showing an example of angle of view control in a modified example of this embodiment. The control in FIG. 6 shows an example of starting trace recording from a state of an imaging angle of view 211, controlling the camera to pan and tilt along the trajectory shown by the dashed line, thereby performing camera control from the imaging angle of view 211 to the imaging angle of view 213, and ending the trace recording at the imaging angle of view 213.

[0040] When the user operates the client device 2 to perform camera control to instruct the start of trace recording, the client device 2 supplies the imaging device 1 with a camera control command to instruct the start of trace recording.

[0041] The following describes the processing shown in Fig. 3. Note that common reference numerals are used to designate common processes between Fig. 3 and Fig. 5.

[0042] First, in S111, the system control unit 11 judges whether or not control to stop recording of the trace has been instructed. If control to stop recording of the trace has not been instructed, the process proceeds to S112.

[0043] In S112, the system control unit 11 performs control of panning, tilting, zooming, etc. in accordance with a control instruction from the client device 2, and the process proceeds to S113.

[0044] It should be noted that while the controls of S111 to S114 are being performed, the system control unit 11 records trace information in the recording unit 20 in parallel.

[0045] Here, the recorded trace information will be described with reference to FIG.

[0046] 7 is a diagram showing an example of trace information stored in the storage unit 20 by the system control unit 11. The trace information is used to reproduce the pan control, tilt control, and zoom control that were performed when the trace information was recorded.

[0047] The trace information is associated with a trace ID, and when the trace ID is designated by the client device 2, pan control, tilt control, and zoom control are reproduced under the control of the system control unit 11.

[0048] The trace information of trace ID1 in FIG. 7 corresponds to the change in the imaging angle of view (including the change in the imaging direction) shown in FIG. 4, for example.

[0049] The trace information includes information indicating the angle of view at the start coordinate (p0, t0) indicating the pan value (pan angle), tilt value (tilt angle), and zoom value at the angle of view at the start point corresponding to the imaging angle of view 211. Note that at least the pan value and tilt value need to be recorded. The trace information also includes information indicating the angle of view at the coordinate (p2, t2) at the end point of trace recording. Note that if the information on the elapsed time of 2000 ms includes information indicating a period (e.g., 100 ms) for which the imaging direction is to be changed by this information, the information indicating the stop coordinates can be omitted. This is because the desired stop coordinates can be reached by changing the imaging direction for a predetermined period (e.g., 100 ms) according to the information on the elapsed time of 2000 ms.

[0050] The trace information includes pan control information, tilt control information, and zoom control information at the time when a new control command is instructed. Furthermore, the trace information may include pan control information, tilt control information, and zoom control information for each predetermined time. For example, information indicating the control command instructed at an elapsed time of 1035 ms is recorded as follows: pan speed 18, pan direction Right, tilt speed 2, tilt direction Down, zoom speed 0, and no zoom direction.

[0051] The pan control information includes information indicating the speed at which the imaging direction is changed in the pan direction and the pan direction (right or left). The tilt control information includes information indicating the speed at which the imaging direction is changed in the tilt direction and the tilt direction (up or down). The zoom control information includes information indicating the speed at which the zoom magnification is changed and whether to enlarge or widen the zoom. Note that if the direction does not change from the previous direction (left or right, or up or down), the information indicating the direction may be omitted in the trace information and only the information indicating the speed may be used.

[0052] Here, the intermediate coordinates (p1, t1) corresponding to the imaging angle of view 212 are coordinates at the time when the change in the imaging direction stops in the pan direction or tilt direction. The stop point may be the time when the change in the pan direction is reversed, that is, when the imaging direction changes from right to left (or from left to right), rather than the time when the imaging direction stops completely. Even in such a case, the pan direction is temporarily stopped. The stop point may be the time when the change in the tilt direction is reversed, that is, when the imaging direction changes from up to down (or from down to up). Even in such a case, the tilt direction is temporarily stopped.

[0053] 7, the tilt direction changes from up to down at an elapsed time of 1035 ms. At this point, the system control unit 11 determines that the imaging direction has stopped in the tilt direction.

[0054] Also, at the time when the control finally stops, 2100 ms later, the system control unit 11 determines that the pan control, tilt control, and zoom control have stopped.

[0055] Returning to the description of FIG. 3, in S113, the system control unit 11 checks the state of pan, tilt, and zoom based on the control in S112, and if it is determined that any one of the pan, tilt, and zoom controls has started or stopped, the process proceeds to S114. Here, the timing at which these controls stop may not necessarily coincide with the time at which these controls are instructed. In other words, it may take time from when an instruction (command) is input until the instruction is actually reflected. In that case, the process of S114 may be executed when it is determined that any one of the pan, tilt, and zoom controls has actually started or stopped. Alternatively, it is possible to execute the process of S114 at the time when the instruction is input. Whether the instruction is immediately reflected or not depends on the state of the imaging device 1 when the instruction is issued (the current moving speed and the setting of the acceleration / deceleration mode) until the stoppage. For example, the faster the current speed when instructing, the longer it takes until the stoppage. Therefore, it is determined that the imaging device has actually stopped after a specific time has elapsed since the instruction to stop (reverse) was issued. For example, it is possible to check the driving state to determine whether to stop, or to calculate the time from the instruction to stop (reverse) to the actual stop, and determine whether to stop after the calculated time has elapsed.

[0056] Next, in S114, the system control unit 11 acquires image data generated by the image processing unit 13 at the time when it is determined that any one of the pan, tilt, and zoom controls has started or stopped. Then, the system control unit 11 records the acquired one or more image data (thumbnail images) in the recording unit 20. At this time, the image data is recorded in association with a trace ID or trace information. For example, the image data may be recorded together with the trace information, or the trace ID may be included in the metadata of the image data.

[0057] The image data recorded here is, as an example, a still image. However, even if the image recorded is a still image, a plurality of recorded still images may be displayed in succession to be displayed like a moving image.

[0058] Also, at this time, the acquired image data may be recorded after a process of reducing the size. Of course, a process of reducing the size to a plurality of sizes may be performed and each may be recorded. In this way, the system control unit 11 also functions as a recording control means. In this way, the system control unit 11 also functions as a determination means for determining whether or not to record the captured image data (still image) based on the control in the first period during which the trace is recorded. Here, the first period is the period from when the recording of the trace, which will be described later, begins to when it ends.

[0059] For example, in FIG. 4, pan and tilt control is started at an imaging angle of view 201, and therefore image data at the imaging angle of view 201 is recorded.

[0060] Since the zoom speed becomes 0 at an elapsed time of 100 ms in the trace information of trace ID 1 in FIG. 7, the system control unit 11 executes recording of the image data captured at that time.

[0061] Furthermore, since the tilt control is momentarily stopped (reversed from upward to downward) at the imaging angle of view 202 (elapsed time 1035 ms), image data of the imaging angle of view 202 is recorded.

[0062] Furthermore, since all pan and tilt controls are stopped at the imaging angle of view 202, image data of the imaging angle of view 202 is recorded.

[0063] Here, the image data may be recorded when it is determined that any one of pan, tilt, and zoom control is stopped, or when a specific time has elapsed while the control is stopped. The specific stop time may be set to a predetermined value, or may be set to a specific value by the user.

[0064] In addition, when determining whether the control of any one of pan, tilt, and zoom has stopped, the image data may be recorded at a timing determined in advance. For example, the timing to stop is determined in advance based on a stop command and a control state such as a transition of the control speed and an acceleration / deceleration setting, and the image data is temporarily recorded at the determined timing.

[0065] After that, the image data that was temporarily recorded at the timing when the camera stopped is actually recorded. This makes it possible to reduce the discrepancy between the timing when the image data is acquired and the timing when the control of one of the pan, tilt, or zoom stops.

[0066] Furthermore, when recording image data, the time that has elapsed since the start of trace recording at the timing when it is determined to record the image data may be added to the image data and recorded. By adding the time that has elapsed since the start of trace recording to the image data, when presenting image data showing an overview of the behavior of the trace to a user, it becomes possible to switch the display of the image data based on the elapsed time added to each image data. As a result, for example, when displaying each image data while switching it according to the elapsed time, it becomes possible to present, in a small display area, how much time has elapsed since the start and to which imaging angle of view it is controlled.

[0067] Furthermore, when recording image data, the angle of view setting value at the timing when it is determined to record the image data may be added to the image data and recorded. By adding the angle of view setting value to the image data, when presenting image data showing an overview of the tracing behavior to the user, an overview of the control direction between each piece of image data can be obtained from the image data. This makes it possible to present, for example, the control direction between each piece of image data when displaying the pieces of image data side by side.

[0068] In S113, the system control unit 11 checks the pan, tilt, and zoom states based on the control in S112, and if it is determined that the control of any one of pan, tilt, and zoom has not started or stopped, the process returns to S111. In S111, if control to stop trace recording is instructed, the system control unit 11 performs a process to stop trace recording and ends the process of trace recording.

[0069] The system control unit 11 transmits one or more pieces of image data recorded as described above to the client device 2 via the communication unit. The client device 2 displays the received image data on the display unit, so that the user can check the image reproduced by the trace information.

[0070] As described above, in this embodiment, image data is recorded at the timing of start and stop (including momentary stop) of at least one of pan, tilt, and zoom controls among the controls during trace recording. This creates image data showing an overview of the control reproduced by tracing. Therefore, by checking multiple image data associated with the trace information, the user can easily grasp the control reproduced by the trace information.

[0071] In the above embodiment, in S113, the system control unit 11 checks the pan, tilt, and zoom states based on the control in S112, and determines whether the control of any one of the pan, tilt, and zoom has started or stopped. However, as shown in Fig. 5, the system control unit 11 may be configured to determine whether the magnitude relationship between the pan and tilt speeds has changed in S123.

[0072] 6, when pan and tilt control is performed according to the dashed line from imaging angle of view 211 to imaging angle of view 213, the magnitude relationship between the pan and tilt speeds changes from pan<tilt to pan>tilt at imaging angle of view 212. In this case, image data for imaging angle of view 212 can be recorded.

[0073] The trace information of trace ID2 in Fig. 7 corresponds to the change in the imaging angle of view (including the change in the imaging direction) shown in Fig. 6 as an example. In the example shown in Fig. 7, at an elapsed time of 815 ms (corresponding to the imaging angle of view 212 in Fig. 6), the rate of change in the tilt direction is greater than the rate of change in the pan direction. At this point, the system control unit 11 records the image data. Also, when the magnitude relationship between the speeds changes, information indicating the magnitude relationship is stored in S125 and is referred to in subsequent determinations.

[0074] Note that the system may be configured to record image data when either the determination in S113 or the determination in S123 is true. In other words, the process in Fig. 3 and the process in Fig. 5 may be performed simultaneously. This makes it possible to record image data when the control of any one of pan, tilt, and zoom starts or stops, when it remains stopped for a specific period of time after stopping, or when the magnitude relationship between the pan and tilt speeds changes. This makes it easier to grasp the outline of the trace behavior.

[0075] <Second embodiment> Hereinafter, the second embodiment will be described with reference to Figures 8, 9, and 10. Note that descriptions of parts similar to those of the other embodiments will be omitted where appropriate.

[0076] In the above-described first embodiment, a method for recording image data based on control during trace recording was described. In the second embodiment, however, a decision as to whether or not to record image data is made again depending on changes from the last time image data was recorded.

[0077] The details of this embodiment will be described below.

[0078] The operation of the imaging system will be described below with reference to FIGS.

[0079] Fig. 8 is a flowchart showing an example of determining whether to record image data depending on a change from the previous time when the image data was recorded in this embodiment. The process in Fig. 8 is executed when the user operates the client device 2 to perform camera control to instruct the imaging device 1 to start recording the trace.

[0080] In S133, as described in the first embodiment, when any one of pan, tilt, and zoom control is started or stopped, image data captured at that time is selected as a candidate for a thumbnail image.

[0081] In S134, the system control unit 11 measures the time that has elapsed since the image data was previously selected as a thumbnail image, and judges whether or not a specific time has elapsed. If it is judged that the specific time has elapsed, the process proceeds to S114. In S114, the configuration and contents are equivalent to those described in FIG. 3. That is, the image selected as a candidate for the thumbnail image in S133 is recorded as an actual thumbnail image. Thereafter, the process returns to S111. Since the configuration and contents of S111 are equivalent to those described in FIG. 3, a description thereof will be omitted. The specific time may be configured to be set to a predetermined time, or may be configured to be set by the user.

[0082] As described above, if the control of any of pan, tilt, and zoom is started or stopped again before a specific time has elapsed, the image data at that time can be prevented from being included in the final thumbnail image. Alternatively, if the magnitude relationship between the pan and tilt speeds changes again before a specific time has elapsed, the image data at that time can be prevented from being included in the final thumbnail image. This prevents image data with little change from being recorded in the image data to be recorded based on the determination of image data recording, making it possible to reduce the amount of image data required to show an overview of the tracing behavior.

[0083] In the embodiment described above, in S134, the system control unit 11 measures the elapsed time since the previous image data was recorded and determines whether a specific time has elapsed. However, the process may be as shown in FIG. 9.

[0084] Fig. 9 is a flowchart showing an example of determining whether to record image data depending on a change from the previous time when the image data was recorded in a modified example of this embodiment. The process in Fig. 9 is executed when the user operates the client device 2 to perform camera control to instruct the imaging device 1 to start recording the trace.

[0085] 9, the system control unit 11 may be configured to determine in S144 whether the angle of view setting value (pan value, tilt value, or zoom value) when the image data was previously recorded has changed by a predetermined amount or more. The specific value may be configured to be set to a predetermined value, or may be configured to be user-settable.

[0086] Alternatively, the process may be as shown in Fig. 10. Fig. 10 is a flow chart showing an example of determining whether or not to record image data according to a preset determination standard in a modified example of this embodiment. The process in Fig. 10 is executed when a user operates the client device 2 to perform camera control to instruct the imaging device 1 to start recording a trace.

[0087] 10, the system control unit 11 may be configured to determine whether or not to record image data depending on whether the determination result exceeds a preset determination level in S154. For example, the determination level is set to 3 when all of the pan, tilt, and zoom controls are started or stopped. The determination level is set to 2 when any two of the pan, tilt, and zoom controls are started or stopped. The determination level is set to 1 when any one of the pan, tilt, and zoom controls is started or stopped.

[0088] At this time, if the judgment level at the time of judgment is set to 2 or more in advance, image data is recorded when all pan, tilt, and zoom controls are started or stopped, or when any two of pan, tilt, and zoom controls are started or stopped. Also, when any one of pan, tilt, and zoom controls is started or stopped, image data can be prevented from being recorded. This makes it possible to set the level at which image data is recorded for image data that is to be recorded based on the judgment of recording image data, and thus makes it possible to reduce the amount of data required to show an overview of the behavior of the trace. The judgment level may be configured to be set to a predetermined value, or may be configured to be set by the user to a specific value.

[0089] Although the embodiments of the present invention have been described above, the present invention is not limited to these embodiments, and various modifications and changes are possible within the scope of the gist of the present invention. Furthermore, the present invention can be embodied as, for example, a system, an apparatus, a method, a program, or a recording medium.

[0090] (Other Examples) Next, a hardware configuration for realizing each function of the control device of each embodiment will be described with reference to Fig. 11. Note that each component of the camera other than the image sensor and the lens in each embodiment may also be realized by the hardware configuration shown in Fig. 11.

[0091] The RAM (Radom Access Memory) 1102 temporarily stores computer programs executed by the CPU (Central Processing Unit) 1101. The RAM 1102 also temporarily stores data (commands and video data) acquired from the outside via the communication interface 1104. The RAM 1102 also provides a work area used when the CPU 1101 executes various processes. The RAM 1102 also functions as, for example, a frame memory or a buffer memory.

[0092] The CPU 1101 executes computer programs stored in the RAM 1102. In addition to the CPU, a processor such as a DSP (Digital Signal Processor) or an ASIC (Application Specific Integrated Circuit) may also be used.

[0093] An HDD (Hard Disk Drive) 1103 stores an operating system program and video data, as well as computer programs.

[0094] Computer programs and data stored in the HDD 1103 are loaded into the RAM 1102 as appropriate under the control of the CPU 1101, and executed by the CPU 1101. Other storage media such as flash memory may be used instead of the HDD. A bus 1105 connects the various pieces of hardware. The various pieces of hardware exchange data via the bus 1105. The above is the hardware configuration in each embodiment.

[0095] The present invention can also be realized by a process in which one or more processors read and execute a program that realizes one or more functions of the above-mentioned embodiments. The program may be supplied to a system or device having a processor via a network or a storage medium. The present invention can also be realized by a circuit (e.g., ASIC) that realizes one or more functions of the above-mentioned embodiments.

[0096] Moreover, the control device in each embodiment may be realized by hardware as shown in FIG. 11, or can be realized by software.

[0097] Furthermore, the present invention is not limited to the above-described embodiments, and various modifications are possible without departing from the spirit of the present invention. For example, combinations of the embodiments and modifications are also included in the disclosure of this specification. [Explanation of symbols]

[0098] 11 System control section 12 Imaging unit 19 Pan / tilt control section 15 Zoom control section 20 Recording Section 30 Communications Department

Claims

1. A control means for executing at least one of a zoom control for changing a zoom value of an image capturing means for capturing an image, a pan control for changing an image capturing direction of the image capturing means in a pan direction, and a tilt control for changing the image capturing direction in a tilt direction; a recording control means for recording control information indicating control by the control means during a first period; a determination means for determining whether to record a still image captured by the imaging means based on the control by the control means during the first period; having The recording control means causes one or more still images captured by the imaging means to be recorded in association with the control information based on the determination by the determination means. A control device comprising:

2. The determination means determines to record a still image captured by the imaging means when a change in the imaging direction in the pan direction or the tilt direction stops.

2. The control device according to claim 1.

3. The determining means determines that the still image captured by the imaging means is to be recorded when the change in the zoom value stops.

2. The control device according to claim 1.

4. The determination means determines to record the still image captured by the imaging means when a magnitude relationship between a speed of change of the imaging direction in the pan direction and a speed of change of the imaging direction in the tilt direction changes.

2. The control device according to claim 1.

5. The determination means determines that a still image captured by the imaging means is to be recorded when a change in the imaging direction in the pan direction or the tilt direction stops for a predetermined period of time.

2. The control device according to claim 1.

6. The determining means does not determine to record the still image captured by the imaging means until a predetermined time has elapsed after determining to record the first image.

2. The control device according to claim 1.

7. After determining that the first image is to be recorded, the determining means does not determine that the still image captured by the imaging means is to be recorded until at least one of the zoom control, the pan control, and the tilt control changes by a predetermined amount or more.

2. The control device according to claim 1.

8. The recording control means records a still image captured by the imaging means in association with information indicating control information related to the control of the control means.

2. The control device according to claim 1.

9. The control information is information regarding an angle of view.

9. The control device according to claim 8.

10. The still image is a thumbnail image.

2. The control device according to claim 1.

11. a control step of executing at least one of a zoom control for changing a zoom value of an imaging means for capturing an image, a pan control for changing an imaging direction of the imaging means in a pan direction, and a tilt control for changing the imaging direction in a tilt direction; a recording control step of recording control information indicating control performed by the control step during a first period; a determination step of determining whether to record a still image captured by the imaging means based on the control by the control step during the first period; having In the recording control step, based on the determination in the determination step, one or more still images captured by the imaging means are recorded in association with the control information. A control method comprising:

12. A program for causing a computer to execute the control method according to claim 11.

Images