Imaging device and control method and program therefor, and system
Patent Information
- Application Number
- JP2022156461
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2022-09-29
- Publication Date
- 2025-09-25
- Estimated Expiration
- 2042-09-29
AI Technical Summary
Existing imaging devices lack sufficient metadata for reference by external devices during IP streaming, as metadata is not fully recorded and transmitted from the start to the end of video recording.
An imaging device that generates and transmits metadata related to the start and end of recording, along with video data, to an external device via communication means, ensuring comprehensive metadata capture and transmission.
Enables the recording and transmission of video data with associated metadata from start to end, facilitating efficient metadata utilization by external devices.
Smart Images

Figure 00000000_0000_ABST
Abstract
Description
[Technical field]
[0001] The present invention relates to an imaging apparatus, a control method, a program, and a system thereof. [Background technology]
[0002] In recent years, IP broadcasting systems are becoming more prevalent at news sites such as broadcasting stations and news agencies, and IP streaming technology is being used to continuously transmit video data being shot by video processing devices such as digital still cameras and digital video cameras to the outside via a network. In addition, by utilizing additional information files in which various metadata about the video data being shot is written, news reporting with high speed and speed is realized more quickly and easily. For example, metadata such as the video format and recording length can be recorded in the additional information file along with the shot video. In addition, communication can be performed between a mobile terminal and a digital video camera, and coverage information such as the coverage title and coverage location can be written in the additional information file at the reporting site. The additional information file is used, for example, as information to more easily search for desired video data in a video data server. In this case, the format and recording length of the video data can be known by viewing various metadata of the video data. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] JP 2004-363825 A Summary of the Invention [Problem to be solved by the invention]
[0004] The metadata (additional information) recorded in the additional information file associated with the video data includes not only the additional information set by the user, but also the additional information updated when the video recording starts and when the recording ends. In Patent Document 1, when recording video data (video data), metadata related to the video data is also created at the same time and stored inside the device. However, when the video processing device itself performs IP streaming and stores the video data in an external device as a communication destination, there is a problem that there is a shortage of metadata to be referenced by the external device if the additional information file stored inside the device is simply transmitted to the external device as is as in Prior Document 1.
[0005] The present invention has been made in consideration of the above-mentioned problems, and aims to provide a technology that enables a device that records moving image data to be provided with and record not only a file of the moving image data, but also a metadata file that describes metadata from the start to the end of recording of the moving image. [Means for solving the problem]
[0006] In order to solve this problem, for example, an imaging device according to the present invention has the following configuration. An imaging device having a communication means, which transmits captured moving image data to an external device for recording via the communication means, a video transmission means for receiving an instruction to start recording, transmitting video data obtained by imaging using the imaging means to the external device via the communication means, and for receiving an instruction to end recording, ending transmission of the video data to the external device; a metadata generating means for generating metadata related to the start of recording of the moving image upon receiving an instruction to start recording, and generating metadata related to the end of recording of the moving image upon receiving an instruction to end recording; The recording device further comprises a metadata transmission means for receiving an instruction to end the recording and transmitting metadata from the start of the recording to the end of the recording to the external device via the communication means. Effect of the Invention
[0007] According to the present invention, it is possible to record moving image data and metadata from the start to the end of the moving image data. [Brief description of the drawings]
[0008] [Figure 1] FIG. 1 is a diagram showing an example of a system configuration according to a first embodiment. [Diagram 2] FIG. 1 is a block diagram of a digital video camera. [Diagram 3] A diagram showing the structure of an XML file. [Figure 4] FIG. 1 is a block diagram of a network recorder. [Diagram 5] 4 is a flowchart showing the basic operation of the digital video camera. [Figure 6] A diagram showing the UI for selecting an XML file for settings. [Figure 7] 4 is a flowchart showing the basic operation of the network recorder. [Figure 8A] 5 is a flowchart showing a characteristic processing procedure of the digital video camera according to the first embodiment. [Figure 8B] 5 is a flowchart showing a characteristic processing procedure of the network recorder according to the first embodiment. [Figure 9] FIG. 11 is a system configuration diagram according to a second embodiment. [Figure 10] FIG. 2 is a block diagram of a controller. [Figure 11] 4 is a flowchart showing a basic operation of a controller. [Figure 12A] 10 is a flowchart showing a characteristic processing procedure of a controller according to the second embodiment. [Figure 12B] 10 is a flowchart showing a characteristic processing procedure of a digital video camera according to a second embodiment. [Figure 13] FIG. 1A is a diagram showing an example of metadata at the start of recording an XML file on a digital video camera, and FIG. 1B is a diagram showing an example of corrected metadata at the start of recording an XML file on a network recorder. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0009] Hereinafter, the embodiments will be described in detail with reference to the attached drawings. Note that the following embodiments do not limit the invention according to the claims. Although the embodiments describe a number of features, not all of these features are essential to the invention, and the features may be combined in any manner. Furthermore, in the attached drawings, the same reference numbers are used for the same or similar configurations, and duplicated descriptions are omitted.
[0010] [First embodiment] Fig. 1 is a diagram showing an example of a system configuration of this embodiment. The system includes a digital video camera 100 that shoots moving images and creates and transmits metadata, and a network recorder 200 that stores the moving image data and metadata transmitted from the digital video camera 100. In this embodiment, the digital video camera 100 and the network recorder 200 are connected via a local area network (LAN). The digital video camera 100 and the network recorder 200 may be connected via a network switch or the like. The communication protocol is the Internet Protocol, but there is no particular restriction on the type. Furthermore, the connection form may be either wired or wireless.
[0011] 2 is a block diagram of the digital video camera 100. The digital video camera 100 has a control unit 101, an image compression / decompression unit 102, an imaging unit 103, an image processing unit 104, a network I / F 105, a display unit 106, an operation unit 107, a ROM 108, a RAM 109, and a recording medium I / F 110. These components are driven by power obtained by rectifying AC power supplied from an external source to a predetermined voltage, or by power supplied from a built-in battery (not shown).
[0012] The control unit 101 is composed of a processor such as a CPU, and controls the entire device. Specifically, the control unit 101 loads a program recorded in the ROM 108 into the RAM 109 and executes it to control each component and perform calculation processing, and executes processing according to a flowchart described later. The ROM 108 is a non-volatile memory, and stores the programs executed by the control unit 101 and various settings.
[0013] The RAM 109 is a volatile memory used as a working memory for the control unit 101. The RAM 109 is also used as a VRAM (Video Random Access Memory) for temporarily storing data to be compressed or expanded by the image compression / expansion unit 102, such as image data captured by the imaging unit 103 and processed by the image processing unit 104, or image data read from the recording medium 111, or data to be displayed on the display unit 106. The RAM 109 is also used as a RAM for temporarily storing an XML (Extensible Markup Language) file to be recorded in association with the captured image, and metadata to be written in the XML file. The XML file is generated under the control of the control unit 101. The XML file is generated using metadata (additional information) included in a setting XML file received from an external device by the network I / F 105 or a setting XML file recorded on the recording medium 111, and metadata that can be obtained at the start of recording or the completion of recording. Details of the metadata configuration included in the XML file will be described later with reference to FIG. 3.
[0014] The control unit 101 also functions as a display control unit, since it generates display data for the display unit 106 and controls the display timing. The control unit 101 also functions as a recording control unit, since it controls recording and reading of data to the recording medium 111 via the recording medium I / F 110. The control unit 101 may be configured with multiple processors, or the control unit 101 may be configured integrally with the functions of other components (e.g., image compression / decompression unit 102, image processing unit 104), or the control unit 101 may be provided with some of the functions of the other components.
[0015] A recording medium 111 for recording image data can be attached to the digital video camera 100. To this end, the digital video camera 100 has an interface of a recording medium I / F 110. The recording medium I / F 110 has a slot into which a removable recording medium 111 such as a memory card can be inserted. FIG. 2 illustrates an example in which the recording medium 111 is attached to the recording medium I / F 110. Although the digital video camera 100 has been described as being configured to record image data on a removable recording medium 111, a configuration in which image data is recorded on a non-removable recording medium built into the digital video camera 100 is also conceivable.
[0016] The storage medium 111 is used to record files such as XML files and moving image data obtained by capturing an image using the imaging unit 103 and performing various processes using the image processing unit 104 and the image compression / expansion unit 102. There is no particular limit to the type of recording medium, but the recording medium 111 can be, for example, a recording medium such as an SD card (SD Memory Card) (registered trademark) or a CF Express card (registered trademark).
[0017] The image processing unit 104 performs predetermined pixel interpolation, resizing, and color conversion processing on the image data captured by the imaging unit 103. The image processing unit 104 also performs predetermined calculation processing using the captured image data. The control unit 101 performs various controls (exposure control, auto white balance control, etc.) related to the imaging by the imaging unit 103 based on the obtained calculation results.
[0018] The image compression / decompression unit 102 performs a process of compressing and encoding the image data that has been image-processed by the image processing unit 104 , and performs a process of decompressing (decoding) the image data that has been read from the recording medium 111 .
[0019] The imaging unit 103 has a photographing lens (including a zoom lens and a focus lens) and an image sensor. Based on the control of the control unit 101, the imaging unit 103 captures an image of a subject, generates image data such as still images and video data, and outputs the image data.
[0020] The network I / F 105 transmits and receives data to and from external devices such as an external camera, a personal computer, a smartphone, a tablet, etc., under the control of the control unit 101. The network I / F 105 can transmit setting information and operation information of the digital video camera 100 to an external device, and can receive commands for operating the digital video camera 100 and XML files to be recorded together with image data from the external device. The received data is stored in the RAM 109. The transmittable data includes digital image data and analog video signals. The network I / F 105 also transmits and receives data to and from the network recorder 200 under the control of the control unit 101. The network I / F 105 can transmit XML files created by the digital video camera 100 and moving image data to the network recorder 200. In this embodiment, when the network recorder 200 is connected, the control unit 101 continuously transmits moving image data obtained by capturing an image using the imaging unit 103 and performing various processes in the image processing unit 104 and the image compression / expansion unit 102 to the network recorder 200 through the network I / F 105.
[0021] The display unit 106 is a display for displaying various setting states, images captured by the imaging unit 103, images read out and played back from a recording medium, and the like, based on the control of the control unit 101. The display unit 106 includes a display within a peer-type finder, a vari-angle liquid crystal monitor, and the like.
[0022] The operation unit 107 is an operation unit that accepts operations from a user and includes a power switch for supplying power to the digital video camera 100, a shooting start button, a mode switching button for switching between a camera mode (shooting mode) and a playback mode, etc. If the operation unit 107 includes a touch panel, the touch panel may be any of various types of touch panels, such as a resistive film type, a capacitive type, a surface acoustic wave type, an infrared type, an electromagnetic induction type, an image recognition type, and an optical sensor type.
[0023] FIG. 3 shows an example of the metadata (additional information) structure included in an XML file recorded in association with video data in this embodiment. An XML file 400 is composed of metadata 401 recorded at the start of recording, metadata 402 set by the user, and metadata 403 recorded at the end of recording. Each piece of information in the metadata 401 is additional information that is determined at the start of recording of video data and is not changed after recording has started. For example, the information includes creation date and time, file name, video data identification information, file format, audio information, etc. Each piece of information in the metadata 402 is additional information that is set by the user, such as video data title, shooting information, photographer, keywords, category, genre, language information, rights information, etc. Each piece of information in the metadata 403 is additional information that is determined at the end of recording of video data and cannot be read out at the start of recording of video data, such as update date and time, recording length of video data (recording time or number of frames), etc.
[0024] 4 is a block diagram of a network recorder 200 according to an embodiment. The network recorder 200 includes a control unit 201, a network I / F 202, a data storage unit 203, a ROM 204, a RAM 205, and a video output I / F 206. These components are driven by power obtained by rectifying AC power supplied from an external source to a predetermined voltage, or by power supplied from a built-in battery (not shown).
[0025] The control unit 201 is composed of a processor such as a CPU, and controls the entire device. Specifically, the control unit 201 loads a program recorded in a ROM 204 into a RAM 205 and executes it to control each component and perform calculation processing, and executes the flowcharts described below.
[0026] The data storage unit 203 is a storage unit for storing moving image data files and XML files transmitted from the digital video camera 100, and is configured by a recording device such as an SSD (Solid State Drive) or HDD (Hard Disk Drive).
[0027] The ROM 204 is a non-volatile recording medium, and stores the programs executed by the control unit 201 and various settings.
[0028] The RAM 205 is a volatile recording medium used as a work memory for the control unit 201. The RAM 205 is also used as a VRAM. The control unit 201 also controls video output to a video output device such as a display via the video output I / F 206, and therefore also functions as a video control unit. The control unit 201 may be configured with a plurality of processors, or the control unit 201 may be configured integrally by providing the functions of other components (for example, the data storage unit 203), or some of the functions of the other components may be provided in the control unit 201.
[0029] FIG. 5 is an operation flow diagram showing the basic operation of the digital video camera 100. The control unit 101 reads out a program stored in the ROM 108, expands it in the RAM 109, and executes the program. As a result, the control unit 101 controls each unit and executes arithmetic processing. When the camera mode (shooting mode) of the digital video camera 100 is set in accordance with a user's operation on the operation unit 107, the control unit 101 starts the processing of FIG. 5. Note that in this embodiment, if the digital video camera 100 is connected to the network recorder 200 at the time the flow of FIG. 5 is started, the digital video camera 100 continues to continuously transmit video image data to the connected network recorder 200. Also, the processing shown in FIG. 5 is merely an example, and the order is not limited.
[0030] In S500, the control unit 101 detects a user's operation of a menu button included in the operation unit 107, and causes the display unit 106 to display a menu 600 as shown in Fig. 6. The user can select an XML file for settings from the items in the menu 600 by operating a selection cursor 601 using a cross button included in the operation unit 107. When the XML file for settings is selected by the user, the process proceeds to S501.
[0031] The illustration shows that "Recording / Media Setup" is selected from the main menu, "Add XML file" is selected from the submenu that is displayed in response to that selection, and then "XML file 2" is selected as the XML file from that submenu.
[0032] In S501, the control unit 101 reads the contents of the setting XML file set in S500 from the recording medium 111 to the RAM 109 via the recording medium I / F 110. Then, the control unit 101 writes only necessary information into the XML file to be recorded in association with the video data, in accordance with the structure of the XML file, as recording metadata, into the RAM 109.
[0033] In S502, the control unit 101 determines whether or not a moving image recording start instruction has been input from the user via the operation unit 107. If the control unit 101 determines that a moving image recording start instruction has been input from the user, the process proceeds to S503. If the control unit 101 determines that a moving image recording start instruction has not been input from the user, the process returns to S502 and waits for the input.
[0034] In S503, in response to the recording start instruction input in S502, the control unit 101 writes out to the recording medium 111 the video data obtained by capturing an image using the imaging unit 103 and performing various processes in the image processing unit 104 and the image compression / expansion unit 102.
[0035] In S504, the control unit 101 reads out the video data from the RAM 109 and transmits it to the network recorder 200 via the network I / F 105, and also transmits a recording start command. At this time, the control unit 101 obtains the recording start time from a timer (not shown). Note that when the recording start command is received by the network recorder 200 connected to the digital video camera 100, it is a command for starting recording of the video data on the network recorder 200 side.
[0036] In S505, in response to the generation of the video data, the control unit 101 writes information that can be obtained at the start of recording of the video data to the RAM 109 as recording start information metadata. When a video is recorded in the network recorder 200, the recording start information metadata also includes information indicating that the video is being transmitted to the network recorder 200. Then, the control unit 101 writes an XML file to the RAM 109 using the recording start information metadata written to the RAM 109 in S505 and the recording metadata written to the RAM 109 in S501. That is, of the XML file in FIG. 3, the recording start information metadata is set to the metadata 401 as shown in FIG. 13(a), and the recording metadata is set to the metadata 402, and the XML file is written to the RAM 109. At this time, the XML file may be generated by leaving each piece of information in the metadata 403 blank or set to 0, or an XML file that does not include the metadata 403 may be generated.
[0037] In S506, the control unit 101 reads out the XML file generated in S505 from the RAM 109, associates it with the video data stored in the recording medium 111 in S503, and writes it to the recording medium 111 via the recording medium I / F 110.
[0038] In S507, the control unit 101 determines whether or not a recording end instruction for moving image data has been input from the user via the operation unit 107. If the control unit 101 determines that a recording end instruction has been input, the process proceeds to S508. On the other hand, if the control unit 101 determines that a recording end instruction has not been input, the process returns to S507, and moving image recording continues until a recording end instruction is input.
[0039] In S508, the control unit 101 overwrites the recording start command written to the RAM 109 in S504 with the recording end command. Note that when the network recorder 200 connected to the digital video camera 100 receives this recording end command, it ends recording of the video data.
[0040] In S509, in response to input of an instruction to end recording by operating operation unit 107, control unit 101 writes out as moving image data the moving image data shot up until the input of the instruction to end recording to recording medium 111. Then, the header of the moving image data is written out or updated, and the moving image data recording process is completed.
[0041] In S510, the control unit 101 writes information that can be obtained at the end of recording of the video data to the RAM 109 as recording end information metadata. At this time, the control unit 101 obtains the time at the timing of the recording end from a timer (not shown) and calculates the recording time by subtracting the time at the start of recording. Then, the control unit 101 reads the XML file recorded on the recording medium 111 in S506, adds the recording end information metadata to the XML file as metadata 403, and re-records it on the recording medium 111. Since the information of the metadata 403 determined at the end of recording is not recorded in the XML file written on the recording medium 111 in S506, the information to be recorded in the XML file is not included. Therefore, the control unit 101 overwrites the XML file recorded on the recording medium 111 in S506 with an XML file in which the information of the metadata 403 is described in S510, and the recording of the XML file is completed. The process of S510 may be executed when the recording end information metadata can be generated, that is, when the recording of the video data is completed and the information on the recording time of the video data can be obtained, without waiting for the completion of the recording of the video data. Therefore, the recording of the XML file may be completed before the recording of the video data is completed.
[0042] By executing the above steps, the digital video camera 100 can store, on the recording medium 111, the video data and the XML file associated with the video data.
[0043] Fig. 7 is an operational flow diagram showing the basic operation of the network recorder 200. The control unit 201 reads out a program stored in the ROM 204, loads it in the RAM 205, and executes the loaded program to control each unit and perform arithmetic processing, thereby realizing the operation. Note that the processing shown in Fig. 7 is merely an example, and the order is not limited to this.
[0044] In S700, the control unit 201 determines whether or not moving image data has been received from the digital video camera 100 via the network I / F 202. If the control unit 201 determines that moving image data has been received, the process proceeds to S701. If the control unit 201 determines that moving image data has not been received, the process returns to S700 and waits for reception. In other words, the control unit 201 repeats the process of S700 until moving image data is received. In S701, the control unit 201 determines whether or not a recording start command has been received from the digital video camera 100 via the network I / F 202. If the control unit 201 determines that a recording start command has been received, the process proceeds to S702. If the control unit 201 determines that a recording start command has not been received, the process returns to S701 and waits for the command to be received. In other words, the process of S701 is repeated until the recording start command is received.
[0045] In S702, the control unit 201 stores the video data received from the external device (digital video camera 100) via the network I / F 202 in the data storage unit 203. Note that if video data is continuously received from the external device, the control unit 201 continues to store the received video data in the data storage unit 203 one by one.
[0046] In S703, the control unit 201 determines whether or not a recording end command has been received from the digital video camera 100 via the network I / F 202. If the control unit 201 determines that a recording end command has been received, it ends the recording operation of the video data. On the other hand, if the control unit 201 determines that a recording end command has not been received, it returns the process to S702. In other words, the control unit 201 repeats the processes of S702 and S703 until it receives a recording end command.
[0047] By executing the above steps, the network recorder 200 can store the video data received from the digital video camera 100 in the data storage unit 203 .
[0048] Fig. 8A is an operation flow diagram showing characteristic operations of the digital video camera 100 in this embodiment. The control unit 101 reads out a program stored in the ROM 108, loads it in the RAM 109, and executes the loaded program to control each unit and perform calculation processing. When the digital video camera 100 is set to the camera mode (shooting mode) by a user's operation on the operation unit 107, the control unit 101 starts the processing of Fig. 8A. Note that the processing shown in Fig. 8A is merely an example, and the order is not limited. In Fig. 8A, S800a to S805a are the same as S500 to S505 in Fig. 5, respectively, and therefore description thereof will be omitted.
[0049] In S806a, the control unit 101 writes information that can be obtained at the start of recording of the video data to the RAM 109 as recording start information metadata. When a video is recorded inside the camera, the recording start information metadata also includes information indicating that a video image was recorded by the camera. Then, the control unit 101 writes an XML file for the network recorder 200 to the RAM 109 using the recording start information metadata written to the RAM 109 in S806a and the recording metadata written to the RAM 109 in S801a. That is, the control unit 201 writes the XML file for the network recorder 200 to the RAM 109 by setting the recording start information metadata to the metadata 401 as shown in FIG. 13(b) in the XML file of FIG. 3 and setting the recording metadata to the metadata 402. At this time, the XML file may be generated by leaving each piece of information in the metadata 403 blank or set to 0, or an XML file that does not include the metadata 403 may be generated.
[0050] In steps S807a to S811a, the control unit 201 performs the same processes as those in steps S506 to S510 of FIG. 5 described above, using the XML file for the digital video camera 100 created in step S805a.
[0051] In S812a, the control unit 101 writes information that can be obtained at the end of recording of the video data to the RAM 109 as recording end information metadata. Then, the control unit 101 writes the recording end information metadata to the RAM 109 by adding it as metadata 403. The XML file for the network recorder 200 recorded in the RAM 109 in S806a does not include information of the metadata 403 determined at the end of recording, and does not include information to be recorded in the XML file. Therefore, in S812a, the control unit 201 generates an XML file describing information of the metadata 403 and writes (overwrites) it to the RAM 109, completing the saving of the XML file. Note that the process of S812a is executed at the timing when recording end information metadata can be generated, that is, at the timing of the completion of recording of the video data when information on the recording time of the video data can be obtained, without waiting for the completion of recording of the video data. Therefore, the recording of the XML file for the network recorder 200 may be completed before the completion of recording of the video data. Also, metadata required for updating the XML file for the network recorder 200, such as the file name of the video data recorded by the network recorder 200, may be obtained from the network recorder 200 and added to the recording end information metadata. When writing of the XML file for the network recorder 200 is completed, the control unit 101 advances the process to S813a.
[0052] In S813a, the control unit 101 reads out from the RAM 109 the XML file for the network recorder 200 saved in S812a, and transmits it to the network recorder 200. Note that in this embodiment, the XML file is transmitted to the network recorder 200 as an XML file, but the data described in the XML file for the network recorder 200 may be read out from the RAM 109 and transmitted to the network recorder 200 as is without being converted into an XML file. Also, when two or more external devices are connected to the digital video camera 100, the XML file may be transmitted to all of the external devices.
[0053] Fig. 8B is an operational flow diagram showing a characteristic operation of the network recorder 200 in this embodiment. The control unit 201 reads out a program stored in the ROM 204, loads it in the RAM 205, and executes the loaded program to control each unit and perform calculation processing. Note that the processing shown in Fig. 8B is merely an example, and the order of processing is not limited.
[0054] S800b to S803b are the same as S700 to S503 in FIG. 7, respectively, and therefore their description will be omitted.
[0055] In S804b, the control unit 201 determines whether or not an XML file has been received from the digital video camera 100 via the network I / F 202. If the control unit 201 determines that an XML file has been received, the process proceeds to S805b, and if the control unit 201 determines that an XML file has not been received, the process returns to S804b. In other words, the control unit 201 repeats the process of S804b until an XML file is received.
[0056] In S805b, the control unit 201 writes out the XML file received from the external device via the network I / F 202 to the data storage unit 203 in association with the video data stored in the data storage unit 203 in S802b.
[0057] As described above, when starting recording, digital video camera 100 starts transmitting moving images to network recorder 200, and transmits a command instructing the timing of recording the moving images on network recorder 200. Then, after completing (stopping) recording of the moving images, it transmits a command indicating the end of recording, terminates transmission of the moving images, completes generation of a metadata file (XML file) for use by network recorder 200, and transmits the generated metadata file to network recorder 200. This enables network recorder 200 to save the moving images captured by digital video camera 100 as a moving image data file, and to associate and save the metadata file corresponding to the moving image data file.
[0058] When the control unit 201 of the network recorder 200 receives a recording end command, it may transmit the file name of the recorded video data to the digital video camera 100. When the control unit 101 of the digital video camera 100 receives the file name, it adds the file name to the XML file to be saved, and then transmits the XML file to the network recorder 200. In this way, the video data recorded in the network recorder 200 can be firmly associated with the XML file.
[0059] [Second embodiment] A second embodiment will now be described. Fig. 9 is a diagram showing an example of a system configuration of the second embodiment. This system includes a digital video camera 100 that shoots moving images and creates and transmits metadata, a network recorder 200 that stores the moving image data and metadata transmitted from the digital video camera 100, and a controller 300 that remotely controls the digital video camera 100.
[0060] The configurations of the digital video camera 100 and the network recorder 200 are the same as those of the first embodiment described above. The controller 300 of this second embodiment instructs the digital video camera 100 to start and stop recording in response to a user's operation. In other words, the controller 300 is used to externally perform processes equivalent to S502 and S507 of Fig. 5 of the first embodiment.
[0061] The network recorder 200 executes a flow similar to that described in Fig. 8(b). In the second embodiment, the digital video camera 100, the network recorder 200, and the controller 300 are connected to each other so as to be able to communicate with each other via a local area network (LAN). The digital video camera 100, the network recorder 200, and the controller 300 may be connected via a network switch or the like. There are no particular limitations on the communication protocol, and the connection form may be either wired or wireless.
[0062] 10 is a block diagram of the controller 300. The controller 300 has a control unit 301, a network I / F 302, a display unit 303, an operation unit 304, a ROM 305, and a RAM 306. These components are connected so as to be able to exchange data with each other. Each component is driven by power supplied from an outlet or power supplied from a battery.
[0063] The control unit 301 is a system control unit such as a CPU that controls the entire system of the controller 300. The control unit 301 loads a program recorded in a ROM 305 into a RAM 306, and executes the loaded program to control each component and perform calculation processing, and execute a flowchart described below. The control unit 301 also functions as a display control unit, since it generates display data for the display unit 303 and controls the display timing. The control unit 301 may be configured with a plurality of processors, or the control unit 301 may be configured integrally with the functions of other components (for example, an operation unit 304), or some of the functions of the other components may be provided in the control unit 301.
[0064] The ROM 305 is a non-volatile recording medium, and stores the programs executed by the control unit 301 and various settings.
[0065] The RAM 306 is a volatile recording medium used as a work memory for the control unit 301. The RAM 306 is also used as a VRAM that temporarily stores data to be displayed on the display unit 303.
[0066] The network I / F 302 transmits and receives data to and from connected external devices under the control of the control unit 301. The control unit 301 can transmit commands for operating external devices to the external devices via the network I / F 302. The control unit 301 also receives setting information and operation information of the external devices from the external devices and stores them in the RAM 306.
[0067] The display unit 303 is a display for displaying various setting states, received setting information of external devices, and the like, based on the control of the control unit 301.
[0068] The operation unit 304 is an operation unit that receives operations from a user and includes a power switch for supplying power to the controller 300 and operation buttons for operating the digital video camera 100. If the operation unit 304 includes a touch panel, the control unit 301 can detect the following operations on the touch panel. The touch panel may be any of various types of touch panels, such as a resistive film type, a capacitive type, a surface acoustic wave type, an infrared type, an electromagnetic induction type, an image recognition type, and an optical sensor type.
[0069] Fig. 11 is an operational flow diagram showing the basic operation of the controller 300. The control unit 301 reads out a program stored in the ROM 305, loads it in the RAM 306, and executes the loaded program to control each unit and perform calculation processing. Note that the processing shown in Fig. 11 is merely an example, and the order is not limited.
[0070] In S1100, the control unit 301 determines whether or not the user has input an instruction to start recording video data by operating the operation unit 304. If the control unit 301 determines that a recording start instruction has been input, the process proceeds to S1101. If the control unit 301 determines that a recording start instruction has not been input, the process returns to S1100. That is, the control unit 301 repeats the process of S1100 until a recording start instruction is input.
[0071] In S1101 , the control unit 301 transmits a recording start command to the external device via the network I / F 302 .
[0072] In S1102, the control unit 301 determines whether or not an instruction to end recording of moving image data has been input by operating the operation unit 304 to instruct the end of recording of moving image data. If it is determined that an instruction to end recording has been input, the process proceeds to S1103. If it is determined that an instruction to end recording has not been input, the process returns to S1102. In other words, the process of S1100 is repeated until an instruction to end recording is input.
[0073] In S1103, the control unit 301 transmits a recording end command to the external device via the network I / F 302, and ends the process.
[0074] Fig. 12A is an operational flow diagram showing a characteristic operation of the controller 300 in this embodiment. The control unit 301 reads out a program stored in the ROM 305, loads it in the RAM 306, and executes the loaded program to control each unit and perform calculation processing. Note that the processing shown in Fig. 12A is merely an example, and the order of processing is not limited.
[0075] In S1200a, control unit 301 determines whether or not a designation (or selection) operation of a device (corresponding to a digital video camera in this embodiment) that transmits a recording instruction has been performed via operation unit 304. If control unit 301 determines that a user has performed an operation to designate a device that transmits a recording instruction, it advances the process to S1201a. If control unit 301 determines that no such operation has been performed, it returns the process to S1200a. That is, control unit 301 repeats the process of S1200a until an operation to designate a device that transmits a recording instruction is input. Note that there may be multiple devices that transmit a recording instruction, and there is no particular limit to the number of devices.
[0076] In S1201a, the control unit 301 determines whether or not a command to start moving image recording has been issued from the user via the operation unit 304. If the control unit 301 determines that a command to start moving image recording has been issued, the process proceeds to S1202a. If the control unit 301 determines that a command to start moving image recording has not been issued, the process returns to S1201a. That is, the control unit 301 repeats the process of S1201a until a command to start moving image recording is issued.
[0077] In S1202a, control unit 301 transmits a recording start command to the device set in S1200a via network I / F 302. If multiple devices are selected in S1200a, control unit 301 transmits the recording start command to all of the devices, but the timing at which the recording start command is transmitted may differ.
[0078] In S1203a, the control unit 301 determines whether or not the user has operated to instruct the end of video recording via the operation unit 304. If the control unit 301 determines that the user has operated to instruct the end of video recording, the process proceeds to S1204a. If the control unit 301 determines that the user has not operated to instruct the end of video recording, the process returns to S1203a. That is, the control unit 301 repeats the process of S1203a until an instruction to end recording is input.
[0079] In S1204a, the control unit 301 transmits a recording end command to the device specified in S1200a via the network I / F 302, and ends this process. Note that if multiple devices are selected in S1200a, the control unit 301 transmits the recording end command to all of the devices, but the timing at which the recording end command is transmitted may differ.
[0080] By executing the above steps, the controller 300 can remotely control the digital video camera 100 to issue instructions to the network recorder 200 to start and stop recording of moving image data.
[0081] Fig. 12B is an operational flow diagram showing characteristic operations of the digital video camera 100 in the second embodiment. The control unit 101 reads out a program stored in the ROM 108, loads it in the RAM 109, and executes the loaded program to control each unit and perform calculation processing. Note that the processing shown in Fig. 12B is merely an example, and the order of processing is not limited.
[0082] 8A, the description of which will be omitted. In addition, in S1200b, the control unit 101 may select an XML file in accordance with a selection command received from the controller 300.
[0083] In S1202b, the control unit 101 determines whether or not a recording start command has been received from the controller 300 via the network I / F 105. If the control unit 101 determines that a recording start command has been received, the process proceeds to S1203b. If the control unit 101 determines that a recording start command has not been received, the process returns to S1202b. That is, the control unit 101 repeats the process of S1202b until the recording start command is received.
[0084] The control unit 101 performs the same processes as S803a to S807a in Fig. 8(a) in steps S1203b to S1207b, respectively, and therefore a description of these steps S1203b to S1207b will be omitted.
[0085] In S1208b, the control unit 101 determines whether or not a recording end command has been received from the controller 300 via the network I / F 105. If the control unit 101 determines that a recording end command has been received, the process proceeds to S1209b. If the control unit 101 determines that a recording end command has not been received, the process returns to S1208b. That is, the control unit 101 repeats the process of S1208b and continues recording the moving image until the recording end command is received.
[0086] The control unit 101 performs operations similar to those of S808a to S813a in FIG. 8(a) in steps S1208b to S1213b, respectively.
[0087] As described above, the user can operate controller 300 to send instructions to the remote digital video camera 100 to start and stop recording of video, thereby achieving the same effect as in the first embodiment, i.e., causing digital video camera 100 to record a video file and an XML file that contains metadata related to the video in that video file from the start to the end of recording.
[0088] (Other Examples) The present invention can also be realized by a process in which a program for implementing one or more of the functions of the above-described embodiments is supplied to a system or device via a network or a storage medium, and one or more processors in a computer of the system or device read and execute the program. The present invention can also be realized by a circuit (e.g., ASIC) that implements one or more of the functions.
[0089] The disclosure of this specification includes the following imaging apparatus, its control method, program, and system. (Item 1) An imaging device having a communication means, which transmits captured moving image data to an external device for recording via the communication means, a video transmission means for receiving an instruction to start recording, transmitting video data obtained by imaging using the imaging means to the external device via the communication means, and for receiving an instruction to end recording, ending transmission of the video data to the external device; a metadata generating means for generating metadata related to the start of recording of the moving image upon receiving an instruction to start recording, and generating metadata related to the end of recording of the moving image upon receiving an instruction to end recording; a metadata transmission means for receiving an instruction to end the recording and transmitting metadata from the start of the recording to the end of the recording to the external device via the communication means; An imaging device comprising: (Item 2) The imaging device according to item 1, characterized in that the instruction to start recording and the instruction to end recording are received from an external control device via the communication means. (Item 3) the video transmission means, upon receiving an instruction to start recording, transmits a recording start command to the external device in addition to the video data, and upon receiving an instruction to end recording, transmits a recording end command to the external device; When the instruction to end the recording is received, the metadata generating means receives from the external device a file name of the video data recorded by the external device, and generates metadata including the received file name. 3. The imaging device according to item 1 or 2, (Item 4) The metadata generating means generates metadata including a recording time from when an instruction to start recording is received to when an instruction to end recording is received. 4. The imaging device according to any one of items 1 to 3. (Item 5) A method for controlling an imaging device having a communication means, the imaging device transmitting moving image data obtained by imaging via the communication means to an external device for recording, comprising the steps of: a moving image transmitting step of transmitting moving image data captured by the imaging means to the external device via the communication means in response to an instruction to start recording, and of ending transmission of the moving image data to the external device in response to an instruction to end recording; a metadata generation step of generating metadata related to the start of recording of the moving image upon receiving an instruction to start recording, and generating metadata related to the end of recording of the moving image upon receiving an instruction to end recording; a metadata transmission step of receiving an instruction to end the recording and transmitting metadata from the start of the recording to the end of the recording as a metadata file to the external device via the communication means; 13. A method for controlling an imaging apparatus comprising: (Item 6) A program that, when read and executed by a computer, causes the computer to function as any one of the means described in items 1 to 4. (Item 7) A system having an imaging device and a recording device connected to a network, The imaging device includes: a video transmission means for receiving an instruction to start recording, transmitting video data captured by the imaging means to the recording device, and for receiving an instruction to end recording, ending transmission of the video data to the recording device; a metadata generating means for generating metadata related to the start of recording of the moving image upon receiving an instruction to start recording, and generating metadata related to the end of recording of the moving image upon receiving an instruction to end recording; a metadata transmission means for receiving an instruction to end the recording and transmitting metadata from the start of the recording to the end of the recording to the recording device, The recording device includes: a first recording means for recording the moving image data received from the imaging device as a moving image file on a recording medium; and a second recording means for recording the metadata received from the imaging device as a metadata file related to the recorded moving image file. A system characterized by: (Item 8) The imaging device further includes a control device that remotely controls the imaging device, The imaging device receives an instruction to start recording and an instruction to end recording from the control device. 8. The system according to item 7, characterized in that
[0090] The invention is not limited to the above-described embodiments, and various modifications and variations are possible without departing from the spirit and scope of the invention. Accordingly, the following claims are appended to apprise the public of the scope of the invention. [Explanation of symbols]
[0091] 100... digital video camera, 101... control unit, 102... image compression / expansion unit, 103... imaging unit, 104... image processing unit, 105... network I / F, 106... display unit, 107... operation unit, 108... ROM, 109... RAM, 110... recording medium I / F, 111... recording medium
Claims
1. An imaging device having a communication means, which transmits captured moving image data to an external device for recording via the communication means, a video transmission means for receiving an instruction to start recording, transmitting the video data obtained by imaging by the imaging means to the external device via the communication means, and for receiving an instruction to end recording, and for ending transmission of the video data to the external device; a metadata generating means for generating metadata relating to the start of recording of the video data in response to an instruction to start recording, and generating metadata relating to the end of recording of the video data in response to an instruction to end recording; a metadata transmission means for receiving an instruction to end the recording and transmitting metadata from the start of the recording to the end of the recording to the external device via the communication means; An imaging device comprising:
2. 2. The imaging device according to claim 1, wherein the instruction to start recording and the instruction to end recording are received from an external control device via the communication means.
3. the video transmission means, upon receiving the instruction to start recording, transmits a recording start command to the external device in addition to the video data, and upon receiving the instruction to end recording, transmits a recording end command to the external device; When the instruction to end the recording is received, the metadata generating means receives from the external device a file name of the video data recorded by the external device, and generates metadata including the received file name.
2. The imaging device according to claim 1.
4. The metadata generating means generates metadata including a recording time from when the instruction to start recording is received until when the instruction to end recording is received.
2. The imaging device according to claim 1.
5. A control method for an imaging device having a communication means, which transmits captured moving image data to an external device for recording via the communication means, a moving image transmitting step of transmitting the moving image data obtained by imaging by the imaging means to the external device via the communication means in response to an instruction to start recording, and terminating transmission of the moving image data to the external device in response to an instruction to end recording; a metadata generation step of generating metadata relating to the start of recording of the video data in response to an instruction to start recording, and generating metadata relating to the end of recording of the video data in response to an instruction to end recording; a metadata transmission step of receiving an instruction to end the recording and transmitting metadata from the start of the recording to the end of the recording as a metadata file to the external device via the communication means; 10. A method for controlling an imaging device, comprising:
6. A program for causing a computer to function as each of the means of the imaging apparatus according to claim 1 when the program is read and executed by the computer.
7. A system having an imaging device and a recording device connected to a network, The imaging device is a video transmission means for receiving an instruction to start recording, transmitting video data captured by the imaging means to the recording device, and for receiving an instruction to end recording, ending transmission of the video data to the recording device; a metadata generating means for generating metadata relating to the start of recording of the video data in response to an instruction to start recording, and generating metadata relating to the end of recording of the video data in response to an instruction to end recording; a metadata transmission means for receiving an instruction to end the recording and transmitting metadata from the start of the recording to the end of the recording to the recording device, The recording device a first recording means for recording the moving image data received from the imaging device as a moving image file on a recording medium; and a second recording means for recording the metadata received from the imaging device as a metadata file associated with the recorded moving image file. A system characterized by:
8. Further, a control device for remotely controlling the imaging device is provided, The imaging device receives an instruction to start recording and an instruction to end recording from the control device.
8. The system of claim 7.