Imaging device, control method thereof, external device, program, and storage medium

Abstract

To provide an imaging apparatus, a program, and a recording medium that can easily grasp the type of an additional information file associated with a photographed moving image file.SOLUTION: A digital video camera 100 comprises: an imaging unit 12; a recording medium I / F 19 that records, in a recording medium 20, image data picked up by the imaging unit and an additional information file being a file of additional information on the image data; and a control unit 10 that controls the recording medium I / F to record information on the type of the additional information file in a metadata area of the image data.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present invention relates to a technique for recording a video file and an additional information file associated with the video file on a recording medium.

Background Art

[0002] In recent years, with the rise of SNS (Social Networking Service) such as Twitter, at news sites of broadcasting stations and news agencies, there has been a demand to convey more accurate information more quickly than before. Therefore, even in video processing devices such as digital still cameras and digital video cameras, by utilizing not only video files but also additional information files in which various metadata about the video files are written, it has been possible to realize more rapid and easy reporting with high timeliness.

[0003] For example, it is possible to record metadata such as the format and recording length of a video together with the captured video. In addition, it is possible to communicate from a mobile terminal to a digital video camera and write newsgathering information such as a newsgathering title and a newsgathering location to an additional information file at the news site. The additional information file is used, for example, as information for more easily searching for a desired video file in a video file server. At that time, by browsing various metadata of the video file, it is possible to know the format and recording length of the video file.

[0004] Patent Document 1 describes a technique for preventing the user from accidentally associating and recording the content of an additional information file associated with a video from a communication device or the like with an incorrect target video file.

Prior Art Documents

Patent Documents

[0005]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0006] However, in the technology described in Patent Document 1 above, it is not possible to easily grasp from an external editing device the type or presence / absence of an additional information file associated with a video file captured by an imaging device. In order to grasp this, it is necessary to acquire the additional information file and perform analysis. Therefore, there is a risk that the user may not be able to perform content editing of the additional information file as intended on the video file from an external editing device.

[0007] The present invention has been made in view of the above-described problems, and an object thereof is to provide an imaging device capable of easily grasping the type of an additional information file associated with a captured video file.

Means for Solving the Problems

[0008] The imaging device according to the present invention includes video data Video file and an additional information file that is a file of additional information for the video data and recording means for recording on a recording medium, and control means for controlling the recording means to record the type information of the additional information file Additional information recorded in the metadata area of the video within the file . It is characterized by comprising:

Effects of the Invention

[0009] According to the present invention, it becomes possible to easily grasp the type of an additional information file associated with a captured video file.

Brief Description of the Drawings

[0010]

Figure 1

Figure 2

Figure 3A

Figure 3B

Figure 3C

Figure 4

Figure 5A

Figure 5B

Figure 6A

Figure 6B

Figure 7A

Figure 7B

Figure 7C

Figure 8A

Figure 8B

Figure 9A

Figure 9B

Figure 9C

Figure 10A

Figure 10B

Figure 10C

Figure 11

Figure 12

Figure 13

Best Mode for Carrying Out the Invention

[0011] Hereinafter, embodiments will be described in detail with reference to the accompanying drawings. Note that the following embodiments do not limit the invention according to the claims. Although a plurality of features are described in the embodiments, not all of these plurality of features are essential to the invention, and the plurality of features may be arbitrarily combined. Further, in the accompanying drawings, the same or similar configurations are denoted by the same reference numerals, and duplicate descriptions are omitted.

[0012] (First Embodiment) FIG. 1 is a diagram showing the configuration of a digital video camera 100 (camcorder), which is a first embodiment of the imaging device of the present invention. FIG. 2 is a diagram showing the configuration of a mobile terminal 200 as an editing device in the first embodiment of the present invention.

[0013] In FIG. 1, the digital video camera 100 includes a control unit 10, an image compression / expansion unit 11, an imaging unit 12, an image processing unit 13, a wireless communication unit 14, a display unit 15, an operation unit 16, a ROM 17, a RAM 18, a recording medium I / F 19, and a removable recording medium 20. Each component is connected to the control unit 10, and the control unit 10 and each component can exchange data with each other.

[0014] The control unit 10 is a system control unit that controls the entire system of the digital video camera 100 and consists of a CPU. The control unit 10 controls each component by expanding and executing the program recorded in the ROM 17 in the RAM 18, and executes the operations of the flowchart described later.

[0015] The ROM 17 is a non-volatile recording medium and stores the program executed by the control unit 10. The RAM 18 is a volatile recording medium used as a work memory of the control unit 10. Further, the RAM 18 is also used as a VRAM for temporarily storing the image data captured by the imaging unit 12 and processed by the image processing unit 13 or the image data read from the removable recording medium 20 when performing compression processing or expansion processing by the image compression / expansion unit 11 or when displaying on the display unit 15. Furthermore, it is also used as a storage unit for temporarily storing the additional information recorded in association with the captured image. The additional information can be received from the wireless communication unit 24 of the mobile terminal 200. In this embodiment, the additional information is described as an XML file (Extensible Markup Language file) of a markup language, but it may not be an XML file as long as it is information indicating the additional information.

[0016] The digital video camera 100 can be equipped with a recording medium 20 for recording image data. For this purpose, it has a recording medium I / F (interface) 19. The recording medium I / F 19 has a slot into which a detachable recording medium such as a memory card can be inserted. In FIG. 1, a state where the detachable recording medium 20 is attached to the recording medium I / F 19 is shown. In the digital video camera 100, the configuration for recording image data on the detachable recording medium 20 has been described, but a configuration in which image data is recorded in a memory that is not detachable and is built into the digital video camera 100 may also be used.

[0017] The image processing unit 13 performs predetermined pixel interpolation processing, resizing processing, and color conversion processing on the image data captured by the imaging unit 12. Also, in the image processing unit 13, predetermined arithmetic processing is performed using the captured image data, and the control unit 10 performs various controls (such as exposure control and auto white balance control) regarding imaging by the imaging unit 12 based on the obtained arithmetic results.

[0018] The image compression / decompression unit 11 performs processing to compress the image data processed by the image processing unit 13 and processing to decompress the image data read from the detachable recording medium 20.

[0019] The imaging unit 12 has a photographing lens (including a zoom lens and a focus lens) and an image sensor, and captures a subject based on the control of the control unit 10 to obtain image data such as still image data and moving image data.

[0020] The display unit 15 displays various setting states, the image captured by the imaging unit 12, the image read from the detachable recording medium 20 and played back, etc. based on the control of the control unit 10. It is configured as a display in a peephole-type viewfinder, a vari-angle liquid crystal monitor, etc.

[0021] The operation unit 16 includes a power switch for turning on / off the power of the digital video camera 100, a shooting start button, a mode switching button for switching operation modes such as a camera mode (shooting mode) and a playback mode, etc., and receives operations from the user. When the operation unit 16 includes a touch panel, the control unit 10 can detect the following operations on the touch panel. · Touching the touch panel with a finger or a pen (hereinafter referred to as touch down). · Being in a state of touching the touch panel with a finger or a pen (hereinafter referred to as touch on). · Moving while touching the touch panel with a finger or a pen (hereinafter referred to as move). · Releasing the finger or pen that was touching the touch panel (hereinafter referred to as touch up).

[0022] A state where nothing is touching the touch panel (hereinafter referred to as touch off).

[0023] These operations and the position coordinates where a finger or a pen is touching on the touch panel are notified to the control unit 10, and the control unit 10 determines what kind of operation has been performed on the touch panel based on the notified information. Regarding the move, about the moving direction of the finger or pen moving on the touch panel, it can also be determined for each vertical component and horizontal component on the touch panel based on the change in the position coordinates.

[0024] Also, when a touch-up is performed on the touch panel after a certain movement from a touch-down, it is considered that a stroke has been drawn. An operation of quickly drawing a stroke is called a flick. A flick is an operation of quickly moving a finger a certain distance while touching the touch panel and then releasing it. In other words, it is an operation of quickly tracing on the touch panel as if flicking with a finger. When it is detected that the movement is over a predetermined distance and at a predetermined speed or more, and a touch-up is detected as it is, it can be determined that a flick has been performed. Also, when it is detected that the movement is over a predetermined distance and at a speed less than the predetermined speed, it is determined that a drag has been performed. The touch panel may be of any of various types such as a resistive film type, a capacitance type, a surface acoustic wave type, an infrared type, an electromagnetic induction type, an image recognition type, an optical sensor type, etc.

[0025] Based on the control of the control unit 10, the wireless communication unit 14 performs wireless communication for sending and receiving data with external devices such as an external camera and a personal computer. The wireless communication unit 14 transmits the setting information and operation information of the digital video camera 100 to the outside, and receives commands for operating the digital video camera 100 and additional information such as additional information to be recorded together with image data. The data that can be transmitted and received includes digital image data, analog video signals, additional information, and the like.

[0026] FIG. 2 is a block diagram showing the configuration of the mobile terminal 200 as an external device in the first embodiment.

[0027] In FIG. 2, the mobile terminal 200 includes a control unit 21, a display unit 22, an operation unit 23, a wireless communication unit 24, a ROM 25, a RAM 26, and a file control unit 27. Each component is connected to the control unit 21, and the control unit 21 and each component can exchange data with each other.

[0028] The control unit 21 is a system control unit that controls the entire system of the mobile terminal 200 and consists of a CPU. By expanding and executing the program recorded in the ROM 25 in the RAM 26, the control unit 21 controls each component and executes the operations of the flowchart described later. The ROM 25 is a non-volatile storage medium that stores the programs executed by the control unit 21. The RAM 26 is a volatile storage medium used as a work memory for the control unit 21.

[0029] Based on the control of the control unit 21, the display unit 22 displays various setting states, data received by the wireless communication unit 24 (including digital image data, analog video signals, additional information, etc.).

[0030] The operation unit 23 includes a power switch for turning on / off the power of the mobile terminal 200 and is an operation unit that receives operations from the user. Note that the operation unit 23 includes a touch panel similar to the operation unit 16.

[0031] Based on the control of the control unit 21, the wireless communication unit 24 performs wireless communication for sending and receiving data with external devices such as an external camera and a personal computer. The wireless communication unit 24 receives setting information and operation information of the digital video camera 100 and transmits commands and additional information such as image data for operating the digital video camera 100 to the digital video camera 100. The data that can be sent and received includes digital image data, analog video signals, additional information, etc.

[0032] The file control unit 27 can perform controls such as analysis of data such as video files and additional information sent from the wireless communication unit 24 and generation of thumbnail images. The file control unit 27 realizes the above controls in cooperation with the control unit 2. Also, the mobile terminal 200 can freely install an application published on a predetermined website. The mobile terminal 200 of the present embodiment installs a communication application for communication with the digital video camera 100, and the control unit 21 executes the communication application, thereby establishing communication between the mobile terminal 200 and the digital video camera 100.

[0033] Next, FIG. 3A is a diagram showing the folder structure of the video file and the additional information file of the present embodiment.

[0034] In the present embodiment, the case of recording compressed video frames, management information such as time codes, and audio data in a container structure called MP4 (MPEG-4 Part14 or ISO / IEC14496-14:2003) will be described as an example, but file formats such as AVCHD (Advanced Video Codec High Definition) and MXF (Material eXchange Format) may also be used. The folder structure of the MP4 recorded in the control unit 10 is shown in FIG. 3A.

[0035] When the user operates the operation unit 16 of the digital video camera 100 and the removable recording medium 20 is initialized, a DCIM folder 301 is generated. Also, when recording is started by operating the operation unit 16, a 100_0128 folder 302 is generated. The 100 in the folder name represents the directory number, which is assigned in order from 100 and increases up to 999 at most. The 0128 in the folder name represents the creation date and month, indicating that it was created on January 28th.

[0036] Furthermore, the stream file MVI_0001.MP4(303) and the additional information MVI_0001.XML(304) are recorded. When multiple video files are recorded, the file names of the MP4 files and XML files change and increase. Time codes and the like that need to be set in frame units are recorded in MVI_0001.MP4(303). Also, tag information and the like are recorded in MVI_0001.XML(304).

[0037] Next, FIG. 3B is a diagram showing the configuration of the video file of the present embodiment.

[0038] In FIG. 3B, 310 is an ftyp box indicating file format compatibility. 311 is a moov box in which management information necessary for playback and thumbnail images are stored. 312 is a box in which XMP (Extensibile Metadata Platform) is stored, and arbitrary metadata can be set. 313 is a uuid box to which arbitrary information can be added. A preview image 327 is stored here. 314 is an mdat box in which encoded video data, audio data, time code data, and frame unit metadata are stored.

[0039] Subsequently, the configuration of the moov box 311 will be described.

[0040] 321 is a uuid box where arbitrary information can be added, and stores a thumbnail image 325 to be displayed during playback and management information 326 to be used during playback. 315 to 317 are track boxes, which are boxes storing management information related to video data, audio data, and time code data. 318 to 320 are stsz boxes, which store the data size for each encoding unit of video data, audio data, time code data, and frame unit metadata. 322 to 324 are stco boxes stored in the track box. The stco box stores information indicating the storage location of mdat314 of video data, audio data, time code data, and frame unit metadata. Each data is stored in the mdat box 314 in a unit called a chunk, which is composed of one or more encoding units.

[0041] Subsequently, the configuration of the mdat box 314 will be described.

[0042] 330 to 338 are video data, audio data, time code data, and frame unit metadata stored in the mdat box 314. Each data can be accessed in chunk units from the value described in the stco box. For example, 330 (CV1) can be traced from 350 in the stco box 322.

[0043] Next, FIG. 3C is a diagram showing the content of the metadata of the video file and the additional information file of the present embodiment.

[0044] 360 is the content of the metadata area in the video file, and these are stored in the management information 326. In the management information 326, the shutter speed, the F value indicating the brightness of the lens, the recording frame rate, the playback frame rate, and the recording time, which are the information at the time of shooting by the digital video camera 100, are recorded. Also, an XML file, which is an additional information file, is recorded together with the video file, and further, information including the type information of the XML file is recorded.

[0045] 361 is the content of the type information of the XML file described in the content 360 of the metadata area, and these are stored in the management information 326. 361 records any of the information indicating whether an XML file is recorded, the information indicating that the XML file is in the original format with tag information unique to the digital video camera 100, and the information indicating that the XML file is NewsMetadata in the standard format standardized for news reporting purposes. For illustration in Fig. 3C, it is shown as if all the information is described in the recording area 361 of the XML file type information, but actually any of them is recorded as described above.

[0046] 362 is a diagram showing the content of the metadata when the XML file is recorded in the original format with tag information unique to the digital video camera 100. In 362, the title, photographer, shooting information, product name, firmware version information, serial number, lens name, etc. of the digital video camera 100 are recorded.

[0047] 363 is a diagram showing the content of the metadata when the XML file is recorded as NewsMetadata in the standard format standardized for news reporting purposes. As an example of the standard format standardized for news reporting purposes, there is NewsML-G2 standardized by the IPTC (International Press Telecommunications Council). In the content 363 of the metadata, the title, photographer, shooting information, keywords, category, genre, date and time information, language information, contributor, rights information, information about the video file (file name, recording time, identification information, file format, audio information), etc. are recorded.

[0048] Fig. 4 is a diagram showing the operation sequence when the digital video camera 100 (camcorder) is connected to the mobile terminal 200.

[0049] In step S401, when the user operates the operation unit 16 of the digital video camera 100, a wireless connection with the mobile terminal 200 is instructed, and the control unit 10 sends an instruction to the wireless communication unit 14.

[0050] In step S402, when the user operates the operation unit 23 of the mobile terminal 200, a wireless connection with the digital video camera 100 is instructed, and the control unit 21 sends an instruction to the wireless communication unit 24.

[0051] In step S403, the wireless communication unit 14 of the digital video camera 100 and the wireless communication unit 24 of the mobile terminal 200 perform a wireless connection between the digital video camera 100 and the mobile terminal 200. When a wireless connection is established between the digital video camera 100 and the mobile terminal 200, it becomes possible to transmit and receive control commands, setting information, digital image data, analog video signals, and additional information.

[0052] FIG. 5A is a flowchart showing the operation of the digital video camera 100. This flowchart is started in response to the user inputting a recording start request to the control unit 10 of the digital video camera 100 by operating the operation unit 16. Also, this flowchart is started in a state where the digital video camera 100 is not connected to the mobile terminal 200.

[0053] In step S500, the control unit 10 generates metadata information necessary to start recording on the removable recording medium 20 and stores it in the RAM 18.

[0054] In step S501, the control unit 10 determines whether the recording setting of the XML file is ON. The ON / OFF of the recording setting of the XML file can be set by the user's operation on the operation unit 16. By pressing the menu button included in the operation unit 16, a menu 600 as shown in FIG. 6A is opened, and an item indicating the recording setting of the XML file, for example, ON (601), can be selected from the menu items for setting. When the control unit 10 determines that the recording setting of the XML file is ON, the process proceeds to step S502; otherwise, the process proceeds to step S505.

[0055] In step S502, the control unit 10 determines whether the type setting of the XML file is NewsMetadata. The type setting of the XML file can be set by the user's operation on the operation unit 16. By pressing the menu button included in the operation unit 16, a menu 602 as shown in FIG. 6B is opened, and an item representing the type setting of the XML file, for example, NewsMetadata (603), can be selected from the menu items for setting. The user should set the type of the XML file in the menu of FIG. 6B in advance before performing the recording start request operation to start the operation in FIG. 5A. Note that by default, the recording setting of the XML file in the menu of FIG. 6A is OFF. When the control unit 10 determines that the type setting of the XML file is NewsMetadata, the process proceeds to step S503; otherwise, the process proceeds to step S504.

[0056] In step S503, the control unit 10 reads out the metadata information held in the RAM 18 in step S500 and instructs to record the metadata information on the removable recording medium 20. Then, the metadata information 363 (see FIG. 3C) is written as NewsMetadata in the XML file.

[0057] In step S504, the control unit 10 reads out the metadata information held in the RAM 18 in step S500, and instructs to record the metadata information on the removable recording medium 20. Then, the metadata information 362 (see FIG. 3C) is written as original information not standardized in the XML file.

[0058] In step S505, the control unit 10 writes the type information of the XML file written in the management information 326 of the video file as metadata information to the RAM 18. For example, when this step is executed after the metadata information 363 is written to the XML file as NewsMetadata in step S503, the information indicating NewsMetadata is written as the type information of the XML file. Also, when this step is executed after the metadata information 362 is written to the XML file as original information not standardized in step S504, the information indicating original is written as the type information of the XML file.

[0059] In step S506, the control unit 10 reads out the metadata information held in the RAM 18 in steps S500 and S505, formats it into the format of the management information 326 of the video file, and issues an instruction to write it to the removable recording medium 20. Then, the metadata information 360 (see FIG. 3C) is written to the removable recording medium 20 as the management information of the video file which is a part of the video file.

[0060] In step S507, the control unit 10 formats the video data, audio data, and time code data held in the RAM 18 into the format of FIG. 3B, and instructs to write them to the removable recording medium 20. Then, the video data, audio data, and time code data are written to the removable recording medium 20 as a video file.

[0061] Figure 5B is a flowchart showing the operation of the digital video camera 100. This flowchart is started in response to a recording stop request being input to the control unit 10 of the digital video camera 100 by the user operating the operation unit 16 after the recording of the video file has been started by the process of Figure 5A. Also, this flowchart is started when the digital video camera 100 is not connected to the mobile terminal 200.

[0062] In step S510, the control unit 10 generates metadata information necessary to stop the recording to the removable recording medium 20 and stores it in the RAM 18.

[0063] In step S511, the control unit 10 determines whether the recording setting of the XML file is ON. The ON / OFF of the recording setting of the XML file can be set by the user operating the operation unit 16 as already described. If the control unit 10 determines that the recording setting of the XML file is ON, the process proceeds to step S512, otherwise, the process proceeds to step S514.

[0064] In step S512, the control unit 10 determines whether the type setting of the XML file is NewsMetadata. The type setting of the XML file can be set by the user operating the operation unit 16 as already described. If the control unit 10 determines that the type setting of the XML file is NewsMetadata, the process proceeds to step S513, otherwise, the process proceeds to step S514.

[0065] In step S513, the control unit 10 reads out the XML file written at the start of recording from the removable recording medium 20 into the RAM 18 using the recording medium I / F 19. Then, the recording time and update date and time information of the video file generated in step S510 are updated for the XML file read into the RAM 18. Further, the control unit 10 writes the updated XML file back to the removable recording medium 20 as an XML file again using the recording medium I / F 19.

[0066] In step S514, the control unit 10 formats the video data, audio data, and time code data stored in the RAM 10 up to the time when the recording stop request is received into the format of FIG. 3B. Then, using the recording medium I / F 19, the control unit 10 writes the video data, audio data, and time code data as a video file to the removable recording medium 20 and ends the recording stop process.

[0067] FIGS. 7A to 7C are flowcharts showing the operations of the digital video camera 100 when the digital video camera 100 connected to the mobile terminal 200 receives a control request from the mobile terminal 200 according to the procedure of FIG. 4. For the sake of explanation, it is assumed that a video file has been recorded in the digital video camera 100 by the operations of FIGS. 5A and 5B in advance.

[0068] The flowchart of FIG. 7A is started in response to the digital video camera 100 connected to the mobile terminal 200 receiving a transmission request for a list of the number of video files in the digital video camera 100 from the mobile terminal 200 according to the procedure of FIG. 4.

[0069] In step S701, the control unit 10 determines whether there is a transmission request for a list of the number of video files from the outside via the wireless communication unit 14. If the control unit 10 determines that there is a transmission request for a list of the number of video files, the process proceeds to step S702. If not, step S701 is repeated.

[0070] In step S702, the control unit 10 writes information about the video files recorded on the removable recording medium 20 as a list to the RAM 18. The list includes information such as the number of video files. The control unit 10 transmits the list written to the RAM 18 to the outside using the wireless communication unit 14.

[0071] The flowchart of FIG. 7B is started when the digital video camera 100 connected to the mobile terminal 200 according to the procedure of FIG. 4 receives a transmission request for a thumbnail image and management information for a specified video file in the digital video camera 100 from the mobile terminal 200.

[0072] In step S703, the control unit 10 determines, via the wireless communication unit 14, whether there is a transmission request for a thumbnail image and management information for a video file from the outside. If the control unit 10 determines that there is a transmission request for a thumbnail image and management information for a video file, the process proceeds to step S704. If not, step S703 is repeated.

[0073] In step S704, the control unit 10 reads and analyzes the thumbnail image 325 and management information 326 of the video file recorded on the removable recording medium 20 for the video file specified from the outside, and expands them in the RAM 18. When the reading and analysis of the thumbnail image 325 and management information 326 are completed, the control unit 10 transmits the thumbnail image 325 and management information 326 to the outside using the wireless communication unit 14.

[0074] The flowchart of FIG. 7C is started when the digital video camera 100 connected to the mobile terminal 200 according to the procedure of FIG. 4 receives a transmission request for an XML file for a specified video file in the digital video camera 100 from the mobile terminal 200.

[0075] In step S705, the control unit 10 determines, via the wireless communication unit 14, whether there is a transmission request for an XML file for a video file from the outside. If the control unit 10 determines that there is a transmission request for an XML file for a video file, the process proceeds to step S706. If not, step S705 is repeated.

[0076] In step S706, the control unit 10 reads and analyzes the XML file of the video file recorded on the removable recording medium 20 for the video file specified from the outside, and expands it in the RAM 18. When the reading and analysis of the XML file are completed, the control unit 10 transmits the XML file to the outside using the wireless communication unit 14.

[0077] FIGS. 8A and 8B are flowcharts showing the operations of the mobile terminal 200 when transmitting a control request regarding a video file or an XML file in the digital video camera 100 described in FIGS. 7A to 7C from the mobile terminal 200. The operations shown in these flowcharts are realized by executing a communication application installed in the mobile terminal 200 for communicating with the digital video camera 100.

[0078] The flowchart of FIG. 8A starts in a state where the mobile terminal 200 connected to the digital video camera 100 according to the procedure of FIG. 4 can request a list of video files in the digital video camera 100 from the user. For example, when a menu button included in the operation unit 23 is operated, the control unit 21 displays a screen 900 as shown in FIG. 9A according to the operation of the communication application, and enables selection of the display of the list of video files of the digital video camera 100 from among the menu items.

[0079] In step S801, the control unit 21 determines whether there is a request for a list display of the video files in the digital video camera 100 due to an operation of the operation unit 23 by the user. For example, when the icon 901 in FIG. 9A is selected by the operation unit 23, it is determined that there is a request for a list display of the video files. If the control unit 21 determines that there is a request for a list display of the video file list, the process proceeds to step S802, and if it determines otherwise, step S801 is repeated.

[0080] In step S802, the control unit 21 issues a request to transmit a list of video files to the digital video camera 100 via the wireless communication unit 24. The digital video camera 100 that has received this request performs the operations described with reference to FIG. 7A.

[0081] In step S803, the control unit 21 determines, via the wireless communication unit 24, whether or not it has been able to acquire a list of video files from the digital video camera 100. If the control unit 21 determines that it has been able to acquire the list of video files, the process proceeds to step S804; otherwise, step S803 is repeated.

[0082] In step S804, the control unit 21 expands the information acquired via the wireless communication unit 24 in the RAM 26, and determines the number of video files from which to acquire thumbnail images and metadata in consideration of the displayable area of the display unit 22.

[0083] In step S805, the control unit 21 issues a request to transmit thumbnail images and metadata to the digital video camera 100 via the wireless communication unit 24. The digital video camera 100 that has received this request performs the operations described with reference to FIG. 7B.

[0084] In step S806, the control unit 21 determines, via the wireless communication unit 24, whether or not it has been able to acquire thumbnail images and metadata from the digital video camera 100. If the control unit 21 determines that it has been able to acquire the thumbnail images and metadata, the process proceeds to step S807; otherwise, step S806 is repeated.

[0085] In step S807, the control unit 21 expands the thumbnail image information acquired via the wireless communication unit 24 in the RAM 26, and displays the thumbnail images in consideration of the displayable area of the display unit 22.

[0086] In step S808, the control unit 21 expands the metadata information acquired via the wireless communication unit 24 in the RAM 26 and performs analysis.

[0087] In step S809, the control unit 21 displays a part of the metadata information expanded in the RAM 26 on the display unit 22.

[0088] In step S810, the control unit 21 determines whether the type of the XML file in a part of the metadata information expanded in the RAM 26 is NewsMetadata. When the control unit 21 determines that the type of the XML file is NewsMetadata, the process proceeds to step S811; when it determines otherwise, the process proceeds to step S812.

[0089] In step S811, the control unit 21 causes the display unit 22 to display an icon indicating that the type of the XML file is NewsMetadata.

[0090] In step S812, since the type of the XML file is not NewsMetadata, the control unit 21 controls so as not to display an icon on the display unit 22. In this case, the user will see it as the same as a video file without a corresponding XML file. Note that this is the case when the communication application installed in the mobile terminal 200 only supports standardized ones such as NewsMetadata. For example, when the communication application can understand an XML file in an original format, an icon may be displayed in the same way as when the type of the XML file is NewsMetadata. Furthermore, different icons may be displayed so as to be able to distinguish that it is original.

[0091] Figure 9B shows a state where a screen 902 is opened in which a thumbnail image of a video file of the digital video camera 100 and the content of a metadata list are displayed by operating a menu button included in the operation unit 23. Reference numeral 904 represents a part of the content of the metadata information, and indicates the file name, date and time information, recording time, and video file size of the video file. Reference numeral 905 indicates the type information of the XML file associated with the video file, and here it represents that a NewsMetadata XML file is recorded in the video file 903.

[0092] In step S813, the control unit 21 determines whether or not the upper limit of the number of video files in the list of video files stored in the RAM 26 has been reached. If the control unit 21 determines that the upper limit of the number of video files has been reached, the process ends. If it determines otherwise, the process returns to step S805.

[0093] Figure 8B is a flowchart showing the operation when there is a request to display NewsMetadata information associated with a video file in the digital video camera 100 on the mobile terminal 200 by a user operation.

[0094] In step S814, the control unit 21 determines whether or not there is a request to display NewsMetadata associated with a video file in the digital video camera 100 by operating the operation unit 23. If the control unit 21 determines that there is a request to display NewsMetadata, the process proceeds to step S815. If it determines otherwise, step S814 is repeated.

[0095] In step S815, the control unit 21 requests the digital video camera 100 to transmit the NewsMetadata XML file via the wireless communication unit 24. At this time, the digital video camera 100 performs the operation described with reference to FIG. 7C.

[0096] In step S816, the control unit 21 determines whether it has been able to acquire the XML file of NewsMetadata from the digital video camera 100 via the wireless communication unit 24. If the control unit 21 determines that it has been able to acquire the XML file of NewsMetadata, the process proceeds to step S817. If it determines otherwise, step S816 is repeated.

[0097] In step S817, the control unit 21 uses the file control unit 27 to analyze the XML file stored in the RAM 26.

[0098] In step S818, the control unit 21 causes the display unit 22 to display the content analyzed by the file control unit 27.

[0099] FIG. 9C shows a state in which a screen 906 on which the content of the XML file of NewsMetadata of the digital video camera 100 is displayed is opened by operating a menu button included in the operation unit 23. An icon 907 represents a part of the content of the XML file of NewsMetadata, and a title name, description content, category information, copyright information, regulation information, etc. are shown.

[0100] As described above, in the first embodiment, the video file recorded by the digital video camera 100, the XML file, and their metadata information are recorded. Then, the video file of the digital video camera 100 is acquired from the mobile terminal 200, and the type of the XML file is acquired from the metadata information recorded in the video file. Thereby, it becomes possible to display the type of the XML file and further display the content of the XML file.

[0101] That is, the type of the XML file can be acquired by referring to the metadata information of the video file without analyzing the content of the XML file. Also, by displaying the type of the XML file on the mobile terminal 200 using that information, the type of the XML file associated with the video file can be easily confirmed.

[0102] In this embodiment, it has been described that the icon display is performed only in the case of NewsMetadata, but the icon may also be displayed in the case of the original XML file.

[0103] Since NewsMetadata is in a standardized format, it is highly likely that this format will be used. Therefore, performing icon display only for NewsMetadata is effective when displaying only those with high usage frequency.

[0104] On the other hand, when displaying icons for all types of XML files, it can be considered a merit that all the type information of the XML files associated with the video files can be grasped.

[0105] (Second Embodiment) In this second embodiment, the configuration of the digital video camera 100 and the mobile terminal 200 as an editing device is the same as that of the first embodiment shown in FIGS. 1 and 2. In the first embodiment, the case where the video file is MP4 has been described, but in the second embodiment, the case where the video file is MXF will be described.

[0106] FIG. 10A is a diagram showing the folder configuration of MXF recorded in the control unit 10.

[0107] When the user operates the operation unit 16 of the digital video camera 100 and the removable recording medium 20 is initialized, the CONTENS folder 1001 and the CLIPS001 folder 1002 are generated. Also, when recording is started by operating the operation unit 16, INDEX.MIF (1003) is generated. Further, the stream file A001C001_141120XX_CANON.MXF (1004) and the additional information A001C001_141120XX_CANON.XML (1005) are recorded.

[0108] As multiple video files are recorded, the file names of the MXF file and the XML file change and increase. And the management file that consolidates the video file information into one is INDEX.MIF(1003). The existence of INDEX.MIF(1003) enables analyzing a single management file instead of analyzing the inside of the folder in units of video files when the number of video files increases, which can reduce the analysis time. Also, timecodes and the like that need to be set in frame units are recorded in A001C001_141120XX_CANON.MXF(1004). Also, tag information and the like are recorded in A001C001_141120XX_CANON.XML(1005).

[0109] Figure 10B is a diagram showing the container structure of MXF.

[0110] Header 1006 indicates the start of the file and records metadata information about the file. When recording image data, information such as the resolution and frame rate to be recorded is recorded in this area of header 1006. Frame1007 (hereinafter referred to as frame information) represents the data of each frame and is composed of frame metadata information 1009, image data 1010, and audio data 1011. Footer 1008 is information indicating the end of the file. The frame number is recorded in the area of frame metadata information 1009 with the start frame being 0. A001C001_141120XX_CANON.XML(1005) is an XML (Extensible Markup Language) file of a markup language, similar to the first embodiment.

[0111] Figure 10C is a diagram showing the configuration of INDEX.MIF(1003) recorded in control unit 10.

[0112] Symbol 1012 indicates the content of the metadata in INDEX.MIF(1003), which is stored in the management information file. The management information file includes information such as the number of video files, the file names of the video files, the recording frame rate, the playback frame rate, the recording time, and the type information of the XML file.

[0113] Figure 11 is a flowchart showing the operation when the user sends a recording start request to the control unit 10 of the digital video camera 100 by operating the operation unit 16. Since the operation of this flowchart has many common parts with the operation of the flowchart shown in Figure 5A, the same step numbers are assigned to the common parts and the description is omitted.

[0114] In step S1101, the control unit 10 writes the type information of the XML file to be written to the management information file INDEX.MIF(1003) into the RAM 10.

[0115] In step S1102, the control unit 10 reads out the metadata information stored in the RAM 18 in step S500 or step S1101, and converts it into the format of the management information 1006 of the video file and the format of the management information file INDEX.MIF(1003). Then, the metadata information 360, 1012 is written to the removable recording medium 20 as the management information 1006 of the video file and the management information file INDEX.MIF via the recording medium I / F 19.

[0116] Figure 12 is a flowchart showing the operation when the digital video camera 100 receives a transmission request for a thumbnail image and a management information file for a specified video file in the digital video camera 100 from the mobile terminal 200.

[0117] In step S1201, the control unit 10 determines, via the wireless communication unit 14, whether there is a transmission request for a thumbnail image and a management information file for a video file from the outside. If the control unit 10 determines that there is a transmission request for a thumbnail image and a management information file for a video file, the process proceeds to step S1202. If it determines otherwise, step S1201 is repeated.

[0118] In step S1202, the control unit 10 reads and analyzes the thumbnail image and the management information file of the video file recorded on the removable recording medium 20 for the video file specified from the outside, and expands them in the RAM 18. When the reading and analysis of the thumbnail image and the management information file are completed, the control unit 10 uses the wireless communication unit 14 to transmit the thumbnail image and the management information file to the outside.

[0119] FIG. 13 is a flowchart showing the operation when there is a request for thumbnail image display, metadata information display of the management information file, and icon display of the XML file for the video file in the digital video camera 100 on the mobile terminal 200 by the user's operation. Since there are many common parts in the operation of this flowchart and the operation of the flowchart shown in FIG. 8A, the same step numbers are assigned to the common parts and the description is omitted.

[0120] In step S1301, the control unit 21 makes a transmission request for a thumbnail image and a management information file to the digital video camera 100 via the wireless communication unit 24. At this time, the digital video camera 100 performs the operation described in FIG. 12.

[0121] In step S1302, the control unit 21 determines, via the wireless communication unit 24, whether it has been able to acquire the thumbnail image and the management information file from the digital video camera 100. If the control unit 21 determines that it has been able to acquire the thumbnail image and the management information file, the process proceeds to step S807. If it determines otherwise, step S1302 is repeated.

[0122] In step S1303, the control unit 21 expands the management information file acquired via the wireless communication unit 24 in the RAM 26 and performs analysis.

[0123] In step S1304, the control unit 21 displays a part of the analyzed management information file on the display unit 22.

[0124] In step S1305, the control unit 21 determines whether the type of the XML file in a part of the analyzed management information file is NewsMetadata. When the control unit 21 determines that the type of the XML file is NewsMetadata, the process proceeds to step S811, and when it determines otherwise, the process proceeds to step S812.

[0125] As described above, also in the second embodiment, the video file recorded by the digital video camera 100, the XML file, and their metadata information are recorded. Then, the video file of the digital video camera 100 is acquired from the mobile terminal 200, and the type of the XML file is acquired from the metadata information recorded in the video file. Thereby, it becomes possible to display the type of the XML file and further display the content of the XML file.

[0126] Although the present invention has been described in detail based on its preferred embodiments, the present invention is not limited to these specific embodiments, and various forms within the scope not departing from the gist of this invention are also included in the present invention. Some of the above-described embodiments may be combined as appropriate.

[0127] Also, when a software program for realizing the functions of the above-described embodiments is supplied from a recording medium directly or to a system or device having a computer capable of executing the program using wired / wireless communication and the program is executed, it is also included in the present invention.

[0128] Therefore, in order to implement the functional processing of the present invention on a computer, the program code itself supplied to and installed in the computer also implements the present invention. That is, the computer program itself for implementing the functional processing of the present invention is also included in the present invention.

[0129] In that case, as long as the program has the function, the form of the program is not limited, such as object code, a program executed by an interpreter, script data supplied to the OS, etc.

[0130] As a recording medium for supplying the program, for example, a magnetic recording medium such as a hard disk or magnetic tape, an optical / photo-magnetic storage medium, or a non-volatile semiconductor memory may be used. Also, as a method for supplying the program, a method may be considered in which the computer program forming the present invention is stored in a server on a computer network, and a connected client computer downloads and programs the computer program.

Industrial Applicability

[0131] In the above-described embodiments, the case where the present invention is applied to a digital video camera has been described as an example, but this is not limited to this example. That is, the present invention may be applied to any device equipped with an imaging element. That is, as long as it is a device capable of imaging an image, such as a mobile phone terminal, a portable image viewer, a television equipped with a camera, a digital photo frame, a music player, a game machine, an e-book reader, etc., the present invention is applicable. Also, regarding the invention related to the configuration for playing back a moving image in each of the above-described embodiments, it is also applicable to an image processing device that does not have a function of imaging an image.

Explanation of Reference Numerals

[0132] 10: Control unit, 11: Image compression / expansion unit, 12: Imaging unit, 13: Image processing unit, 14: Wireless communication unit, 15: Display unit, 16: Operation unit, 17: ROM, 18: RAM, 19: Recording medium I / F, 20: Removable recording medium

Claims

1. Recording means for recording a video file of video data and an additional information file that is a file of additional information of the video data on a recording medium, Control means for controlling the recording means so as to record type information of the additional information recorded in the additional information file in a metadata area in the video file, An imaging device comprising the same.

2. The imaging device according to claim 1, wherein the control means controls the recording means to record the additional information file as an XML (Extensible Markup Language) file on the recording medium.

3. It has selection means for selecting whether to record the additional information of the additional information file in an original format or in a standardized standard format, The imaging device according to claim 1 or 2, wherein the control means controls the recording means to record, as the type information, whether the additional information of the additional information file is in the original format or the standard format in the video file.

4. The imaging device according to any one of claims 1 to 3, further comprising transmission means for transmitting the type information to the outside.

5. The imaging device according to any one of claims 1 to 4, wherein the control means controls the recording means to record the additional information recorded in the additional information file in the format of NewsML-G2 standardized by the IPTC (International Press Telecommunications Council).

6. An external device comprising communication means for communicating with the imaging device according to any one of claims 1 to 5, and receiving and displaying the type information.

7. A method for controlling an imaging device comprising recording means for recording a video file of video data and an additional information file that is a file of additional information of the video data on a recording medium, The method for controlling an imaging device, comprising a control step of controlling the recording means so as to record type information of the additional information recorded in the additional information file in a metadata area in the video file.

8. A program for causing a computer to function as each means of the imaging device according to any one of claims 1 to 5.

9. A computer-readable storage medium storing a program for causing a computer to function as each means of the imaging device according to any one of claims 1 to 5.

Images