Recording device, electronic device, and control method thereof, program, and storage medium

Abstract

To provide a recording apparatus capable of easily grasping identification information of an additional information file associated with a captured moving-image file.SOLUTION: A recording apparatus includes control means configured to perform control to record, on a recording medium, a moving-image file and an additional information file including additional information of the moving-image file. The control means performs control to record the identification information for identifying a data structure of the additional information file on a file different from the additional information file.SELECTED DRAWING: Figure 14

Description

[Technical Field]

[0001] The present invention relates to a technique for recording a moving image file and an additional information file associated with the moving image file on a recording medium. [Background technology]

[0002] In recent years, with the rise of social networking services (SNS) such as Twitter, broadcasting stations, news agencies, and other news sites are being required to convey accurate information more quickly than ever before. To this end, video processing devices such as digital still cameras and digital video cameras are now using not only video files but also additional information files that contain various metadata about the video files, enabling faster, more timely reporting.

[0003] For example, metadata such as the video format and recording length can be recorded along with the video. Alternatively, a mobile device can communicate with a digital video camera and write information about the coverage, such as the title and location of the coverage, into an additional information file at the scene of the news report. Additional information files are used, for example, as information to more easily search for desired video files within a video file server. By viewing the various metadata of a video file, the format and recording length of the video file can be determined.

[0004] Patent Document 1 describes a technique for preventing a user from inputting the contents of an additional information file to be associated with a video from a communication device or the like and recording the information in association with a wrong target video file. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] Japanese Patent Application Laid-Open No. 2013-98658 Summary of the Invention [Problem to be solved by the invention]

[0006] However, the technology described in Patent Document 1 does not allow an external editing device to easily ascertain the type, presence or absence of an additional information file associated with a video file captured by an imaging device, or the identification information of the data structure. To ascertain this information, the additional information file must be acquired and analyzed. As a result, there is a risk that the external editing device will not be able to edit the content of the additional information file as intended by the user for the video file.

[0007] The present invention has been made in consideration of the above-mentioned problems, and its purpose is to provide a recording device that can easily grasp the identification information of an additional information file associated with a captured video file. [Means for solving the problem]

[0008] The recording device of the present invention comprises: The video file and the additional information file including additional information of the video file are recorded on a recording medium by a control means, and the control means controls the recording medium to record identification information for identifying a data structure of the additional information file, The video file Recorded in and record version information as the identification information. The present invention is characterized in that it controls the temperature so that the temperature is high. [Effects of the Invention]

[0009] According to the present invention, it is possible to easily grasp the identification information of the additional information file associated with the captured moving image file. [Brief explanation of the drawings]

[0010] [Figure 1] 1 is a diagram showing the configuration of a digital video camera that is a first embodiment of an imaging apparatus of the present invention. [Figure 2] FIG. 2 is a block diagram showing the configuration of a mobile terminal according to the first embodiment. [Figure 3A] FIG. 3 is a diagram showing the structure of an MP4 folder in the first embodiment. [Figure 3B] FIG. 2 is a diagram showing the structure of an MP4 file according to the first embodiment. [Figure 3C] 3A and 3B are diagrams illustrating the structure of metadata in a video file and an XML file according to the first embodiment. [Figure 4] FIG. 3 is a diagram showing a connection sequence between a digital video camera and a mobile terminal according to the first embodiment. [Figure 5A] 5 is a flowchart showing recording start processing of the digital video camera according to the first embodiment. [Figure 5B] 5 is a flowchart showing recording stop processing of the digital video camera according to the first embodiment. [Figure 6] FIG. 2 is a diagram showing a menu screen of the digital video camera according to the first embodiment. [Figure 7] 6 is a flowchart showing the operation of the digital video camera in the first embodiment when it receives a request to send a video file list, a request to send thumbnail images and metadata, and a request to send an XML file. [Figure 8A] 6 is a flowchart showing the operation of displaying a list of video files on the mobile terminal according to the first embodiment. [Figure 8B] 6 is a flowchart showing the operation of displaying the contents of an XML file on the mobile terminal according to the first embodiment. [Figure 9] 3A to 3C are diagrams showing a selection screen, a video file list display screen, and an XML file display screen on the mobile terminal according to the first embodiment. [Figure 10] 3A to 3C are diagrams showing the structure of an XF-AVC folder, the structure of an XF-AVC file, and the structure of metadata in a management information file according to the first embodiment. [Figure 11] 10 is a flowchart showing recording start processing of a digital video camera according to a second embodiment. [Figure 12] 10 is a flowchart showing the operation of a digital video camera according to a second embodiment when it receives a request to transmit thumbnail images and metadata. [Figure 13] 10 is a flowchart showing the operation of displaying a list of video files on a mobile terminal according to the second embodiment. [Figure 14] 10 is a flowchart showing recording start processing of a digital video camera according to a third embodiment. [Figure 15] 10 is a flowchart showing the operation of displaying a list of video files on a mobile terminal according to the third embodiment. [Figure 16] FIG. 13 is a diagram illustrating an example of the contents of an XML file according to the third embodiment. [Figure 17] 13 is a node information table for analyzing an XML file according to the third embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0011] Hereinafter, embodiments will be described in detail with reference to the accompanying drawings. Note that the following embodiments do not limit the scope of the invention claimed. Although multiple features are described in the embodiments, not all of these multiple features are necessarily essential to the invention, and multiple features may be combined arbitrarily. Furthermore, in the accompanying drawings, the same reference numerals are used to designate the same or similar components, and redundant explanations will be omitted.

[0012] (First embodiment) Fig. 1 is a diagram showing the configuration of a digital video camera 100 (camcorder) which is a first embodiment of an imaging device of the present invention, and Fig. 2 is a diagram showing the configuration of a mobile terminal 200 which serves as an editing device in the first embodiment of the present invention.

[0013] 1, the digital video camera 100 includes a control unit 10, an image compression / decompression unit 11, an imaging unit 12, an image processing unit 13, a wireless communication unit 14, a display unit 15, an operation unit 16, a ROM 17, a RAM 18, a recording medium I / F 19, and a removable recording device 20. Each component is connected to the control unit 10, and the control unit 10 and each component can exchange data with each other.

[0014] The control unit 10 is a system control unit that controls the overall system of the digital video camera 100. The control unit 10 controls each component by loading a program recorded in the ROM 17 into the RAM 18 and executing the program, thereby performing the operations of the flowcharts described below. The control unit 10 also controls recording to the recording medium 20 and display on the display unit 15.

[0015] The ROM 17 is a non-volatile recording medium that stores programs executed by the control unit 10. The RAM 18 is a volatile recording medium that is used as a work memory for the control unit 10. The RAM 18 is also used as RAM when the image compression / decompression unit 11 compresses or decompresses image data captured by the imaging unit 12 and processed by the image processing unit 13, or image data read from the removable recording medium 20. The RAM 18 is also used as VRAM that temporarily stores display data when displaying on the display unit 15. Furthermore, the RAM 18 is also used as a memory unit that temporarily stores additional information that is recorded in association with the captured image. The additional information can be received from the wireless communication unit 24 of the mobile terminal 200. In this embodiment, the additional information will be described as an XML (Extensible MarkUp Language) file in markup language, but it does not have to be an XML file as long as it is information indicating the additional information.

[0016] The digital video camera 100 can be equipped with a recording medium 20, such as an SD card, for recording image data. To this end, it has a recording medium I / F (interface) 19. The recording medium I / F 19 has a slot into which a removable recording medium, such as a memory card, can be inserted. FIG. 1 shows a state in which the removable recording medium 20 is attached to the recording medium I / F 19. Although the digital video camera 100 has been described as being configured to record image data on the removable recording medium 20, it may also be configured to record image data in a non-removable memory built into the digital video camera 100.

[0017] The image processing unit 13 performs predetermined pixel interpolation processing, resizing processing, and color conversion processing on the image data captured by the imaging unit 12. The image processing unit 13 also performs predetermined calculation processing using the captured image data, and the control unit 10 performs various controls (exposure control, auto white balance control, etc.) related to the imaging by the imaging unit 12 based on the obtained calculation results.

[0018] The image compression / expansion unit 11 compresses image data that has been image-processed by the image processing unit 13 and expands image data that has been read from the removable recording medium 20 .

[0019] The imaging unit 12 has a photographing lens (including a zoom lens and a focus lens) and an imaging element, and captures an image of a subject under the control of the control unit 10, and acquires image data such as still image data and moving image data.

[0020] The display unit 15 displays various setting states, images captured by the imaging unit 12, images read and played back from the removable recording medium 20, etc., under the control of the control unit 10. It is configured as a display within a peer-type finder, a vari-angle LCD monitor, etc.

[0021] Operation unit 16 includes a power switch for turning digital video camera 100 on and off, a recording start button, a mode switching button for switching between operation modes such as camera mode (recording mode) and playback mode, and accepts operations from the user. If operation unit 16 includes a touch panel, control unit 10 can detect the following operations on the touch panel. Touching the touch panel with a finger or pen (hereafter referred to as touchdown). The touch panel is in contact with a finger or pen (hereafter referred to as "touch-on"). - Moving your finger or pen while touching the touch panel (hereafter referred to as "move"). -Removing your finger or pen from the touch panel (hereinafter referred to as "touch-up").

[0022] A state in which nothing is touching the touch panel (hereinafter referred to as touch-off).

[0023] These operations and the position coordinates where the finger or pen touches the touch panel are notified to the control unit 10, which determines what operation was performed on the touch panel based on the notified information. Regarding moves, the direction of movement of the finger or pen moving on the touch panel can also be determined for each vertical and horizontal component on the touch panel based on changes in the position coordinates.

[0024] Furthermore, when a touch panel is touched down, followed by a certain movement and then touched up, it is considered that a stroke has been drawn. The operation of quickly drawing a stroke is called a flick. A flick is an operation in which a finger is kept on the touch panel, quickly moved a certain distance, and then released; in other words, it is an operation in which the finger is quickly traced across the touch panel as if flicking. A flick can be determined to have been performed when a movement of at least a predetermined distance at at least a predetermined speed is detected, and a touch up is then detected. Furthermore, a drag can be determined to have been performed when a movement of at least a predetermined distance at less than the predetermined speed is detected. The touch panel may be any of a variety of types, such as a resistive film type, a capacitive type, a surface acoustic wave type, an infrared type, an electromagnetic induction type, an image recognition type, or an optical sensor type.

[0025] The wireless communication unit 14 transmits and receives data to and from external devices such as an external camera or a personal computer via wireless communication under the control of the control unit 10. The wireless communication unit 14 transmits setting information and operation information for the digital video camera 100 to the outside, and receives commands for operating the digital video camera 100 and additional information to be recorded together with image data. Data that can be transmitted and received includes digital image data, analog video signals, additional information, and the like.

[0026] FIG. 2 is a block diagram showing the configuration of a mobile terminal 200 as an external device in the first embodiment.

[0027] 2, mobile terminal 200 includes control unit 21, display unit 22, operation unit 23, wireless communication unit 24, ROM 25, RAM 26, and file control unit 27. Each component is connected to control unit 21, and control unit 21 and each component can exchange data with each other.

[0028] The control unit 21 is a system control unit that controls the overall system of the mobile terminal 200. The control unit 21 controls each component by loading a program recorded in the ROM 25 into the RAM 26 and executing the program, thereby performing the operations of the flowcharts described below. The ROM 25 is a non-volatile storage medium that stores the program executed by the control unit 21. The RAM 26 is a volatile storage medium that is used as a work memory for the control unit 21.

[0029] Under the control of the control unit 21, the display unit 22 displays various setting states, data received via the wireless communication unit 24 (including digital image data, analog video signals, and additional information), and the like.

[0030] The operation unit 23 is an operation unit that receives operations from a user and includes a power switch for turning on / off the power of the mobile terminal 200. Note that the operation unit 23 includes a touch panel, similar to the operation unit 16.

[0031] The wireless communication unit 24 transmits and receives data to and from external devices such as an external camera or a personal computer via wireless communication under the control of the control unit 21. The wireless communication unit 24 receives setting information and operation information for the digital video camera 100, and transmits commands for operating the digital video camera 100 and additional information to be recorded together with image data to the digital video camera 100. Data that can be transmitted and received includes digital image data, analog video signals, additional information, and the like.

[0032] The file control unit 27 is capable of analyzing data such as moving image files and additional information sent from the wireless communication unit 24, and controlling the generation of thumbnail images.

[0033] Next, FIG. 3A is a diagram showing the folder structure of the moving image file and the additional information file in this embodiment.

[0034] In this embodiment, an example will be described in which compressed video frames, management information such as time codes, and audio data are recorded in a container structure called MP4 (MPEG-4 Part 14 or ISO / IEC 14496-14:2003). However, file formats such as AVCHD (Advanced Video Codec High Definition) and MXF (Material eXchange Format) may also be used. The folder structure of MP4 recorded in the control unit 10 is shown in FIG. 3A.

[0035] When the user operates the operation unit 16 of the digital video camera 100 to initialize the removable recording medium 20, a DCIM folder 301 is generated. When recording is started by operating the operation unit 16, a 100_0128 folder 302 is generated. The 100 in the folder name represents the directory number, which is assigned sequentially from 100 and increases up to a maximum of 999. The 0128 in the folder name represents the creation date, indicating that it was created on January 28th.

[0036] Additionally, the stream file MVI_0001.MP4 (303) and additional information MVI_0001.XML (304) are recorded. As multiple video files are recorded, the file names of the MP4 and XML files change and increase. Information such as time codes that must be set on a frame-by-frame basis is recorded in MVI_0001.MP4 (303). Tag information, etc. is recorded in MVI_0001.XML (304).

[0037] Next, FIG. 3B is a diagram showing the structure of a moving image file in this embodiment.

[0038] In FIG. 3B, 310 is an ftyp box indicating file format compatibility. 311 is an area called a header written in the beginning of a video file, and is a moov box storing management information and thumbnail images required for playback. 312 is a box storing XMP (Extensible Metadata Platform), allowing arbitrary metadata to be set. 313 is a uuid box to which arbitrary information can be added. A preview image 327 is stored here. 314 is an mdat box storing encoded video data, audio data, time code data, and metadata for each frame.

[0039] Next, the configuration of the moov box 311 will be described.

[0040] Reference numeral 321 denotes a UUID box to which any information can be added, and stores a thumbnail image 325 to be displayed during playback and management information 326 used during playback. Reference numerals 315 to 317 denote track boxes, which store management information related to video data, audio data, and time code data. Reference numerals 318 to 320 denote STSZ boxes, which store the data sizes of the video data, audio data, time code data, and frame-based metadata for each encoding unit. Reference numerals 322 to 324 denote STCO boxes stored in the track box. The STCO boxes store information indicating the storage locations of the video data, audio data, time code data, and frame-based metadata in the MDAT 314. Each piece of data is stored in the MDAT box 314 in units called chunks, which consist of one or more encoding units.

[0041] Next, the configuration of the mdat box 314 will be described.

[0042] 330 to 338 are video data, audio data, time code data, and metadata in frame units stored in the mdat box 314. Each piece of data can be accessed in chunk units using the value written in the stco box. For example, 330 (CV1) can be traced from 350 in the stco box 322.

[0043] Next, FIG. 3C is a diagram showing the contents of metadata in the moving image file and the additional information file of this embodiment.

[0044] Reference numeral 360 denotes the contents of the metadata in the video file, which are stored in management information 326. The management information 326 records information about the time of shooting with the digital video camera 100, such as the shutter speed, the F-number indicating the lens brightness, the recording frame rate, the playback frame rate, and the recording time. In addition, an XML file, which is an additional information file, is recorded together with the video file, and information including type information of the XML file is also recorded.

[0045] Reference numeral 361 denotes the content of the type information of the XML file described in the metadata content 360, which is stored in the management information 326. 361 records information indicating whether an XML file has been recorded, information indicating that the XML file is in an original format having tag information specific to the digital video camera 100, and information indicating that the XML file is NewsMetadata, which is a standard format standardized for news reporting purposes.

[0046] Reference numeral 362 shows the contents of metadata when the XML file is recorded in the original format having tag information specific to the digital video camera 100. Recorded in 362 is the title, photographer, shooting information, product name, firmware version information, serial number, lens name, etc. of the digital video camera 100.

[0047] 363 shows the contents of metadata when the XML file is recorded in NewsMetadata, a standard format standardized for news reporting. An example of a standard format standardized for news reporting is the NewsML-G2 format standardized by the IPTC (International Press Telecommunications Council). The metadata contents 363 include the title, photographer, shooting information, keywords, category, genre, date and time information, language information, contributors, rights information, and information about the video file (file name, recording time, identification information, file format, audio information), etc.

[0048] FIG. 4 is a diagram showing an operation sequence when the digital video camera 100 (camcorder) and the mobile terminal 200 are connected.

[0049] In step S401, the user operates the operation unit 16 of the digital video camera 100 to instruct wireless connection with the mobile terminal 200, and the control unit 10 sends an instruction to the wireless communication unit .

[0050] In step S402, the user operates the operation unit 23 of the mobile terminal 200 to instruct wireless connection with the digital video camera 100, and the control unit 21 sends an instruction to the wireless communication unit 24.

[0051] In step S403, the wireless communication unit 14 of the digital video camera 100 and the wireless communication unit 24 of the mobile terminal 200 establish a wireless connection between the digital video camera 100 and the mobile terminal 200. Once a wireless connection is established between the digital video camera 100 and the mobile terminal 200, it becomes possible to send and receive control commands, setting information, digital image data, analog video signals, and additional information.

[0052] FIG. 5A is a flowchart showing the operation when the user operates the operation unit 16 to send a recording start request to the control unit 10 of the digital video camera 100.

[0053] In step S500, the control unit 10 generates metadata information required to start recording on the removable recording medium 20, and stores it in the RAM 18.

[0054] In step S501, the control unit 10 determines whether the XML file recording setting is ON. The ON / OFF of the XML file recording setting can be set by the user operating the operation unit 16. By pressing a menu button included in the operation unit 16, a menu 600 as shown in FIG. 6(a) is opened, and an item indicating the XML file recording setting, for example, ON (601), can be selected from the menu items to set it. If the control unit 10 determines that the XML file recording setting is ON, the process proceeds to step S502; otherwise, the process proceeds to step S505.

[0055] In step S502, the control unit 10 determines whether the type setting of the XML file is NewsMetadata. The type setting of the XML file can be set by the user operating the operation unit 16. By pressing a menu button included in the operation unit 16, a menu 602 as shown in FIG. 6(b) is opened, and an item representing the type setting of the XML file, for example, NewsMetadata (603), can be selected from the menu items and set. If the control unit 10 determines that the type setting of the XML file is NewsMetadata, the process proceeds to step S503; otherwise, the process proceeds to step S504.

[0056] In step S503, the control unit 10 reads the metadata information stored in the RAM 18 in step S500, and instructs the removable recording medium 20 to record the metadata information. Then, the metadata information 363 (see FIG. 3C) is written to the XML file as NewsMetadata.

[0057] In step S504, the control unit 10 reads the metadata information stored in the RAM 18 in step S500, and instructs the removable recording medium 20 to record the metadata information. Then, the metadata information 362 (see FIG. 3C) is written to the XML file as original information that is not standardized.

[0058] In step S505, the control unit 10 writes the type information of the XML file written in the management information 326 of the moving image file into the RAM 18 as metadata information.

[0059] In step S506, the control unit 10 reads out the metadata information stored in RAM 18 in steps S500 and S505, converts it into the format of moving image file management information 326, and issues an instruction to write it to the removable recording medium 20. Then, the metadata information 360 (see FIG. 3C) is written to the removable recording medium 20 as moving image file management information, which is part of the moving image file.

[0060] In step S507, the control unit 10 instructs the RAM 18 to convert the video data, audio data, and time code data stored in the RAM 18 into the format shown in Fig. 3B and write the converted data to the removable recording medium 20. The video data, audio data, and time code data are then written to the removable recording medium 20 as a video file.

[0061] FIG. 5B is a flowchart showing the operation when the user operates the operation unit 16 to send a recording stop request to the control unit 10 of the digital video camera 100.

[0062] In step S510, the control unit 10 generates metadata information required to stop recording on the removable recording medium 20, and stores it in the RAM 18.

[0063] In step S511, the control unit 10 determines whether the XML file recording setting is ON. As already described, the XML file recording setting can be turned ON / OFF by the user operating the operation unit 16. If the control unit 10 determines that the XML file recording setting is ON, the process proceeds to step S512; otherwise, the process proceeds to step S514.

[0064] In step S512, the control unit 10 determines whether the type setting of the XML file is NewsMetadata. As already described, the type setting of the XML file can be set by the user operating the operation unit 16. If the control unit 10 determines that the type setting of the XML file is NewsMetadata, the process proceeds to step S513; otherwise, the process proceeds to step S514.

[0065] In step S513, the control unit 10 uses the recording medium I / F 19 to read the XML file that was written at the start of recording from the removable recording medium 20 into RAM 18. Then, the control unit 10 updates the recording time and update date and time information of the video file generated in step S510 in the XML file read into RAM 18. Furthermore, the control unit 10 uses the recording medium I / F 19 to write the updated XML file back into the removable recording medium 20 as an XML file.

[0066] In step S514, the control unit 10 converts the video data, audio data, and time code data stored in RAM 18 up to the time when the recording stop request was received into the format shown in Fig. 3B. Then, using the recording medium I / F 19, the video data, audio data, and time code data are written to the removable recording medium 20 as a video file, and the recording stop process is terminated.

[0067] 7(a) to 7(c) are flowcharts showing the operation of the digital video camera 100 when it receives a control request from the mobile terminal 200. FIG.

[0068] FIG. 7(a) is a flowchart showing the operation of the digital video camera 100 when it receives a request from the mobile terminal 200 to send a list of the number of video files stored in the digital video camera 100.

[0069] In step S701, the control unit 10 determines whether or not there has been a request to transmit a list of the number of video files from outside via the wireless communication unit 14. If the control unit 10 determines that there has been a request to transmit a list of the number of video files, the process proceeds to step S702;

[0070] In step S702, the control unit 10 writes information about the video files recorded on the removable recording medium 20 as a list into the RAM 18. The list includes information such as the number of video files. The control unit 10 uses the wireless communication unit 14 to transmit the list written in the RAM 18 to an external device.

[0071] FIG. 7B is a flowchart showing the operation of the digital video camera 100 when it receives a request from the mobile terminal 200 to send a thumbnail image and management information for a specified video file in the digital video camera 100 .

[0072] In step S703, the control unit 10 determines whether or not a request to transmit a thumbnail image and management information for the video file has been received from the outside via the wireless communication unit 14. If the control unit 10 determines that a request to transmit a thumbnail image and management information for the video file has been received, the process proceeds to step S704;

[0073] In step S704, the control unit 10 reads and analyzes the thumbnail image 325 and management information 326 of the externally specified video file recorded on the removable recording medium 20, and stores them in RAM 18. After the control unit 10 has finished reading and analyzing the thumbnail image 325 and management information 326, it uses the wireless communication unit 14 to transmit the thumbnail image 325 and management information 326 to the outside. Because the thumbnail image 325 and management information 326 of the video file are recorded in an area near the beginning of the video file, they can be read more quickly than if the entire video file were read. For example, the thumbnail image 325 and management information 326 can be read by reading a specific size of data from the beginning of the video file, rather than the entire video file.

[0074] FIG. 7(c) is a flowchart showing the operation of the digital video camera 100 when it receives a request from the mobile terminal 200 to send an XML file for a specified video file stored in the digital video camera 100.

[0075] In step S705, the control unit 10 determines whether or not there has been an external request to transmit an XML file for the moving image file via the wireless communication unit 14. If the control unit 10 determines that there has been an external request to transmit an XML file for the moving image file, the process proceeds to step S706;

[0076] In step S706, the control unit 10 reads and analyzes the XML file of the externally specified moving image file recorded on the removable recording medium 20, and expands it in the RAM 18. After completing the reading and analysis of the XML file, the control unit 10 transmits the XML file to the outside using the wireless communication unit 14.

[0077] 8A and 8B are flowcharts showing the operation when a request for control regarding a video file or an XML file in the digital video camera 100 is received from the mobile terminal 200.

[0078] FIG. 8A is a flowchart showing the operation when a user requests mobile terminal 200 to display a list of video files stored in digital video camera 100.

[0079] In step S801, the control unit 21 determines whether or not a request for displaying a list of video files in the digital video camera 100 has been made by the user operating the operation unit 23. If the control unit 21 determines that a request for displaying a list of video files has been made, the process proceeds to step S802; otherwise, the control unit 21 repeats step S801.

[0080] In step S802, the control unit 21 requests the digital video camera 100 to transmit a video file list via the wireless communication unit 24. At this time, the digital video camera 100 performs the operation described in FIG. 7(a). Furthermore, when the menu button included in the operation unit 23 is operated, the control unit 21 displays a screen 900 as shown in FIG. 9(a), and makes it possible to select a list of video files in the digital video camera 100 from the menu items. When an icon 901 is selected by the operation unit 23, the control unit 21 displays a screen on which the contents of the video files in the digital video camera 100 can be confirmed.

[0081] In step S803, the control unit 21 determines whether or not the video file list has been acquired from the digital video camera 100 via the wireless communication unit 24. If the control unit 21 determines that the video file list has been acquired, the process proceeds to step S804; otherwise, the control unit 21 repeats step S803.

[0082] In step S804, the control unit 21 expands the information acquired via the wireless communication unit 24 into the RAM 26, and, taking into consideration the area that can be displayed on the display unit 22, determines the number of video files for which thumbnail images and metadata are to be acquired.

[0083] In step S805, the control unit 21 requests the digital video camera 100 to transmit the thumbnail images and metadata in the video file via the wireless communication unit 24. At this time, the digital video camera 100 performs the operation described in FIG. 7(b).

[0084] In step S806, the control unit 21 determines whether or not the thumbnail image and metadata have been acquired from the digital video camera 100 via the wireless communication unit 24. If the control unit 21 determines that the thumbnail image and metadata have been acquired, the process proceeds to step S807;

[0085] In step S807, the control unit 21 expands the thumbnail image information acquired via the wireless communication unit 24 in the RAM 26, and displays the thumbnail image of the video file on the display unit 22, taking into consideration the displayable area.

[0086] In step S808, the control unit 21 loads the metadata information of the moving image file acquired via the wireless communication unit 24 into the RAM 26 and analyzes it.

[0087] In step S809, the control unit 21 displays on the display unit 22 part of the metadata information of the moving image file expanded in the RAM .

[0088] In step S810, control unit 21 determines whether the type of the XML file in part of the metadata information of the video file expanded in RAM 26 is NewsMetadata. If control unit 21 determines that the type of the XML file is NewsMetadata, the process proceeds to step S811; otherwise, the process proceeds to step S812.

[0089] In step S811, the control unit 21 causes the display unit 22 to display an icon indicating that the type of the XML file is NewsMetadata (icon 905 in FIG. 9(b)).

[0090] In step S812, the control unit 21 controls the display unit 22 not to display an icon because the type of the XML file is not NewsMetadata.

[0091] 9(b) shows a state in which a screen 902 is opened by operating a menu button included in the operation unit 23, displaying thumbnail images of video files in the digital video camera 100 and a list of metadata. Reference numeral 904 indicates part of the metadata information, such as the file name, date and time information, recording time, and video file size of the video file. Reference numeral 905 indicates type information of the XML file associated with the video file, and in this case, indicates that a NewsMetadata XML file is recorded in the video file 903. In this embodiment, the type of XML file is indicated by an icon displayed together with the thumbnail image, but it may also be displayed by another display item.

[0092] In step S813, control unit 21 determines whether the upper limit of the number of moving image files in the moving image file list stored in RAM 26 has been reached. If control unit 21 determines that the upper limit of the number of moving image files has been reached, it ends the process, but if it determines that the upper limit has not been reached, it returns the process to step S805.

[0093] FIG. 8B is a flowchart showing the operation when a request is made by a user to display information about NewsMetadata associated with a video file in digital video camera 100 on mobile terminal 200.

[0094] In step S814, the control unit 21 determines whether or not a request to display NewsMetadata associated with a video file in the digital video camera 100 has been made by operation of the operation unit 23. In this embodiment, it is determined that a request to display NewsMetadata has been made when an operation (touch operation) has been made on the icon 905. If the control unit 21 determines that a request to display NewsMetadata has been made, the process proceeds to step S815; if it determines that a request to display NewsMetadata has not been made, the control unit 21 repeats step S814.

[0095] In step S815, the control unit 21 requests the digital video camera 100 to transmit the XML file of NewsMetadata via the wireless communication unit 24. At this time, the digital video camera 100 performs the operation described in FIG.

[0096] In step S816, the control unit 21 determines whether or not the NewsMetadata XML file was acquired from the digital video camera 100 via the wireless communication unit 24. If the control unit 21 determines that the NewsMetadata XML file was acquired, the process proceeds to step S817; if the control unit 21 determines that the NewsMetadata XML file was acquired, the process repeats step S816.

[0097] In step S817, the control unit 21 uses the file control unit 27 to analyze the XML file stored in the RAM 26.

[0098] In step S818, the control unit 21 causes the display unit 22 to display the contents analyzed by the file control unit 27.

[0099] 9(c) shows a state in which a screen 906 displaying the contents of the NewsMetadata XML file of the digital video camera 100 has been opened by operating a menu button included in the operation unit 23. An icon 907 represents part of the contents of the NewsMetadata XML file, and shows the title name, description, category information, copyright information, regulatory information, etc.

[0100] As described above, in the first embodiment, the video file and XML file recorded by the digital video camera 100 and their metadata information are recorded. Then, the video file of the digital video camera 100 is acquired from the mobile terminal 200, and the type of the XML file is acquired from the metadata information recorded in the video file. This makes it possible to display the type of the XML file and, further, the contents of the XML file.

[0101] In other words, the type of the XML file can be obtained by referring to the metadata information of the video file without analyzing the contents of the XML file. Furthermore, by using this information to display the type of the XML file on mobile terminal 200, the type of the XML file associated with the video file can be easily confirmed.

[0102] In this embodiment, an icon is displayed only in the case of NewsMetadata, but there is no problem in displaying an icon in the case of an original XML file as well. When displaying an icon for an original XML file as well, the control unit 21 may display a different icon depending on the file type so that the file type can be identified. When the user operates an original icon other than NewsMetadata and requests to display an XML file, the control unit 21 may obtain the original XML file and display the contents of the XML file, just as in the case of NewsMetadata.

[0103] Displaying only NewsMetadata icons is effective when displaying only frequently used files. Displaying all XML file types as icons makes it possible to see whether an XML file is associated with a video file. Another advantage is that by displaying a different icon for each file type, it is possible to see all the type information for XML files associated with a video file. The user may be able to set whether to display only NewsMetadata icons or to display icons for XML files other than NewsMetadata as well. The user may also be able to set this for each file type.

[0104] (Second embodiment) In this second embodiment, the configurations of the digital video camera 100 and the mobile terminal 200 as an editing device are the same as those in the first embodiment shown in Figures 1 and 2. In the first embodiment, a case where the moving image file is MP4 was described, but in the second embodiment, a case where the moving image file is MXF will be described.

[0105] FIG. 10(a) is a diagram showing the folder structure of MXF recorded in the control unit 10.

[0106] When the user operates the operation unit 16 of the digital video camera 100 to initialize the removable recording medium 20, a CONTENS folder 1001 and a CLIPS001 folder 1002 are generated. When recording is started by operating the operation unit 16, an INDEX.MIF (1003) is generated. In addition, a stream file A001C001_141120XX_CANON.MXF (1004) and additional information A001C001_141120XX_CANON.XML (1005) are recorded.

[0107] As multiple video files are recorded, the file names of the MXF and XML files change and increase. The management file that consolidates all of this video file information is INDEX.MIF(1003). The existence of INDEX.MIF(1003) reduces analysis time by allowing analysis of a single management file rather than analyzing each video file individually when the number of video files increases. Information such as time codes, which must be set frame by frame, is recorded in A001C001_141120XX_CANON.MXF(1004). Tag information is recorded in A001C001_141120XX_CANON.XML(1005).

[0108] FIG. 10(b) is a diagram showing the container structure of MXF.

[0109] Header 1006 indicates the start of the file and records metadata information related to the file. When recording image data, information such as the recording resolution and frame rate is recorded in the area of ​​this header 1006. Frame 1007 (hereinafter referred to as frame information) represents the data of each frame and is made up of frame metadata information 1009, image data 1010, and audio data 1011. Footer 1008 is information indicating the end of the file. Frame numbers are recorded in the area of ​​frame metadata information 1009, with the start frame being numbered 0. A001C001_141120XX_CANON.XML (1005) is an XML (Extensible Markup Language) file in markup language, as in the first embodiment.

[0110] FIG. 10C is a diagram showing the structure of INDEX.MIF (1003) recorded in the control unit 10.

[0111] Reference numeral 1012 denotes the contents of the metadata in INDEX.MIF (1003), which are stored in a management information file. The management information file contains information on the number of video files, the file names of the video files, the recording frame rate, the playback frame rate, the recording time, and XML file type information.

[0112] 11 is a flowchart showing the operation when a user operates the operation unit 16 to send a recording start request to the control unit 10 of the digital video camera 100. Since the operation of this flowchart has much in common with the operation of the flowchart shown in FIG. 5A, the common parts are given the same step numbers and their explanations are omitted.

[0113] In step S1101, the control unit 10 writes to the RAM 18 the type information of the XML file to be written to the management information file INDEX.MIF (1003).

[0114] In step S1102, the control unit 10 reads out the metadata information stored in RAM 18 in step S500 or step S1101, and converts it into the format of the video file management information 1006 or the format of the management information file INDEX.MIF (1003). Then, the metadata information 360, 1012 is written to the removable recording medium 20 via the recording medium I / F 19 as the video file management information 1006 or the management information file INDEX.MIF.

[0115] FIG. 12 is a flowchart showing the operation of the digital video camera 100 when it receives a request from the mobile terminal 200 to send a thumbnail image and a management information file for a specified video file stored in the digital video camera 100 .

[0116] In step S1201, the control unit 10 determines whether or not there has been an external request to transmit a thumbnail image and a management information file for the video file via the wireless communication unit 14. If the control unit 10 determines that there has been a request to transmit a thumbnail image and a management information file for the video file, the process proceeds to step S1202; otherwise, step S1201 is repeated.

[0117] In step S1202, the control unit 10 reads and analyzes the thumbnail image and management information file of the externally specified moving image file recorded on the removable recording medium 20, and stores them in RAM 18. After completing the reading and analysis of the thumbnail image and management information file, the control unit 10 uses the wireless communication unit 14 to transmit the thumbnail image and management information file to the outside.

[0118] 13 is a flowchart showing the operation when a user requests mobile terminal 200 to display a list of video files in digital video camera 100. The operation of this flowchart has much in common with the operation of the flowchart shown in FIG. 8A, so the common parts are given the same step numbers and will not be described again.

[0119] In step S1301, the control unit 21 requests the digital video camera 100 to transmit thumbnail images and management information files via the wireless communication unit 24. At this time, the digital video camera 100 performs the operation described with reference to FIG.

[0120] In step S1302, the control unit 21 determines whether or not the thumbnail image and management information file were acquired from the digital video camera 100 via the wireless communication unit 24. If the control unit 21 determines that the thumbnail image and management information file were acquired, the process proceeds to step S807; otherwise, the control unit 21 repeats step S1302.

[0121] In step S1303, the control unit 21 loads the management information file acquired via the wireless communication unit 24 into the RAM 26 and analyzes it.

[0122] In step S1304, the control unit 21 displays a part of the analyzed management information file on the display unit 22.

[0123] In step S1305, the control unit 21 determines whether the type of the XML file in the analyzed part of the management information file is NewsMetadata. If the control unit 21 determines that the type of the XML file is NewsMetadata, the process proceeds to step S811; otherwise, the control unit 21 proceeds to step S812.

[0124] As described above, in the second embodiment, moving image files and XML files recorded by digital video camera 100 and their metadata information are also recorded. Then, the moving image files of digital video camera 100 are obtained from mobile terminal 200, and the type of the XML file is obtained from the metadata information recorded in the moving image files. This makes it possible to display the type of the XML file and, further, the contents of the XML file.

[0125] (Third embodiment) In the third embodiment, the configurations of the digital video camera 100 and the mobile terminal 200 serving as an editing device are the same as those in the first embodiment shown in FIGS. 1 and 2. Furthermore, the basic processing (processing in FIGS. 5A, 5B, 7, 8A, and 8B) is also the same as in the first embodiment, so only differences from the first embodiment will be described. In the third embodiment, processing by the digital video camera 100 and the mobile terminal 200 is described for a case in which XML files of the same type exist but have different data structures of metadata information. Such a situation may occur, for example, when the firmware of the digital video camera 100 is upgraded / downgraded, and recording XML files for each upgrade results in files with different XML file data structures. When recording an XML file, the digital video camera 100 records version information in the video file as identification information for identifying the data structure of the XML file. The mobile terminal 200 then performs processing according to the version information. This allows the mobile terminal 200 to appropriately handle XML files of the same type but with different data structures of metadata information.

[0126] FIG. 14 is a flowchart showing the recording start process of the digital video camera 100 according to this embodiment. This flowchart shows the operation performed when a user operates the operation unit 16 to send a recording start request to the control unit 10 of the digital video camera 100. The operation of this flowchart is essentially the same as that shown in FIG. 5A, with some differences. Therefore, the same step numbers are used for common steps, and their explanations are omitted, with only the differences explained below. In S1401, the control unit 10 reads version information about the data structure of the XML file pre-recorded in ROM 17 and writes the read version information to RAM 18 as metadata information to be written to the management information 326 of the video file. Note that, in this embodiment, if the file type is NewsMetadata, the version information is recorded in the file by the control unit 10 itself; if the file type is not NewsMetadata, the version information is not recorded. Therefore, if the file type is not NewsMetadata, the process of S1401 is not executed. NewsMetadata is a NewsML-G2 standard, and since there is a possibility that the standard version may be revised, and since there is a large amount of metadata, it is thought that the way it is used and utilized may change, version information will be recorded.

[0127] Next, in S1402, the control unit 10 reads the metadata information stored in RAM 18 in S500, S505, and S1400, formats it into the video file management information 326, and instructs the removable recording medium I / F 19 to write it to the removable recording medium 20. Then, the removable recording medium I / F 19 writes the metadata information, including the metadata at the start of recording, the file type of the XML file, and version information about the data structure, to the removable recording medium 20 as video file management information 326, which is part of the video file. If the video file is in MP4 format, the process described above is executed. If the video file is in MXF format, it is preferable to define and record an area for storing version information about the data structure of the XML file in the management file (INDEX.MIF) in the second embodiment. That is, the control unit 10 reads the metadata information stored in RAM 18 in S500, S505, and S1400. Then, the metadata information, including the metadata at the start of recording, the file type of the XML file, and the version information of the data structure, is converted into the format of the video file management information 1006 and the format of the management information file INDEX.MIF (1003). The converted information is written to the removable recording medium 20 as the video file management information 1006 and the management information file INDEX.MIF.

[0128] As described above, in the third embodiment, an example was shown in which not only the file type of an XML file but also version information of the data structure is recorded in the management information 326, but the present invention is not limited to this.

[0129] It is conceivable that the version information may change due to revisions to the standards for metadata recorded in XML files or changes in the operation and utilization methods of XML files. In this embodiment, the version information is recorded in the video file or management information file, so that the version of the data structure of the XML file can be determined without reading the XML file. Various definitions can be applied to the version information of the data structure. When recording an XML file conforming to the NewsML-G2 standard, version information different from the version defined by the standard may be used. In other words, as long as the type of metadata recorded in the XML file in the digital video camera 100, i.e., the data structure of the XML file, can be identified, independently defined version information may be used.

[0130] Furthermore, if the operation and utilization of XML files differs depending on the region in which the digital video camera 100 is used, it is possible to adapt the data structure of the XML file to the region in which it is used. Therefore, the version information may be different depending on the region in which it is used. Alternatively, in addition to the version information on the data structure, destination information indicating the region in which it is used may be recorded in the management information or management information file for the video file. Alternatively, destination information may be recorded instead of version information. The destination information may be a country code written in alphabetical order, or may include region information.

[0131] 15 is a flowchart showing the operation when a user requests mobile terminal 200 to display a list of video files in digital video camera 100. The operation of this flowchart is basically the same as the flowchart shown in FIG. 8A, but there are some differences. Therefore, the same step numbers are assigned to the common parts, and explanations will be omitted, and only the differences will be explained.

[0132] If it is determined in S810 that the XML file type of the metadata of the video file is NewsMetadata, the process proceeds to S1501. In S1501, control unit 21 determines the version information of the data structure of the XML file that is part of the metadata information of the video file expanded in RAM 26. If the version information is a version that is compatible with the software program (application) currently running on mobile terminal 200, control unit 21 proceeds to S811; otherwise, the process proceeds to S1502.

[0133] In S1502, the control unit 21 causes the display unit 22 to display a message urging the user to update the application because the XML file contains metadata that is incompatible with the currently running software program (application). The control unit 21 may further determine whether the application is up to date, and may display a message urging the user to update only if the application is not up to date. The control unit 21 may also display a message urging the user to update only if updating the application makes it compatible with the version of the XML file. Note that if the message has been displayed once before, it may not be displayed.

[0134] If the version information is not compatible with the software program (application) currently running on mobile terminal 200, it is possible that the metadata of the XML file cannot be displayed, or that some of the metadata cannot be displayed. Therefore, in S1503, control unit 21 displays an icon indicating an incompatible version of NewsMetadata, such as icon 908 in FIG. 9(d), which is different from the normal icon 905, in the display field for the corresponding video file. Even if it is determined that the XML file type is not NewsMetadata, as described in the first embodiment, an icon may be displayed if an XML file related to the video file exists. In this case, if the file type is not NewsMetadata, control unit 21 may display the icon without determining the version information in S1501.

[0135] FIG. 16 shows an example of the data structure of a NewsMetadata XML file, where FIG. 16(a) shows the data structure of version 1.0, and FIG. 16(b) shows the data structure of version 2.0.

[0136] NewsMetadata is written based on the XML format, with nodes shown in a hierarchical structure, and some nodes contain specific data defined based on the XML format, known as elements and attributes.

[0137] There are differences between each version. In version 1.0, as shown in 1601 of Figure 16(a), <organisationdetails>It includes the information below the node, but version 2.0 does not include it.

[0138] In addition, in version 2.0, the following are shown in 1602 and 1603 in FIG. 16(b): <versioncreated>Node and <firstcreated>Node and <contentmeta>The difference is that it includes nodes and below, but version 1.0 does not include them.

[0139] Therefore, in the mobile terminal 200, when the control unit 21 acquires the XML file, analyzes the XML file in S817, and displays the contents of the XML file in S818, the analysis and display are performed according to the version information. When the control unit 21 analyzes and displays an XML file according to the version of the data structure, it refers to a table showing the node information corresponding to each version, as shown in FIGS. 17(a) and 17(b).

[0140] Fig. 17(a) is a table showing the data structure corresponding to version 1.0, i.e., information about each node constituting the structure. Fig. 17(b) is a table showing the data structure corresponding to version 2.0, i.e., information about each node constituting the structure. Note that information corresponding to the table showing information about each node shown in Figs. 17(a) and (b) is stored in advance in ROM 25, and control unit 21 refers to this information.

[0141] 17 includes the name of the node, the name of the parent node of the node, the layer of the node, and information indicating whether the node has information to be read. The control unit reads out the table corresponding to the version of the XML file from ROM 25, reads out information from the target node of the XML file based on the information written in the read table, and displays the read information on the display unit 22.

[0142] In addition, as a method of referencing node information etc. described in an XML file, it is possible to apply commonly known models such as DOM (Document Object Model) or SAX (Simple API for XML).

[0143] In the above description, version information is used as identification information for identifying the data structure, but this is not limited to this method. As explained previously, information indicating the destination or region may also be used, and any information that can identify the data structure may be used.

[0144] As described above, according to the third embodiment, identification information for identifying the data structure of an XML file is recorded in a video file, so that the version of the XML file can be determined without acquiring the XML file, and appropriate measures can be taken depending on the XML file.

[0145] The above description has been given assuming that the video file is MP4. However, the present invention is also applicable to video files in MXF format. In this case, it is advisable to combine the second and third embodiments. That is, the digital video camera 100 records not only the file type but also version information (identification information) in the management information file. When displaying a thumbnail image, the mobile terminal 200 requests the thumbnail image and the management information file, and displays an icon 905 or the like according to the file type and version information contained in the management information file.

[0146] (Other embodiments) The present invention has been described above in detail based on preferred embodiments thereof. However, the present invention is not limited to these specific embodiments, and various modifications within the scope of the present invention are also included. Parts of the above-described embodiments may be combined as appropriate. For example, the digital video camera 100 may switch between the recording process of the first embodiment and the recording process of the second embodiment depending on the format of the moving image file set at the time of recording. Furthermore, the mobile terminal 200 may switch between the recording process of the second embodiment depending on the format of the moving image file to be displayed.

[0147] The present invention also includes cases where a software program that realizes the functions of the above-described embodiments is supplied to a system or device having a computer that can execute the program directly from a recording medium or via wired / wireless communication, and the program is executed.

[0148] Therefore, the program code itself that is supplied to and installed on a computer to realize the functional processing of the present invention also realizes the present invention. In other words, the computer program itself for realizing the functional processing of the present invention is also included in the present invention.

[0149] In this case, as long as it has the functionality of a program, the form of the program does not matter, such as object code, a program executed by an interpreter, or script data supplied to an OS.

[0150] The recording medium for supplying the program may be, for example, a hard disk, a magnetic recording medium such as a magnetic tape, an optical / magneto-optical storage medium, or a non-volatile semiconductor memory.

[0151] Another method of supplying the program is to store the computer program forming the present invention in a server on a computer network, and have connected client computers download the computer program. [Industrial Applicability]

[0152] In the above-described embodiments, the present invention has been described with reference to a digital video camera as an example, but is not limited to this example. That is, the present invention may be applied to any device equipped with an image sensor. That is, the present invention is applicable to any device capable of capturing images, such as a mobile phone, a portable image viewer, a television equipped with a camera, a digital photo frame, a music player, a game console, or an e-book reader. Furthermore, the present invention is also applicable to devices that do not necessarily have the ability to capture images, such as devices that acquire captured images from an external device and record the acquired images. Furthermore, the inventions relating to the configuration for playing video on a mobile device in the above-described embodiments can also be applied to electronic devices that do not have the ability to capture images.< / contentmeta> < / firstcreated> < / versioncreated> < / organisationdetails>

Claims

1. a control means for controlling recording of a moving image file and an additional information file containing additional information of the moving image file on a recording medium; The recording device is characterized in that the control means controls the recording device so that identification information for identifying the data structure of the additional information file is recorded in the moving image file, and version information is recorded as the identification information.

2. 2. The recording apparatus according to claim 1, wherein the control means records the identification information and the thumbnail image in a header of the moving image file.

3. a selection means for selecting a type of additional information to be recorded in the additional information file; The control means controlling the recording of an additional information file corresponding to the type selected by the selection means; Recording type information corresponding to the type selected by the selection means into the video file. Control it so that 3. The recording apparatus according to claim 1, wherein the recording medium is a recording medium.

4. the additional information file is in XML (Extensible MarkUp Language) format, The selection means selects the recording format of the additional information to be recorded in the additional information file in XML format from a standardized format or an original format in response to a user operation.

4. The recording apparatus according to claim 3.

5. 5. The recording apparatus according to claim 4, wherein the standard format is the NewsML-G2 format standardized by the IPTC (International Press Telecommunications Council).

6. 6. The recording device according to claim 5, wherein the identification information is information relating to a version of the NewsML-G2 standard.

7. The recording device described in any one of claims 4 to 6, characterized in that when the standard format is selected, the control means controls to record the type information and the version information in the video file as the identification information, and when the original format is selected, controls to record the type information in the video file as the identification information without recording the version information.

8. A recording device described in any one of claims 1 to 7, characterized in that the control means records destination information indicating the area of ​​use in the video file together with the identification information.

9. a recording step of recording a moving image file and an additional information file containing additional information of the moving image file on a recording medium, A control method for a recording device, characterized in that in the recording process, identification information for identifying the data structure of the additional information file is recorded in the video file, and version information is recorded as the identification information.

10. A program for causing a computer to function as each of the means of the recording device according to any one of claims 1 to 8.

Images