Image pickup apparatus, control method therefor, program, and system
By generating and sending metadata in the camera device, the problem of lack of metadata in external devices when recording moving image data is solved, complete data recording and efficient management are achieved, and more efficient news reporting is supported.
Patent Information
- Application Number
- CN202380069275.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2022-09-29
- Filing Date
- 2023-08-23
- Publication Date
- 2025-05-16
AI Technical Summary
In IP streaming technology, external devices may lack sufficient metadata to correctly record and process moving image data, especially when video data is sent directly from their own devices to external devices.
By implementing the metadata generation and transmission function in the camera device, it is ensured that when the moving image data is sent from the camera device to the external device, the associated metadata is also recorded and transmitted, and the integrity of the metadata is maintained throughout the entire process from the beginning to the end of the recording.
The solution ensures that external devices can record moving image data and their related metadata in a complete and accurate manner, improves data reliability and searchability, and supports more efficient news reporting and data management.
Smart Images

Figure CN120019639A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to an imaging device, a control method, a program and a system thereof. Background Art
[0002] In the recent news reporting scene of broadcasting companies, news agencies, etc., IP-based broadcasting systems have proliferated, and IP streaming technology has also been used, which is used to continuously send motion image data being shot by video processing equipment such as digital still cameras or digital video cameras to the outside via a network. In addition, an additional information file in which various metadata related to the motion image data in the video is written is used, so that news reports with high immediacy can be realized faster and easier. For example, in the additional information file, metadata such as the format and recording length of the motion image data can be recorded together with the captured motion image data. In addition, communication is performed between the portable terminal and the digital video camera, and in the news reporting scene, interview information such as the interview title or the interview location can be written into the additional information file. The additional information file is used as information for, for example, easier searching for desired motion image data in a motion image data server. At this time, by browsing the various metadata of the motion image data, the format or recording length of the motion image data can be known.
[0003] Citation List
[0004] Patent Literature
[0005] Patent Document 1: Japanese Patent Application Laid-Open No. 2004-363825 Summary of the invention
[0006] Problem that the invention aims to solve
[0007] In the metadata (additional information) recorded in the additional information file associated with the moving image data, there is not only additional information set by the user, but also additional information to be updated when the recording of the moving image data starts and additional information to be updated when the recording ends. In Patent Document 1, when recording video data (moving image data), metadata associated with the moving image data is simultaneously created and stored in the own device. However, in the case where the own video processing device performs IP streaming and stores the moving image data in an external device at the communication destination, as in Patent Document 1, if the additional information file stored in the own device is only directly sent to the external device, the metadata to be referred to by the external device may be insufficient.
[0008] The present invention has been made in consideration of the above-mentioned problems, and provides the following technology: by providing a file of motion image data and a metadata file for describing metadata from the start to the end of recording of the motion image data to a device for recording motion image data, the device is allowed to record not only the file of the motion image data but also the metadata file.
[0009] Solutions for solving problems
[0010] In order to solve this problem, for example, an image pickup device according to the present invention has the following configuration. That is, there is provided an image pickup device, which includes a communication component and is configured to send motion image data obtained by image pickup to an external device via the communication component, the external device being configured to record the motion image data, the image pickup device including:
[0011] a moving image sending means for sending the moving image data obtained by the imaging means to the external device via the communication means when receiving an instruction for starting recording, and for ending the sending of the moving image data to the external device when receiving an instruction for ending recording;
[0012] a metadata generating means for generating metadata associated with the start of recording of the moving image data when receiving an instruction for starting recording, and generating metadata associated with the end of recording of the moving image data when receiving an instruction for ending recording; and
[0013] The metadata transmitting means is configured to transmit the metadata from the start of recording to the end of recording to the external device via the communication means when receiving an instruction for ending recording.
[0014] Effects of the Invention
[0015] According to the present invention, it is possible to cause a device to record moving image data and metadata from the beginning to the end of the moving image data.
[0016] Other features and advantages of the present invention will be apparent from the following description in conjunction with the accompanying drawings. Note that in all drawings, the same reference numerals represent the same or similar components. BRIEF DESCRIPTION OF THE DRAWINGS
[0017] The accompanying drawings, which are incorporated in and constitute a part of the specification, illustrate embodiments of the invention and, together with the description, serve to explain the principles of the invention.
[0018] Figure 1 is a diagram exemplarily showing a system configuration according to a first embodiment;
[0019] Figure 2 is a diagram exemplarily showing a block configuration of a digital video camera;
[0020] Figure 3 is a diagram exemplarily showing the structure of an XML file;
[0021] Figure 4 is a diagram exemplarily showing a block configuration of a network recorder;
[0022] Figure 5 is a flow chart exemplarily showing the basic operation of a digital video camera;
[0023] Figure 6 is a diagram exemplarily showing a setting XML file selection UI;
[0024] Figure 7 is a flow chart exemplifying the basic operation of a network recorder;
[0025] Fig. 8A is a flowchart exemplarily showing a characteristic processing procedure of the digital video camera according to the first embodiment;
[0026] Figure 8B is a flowchart exemplarily showing a characteristic processing procedure of the network recorder according to the first embodiment;
[0027] Fig. 9 is a diagram exemplarily showing a system configuration according to a second embodiment;
[0028] Fig.10 is a diagram exemplarily showing a block configuration of a controller;
[0029] Fig.11 is a flow chart exemplarily showing the basic operation of the controller;
[0030] Fig. 12A is a flowchart exemplarily showing a characteristic processing procedure of a controller according to a second embodiment;
[0031] Fig. 12B is a flowchart exemplarily showing a characteristic processing procedure of the digital video camera according to the second embodiment;
[0032] Fig.13A is a diagram exemplarily showing an example of metadata when starting to record an XML file for a digital video camera; and
[0033] Fig. 13B : is a diagram exemplarily showing an example of metadata after correction when recording of an XML file for a network recorder is started. DETAILED DESCRIPTION
[0034] Embodiments will be described in detail below with reference to the accompanying drawings. Note that the following embodiments are not intended to limit the scope of the claimed invention. A plurality of features are described in the embodiments, but are not limited to inventions requiring all such features, and a plurality of such features may be appropriately combined. In addition, in the accompanying drawings, the same reference numerals are given to the same or similar configurations, and redundant descriptions thereof are omitted.
[0035] [First embodiment]
[0036] Figure 1 is a diagram showing an example of a system configuration according to the present embodiment. The system includes a digital video camera 100 that captures moving images and creates and transmits metadata, and a network recorder 200 that stores moving image data and metadata transmitted from the digital video camera 100. In the present embodiment, the digital video camera 100 and the network recorder 200 are connected via a local area network (LAN). The digital video camera 100 and the network recorder 200 may be connected via a network switch or the like. The communication protocol is an Internet protocol, but the type is not particularly limited. In addition, the connection form may be wired or wireless.
[0037] Figure 2 1 is a diagram showing a block configuration of a digital video camera 100. The digital video camera 100 includes a control unit 101, an image compression / decompression unit 102, an imaging unit 103, an image processing unit 104, a network I / F 105, a display unit 106, an operation unit 107, a ROM 108, a RAM 109, and a recording medium I / F 110. These constituent elements are driven by power obtained by rectifying AC power supplied from the outside into a predetermined voltage or power supplied from an internal battery (not shown).
[0038] The control unit 101 is formed of a processor such as a CPU, and controls the entire device. More specifically, the control unit 101 expands the program recorded in the ROM 108 into the RAM 109 and executes the program, thereby performing control and arithmetic processing of each component, and performing processing according to a flowchart to be described later. The ROM 108 is a nonvolatile memory, and stores the program to be executed by the control unit 101 and various settings.
[0039] The RAM 109 is a volatile memory used as a working memory of the control unit 101. The RAM 109 is also used as a video random access memory (VRAM) that temporarily stores data to be displayed on the display unit 106, or image data captured by the camera unit 103 and processed by the image processing unit 104, or image data read out from the recording medium 111 to be compressed or decompressed by the image compression / decompression unit 102. The RAM 109 is also used to temporarily store an extensible markup language (XML) file to be recorded in association with the captured image or metadata to be written to the XML file. The XML file is generated based on the control of the control unit 101. In order to generate the XML file, metadata (additional information) included in a setting XML file received from an external device via the network I / F 105 or included in a setting XML file recorded in the recording medium 111, as well as metadata that can be acquired when recording starts or is completed, is used. This will be referred to later. Figure 3 Describes the details of the metadata configuration included in the XML file.
[0040] The control unit 101 also functions as a display control unit because it generates display data for the display unit 106 and controls display timing. In addition, the control unit 101 functions as a recording control unit because it controls data recording or reading to the recording medium 111 via the recording medium I / F 110. The control unit 101 may be formed by a plurality of processors. The control unit 101 may be given the functions of other components (e.g., the image compression / decompression unit 102 or the image processing unit 104) so as to be integrally formed. Alternatively, the control unit 101 may be given the functions of a part of other components.
[0041] A recording medium 111 configured to record image data can be attached to the digital video camera 100. To this end, the digital video camera 100 includes a recording medium interface (I / F) 110. The recording medium I / F 110 has a slot into which a removable recording medium 111 such as a memory card can be inserted. Figure 2 An example is shown in which a recording medium 111 is attached to the recording medium I / F 110. Description will be made assuming that the digital video camera 100 according to the present embodiment is configured to record image data in a removable recording medium 111. There is also a possible configuration in which moving image data is recorded in a non-removable recording medium that is built into the digital video camera 100.
[0042] The recording medium 111 is used to record an XML file or moving image data obtained by taking an image by the camera unit 103 and performing various processes by the image processing unit 104 and the image compression / decompression unit 102. Note that the type of recording medium is not particularly limited, and for example, an SD card or CFExpress etc. can be applied to the recording medium 111.
[0043] The image processing unit 104 performs predetermined pixel interpolation, resizing processing, or color conversion processing on the image data captured by the imaging unit 103. In addition, the image processing unit 104 performs predetermined arithmetic processing using the captured image data. The control unit 101 performs various controls (exposure control, automatic white balance processing, etc.) related to imaging by the imaging unit 103 based on the obtained operation results.
[0044] The image compression / decompression unit 102 performs compression encoding processing on the image data subjected to image processing by the image processing unit 104 , and performs decompression (decoding) processing on the image data read out from the recording medium 111 .
[0045] The imaging unit 103 includes an imaging lens (including a zoom lens and a focus lens) and an imaging element. Based on the control of the control unit 101, the imaging unit 103 captures a subject, generates data such as still image data or moving image data, and outputs the data.
[0046] The network I / F 105 transmits / receives data to / from an external device such as an external camera, a personal computer, a smart phone, or a tablet computer based on the control of the control unit 101. Through the network I / F 105, setting information and operation information of the digital video camera 100 can be transmitted to the external device, and a command for operating the digital video camera 100 or an XML file to be recorded together with image data can be received from the external device. The received data is stored in the RAM 109. The data that can be transmitted / received includes digital image data and analog video signals. In addition, the network I / F 105 transmits / receives data to / from the network recorder 200 based on the control of the control unit 101. Through the network I / F 105, an XML file or moving image data created by the digital video camera 100 can be transmitted to the network recorder 200. Note that in this embodiment, if a network recorder 200 is connected, the control unit 101 continues to send the motion image data obtained by capturing images by the camera unit 103 and performing various processes by the image processing unit 104 and the image compression / decompression unit 102 to the network recorder 200 via the network I / F 105.
[0047] The display unit 106 is a display configured to display various setting states, images being captured by the imaging unit 103, or images read out and reproduced from a recording medium based on control of the control unit 101. The display unit 106 is formed as a display in an endoscope type viewfinder or a variable angle liquid crystal monitor.
[0048] The operation unit 107 is an operation unit that accepts an operation from a user, and includes a power switch configured to supply power to the digital video camera 100, a shooting start button, and a mode switching button capable of switching a mode to a camera mode (shooting mode) or a reproduction mode. Note that if a touch panel is included in the operation unit 107, the touch panel may be any of various types of touch panels such as a resistive film type, an electrostatic capacitance type, a surface acoustic wave type, an infrared type, an electromagnetic induction type, an image recognition type, and an optical sensor type.
[0049] Figure 3 An example of the configuration of metadata (additional information) included in an XML file recorded in association with moving image data in the present embodiment is shown. An XML file 400 is formed by metadata 401 recorded based on information read out at the start of recording, metadata 402 set by a user, and metadata 403 recorded based on information read out at the end of recording. Each piece of information of the metadata 401 is information determined at the start of recording of moving image data, and is additional information that does not change after the start of recording. Examples of the information of the metadata 401 are creation date / time, file name, moving image data identification information, file format, and audio information. Each piece of information of the metadata 402 is additional information set by a user, and examples are moving image data title, camera information, camera person, keyword, category, genre, language information, and copyright information. Each piece of information of the metadata 403 is additional information determined at the end of recording of moving image data, and is information that cannot be read out at the start of recording of moving image data. Examples are update date / time and recording length (recording time or number of frames) of moving image data.
[0050] Figure 4 2 is a block diagram of a network recorder 200. The network recorder 200 includes a control unit 201, a network I / F 202, a data storage unit 203, a ROM 204, a RAM 205, and a video output I / F 206. These constituent elements are driven by power obtained by rectifying AC power supplied from the outside into a predetermined voltage or power supplied from an internal battery (not shown).
[0051] The control unit 201 is formed by a processor such as a CPU, and controls the entire device. More specifically, the control unit 201 expands the program recorded in the ROM 204 into the RAM 205 and executes the program, thereby performing control and arithmetic processing of each component, and performing the processing shown in the flowchart to be described later.
[0052] The data storage unit 203 is a storage unit configured to store moving image data or XML data transmitted from the digital video camera 100 as a file, and is formed of a large-capacity recording device such as a solid state drive (SSD) or a hard disk drive (HDD), for example.
[0053] The ROM 204 is a nonvolatile recording medium, and stores programs to be executed by the control unit 201 and various setting information.
[0054] The RAM 205 is a volatile recording medium used as a working memory of the control unit 201. The RAM 205 is also used as a VRAM. In addition, the control unit 201 is used as a video control unit because it controls the video output to a video output device such as a display via a video output I / F 206. The control unit 201 can be formed by a plurality of processors. The control unit 201 can be given the functions of other components (e.g., the data storage unit 203) so as to be formed integrally. Alternatively, the control unit 201 can be given the functions of a part of other components.
[0055] Figure 5 1 is an operation flowchart showing the basic operation of the digital video camera 100. The control unit 101 reads out the program stored in the ROM 108, expands the program to the RAM 109, and executes the expanded program, thereby performing control and arithmetic processing of each unit associated with the operation flowchart. When it is detected that the digital video camera 100 is set in the camera mode (imaging mode) by the user's operation of the operation unit 107, the control unit 101 starts Figure 5 Note that in this embodiment, if Figure 5 The illustrated process starts with the digital video camera 100 already being connected to the network recorder 200 , and the digital video camera 100 continues to continuously transmit moving image data to the connected network recorder 200 . Figure 5 The processes shown are merely examples, and the order is not limited.
[0056] In step S500, the control unit 101 detects a user operation on a menu button included in the operation unit 107, thereby causing the display unit 106 to display a menu as shown in FIG. Figure 6The user can select a setting XML file from the items of menu 600 by operating a selection cursor 601 using a four-way selector included in operation unit 107. When the user selects a setting XML file, the process proceeds to step S501.
[0057] Notice, Figure 6 It is shown that “Recording / Media Setting” is selected in the main menu, “Add XML File” is selected in the submenu displayed according to the selection, and “XML File 2” is selected as the XML file from the submenu.
[0058] In step S501, the control unit 101 reads out the contents of the setting XML file selected in step S500 from the recording medium 111 to the RAM 109 via the recording medium I / F 110. Then, the control unit 101 writes only the information required for the XML file to be recorded in association with the moving image data to the RAM 109 as recording metadata according to the structure of the XML file.
[0059] In step S502, the control unit 101 determines whether a moving image data recording start instruction is input from the user via the operation unit 107. When it is determined that the recording start instruction is input, the control unit 101 advances the process to step S503. When it is determined that the recording start instruction is not input, the control unit 101 returns the process to step S502 to wait for input.
[0060] In step S503, according to the input of the recording start instruction in step S502, the control unit 101 writes (records) in the recording medium 111 the moving image data obtained by capturing an image with the camera unit 103 and performing various processes with the image processing unit 104 and the image compression / decompression unit 102.
[0061] In step S504, the control unit 101 reads out the moving image data from the RAM 109, transmits the moving image data to the network recorder 200 via the network I / F 105, and transmits a recording start command. At this time, the control unit 101 acquires the time of recording start from a timer (not shown). Note that if the network recorder 200 connected to the digital video camera 100 receives the recording start command, the recording start command is a command for starting recording of moving image data on the network recorder 200 side.
[0062] In step S505, the control unit 101 writes information that can be acquired at the start of recording of the moving image data corresponding to the generation of the moving image data as recording start time information metadata to the RAM 109. Note that if the moving image data is recorded in the network recorder 200, the recording start time information metadata includes information indicating that the moving image data is being sent to the network recorder 200. Then, the control unit 101 writes an XML file to the RAM 109 using the recording start time information metadata written to the RAM 109 and the recording metadata written to the RAM 109 in step S501. That is, in Figure 3 In the XML file shown, the metadata of the recording start time information is set as follows Fig.13A The metadata 401 shown is set, and the recording metadata is set as metadata 402, and then the XML file is written to the RAM 109. At this time, the XML file can be generated by setting each information of the metadata 403 to blank or 0, or the XML file not including the metadata 403 can be generated.
[0063] In step S506 , the control unit 101 reads out the XML file generated in step S505 from the RAM 109 , and writes the XML file to the recording medium 111 via the recording medium I / F 110 in association with the moving image data recorded in the recording medium 111 in step S503 .
[0064] In step S507, the control unit 101 determines whether a moving image data recording end instruction is input from the user via the operation unit 107. When it is determined that the recording end instruction is input, the control unit 101 advances the process to step S508. On the other hand, when it is determined that the recording end instruction is not input, the control unit 101 returns the process to step S507 to continue the moving image data recording until the recording end instruction is input.
[0065] In step S508, the control unit 101 overwrites the recording end command on the recording start command written in step S504 to the RAM 109. Note that the network recorder 200 connected to the digital video camera 100 receives the recording end command, thereby ending recording of moving image data.
[0066] In step S509, the control unit 101 writes the moving image data captured until the recording end instruction is input as moving image data to the recording medium 111. The control unit 101 then writes or updates the header of the moving image data, and completes the moving image data recording process.
[0067] In step S510, the control unit 101 writes information that can be obtained when the recording of the moving image data ends as recording end time information metadata to the RAM 109. At this time, the control unit 101 obtains the time of the timing of the end of the recording from a timer (not shown), and subtracts the time of the start of the recording, thereby calculating the recording time. Then, the control unit 101 reads out the XML file recorded in the recording medium 111 in step S506, adds the recording end time information metadata as metadata 403 to the XML file, and records the XML file in the recording medium 111. Since the various information of the metadata 403 determined at the end of the recording is not recorded in the XML file written to the recording medium 111 in step S506, the information that should be recorded is not included in the XML file. Therefore, the control unit 101 overwrites the XML file in which the various information of the metadata 403 is recorded in step S510 on the XML file recorded in the recording medium 111 in step S506, and completes the recording of the XML file. Note that the processing of step S510 can be performed at a timing when the recording end time information metadata can be generated, that is, at a timing when the recording of the moving image data for which the recording time information of the moving image data can be acquired is completed, without waiting for the recording of the moving image data to be completed. Therefore, the recording of the XML file can be completed before the recording of the moving image data is completed.
[0068] By executing the above-described steps, the digital video camera 100 can store moving image data and an XML file associated with the moving image data in the recording medium 111 .
[0069] Figure 7 200 is an operation flowchart showing the basic operation of the network recorder 200. The control unit 201 reads out the program stored in the ROM 204, expands the program to the RAM 205, and executes the expanded program, thereby performing control and arithmetic processing of each unit associated with the operation flowchart. Note that Figure 7 The processes shown are merely examples, and the order is not limited.
[0070] In step S700, the control unit 201 determines whether moving image data is received from the digital video camera 100 via the network I / F 202. When it is determined that moving image data is received, the control unit 201 advances the process to step S701. When it is determined that moving image data is not received, the control unit 201 returns the process to step S700 to wait for reception. That is, the control unit 201 repeats the process of step S700 until moving image data is received.
[0071] In step S701, the control unit 201 determines whether a recording start command is received from the digital video camera 100 via the network I / F 202. When it is determined that the recording start command is received, the control unit 201 advances the process to step S702. When it is determined that the recording start command is not received, the control unit 201 returns the process to step S701 to wait for reception. That is, the control unit 201 repeats the process of step S701 until the recording start command is received.
[0072] In step S702, the control unit 201 stores the moving image data received from the external device (digital video camera 100) via the network I / F 202 in the data storage unit 203. Note that if the moving image data continues to be continuously received from the external device, the control unit 201 continues to store the received moving image data in the data storage unit 203 sequentially.
[0073] In step S703, the control unit 201 determines whether a recording end command is received from the digital video camera 100 via the network I / F 202. When it is determined that the recording end command is received, the control unit 201 ends the moving image data recording operation. On the other hand, when it is determined that the recording end command is not received, the control unit 201 returns the process to S702. That is, the control unit 201 repeats the processes of steps S702 and S703 until the recording end command is received.
[0074] By performing the above-described steps, the network recorder 200 can store the moving image data received from the digital video camera 100 in the data storage unit 203 .
[0075] Fig. 8A 1 is an operation flowchart showing a characteristic operation of the digital video camera 100 according to the present embodiment. The control unit 101 reads out a program stored in the ROM 108, expands the program to the RAM 109, and executes the expanded program, thereby performing control and arithmetic processing of each unit associated with the operation flowchart. If the digital video camera 100 is set in the camera mode (imaging mode) by the user's operation of the operation unit 107, the control unit 101 starts Fig. 8A The process shown. Note that Fig. 8A The processes shown in are merely examples, and the order is not limited. Fig. 8A Steps S800a to S805a in Figure 5 Steps S500 to S505 in are the same, and their description will be omitted.
[0076] In step S806a, the control unit 101 writes information that can be acquired when starting to record the moving image data as recording start time information metadata to the RAM 109. Note that if the moving image data is recorded in a camera, the recording start time information metadata also includes information indicating that the moving image data is recorded in the camera. By using the recording start time information metadata written to the RAM 109 and the recording metadata written to the RAM 109 in step S801a, the control unit 101 writes the XML file for the network recorder 200 to the RAM 109. That is, in Figure 3 In the XML file shown in FIG. 1 , the control unit 201 sets the recording start time information metadata as follows: Fig. 13B The metadata 401 shown is set, and the recorded metadata is set as metadata 402 and the XML file is written to the RAM 109. At this time, the XML file may be generated by setting each information of the metadata 403 to blank or 0, or an XML file not including the metadata 403 may be generated.
[0077] In steps S807a to S811a, the control unit 101 uses the XML file for the digital video camera 100 created in step S805a to perform communication with the Figure 5 The same processing as steps S506 to S510 is performed.
[0078] In step S812a, the control unit 101 writes information that can be acquired when recording of moving image data ends to the RAM 109 as recording end time information metadata. The control unit 101 then adds the recording end time information metadata as metadata 403, and writes the metadata 403 to the RAM 109. The individual information of the metadata 403 determined when recording ends is not recorded in the XML file for the network recorder 200 recorded in the RAM 109 in step S806a, and the information that should be recorded is not included in the XML file. Therefore, in step S812a, the control unit 201 generates an XML file in which the individual information of the metadata 403 is described, writes (overwrites) the XML file to the RAM 109, and completes the storage of the XML file. Note that the processing of step S812a is performed at the timing at which the recording end time information metadata can be generated, that is, at the timing at which the recording of moving image data at which the recording time information of the moving image data can be acquired is completed, without waiting for the completion of the recording of the moving image data. Therefore, the recording of the XML file in the network recorder 200 can be completed before the completion of the recording of the moving image data. Furthermore, the control unit 101 may acquire metadata required for updating the XML file for the network recorder 200 (e.g., the file name of the moving image data that the network recorder 200 has recorded) from the network recorder 200, and add the metadata to the recording end time information metadata. If the writing of the XML file for the network recorder 200 is completed, the control unit 101 advances the process to step S813a.
[0079] In step S813a, the control unit 101 reads out the XML file for the network recorder 200 stored in step S812a from the RAM 109, and transmits the XML file to the network recorder 200. Note that in the present embodiment, data is transmitted as an XML file to the network recorder 200. However, data described in the XML file for the network recorder 200 may be read out from the RAM 109 and directly transmitted to the network recorder 200 without generating an XML file. Furthermore, if two or more external devices are connected to the digital video camera 100, the XML file may be transmitted to all of the external devices.
[0080] Figure 8B 2 is an operation flowchart showing a characteristic operation of the network recorder 200 according to the present embodiment. The control unit 201 reads out a program stored in the ROM 204, expands the program to the RAM 205, and executes the expanded program, thereby performing control and arithmetic processing of each unit associated with the operation flowchart. Note that Figure 8B The processes shown in are merely examples, and the order is not limited.
[0081] Steps S800b to S803b and Figure 7 Steps S700 to S703 in are the same and their description will be omitted.
[0082] In step S804b, the control unit 201 determines whether an XML file is received from the digital video camera 100 via the network I / F 202. When it is determined that an XML file is received, the control unit 201 advances the process to step S805b. When it is determined that an XML file is not received, the control unit 201 returns the process to step S804b. That is, the control unit 201 repeats the process of step S804b until an XML file is received.
[0083] In step S805b, the control unit 201 writes the XML file received from the external device via the network I / F 202 to the data storage unit 203 in association with the moving image data stored in the data storage unit 203 in step S802b.
[0084] As described above, the digital video camera 100 starts transmitting moving image data to the network recorder 200 when recording is started, and simultaneously transmits a command for instructing the timing of recording the moving image data in the network recorder 200. The digital video camera 100 then ends the transmission of the moving image data by transmitting a command for instructing the end of recording after the recording of the moving image data ends (stops), completes the generation of a metadata file (XML file) to be used in the network recorder 200, and transmits the generated metadata file to the network recorder 200. Therefore, the network recorder 200 can store the moving image captured by the digital video camera 100 as a moving image data file, and store the metadata file corresponding to the moving image data file in association.
[0085] Note that, when receiving the recording end command, the control unit 201 of the network recorder 200 may transmit the file name of the recorded moving image data to the digital video camera 100. When receiving the file name, the control unit 101 of the digital video camera 100 adds the file name to the XML file to be transmitted, and then transmits the XML file to the network recorder 200. Therefore, the moving image data recorded in the network recorder 200 and the XML file can be firmly associated with each other.
[0086] [Second embodiment]
[0087] Next, a second embodiment will be described. Fig. 91 is a diagram showing an example of a system configuration according to a second embodiment. The system includes a digital video camera 100 that captures moving images and creates and transmits metadata, a network recorder 200 that stores moving image data and metadata transmitted from the digital video camera 100, and a controller 300 that remotely controls the digital video camera 100.
[0088] The configurations of the digital video camera 100 and the network recorder 200 are the same as those in the first embodiment described above. The controller 300 according to the second embodiment outputs recording start and recording end instructions to the digital video camera 100 according to user operations. That is, the controller 300 is used to communicate with the first embodiment from the outside. Figure 5 The processing corresponding to steps S502 and S507 in .
[0089] Network Recorder 200 Implementation and Reference Figure 8B In the second embodiment, the digital video camera 100, the network recorder 200, and the controller 300 are connected via a local area network (LAN) so that they can communicate with each other. Note that the digital video camera 100, the network recorder 200, and the controller 300 may be connected via a network switch or the like. In addition, the communication protocol is not particularly limited, and the connection form may be wired or wireless.
[0090] Fig.10 300 is a block diagram of a controller 300. The controller 300 includes a control unit 301, a network I / F 302, a display unit 303, an operation unit 304, a ROM 305, and a RAM 306. These constituent elements are connected so that they can exchange data with each other. In addition, the constituent elements are driven by power supplied from a socket or power supplied from a battery.
[0091] The control unit 301 is a system control unit such as a CPU that controls the entire system of the controller 300. The control unit 301 expands the program recorded in the ROM 305 to the RAM 306, and executes the expanded program, thereby controlling and arithmetic processing of each component, and executing the flowchart to be described later. Note that the control unit 301 also serves as a display control unit because it generates display data for the display unit 303 and controls the display timing. In addition, the control unit 301 can be formed by a plurality of processors. The control unit 301 can be given the functions of other components (for example, the operation unit 304) so as to be formed integrally. Alternatively, the control unit 301 can be given the functions of a part of other components.
[0092] The ROM 305 is a nonvolatile recording medium, and stores programs to be executed by the control unit 301 and various settings.
[0093] The RAM 306 is a volatile recording medium used as a working memory of the control unit 301. The RAM 306 is also used as a VRAM that temporarily stores data to be displayed on the display unit 303.
[0094] The network I / F 302 transmits / receives data to / from a connected external device based on control of the control unit 301. The control unit 301 can transmit a command for operating the external device to the external device via the network I / F 302. In addition, the control unit 301 receives setting information and operation information of the external device from the external device, and stores the information in the RAM 306.
[0095] The display unit 303 is a display configured to display various setting states or received setting information of an external device based on the control of the control unit 301 .
[0096] The operation unit 304 is an operation unit that accepts an operation from a user, and includes a power switch configured to supply power to the controller 300 and operation buttons for operating the digital video camera 100. Note that if a touch panel is included in the operation unit 304, the control unit 301 can detect the following operations on the touch panel. The touch panel may be any of various types of touch panels such as a resistive film type, an electrostatic capacitance type, a surface acoustic wave type, an infrared type, an electromagnetic induction type, an image recognition type, and an optical sensor type.
[0097] Fig.11 301 is an operation flowchart showing the basic operation of the controller 300. The control unit 301 reads out the program stored in the ROM 305, expands the program to the RAM 306, and executes the expanded program, thereby performing control and arithmetic processing of each unit associated with the operation flowchart. Note that Fig.11 The processes shown are merely examples, and the order is not limited.
[0098] In step S1100, the control unit 301 determines whether a moving image data recording start instruction is input from the user via the operation unit 304. When it is determined that a recording start instruction is input, the control unit 301 advances the process to step S1101. When it is determined that a recording start instruction is not input, the control unit 301 returns the process to step S1100. That is, the control unit 301 repeats the process of step S1100 until a recording start instruction is input.
[0099] In step S1101 , the control unit 301 transmits a recording start command to an external device via the network I / F 302 .
[0100] In step S1102, the control unit 301 determines whether a moving image data recording end instruction is input from the user via the operation unit 304. When it is determined that a recording end instruction is input, the control unit 301 advances the process to step S1103. When it is determined that a recording end instruction is not input, the control unit 301 returns the process to step S1102. That is, the control unit 301 repeats the process of step S1102 until a recording end instruction is input.
[0101] In step S1103, the control unit 301 transmits a recording end command to the external device via the network I / F 302, and ends the processing.
[0102] Fig. 12A 301 is an operation flowchart showing the characteristic operation of the controller 300 according to the present embodiment. The control unit 301 reads out the program stored in the ROM 305, expands the program to the RAM 306, and executes the expanded program, thereby performing control and arithmetic processing of each unit associated with the operation flowchart. Note that Fig. 12A The processes shown in are merely examples, and the order is not limited.
[0103] In step S1200a, the control unit 301 determines whether an instruction for specifying (or selecting) a device (corresponding to the digital video camera 100 in the present embodiment) to which an instruction related to the recording of moving image data is to be sent is input via the operation unit 304. When it is determined that an instruction for specifying a device to which an instruction is to be sent is input, the control unit 301 advances the processing to step S1201a. When it is determined that a specified instruction is not input, the control unit 301 returns the processing to step S1200a. That is, the control unit 301 repeats the processing of step S1200a until an instruction for specifying a device to which an instruction related to recording is to be sent is input. Note that there may be a plurality of devices to which instructions related to recording are to be sent, and the number is not particularly limited.
[0104] In step S1201a, the control unit 301 determines whether a moving image data recording start instruction is input from the user via the operation unit 304. When it is determined that a recording start instruction is input, the control unit 301 advances the process to step S1202a. When it is determined that a recording start instruction is not input, the control unit 301 returns the process to step S1201a. That is, the control unit 301 repeats the process of step S1201a until a moving image data recording start instruction is input.
[0105] In step S1202a, the control unit 301 sends a record start command to the device set in step S1200a via the network I / F 302. Note that if multiple devices are selected in step S1200a, the control unit 301 sends a record start command to all devices, but the timing of sending the record start command may be different.
[0106] In step S1203a, the control unit 301 determines whether a moving image data recording end instruction is input from the user via the operation unit 304. When it is determined that a recording end instruction is input, the control unit 301 advances the process to step S1204a. When it is determined that a recording end instruction is not input, the control unit 301 returns the process to step S1203a. That is, the control unit 301 repeats the process of step S1203a until a moving image data recording end instruction is input.
[0107] In step S1204a, the control unit 301 sends a record end command to the device specified in step S1200a via the network I / F 302 and ends the process. Note that if multiple devices are selected in step S1200a, the control unit 301 sends a record end command to all devices, but the timing of sending the record end command may be different.
[0108] By executing the above steps, the controller 300 can remotely control the digital video camera 100 so that moving image data recording start and recording end commands for the network recorder 200 are transmitted.
[0109] Fig. 12B 1 is an operation flow chart showing the characteristic operation of the digital video camera 100 according to the second embodiment. The control unit 101 reads out the program stored in the ROM 108, expands the program to the RAM 109, and executes the expanded program, thereby performing control and arithmetic processing of each unit. Note that Fig. 12B The processes shown in are merely examples, and the order is not limited.
[0110] Steps S1200b and S1201b are Fig. 8A Note that in step S1200b, the control unit 101 may select an XML file according to a selection command received from the controller 300.
[0111] In step S1202b, the control unit 101 determines whether a record start command is received from the controller 300 via the network I / F 105. When it is determined that a record start command is received, the control unit 101 advances the process to step S1203b. When it is determined that a record start command is not received, the control unit 101 returns the process to step S1202b. That is, the control unit 101 repeats the process of step S1202b until a record start command is received.
[0112] In steps S1203b to S1207b, the control unit 101 performs Fig. 8A Therefore, the description of steps S1203b to S1207b will be omitted.
[0113] In step S1208b, the control unit 101 determines whether a recording end command is received from the controller 300 via the network I / F 105. When it is determined that the recording end command is received, the control unit 101 advances the process to step S1209b. When it is determined that the recording end command is not received, the control unit 101 returns the process to S1208b. That is, the control unit 101 repeats the process of step S1208b until the recording end command is received, and continues the recording of the moving image data.
[0114] In steps S1209b to S1213b, the control unit 101 performs Fig. 8A The same operations as steps S809a to S813a.
[0115] As described above, the user can send motion image data recording start and end instructions to the digital video camera 100 at a remote location by operating the controller 300, and obtain the same effect as the first embodiment, that is, causing the digital video camera 100 to record a motion image file and an XML file storing metadata associated with the motion image of the motion image file from the start of recording to the end of recording.
[0116] (Other embodiments)
[0117] The present invention can be implemented by supplying a program for implementing one or more functions of the above-mentioned embodiments to a system or device via a network or storage medium and causing one or more processors in a computer of the system or device to read out and execute the program. The present invention can also be implemented by a circuit (e.g., ASIC) for implementing one or more functions.
[0118] The present invention is not limited to the above-described embodiments, and various modifications and variations can be made within the spirit and scope of the present invention. Therefore, in order to inform the public of the scope of the present invention, the following claims are proposed.
[0119] This application claims priority from Japanese Patent Application No. 2022-156461, filed on September 29, 2022, which is hereby incorporated by reference.
Claims
1. An image pickup device, comprising a communication component, and configured to transmit, via the communication component, motion image data obtained by image pickup to an external device, the external device being configured to record the motion image data, the image pickup device being characterized by comprising: a moving image sending means for sending the moving image data obtained by the imaging means to the external device via the communication means when receiving an instruction for starting recording, and for ending the sending of the moving image data to the external device when receiving an instruction for ending recording; a metadata generating means for generating metadata associated with the start of recording of the moving image data when receiving an instruction for starting recording, and generating metadata associated with the end of recording of the moving image data when receiving an instruction for ending recording; as well as The metadata transmitting means is configured to transmit the metadata from the start of recording to the end of recording to the external device via the communication means when receiving an instruction for ending recording.
2. The imaging device according to claim 1, wherein: An instruction for starting recording and an instruction for ending recording are received from an external control device via the communication section.
3. The imaging device according to claim 1 or 2, characterized in that: upon receiving an instruction for starting recording, the moving image sending section sends a recording start command to the external device in addition to the moving image data, and upon receiving an instruction for ending recording, the moving image sending section sends a recording end command to the external device, and Upon receiving an instruction for ending recording, the metadata generation section receives, from the external device, a file name of the moving image data recorded by the external device, and generates metadata including the received file name.
4. The imaging device according to any one of claims 1 to 3, characterized in that: The metadata generation section generates metadata including a recording time from when an instruction to start recording is received to when an instruction to end recording is received.
5. A control method for an imaging device, the imaging device comprising a communication component and configured to send motion image data obtained by imaging to an external device via the communication component, the external device being configured to record the motion image data, the control method being characterized by comprising: a moving image sending step for sending the moving image data obtained by the imaging of the imaging component to the external device via the communication component when receiving an instruction for starting recording, and for ending the sending of the moving image data to the external device when receiving an instruction for ending recording; a metadata generating step for generating metadata associated with the start of recording of the moving image data when an instruction for starting recording is received, and generating metadata associated with the end of recording of the moving image data when an instruction for ending recording is received; as well as The metadata transmitting step is for transmitting metadata from the start of recording to the end of recording to the external device via the communication means when an instruction for ending recording is received. 6 . A program configured to, when loaded and executed by a computer, cause the computer to function as each component of the imaging apparatus according to claim 1 .
7. A system comprising a camera device and a recording device, wherein the camera device is connected to a network, the system being characterized in that: The camera device comprises: a moving image sending component for sending moving image data obtained by the imaging component to an external device when receiving an instruction for starting recording, and for ending the sending of the moving image data to the external device when receiving an instruction for ending recording; a metadata generating means for generating metadata associated with the start of recording of the moving image data when receiving an instruction for starting recording, and generating metadata associated with the end of recording of the moving image data when receiving an instruction for ending recording; as well as a metadata sending component for sending metadata from the start of recording to the end of recording to the external device when receiving an instruction for ending recording, and The recording device comprises: a first recording component for recording the motion image data received from the camera device as a motion image file in a recording medium; as well as The second recording means is configured to record the metadata received from the image pickup device as a metadata file associated with the recorded moving image file.
8. The system according to claim 7, characterized in that Also includes: a control device configured to control the camera device from a remote location, The camera device receives an instruction for starting recording and an instruction for ending recording from the control device.
Citation Information
Patent Citations
Recording and reproducing device, recording and reproducing method, and recording medium and program therefor
JP2004363825A
Printer and computer program for printer
JP2022156461A