Display device and proxy file generation system

Abstract

The embodiment of the invention provides a display device and a proxy file generation system. The display device can be connected with a camera device through a hardware interface, obtains output data of the camera device through the hardware interface, and determines that the current working mode of the camera device is a video recording mode based on working mode indication information in the output data. And performing compression coding processing on the original video data in the output data, and packaging the original video data after compression coding processing and the time code data in the output data into a proxy file. According to the embodiment of the invention, the proxy file generation function is integrated in the display device, and the generation of the proxy file is completed by means of the hardware resources of the display device, so that the camera device does not need to record two video files at the same time, the stable operation of the camera device is ensured, and meanwhile, the proxy file can be synchronously generated in the video recording process. And the real-time performance of proxy file generation is ensured.

Description

Technical Field

[0001] The present application relates to the field of video shooting technology, and in particular to a display device and a proxy file generation system. Background Art

[0002] The original video files captured by the camera during video shooting usually have high resolution and high bit rate. If the original video files are directly edited and produced in the video editing software, the editing efficiency is often very low. Therefore, in order to improve the efficiency of video production, proxy files of the original video files are usually used for video production. Proxy files refer to low-resolution and low-bit rate files obtained by compressing and encoding the original video files.

[0003] In order to generate a proxy file, some methods are to use a camera device to record two video files at the same time during the video recording process, namely, an original video file with high resolution and high bit rate and a proxy file with low resolution and low bit rate. However, due to the limited performance of the camera device, and the high performance requirements of the camera device for recording two video files at the same time, it is easy to have unstable problems such as camera freezes. There are also some methods that upload the original video file collected by the camera device to a cloud server or copy it to the user's computer, and generate a proxy file through the cloud server or the user's computer. However, due to the large amount of data in the original video file, whether it is uploaded to the cloud server or copied to the user's computer, it takes a long time, and the proxy file cannot be generated in real time, and thus cannot meet the needs of scenes where the proxy file needs to be obtained in real time and video production needs to be performed synchronously while recording the video file. Summary of the invention

[0004] In view of this, the present application provides a display device and a proxy file generation system.

[0005] According to a first aspect of the present application, a display device is provided, wherein a hardware interface is provided on the display device, and the display device is connected to a camera device via the hardware interface, and the display device is used to receive output data of the camera device via the hardware interface, and when it is determined based on working mode indication information in the output data that the current working mode of the camera device is in a video recording mode, obtain original video data recorded by the camera device and time code data of the original video data from the output data, perform compression encoding processing on the original video data, and package the compressed and encoded original video data and the time code data into a proxy file; and display the original video data via a display interface.

[0006] According to a second aspect of the present application, a proxy file generation system is provided, the proxy file generation system comprising a camera device and the display device mentioned in the first aspect above.

[0007] By applying the solution provided by the present application, the display device can be connected to the camera device through a hardware interface, and the output data of the camera device can be obtained through the hardware interface. When it is determined that the current working mode of the camera device is in the video recording mode based on the working mode indication information in the output data, the original video data in the output data is compressed and encoded, and the compressed and encoded original video data and the time code data in the output data are packaged into a proxy file. The embodiment of the present application integrates a proxy file generation function in the display device, and uses the hardware resources of the display device to complete the generation of the proxy file, so that the camera device does not need to record two video files at the same time, ensuring the stable operation of the camera device. At the same time, it can also realize the synchronous generation of the proxy file during the video recording process, ensuring the real-time generation of the proxy file. In addition, the camera device does not need to be connected to other devices, that is, it can take into account the original needs of the shooting scene and the needs of generating proxy files at the same time, which can simplify the shooting system and ensure the convenience of setting up the shooting system.

[0008] It should be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0009] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.

[0010] Figure 1 It is a schematic diagram of a display device connected to a camera device in the prior art.

[0011] Figure 2 It is a schematic diagram of generating a proxy file using a display device according to an embodiment of the present application.

[0012] Figure 3 It is a schematic diagram of a display device according to an embodiment of the present application.

[0013] Figure 4 is a schematic diagram of a display device according to another embodiment of the present application. DETAILED DESCRIPTION

[0014] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0015] Camera proxy files refer to low-resolution and low-bitrate video files generated to facilitate video production. At present, when generating proxy files, some methods are to record high-resolution and high-bitrate original video files and low-resolution and low-bitrate proxy files simultaneously during video recording by a camera device. However, due to the limited performance of the camera, recording two video files at the same time is prone to unstable problems such as camera crashes. There are also some methods that upload the original video files collected by the camera device to a cloud server or copy them to the user's computer, and generate proxy files through the cloud server or the user's computer. However, due to the large amount of data in the original video file, it takes a long time to upload it to the cloud server or copy it to the user's computer, and the proxy file cannot be generated in real time. However, there are some scenarios where the editing and post-production of the video file need to be completed synchronously during the process of recording the video file by the camera device, so it is necessary to provide a solution that can not only ensure the stable operation of the camera device, but also synchronously generate proxy files during the process of recording the video by the camera device.

[0016] like Figure 1 As shown, considering that when the current camera device shoots images or videos, in order to facilitate the photographer to view the shooting effect of the image or video, a display device (i.e., head monitor) is usually set at the head position of the camera device, and the display device can display the image or video collected by the camera device in real time, which is convenient for the user to view. In some scenarios, the display device can also integrate a wireless transmission function to transmit the image or video collected by the camera device to one or more video receiving ends in real time, for example, it can be transmitted to the director or other staff's mobile phone, so that these people can remotely view the image or video collected by the camera device. Therefore, the applicant thought that the proxy file generation function can be integrated into the display device at the same time, and the generation of the proxy file can be completed with the help of the hardware resources of the display device, so that the camera device does not need to record two video files at the same time, ensuring the stable operation of the camera device, and at the same time, it can also realize the synchronous generation of the proxy file during the video recording process, ensuring the real-time generation of the proxy file. In addition, the camera device does not need to be connected to other devices, that is, it can take into account the original needs of the shooting scene and the needs of generating proxy files at the same time, which can simplify the shooting system and ensure the convenience of setting up the shooting system.

[0017] Based on the above inventive concept, the present application provides a display device, such as Figure 2 As shown, the display device 11 is provided with a hardware interface, and the display device 11 is connected to the camera device 12 via the hardware interface, wherein the hardware interface can be an interface such as HDMI, SDI, etc. for realizing a video transmission function.

[0018] In order to generate a proxy file, the display device 11 needs to obtain not only the original video data collected by the camera device 12, but also the working mode indication information indicating the current working mode of the camera device 12 and the time code data of the original video data. Generally, the camera device 12 includes two working modes, namely, video recording mode and shooting mode. Considering that the generation operation of the proxy file is only required in the scene of video shooting, the camera device 12 can transmit the working mode indication information indicating its current working mode to the display device 11 during the operation, so that the display device 11 determines whether to start the proxy file generation process based on the working mode indication information. At the same time, when generating a proxy file, in order to accurately mark each frame of the video, the time code data of the original video data is also needed, wherein the time code (Timecode) is the time information used to synchronize and mark the video content, which provides an accurate way to identify each frame in the video data, so as to facilitate editing, recording and playback. The time code is usually expressed in the format of hours, minutes, seconds and frames, for example: HH:MM:SS:FF (hours: minutes: seconds: frames).

[0019] The display device 11 can receive the output data of the camera device 12 through the above-mentioned hardware interface, and the output data may include working mode indication information. The display device 11 can determine whether the current working mode of the camera device 12 is in video recording mode or photographing mode based on the working mode indication information. If it is in video recording mode, the output data also includes the original video data collected by the camera device 12 and the time code data of the original video data. Therefore, the display device 11 can further obtain the original video data and the time code data from the output data, and then the original video data can be compressed and encoded to compress the original video data into low-resolution and low-bitrate video data, for example, it can be compressed into high-compression video data such as H264 / H265. Then the time code data of the original video data can be embedded in the video data after compression and encoding, packaged into a proxy file, and then the proxy file can be stored or output to other devices for subsequent video production, for example, it can be wirelessly transmitted to the video production end to synchronize video production. At the same time, in order to take into account the original display function, the display device 11 can also display the original video data through the display interface for users to view.

[0020] The working mode indication information may be a trigger signal of the camera device 12. Usually, the camera device 12 includes a button for triggering a video recording function or a photo taking function. When a user touches the button, a corresponding trigger signal may be generated. The signal may indicate whether the camera device 12 is currently in a video recording mode or a photo taking mode. The camera device 12 may output the signal to the display device 11 so that the display device 11 can determine the current working mode of the camera device 12.

[0021] In some embodiments, Figure 3 As shown, the display device 11 may include an interface conversion unit 111, a processing unit 112 and a display unit 113, and the interface conversion unit 111 and the display unit 113 are respectively connected to the processing unit 112. The interface conversion unit 111 may be used to receive the output data of the camera device 12 through the above-mentioned hardware interface, and obtain the working mode indication information from the output data, and determine whether the current working mode of the camera device 12 is in the video recording mode based on the working mode indication information. If yes, the original video data and time code data recorded by the camera device 12 are further obtained from the output data, and then the original video data and time code data are output to the processing unit 112. The interface conversion unit 111 may be an HDMI interface conversion chip, a self-compiled FPGA chip, etc.

[0022] The processing unit 112 may be a chip with video compression and coding functions, such as a SOC chip. After acquiring the original video data and time code data output by the interface conversion unit 111, the processing unit 112 may perform compression and coding processing on the original video data, convert the original video data into low-resolution and low-bitrate video data, and then embed the time code data into the original video data after compression and coding processing, and package the two into a proxy file.

[0023] At the same time, the processing unit 112 can also transmit the original video data to the display unit 113, or output the original video data to the display unit 113 after performing certain processing on the original video data, so that the display unit 113 can display the original video data to the user through the display interface, making it convenient for the user to view the video captured by the camera device 12 in real time.

[0024] In some embodiments, the interface conversion unit 111 may perform format conversion processing on the raw video data before outputting the raw video data to the processing unit 112, and then output the raw video data after the format conversion processing to the processing unit 112. Since the data formats compatible with the camera device 12 and the display device 11 may be different, the raw video data output by the camera device 12 may be format converted by the interface conversion unit 111 to be converted into video data compatible with the display device 11, so that the display device 11 can perform subsequent processing and display on the raw video data.

[0025] When generating a proxy file, the processing unit 112 can associate each original video frame in the original video data with its corresponding time code, and embed the time code into the original video frame as a time mark of the original video frame. Accurately associating the original video frame with its corresponding time code is a prerequisite for generating an accurate proxy file. After the processing unit 112 obtains the original video data and the time code data from the interface conversion unit 111, it is necessary to first perform a systematic process on the time code data to obtain the time code corresponding to each video frame, so as to embed it into the original video frame after compression coding to generate a proxy file. Since the processing of the time code data is time-consuming, the acquisition of the time code in the process of generating the proxy file is delayed compared with the acquisition of the original video frame after compression coding, thereby causing the video frame and its corresponding time code to be unable to be accurately associated. In order to solve the above problem, the speed at which the processing unit 112 acquires the time code data can be increased, so that the processing unit 112 can quickly acquire the time code data and process it, so that when the original video frame completes the compression coding, its corresponding time code has also been acquired, that is, the two can be associated.

[0026] In some embodiments, the hardware interface may be an HDMI interface, and the interface conversion unit 111 may be an HDMI interface conversion chip. When the HDMI interface conversion chip outputs the time code data to the processing unit 112, the time code data is usually stored in a designated register on the HDMI interface conversion chip, so that the processing unit 112 reads the time code data from the designated register. In order to allow the processing unit 112 to obtain the time code data as quickly as possible, the processing unit 112 may be configured to access the designated register at a preset time interval, wherein the preset time interval is the minimum access time interval supported by the processing unit 112. Since the HDMI interface conversion chip is a ready-made chip, when the HDMI interface conversion chip outputs data to other chips, it usually stores the data in a corresponding register, and other chips continuously access the register to obtain it. For the time code data, in order to increase the speed at which the processing unit 112 obtains the time code data, the time interval for the processing unit 112 to access the register storing the time code data may be set to the minimum time interval supported by the processing unit 112, so that as long as the interface conversion unit 111 stores the time code data in the register, the processing unit 112 can quickly obtain it, thereby reducing the delay. For example, the processing unit 112 may be a SOC chip. Due to the limitation of the hardware performance of the SOC chip, there needs to be a certain time interval between two accesses to the register by the SOC chip. In order to speed up the acquisition of the time code data, the time interval between the SOC chip accessing the register may be set to the minimum access time interval supported by the SOC chip.

[0027] In some embodiments, the hardware interface may be an SDI interface, since the existing SDI interface conversion chip on the market does not have the function of obtaining the time code data and the operating mode indication information from the output data of the camera device 12. Therefore, for the SDI interface, the interface conversion unit 111 may use a self-compiled FPGA chip. The self-compiled FPGA chip may be configured to automatically report the data to the processing unit 112. Generally, the FPGA chip first performs format conversion processing on each frame of the original video data, and then reports the video frame to the processing unit 112. In the embodiment of the present application, in order to allow the processing unit 112 to obtain the time code data at the fastest speed, the FPGA chip may be configured to give priority to reporting the time code data, that is, first reporting the time code data, and then performing format conversion processing on the original video data.

[0028] Of course, in some embodiments, such as Figure 4 As shown, in order for the display device 11 to support both the HDMI interface and the SDI interface, the interface conversion unit 111 in the display device 11 may include both an HDMI interface conversion chip 111a and an FPGA chip 111b for processing output data of different interfaces.

[0029] Usually, each frame of video signal collected by the camera device 12 is composed of a video data area, a line field synchronization signal, and a blanking area. In order to transmit the current working mode and time code data of the camera device 12 to the display device 11, in some embodiments, the camera device 12 can embed the working mode indication information and time code data into the blanking area of ​​the video signal, and then output the video signal as output data to the display device 11. The interface conversion unit 111 can obtain the working mode indication information and time code data from the blanking area of ​​the video signal.

[0030] In some embodiments, the display device 11 is further used to obtain an image captured by the camera device 12 from the output data and display the image through a display interface when it is determined that the current working mode of the camera device 12 is in the photographing mode based on the working mode indication information in the output data of the camera device 12. If the camera device 12 is in the photographing mode, the display device 11 does not need to start the proxy file generation process, and only needs to complete the display function.

[0031] In some embodiments, the processing unit 112 may analyze and process the original video data before outputting the original video data to the display unit 113 to obtain the video quality parameters of the original video data, and send the video quality parameters to the display unit 113 so that the display unit 113 can simultaneously display the original video data and the video quality parameters. For example, in order to facilitate the user to understand the brightness, contrast and other information of each frame in the currently captured video data, the processing unit 112 may first analyze each frame of the original video data to determine the video quality parameters, and then output the video quality parameters to the display unit 113 so that the display unit 113 can display the video quality parameters while displaying the original video data.

[0032] Considering that the recording of the video and the generation of the proxy file are performed synchronously, and there are some scenes where the video recorded by the camera device 12 may not meet the user's needs and needs to be re-recorded. In this case, the generated proxy file is usually unavailable. In order to facilitate the user to classify the proxy files generated in real time, the user can create two file directories in the display device 11 in advance through the display interface of the display device 11, namely, an available file directory for storing available proxy files, and an unavailable file directory for the user to store unavailable proxy files. When the user believes that the currently recorded video file is unavailable, the user can input a classification instruction through the display interface of the display device 11 so that the display device 11 stores the currently generated proxy file in the file directory of the corresponding category.

[0033] In some embodiments, the display device 11 can also send the recorded proxy file to the video production end in real time so that the video production end can synchronously produce the video based on the proxy file. For example, the display device 11 can be wirelessly connected to the video production end and send the real-time generated proxy file to the video production end, and the video production end can synchronously produce the video.

[0034] Furthermore, the embodiment of the present application also provides a proxy file generation system, which includes a camera device 12 and a display device 11. The display device 11 is provided with a hardware interface, and the display device 11 can be connected to the camera device 12 through the hardware interface and perform data exchange. The functions of the display device 11 and the camera device 12 can refer to the description in the above embodiment, and will not be repeated here.

[0035] Among them, the solutions of the above-mentioned embodiments can be freely combined to obtain new solutions when there is no conflict. Due to space constraints, they will not be listed one by one here.

[0036] The user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with the relevant laws, regulations and standards of relevant countries and regions, and provide corresponding operation entrances for users to choose to authorize or refuse.

[0037] It should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. The terms "include", "comprises" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the statement "comprises a ..." do not exclude the presence of other identical elements in the process, method, article or device including the elements.

[0038] The method and device provided in the embodiments of the present application are introduced in detail above. Specific examples are used in this article to illustrate the principles and implementation methods of the present application. The description of the above embodiments is only used to help understand the method of the present application and its core idea. At the same time, for those skilled in the art, according to the idea of ​​the present application, there will be changes in the specific implementation methods and application scope. In summary, the content of the present application should not be understood as a limitation on the present application.

Claims

1. A display device, characterized in that: The display device is provided with a hardware interface, and the display device is connected to the camera device through the hardware interface. The display device is used to receive output data of the camera device through the hardware interface, and when it is determined based on the working mode indication information in the output data that the current working mode of the camera device is in the video recording mode, obtain the original video data recorded by the camera device and the time code data of the original video data from the output data, perform compression encoding processing on the original video data, and package the compressed and encoded original video data and the time code data into a proxy file; And displaying the original video data through a display interface.

2. The display device according to claim 1, characterized in that The display device comprises an interface conversion unit, a processing unit and a display unit; The interface conversion unit is used to receive the output data through the hardware interface, and when it is determined based on the working mode indication information in the output data that the current working mode of the camera device is in the video recording mode, obtain the original video data and the time code data from the output data, and output the original video data and the time code data to the processing unit; The processing unit is used to perform compression and encoding processing on the original video data, and to package the compressed and encoded original video data and the time code data into a proxy file, and to output the original video data to the display unit; The display unit is used to display the original video data through a display interface.

3. The display device according to claim 2, characterized in that: Before outputting the original video data to the processing unit, the interface conversion unit is further used to perform format conversion processing on the original video data, and output the original video data after the format conversion processing to the processing unit.

4. The display device according to claim 2 or 3, characterized in that: If the hardware interface is an HDMI interface, the interface conversion unit is an HDMI interface conversion chip, and the HDMI interface conversion chip is used to output the time code data to the processing unit, specifically for: The time code data is stored in a designated register on the HDMI interface conversion chip so that the processing unit reads the time code data from the designated register; wherein the processing unit is configured to access the designated register at a preset time interval, and the preset time interval is a minimum access time interval supported by the processing unit.

5. The display device according to claim 3, characterized in that: If the hardware interface is an SDI interface, the interface conversion unit is an FPGA chip, and the FPGA chip is used to output the time code data to the processing unit, specifically for: Before performing format conversion processing on the original video data, the time code data is output to the processing unit.

6. The display device according to claim 2, characterized in that: Before the processing unit outputs the original video data to the display unit, the processing unit is further used to: The original video data is analyzed and processed to obtain a video quality parameter of the original video data, and the video quality parameter is sent to the display unit so that the display unit displays the original video data and the video quality parameter simultaneously.

7. The display device according to claim 1, characterized in that The working mode indication information and the time code data are embedded in a blanking area of ​​the video signal collected by the camera device, and the display device is used to obtain the working mode indication information and the time code data from the blanking area.

8. The display device according to claim 1, characterized in that: The display device is also used to obtain the image taken by the camera device from the output data and display the image through the display interface when it is determined that the current working mode of the camera device is in the photo taking mode based on the working mode indication information in the output data.

9. The display device according to claim 1, characterized in that: After packaging the compressed and coded raw video data and the time code data into a proxy file, the display device is further used to: Based on the classification instruction input by the user through the display interface, the proxy files are stored in a file directory of the corresponding category, wherein the file directory includes an available proxy file directory for storing available proxy files and an unavailable proxy file directory for storing unavailable proxy files.

10. A proxy file generation system, characterized in that: The proxy file generation system comprises a camera device and a display device as described in any one of claims 1-9.

Images