Method, system and apparatus for supplementary video recording, and storage medium

Abstract

Disclosed in the present invention are a method, system and apparatus for supplementary video recording, and a storage medium. The method comprises: collecting video content, and encoding the video content according to a preset chunk duration and a collection start time, so as to obtain an encoded video; sending a recording start request to a cloud storage platform, such that the cloud storage platform determines a recording response on the basis of the recording start request; receiving the recording response, which is sent by the cloud storage platform, and sending the encoded video to the cloud storage platform on the basis of the recording response, such that the cloud storage platform records the encoded video; and upon receiving a supplementary video recording request sent by the cloud storage platform, on the basis of the supplementary video recording request, locating the encoded video corresponding to first start and end times, marking a cache not to be cleared, re-sending to the cloud storage platform the encoded video corresponding to the first start and end times for recording, and removing the mark once the recording is completed. By means of the embodiments of the present invention, the precise localization and retransmission of problematic video frames are implemented to realize the integrity and high quality of video recording, and thus the present invention can be widely applied to the technical field of video recording.

Description

Video re-recording method, system, device and storage medium Technical Field

[0001] The present invention relates to the field of video processing technology, and in particular to a video re-recording method, system, device and storage medium. Background Art

[0002] Typically, video capture devices transmit captured video content to cloud storage platforms for recording and storage. If network jitter or disconnection occurs during the transmission and storage process, the recorded content may be damaged, lost, or unrecoverable, resulting in a complete and intact video recording. Summary of the Invention

[0003] In view of this, the purpose of the embodiments of the present invention is to provide a video re-recording method, system, device and storage medium, which ensure the integrity and high quality of the recorded video content by accurately locating and retransmitting problematic video frames.

[0004] In one aspect, an embodiment of the present invention provides a video re-recording method, which is applied to a video capture device and includes:

[0005] Collecting video content, encoding the video content according to a preset block duration and a collection start time to obtain a coded video; the coded video includes the international standard time when the block data collection starts;

[0006] Sending a recording start request to the cloud storage platform, so that the cloud storage platform determines a recording response based on the recording start request; the recording start request includes an encoding method, a duration of encoded video segments, and a frame rate; and the recording response includes a storage address;

[0007] receiving a recording response sent by the cloud storage platform, and sending the encoded video to the cloud storage platform according to the recording response, so that the cloud storage platform records the encoded video;

[0008] When a re-recording request is received from the cloud storage platform, the encoded video corresponding to the first start and end time is located and marked as not to be cleared from the cache according to the re-recording request, and the encoded video corresponding to the first start and end time is re-sent to the cloud storage platform for recording until the recording is completed and the mark is canceled; the re-recording request is determined according to the first start and end time of the first business problem occurring during the recording process; the first business problem includes a network transmission problem or a business quality problem; the first start and end time is determined according to the first start time and the first end time, the first start time represents the start time of the first business problem, and the first end time represents the end time of the first business problem.

[0009] Optionally, the video re-recording method further includes:

[0010] During the transmission process, detect network transmission problems;

[0011] When a second service problem occurs, recording a second start and end time of the second service problem; the second service problem includes network retransmission or network interruption; the second start and end time are determined based on the second start time and the second end time, the second start time representing the start time of the second service problem, and the second end time representing the end time of the second service problem;

[0012] The encoded video corresponding to the second start and end time is located and marked as cache not cleared, and the encoded video corresponding to the second start and end time is resent to the cloud storage platform for recording until the recording is completed and the mark is canceled.

[0013] Optionally, encoding the video content according to a preset segment duration and a capture start time to obtain an encoded video specifically includes:

[0014] Divide the video content into blocks according to preset block lengths;

[0015] The video content is encoded according to the international standard time at which each data block starts to be collected and a preset encoding method to obtain an encoded video.

[0016] On the other hand, an embodiment of the present invention provides a video re-recording method, which is applied to a cloud storage platform, comprising:

[0017] receiving a recording start request sent by a video capture device, determining a recording response according to the recording start request, and sending the recording response to the video capture device so that the video capture device sends the encoded video according to the recording response; the recording start request includes an encoding mode, a duration of encoded video segments, and a frame rate; the recording response includes a storage address;

[0018] Receiving the encoded video sent by the video capture device and recording the encoded video;

[0019] During the recording process, a first service problem is detected; when the first service problem occurs, a first start and end time of the first service problem is determined; the first service problem includes a network transmission problem or a service quality problem; the first start and end time are determined based on the first start time and the first end time, the first start time represents the start time of the first service problem, and the first end time represents the end time of the first service problem;

[0020] A supplementary recording request is determined according to the first start and end times, and the supplementary recording request is sent to a video capture device, so that the video capture device resends the encoded video corresponding to the first start and end times until the recording is completed.

[0021] Optionally, determining a first start and end time of the first business problem specifically includes:

[0022] Determine the start time and the first coding sequence number of the block data where the first service problem occurs, and determine the first start time according to the start time of the block data, the first coding sequence number and the frame rate;

[0023] Determine the end time and the second coding sequence number of the block data at the end of the first business problem, and determine the first end time according to the end time of the block data, the second coding sequence number and the frame rate;

[0024] The first start and end times are determined according to the first start time and the first end time.

[0025] Optionally, the calculation formula of the first start time is as follows:

[0026] T1=t1+(N1-1)*L / m+n1 / m

[0027] Among them, T1 represents the first starting time, t1 represents the acquisition start time corresponding to the block data where the first business problem occurs, N1 represents the coding sequence number of the video coding image group where the first business problem occurs, L represents the length of the video coding image group, m represents the frame rate, and n1 represents the frame sequence number where the first business problem occurs.

[0028] Optionally, a calculation formula for the first termination time is as follows:

[0029] T2=t2+(N2-1)*L / m+n2 / m

[0030] Among them, T2 represents the first termination time, t2 represents the acquisition start time corresponding to the block data at the end of the first business problem, N2 represents the coding sequence number of the video coding image group at the end of the first business problem, L represents the length of the video coding image group, m represents the frame rate, and n2 represents the frame sequence number at the end of the first business problem.

[0031] In another aspect, an embodiment of the present invention provides a video supplemental recording device, comprising:

[0032] at least one processor;

[0033] at least one memory for storing at least one program;

[0034] When the at least one program is executed by the at least one processor, the at least one processor implements the video re-recording method applied to the video acquisition device or the cloud storage platform.

[0035] On the other hand, an embodiment of the present invention provides a computer-readable storage medium, which stores a program executable by a processor. When the program is executed by the processor, it is used to execute the video re-recording method applied to the video acquisition device or the cloud storage platform.

[0036] On the other hand, an embodiment of the present invention provides a video re-recording system, comprising a video acquisition device and a cloud storage platform connected to each other; wherein,

[0037] The video acquisition device is used to execute the video supplementary recording method applied to the video acquisition device;

[0038] The cloud storage platform is used to execute the video re-recording method applied to the cloud storage platform.

[0039] The implementation of the embodiment of the present invention includes the following beneficial effects: first, the video acquisition device encodes the acquired video content according to the preset block duration and acquisition start time to obtain an encoded video, which includes the international standard time when the block data starts to be acquired, and sends a recording start request to the cloud storage platform. Then, the cloud storage platform receives the recording start request, determines a recording response according to the recording start request, and sends the recording response to the video acquisition device. Then, the video acquisition device sends the encoded video to the cloud storage platform according to the recording response; then, the cloud storage platform records the encoded video. During the recording process, a first business problem is detected. The first business problem includes a network transmission problem and a business quality problem. If the first business problem occurs , determine the first start and end time of the first business problem, determine the re-recording request based on the first start and end time, and send the re-recording request to the video acquisition device. Then, the video acquisition device locates the encoded content corresponding to the first start and end time according to the re-recording request and marks it as cache not cleared, and re-sends the encoded video corresponding to the first start and end time to the cloud storage platform for recording until the recording is completed and the mark is cancelled. In the encoding process of the video content, the international standard time for the start of block data collection is added. During the recording process, if the first business problem occurs, the start and end time of the first business problem is determined based on the international standard time for the start of block data collection, the encoding sequence number, and the frame rate, and the encoded video corresponding to the start and end time is re-transmitted and recorded. For various network transmission problems and business quality problems that occur during the video recording process, a precise positioning and re-recording solution for the problem video frame is provided to solve the problems of time asynchrony, incomplete recording content, or substandard business quality between the video acquisition device and the cloud storage platform. BRIEF DESCRIPTION OF THE DRAWINGS

[0040] FIG1 is a structural block diagram of a video supplementary recording system provided by an embodiment of the present invention;

[0041] FIG2 is a schematic flow chart of the steps of a video supplementary recording method applied to a video capture device according to an embodiment of the present invention;

[0042] 3 is a schematic flow chart of another method for supplementing video recording applied to a video capture device according to an embodiment of the present invention;

[0043] FIG4 is a schematic flow chart of steps of a method for encoding video content provided by an embodiment of the present invention;

[0044] FIG5 is a schematic flow chart of the steps of a video re-recording method applied to a cloud storage platform according to an embodiment of the present invention;

[0045] 6 is a schematic flow chart of steps for determining a first start and end time according to an embodiment of the present invention;

[0046] 7 is a timing diagram of a video supplementary recording method according to a specific embodiment of the present invention;

[0047] 8 is a structural block diagram of a video supplementary recording system applied to a video acquisition device according to an embodiment of the present invention;

[0048] 9 is a structural block diagram of another video recording system applied to a video capture device according to an embodiment of the present invention;

[0049] 10 is a structural block diagram of a video re-recording system applied to a cloud storage platform according to an embodiment of the present invention;

[0050] 11 is a structural block diagram of a video supplementary recording device provided by an embodiment of the present invention;

[0051] FIG12 is a structural block diagram of a computer device provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0052] The present invention will be further described in detail below with reference to the accompanying drawings and specific embodiments. The step numbers in the following embodiments are provided for ease of description only and do not limit the order of the steps. The order of execution of the steps in the embodiments can be adaptively adjusted based on the understanding of those skilled in the art.

[0053] It should be noted that, although the functional modules are divided in the device schematic diagram and the logical order is shown in the flow chart, in some cases, the steps shown or described can be performed in a different order than the module division in the device or the order in the flow chart. The terms "first", "second", etc. in the specification and claims and the above-mentioned drawings are used to distinguish similar objects and are not necessarily used to describe a specific order or precedence. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments of the present application described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device comprising a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0054] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by those skilled in the art to which this application pertains. The terms used herein are for the purpose of describing the embodiments of this application only and are not intended to limit this application.

[0055] Some technical terms in this embodiment are explained below.

[0056] Video recoding (recovery for the damaged content recoding of video surveillance) refers to the process in which video capture equipment transmits captured video content to cloud storage devices for recording. When network transmission or service quality is damaged, a certain mechanism is used between the video capture equipment and the cloud storage device to complete the retransmission and recording of the content.

[0057] Referring to Figure 1, the functions of a video capture device include: content encoding, network or quality detection, recording caching, and transmission control. Content encoding refers to encoding the captured video content, network or quality detection refers to detecting network transmission issues or receiving feedback from the cloud storage platform regarding transmission or service quality issues, recording caching refers to caching the captured video data, and transmission control refers to controlling the transmission and recording of video content. The functions of a cloud storage platform include: content decoding, network transmission or service quality assessment, recording control, and content storage. Content decoding refers to decoding video codes, network transmission or service quality assessment refers to assessing network transmission issues or recording quality, and recording control refers to controlling and updating recorded video content. The video capture device encodes the captured video content and then sends the encoded video to the cloud storage platform. The cloud storage platform decodes, records, and stores the encoded content. During the transmission and recording process, the cloud storage platform can detect network transmission or service quality issues, and the video capture device can detect network transmission or receive feedback from the cloud storage platform on service quality issues. When network transmission or service quality issues are detected, the video capture device locates and caches the video content encoded during the problematic time period and retransmits it until the encoded video content within the problematic time period is recorded. Throughout the transmission and recording process, the cloud storage platform regulates the recorded content through recording control, and the video capture device can regulate it through transmission control.

[0058] 2 , an embodiment of the present invention provides a video supplementary recording method, which is applied to a video acquisition device, including:

[0059] S110 , collecting video content, encoding the video content according to the preset block duration and collection start time to obtain an encoded video; the encoded video includes the international standard time when the block data starts to be collected.

[0060] The preset segment duration can be determined by mutual agreement between the video capture device and the cloud storage platform. For example, a preset segment duration of 5 minutes can be used. The capture start time of the video content is based on the universal time of the video capture device. This supports time synchronization between the video capture device and the cloud storage platform, and enables accurate splicing of recorded video frames.

[0061] Specifically, the collected video content is divided into blocks according to the preset block length, and is sequentially encoded according to the collection start time to obtain an encoded video. The encoded video contains the international standard time and encoding sequence number when the block data starts to be collected, which facilitates the subsequent cloud storage platform to determine the start and end time of the problem frame based on the collection time and encoding sequence number in the decoded video.

[0062] S120. Send a recording start request to the cloud storage platform, so that the cloud storage platform determines a recording response according to the recording start request; the recording start request includes an encoding method, an encoded video block length, and a frame rate; and the recording response includes a storage address.

[0063] Video encoding refers to the method of converting an original video file into another format through compression technology. Codec standards for video streaming include ITU's H.261, H.263, and H.264. Frame rate refers to the frequency (rate) at which bitmap images, measured in frames, appear continuously on a display.

[0064] The first picture in a sequence is called an IDR picture (Immediate Refresh Picture). IDR pictures are all I-frame pictures. In a video encoding sequence, GOP (Group of Picture) refers to the distance between two IDR frames. A longer GOP increases video compression efficiency, but also reduces video quality and stream recovery capabilities. Conversely, the opposite is true.

[0065] The video capture device encodes the captured content based on the encoding method and the duration of the encoded video segments. Based on these factors, the video capture device determines a recording request and sends a start recording request to the cloud storage platform. The cloud storage platform determines the storage address based on the start recording request and, based on these factors, a recording response. The recording response is then fed back to the video capture device.

[0066] S130: Receive a recording response sent by the cloud storage platform, and send the encoded video to the cloud storage platform according to the recording response, so that the cloud storage platform records the encoded video.

[0067] After receiving the recording response from the cloud storage platform, the video capture device sends the encoded video to the cloud storage platform according to the storage address in the recording response. After receiving the encoded video, the cloud storage platform records the encoded video.

[0068] S140. When a re-recording request is received from the cloud storage platform, the encoded video corresponding to the first start and end time is located and marked as not to be cleared from the cache according to the re-recording request, and the encoded video corresponding to the first start and end time is re-sent to the cloud storage platform for recording until the recording is completed and the mark is canceled; the re-recording request is determined according to the first start and end time of the first business problem that occurs during the recording process; the first business problem includes a network transmission problem or a business quality problem.

[0069] The first start and end times are determined based on the first start time and the first end time. The first start time represents the start time of the first service problem, and the first end time represents the end time of the first service problem. Network transmission problems include network interruption and network retransmission, and service quality problems include network packet loss and network jitter.

[0070] During the recording process, the cloud storage platform monitors the quality of network transmission and recorded video services. If any issues arise, the platform determines the initial and final time points at which the issues occurred and ended. Based on these initial and final time points, the platform determines a re-recording request and sends it to the video capture device. Upon receiving the re-recording request from the cloud storage platform, the video capture device locates the video content corresponding to the initial and final time points, marks it as cached and not cleared, and re-sends the encoded video corresponding to the initial and final time points to the cloud storage platform for recording. The recording is then completed, and the mark is removed.

[0071] Optionally, referring to FIG3 , the video supplementary recording method further includes:

[0072] S150, during the recording process, detecting network transmission information;

[0073] S160: When a second service problem occurs, record a second start and end time of the second service problem; the second service problem includes network retransmission or network interruption; the second start and end time are determined based on the second start time and the second end time, the second start time representing the start time of the second service problem, and the second end time representing the end time of the second service problem;

[0074] S170: Locate the encoded video corresponding to the second start and end time and mark it as cache not to be cleared, and resend the encoded video corresponding to the second start and end time to the cloud storage platform for recording until the recording is completed and the mark is canceled.

[0075] During the video transmission and recording process between the video capture device and the cloud storage platform, the video capture device can also detect the second business problem; when the second business problem such as network retransmission or network interruption occurs, the second start and end time of the second business problem is recorded; the encoded video corresponding to the second start and end time is located and marked as not to be cleared from the cache, and the encoded video corresponding to the second start and end time is re-transmitted to the cloud storage platform for recording until the recording is completed and the mark is cancelled.

[0076] Optionally, referring to FIG4 , encoding the video content according to the preset segment duration and acquisition start time to obtain the encoded video specifically includes:

[0077] S111, dividing the video content into blocks according to the preset block length;

[0078] S112 : Encode the video content according to the international standard time at which each data block starts to be collected and a preset encoding method to obtain an encoded video.

[0079] Specifically, first, the video content is divided into blocks according to a preset block length. For example, the video content is divided into blocks according to a preset block length of 3 minutes, and 15 minutes of video content can obtain 5 data blocks; then, the data blocks are encoded according to the international standard time at which they start to be collected and the preset encoding method to obtain the encoded video. For example, the international standard time at which the first block data starts to be collected is 8:00 in the morning, and the international standard time at which the second data block starts to be collected is 8:03 in the morning. The international standard time at which each data block starts to be collected is encoded according to the encoding method to obtain the encoded video.

[0080] 5 , an embodiment of the present invention provides a video re-recording method, which is applied to a cloud storage platform and includes:

[0081] S210. Receive a recording start request sent by a video capture device, determine a recording response based on the recording start request, and send the recording response to the video capture device so that the video capture device sends the encoded video based on the recording response; the recording start request includes an encoding method, encoded video block length, and frame rate; the recording response includes a storage address.

[0082] After the video capture device completes encoding of the captured video content, it sends a recording start request to the cloud storage platform. The recording start request includes the encoding method, encoded video duration and frame rate, etc.; after receiving the recording start request, the cloud storage platform determines the storage address of the decoded video based on the recording start request, determines the recording response based on the storage address, etc., and sends the recording response to the video capture device; the video capture device sends the encoded video to the video capture device based on the recording response.

[0083] S220: Receive the encoded video sent by the video capture device, and record the encoded video.

[0084] The cloud storage platform receives the encoded video from the video capture device and records it based on the duration of the encoded video blocks in the recording start request. For example, if the first block of encoded video starts at 8:00 AM UTC and the second block starts at 8:03 AM UTC, the platform records the encoded video based on the UTC start time and encoding sequence of each block, creating and storing the file.

[0085] S230. During the recording process, a first business problem is detected; when the first business problem occurs, a first start and end time of the first business problem is determined; the first business problem includes a network transmission problem or a business quality problem; the first start and end time are determined based on the first start time and the first end time, the first start time represents the start time of the first business problem, and the first end time represents the end time of the first business problem.

[0086] During the recording process, the cloud storage platform detects first business problems during the transmission and recording process, including discovering network transmission problems, or discovering business quality problems by decoding the encoded video, indicating that the video recording does not meet the standards, and determining the first start and end time of the first business problem, so as to facilitate the determination of the encoded video that needs to be re-recorded later.

[0087] S240: Determine a supplementary recording request according to the first start and end times, and send the supplementary recording request to the video capture device, so that the video capture device resends the encoded video corresponding to the first start and end times until the recording is completed.

[0088] The cloud storage platform determines a re-recording request based on the first start and end times and sends it to the video capture device. After receiving the re-recording request, the video capture device determines the corresponding encoded video based on the first start and end times in the re-recording request and re-sends the encoded video corresponding to the first start and end times to the cloud storage platform for recording until the recording is complete.

[0089] Optionally, referring to FIG6 , determining the first start and end time of the first business problem specifically includes:

[0090] S231A, determining the start time and first coding sequence number of the block data where the first service problem occurs, and determining the first start time according to the start time, the first coding sequence number and the frame rate;

[0091] S232A, determining the end time and the second coding sequence number of the block data at which the first business problem ends, and determining the first end time according to the end time, the second coding sequence number and the frame rate;

[0092] S233A: Determine the first start and end times according to the first start time and the first end time.

[0093] The video content captured by the video capture device is encoded according to the preset block length to obtain an encoded video. The encoded video includes several image groups, each image group has a corresponding number, and each image group contains several frame images.

[0094] If a first business problem occurs, locate the starting video acquisition time, the coding sequence number of the first video coding image group and the first frame sequence number of the block data corresponding to the coded video where the first business problem occurs, and determine the first starting time based on the starting time, the coding sequence number of the first video coding image group, the first frame sequence number and the frame rate; if the first business problem ends, locate the ending time and the second coding sequence number of the coded video at the end of the first business problem, and determine the first ending time based on the ending time, the coding sequence number of the second image group, the second frame sequence number and the frame rate; and use the time period between the first starting time and the first ending time as the first start and end time.

[0095] Optionally, the calculation formula for the first start time is as follows:

[0096] T1=t1+(N1-1)*L / m+n1 / m

[0097] Among them, T1 represents the first starting time, t1 represents the acquisition start time corresponding to the block data where the first business problem occurs, N1 represents the coding sequence number of the video coding image group where the first business problem occurs, L represents the length of the video coding image group, m represents the frame rate, and n1 represents the frame sequence number where the first business problem occurs.

[0098] Optionally, the calculation formula for the first end time is as follows:

[0099] T2=t2+(N2-1)*L / m+n2 / m

[0100] Among them, T2 represents the first termination time, t2 represents the acquisition start time corresponding to the block data at the end of the first business problem, N2 represents the coding sequence number of the video coding image group at the end of the first business problem, L represents the length of the video coding image group, m represents the frame rate, and n2 represents the frame sequence number at the end of the first business problem.

[0101] The implementation of the embodiment of the present invention includes the following beneficial effects: first, the video acquisition device encodes the acquired video content according to the preset block duration and acquisition start time to obtain an encoded video, which includes the international standard time when the block data starts to be acquired, and sends a recording start request to the cloud storage platform. Then, the cloud storage platform receives the recording start request, determines a recording response according to the recording start request, and sends the recording response to the video acquisition device. Then, the video acquisition device sends the encoded video to the cloud storage platform according to the recording response; then, the cloud storage platform records the encoded video. During the recording process, a first business problem is detected. The first business problem includes a network transmission problem and a business quality problem. If the first business problem occurs , determine the first start and end time of the first business problem, determine the re-recording request based on the first start and end time, and send the re-recording request to the video acquisition device. Then, the video acquisition device locates the encoded content corresponding to the first start and end time according to the re-recording request and marks it as cache not cleared, and re-sends the encoded video corresponding to the first start and end time to the cloud storage platform for recording until the recording is completed and the mark is cancelled. In the encoding process of the video content, the international standard time for the start of block data collection is added. During the recording process, if the first business problem occurs, the start and end time of the first business problem is determined based on the international standard time for the start of block data collection, the encoding sequence number, and the frame rate, and the encoded video corresponding to the start and end time is re-transmitted and recorded. For various network transmission problems and business quality problems that occur during the video recording process, a precise positioning and re-recording solution for the problem video frame is provided to solve the problems of time asynchrony, incomplete recording content, or substandard business quality between the video acquisition device and the cloud storage platform.

[0102] In a specific embodiment, referring to FIG7 , the video re-recording process between the video capture device and the cloud storage platform is as follows:

[0103] S01: A video capture device captures video content and encodes the video content according to a preset block duration and a capture start time to obtain an encoded video.

[0104] S02: After the video capture device completes encoding, it sends a recording start request to the cloud storage platform. The recording request carries information such as encoding method, frame rate, and block data duration.

[0105] S03: After receiving the recording start request, the cloud storage platform feeds back a recording response to the video capture device. The recording response includes information such as the storage address.

[0106] S04: Transmit and record the encoded video between the video capture device and the cloud storage platform.

[0107] S05: During the recording process, the cloud storage platform detects the service quality of network transmission and recorded video.

[0108] S06: During the recording process, if the cloud storage platform finds a network transmission problem or a service quality problem, it determines the start and end time of the supplementary recording based on information such as the block data acquisition time where the problem occurred, the coding sequence number of the video coding picture group, the length of the video coding picture group, the frame sequence number and the frame rate.

[0109] S07: The cloud storage platform determines a re-recording request according to the start and end time of the re-recording, and sends the re-recording request to the video capture device.

[0110] S08: During the transmission process, the video capture device detects network transmission problems.

[0111] S09: If the video capture device finds a network transmission problem, it records the start and end time of the encoded video where the network transmission problem occurs.

[0112] S10: The video capture device determines a supplementary recording time period according to the start and end time of the encoded video having the network transmission problem, locates the data blocks corresponding to the supplementary recording time period in the cache, and marks the data blocks corresponding to the supplementary recording time period as cache not cleared.

[0113] S11: The video capture device sends the encoded video corresponding to the supplementary recording time period to the cloud storage platform.

[0114] S12: The cloud storage platform updates, records, and stores the content retransmitted by the video capture device.

[0115] S13: After the video capture device completes the transmission of the supplementary recorded content, it cancels the cache cleanup mark and clears the cache.

[0116] 8 , an embodiment of the present invention provides a video re-recording system, which is applied to a video capture device and includes:

[0117] The first module is used to collect video content and encode the video content according to a preset duration and collection start time to obtain an encoded video; the encoded video includes the international standard time when the block data starts to be collected;

[0118] The second module is used to send a recording start request to the cloud storage platform, so that the cloud storage platform determines a recording response according to the recording start request; the recording start request includes an encoding method, encoded video duration and frame rate; the recording response includes a storage address;

[0119] The third module is used to receive a recording response sent by the cloud storage platform, and send the encoded video to the cloud storage platform according to the recording response, so that the cloud storage platform records the encoded video;

[0120] The fourth module is used to locate the encoded video corresponding to the first start and end time and mark it as not to be cleared in cache according to the supplementary recording request when receiving the supplementary recording request sent by the cloud storage platform, and re-send the encoded video corresponding to the first start and end time to the cloud storage platform for recording until the recording is completed and the mark is cancelled; the supplementary recording request is determined according to the first start and end time of the first business problem occurring during the recording process; the first business problem includes a network transmission problem or the business quality does not meet the standard; the first start and end time is determined according to the first start time and the first end time, the first start time represents the start time of the first business problem, and the first end time represents the end time of the first business problem.

[0121] Referring to FIG9 , the video supplementary recording system applied to the video acquisition device further includes:

[0122] The fifth module is used to detect network transmission problems during the transmission process;

[0123] A sixth module is configured to record, when a second service problem occurs, a second start and end time of the second service problem; the second service problem includes network retransmission or network interruption; the second start and end time are determined based on the second start time and the second end time, the second start time representing the start time of the second service problem, and the second end time representing the end time of the second service problem;

[0124] The seventh module is used to locate the encoded video corresponding to the second start and end time and mark it as cache not cleared, and re-send the encoded video corresponding to the second start and end time to the cloud storage platform for recording until the recording is completed and the mark is canceled.

[0125] The first module is further configured to:

[0126] Divide the video content into blocks according to the preset block length;

[0127] The video content is encoded according to the international standard time at which each data block starts to be collected and a preset encoding method to obtain an encoded video.

[0128] Referring to FIG10 , an embodiment of the present invention provides a video re-recording system, which is applied to a cloud storage platform and includes:

[0129] An eighth module is configured to receive a recording start request sent by a video capture device, determine a recording response based on the recording start request, and send the recording response to the video capture device so that the video capture device sends the encoded video based on the recording response; the recording start request includes an encoding method, encoded video duration, and frame rate; and the recording response includes a storage address;

[0130] The ninth module is used to receive the encoded video sent by the video acquisition device and record the encoded video;

[0131] A tenth module is configured to detect a first service problem during the recording process, and when the first service problem occurs, determine a first start and end time of the first service problem; the first service problem includes a network transmission problem or a video quality problem; the first start and end time are determined based on the first start time and the first end time, the first start time representing the start time of the first service problem, and the first end time representing the end time of the first service problem;

[0132] The eleventh module is used to determine a supplementary recording request according to the first start and end time, and send the supplementary recording request to the video acquisition device, so that the video acquisition device resends the encoded video corresponding to the first start and end time until the recording is completed.

[0133] The tenth module is further specifically used for:

[0134] Determine the start time and the first coding sequence number of the block data where the first service problem occurs, and determine the first start time according to the start time of the block data, the first coding sequence number and the frame rate;

[0135] Determine the end time of the block data at which the first service problem ends and the second coding sequence number, and determine the first end time according to the end time of the block data, the second coding sequence number and the frame rate;

[0136] The first start and end times are determined according to the first start time and the first end time.

[0137] The calculation formula for the first start time is as follows:

[0138] T1=t1+(N1-1)*L / m+n1 / m

[0139] T1 represents the first starting time, t1 represents the acquisition start time corresponding to the block data where the first business problem occurs, N1 represents the coding sequence number of the video coding image group where the first business problem occurs, L represents the length of the video coding image group, m represents the frame rate, and n1 represents the frame sequence number where the first business problem occurs.

[0140] The calculation formula for the first end time is as follows:

[0141] T2=t2+(N2-1)*L / m+n2 / m

[0142] T2 represents the first termination time, t2 represents the acquisition start time corresponding to the block data at the end of the first business problem, N2 represents the coding sequence number of the video coding image group at the end of the first business problem, L represents the length of the video coding image group, m represents the frame rate, and n2 represents the frame sequence number at the end of the first business problem.

[0143] It can be seen that the contents of the above method embodiments are all applicable to the present system embodiments. The functions specifically implemented by the present system embodiments are the same as those of the above method embodiments, and the beneficial effects achieved are also the same as those achieved by the above method embodiments.

[0144] Referring to FIG11 , an embodiment of the present invention provides a video supplementary recording device, comprising:

[0145] at least one processor;

[0146] at least one memory for storing at least one program;

[0147] When at least one program is executed by at least one processor, the at least one processor implements a video re-recording method applied to a video capture device or a cloud storage platform.

[0148] Among them, the memory is a non-transient computer-readable storage medium that can be used to store non-transient software programs and non-transient computer executable programs. The memory may include a high-speed random access memory and may also include a non-transient memory, such as at least one disk storage device, a flash memory device, or other non-transient solid-state storage device. In some embodiments, the memory optionally includes a remote memory remotely arranged relative to the processor, and these remote memories can be connected to the processor via a network. Examples of the above-mentioned network include but are not limited to the Internet, an intranet, a local area network, a mobile communication network and a combination thereof.

[0149] It can be seen that the contents of the above method embodiments are all applicable to the present device embodiments. The functions specifically implemented by the present device embodiments are the same as those of the above method embodiments, and the beneficial effects achieved are also the same as those achieved by the above method embodiments.

[0150] In addition, the embodiments of the present application further disclose a computer program product or computer program, which is stored in a computer-readable storage medium. The processor of a computer device can read the computer program from the computer-readable storage medium, and the processor executes the computer program, so that the computer device performs the above-mentioned method. Similarly, the contents of the above-mentioned method embodiment are all applicable to the present storage medium embodiment, and the functions specifically implemented by the present storage medium embodiment are the same as those of the above-mentioned method embodiment, and the beneficial effects achieved are also the same as those achieved by the above-mentioned method embodiment.

[0151] An embodiment of the present invention further provides a computer-readable storage medium, which stores a program executable by a processor. The program executable by the processor is used to implement the above method when executed by the processor.

[0152] It is understood that all or some steps, systems in the disclosed method above can be implemented as software, firmware, hardware and appropriate combinations thereof. Some physical components or all physical components can be implemented as software by a processor, such as a central processing unit, a digital signal processor or a microprocessor, or implemented as hardware, or implemented as an integrated circuit, such as an application specific integrated circuit. Such software can be distributed on a computer-readable medium, and the computer-readable medium can include computer storage media (or non-transitory media) and communication media (or temporary media). As known to those of ordinary skill in the art, the term computer storage medium is included in any method or technology for storing information (such as computer-readable instructions, data structures, program modules or other data) and is volatile and non-volatile, removable and non-removable media. Computer storage media includes but is not limited to RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disk (DVD) or other optical disk storage, magnetic cassette, magnetic tape, disk storage or other magnetic storage device, or can be used to store desired information and any other medium that can be accessed by a computer. Furthermore, as is well known to those skilled in the art, communication media typically embodies computer-readable instructions, data structures, program modules, or other data in a modulated data signal such as a carrier wave or other transport mechanism, and may include any information delivery media.

[0153] Specifically, referring to FIG12 , a computer device 1200 may include components such as an RF (Radio Frequency) circuit 1210, a memory 1220 including one or more computer-readable storage media, an input unit 1230, a display unit 1240, a sensor 1250, an audio circuit 1260, a short-range wireless transmission module 1270, a processor 1280 including one or more processing cores, and a power supply 1290. Those skilled in the art will appreciate that the device structure shown in FIG12 does not limit the electronic device and may include more or fewer components than shown, or combine certain components, or arrange the components differently.

[0154] The RF circuit 1210 can be used to receive and transmit signals during information transmission or calls. Specifically, it receives downlink information from the base station and transmits it to one or more processors 1280 for processing. It also transmits uplink data to the base station. Typically, the RF circuit 1210 includes, but is not limited to, an antenna, at least one amplifier, a tuner, one or more oscillators, a subscriber identity module (SIM) card, a transceiver, a coupler, an LNA (low noise amplifier), a duplexer, and the like. Furthermore, the RF circuit 1210 can communicate with the network and other devices via wireless communication. Wireless communication can utilize any communication standard or protocol, including but not limited to GSM (Global System of Mobile Communications), GPRS (General Packet Radio Service), CDMA (Code Division Multiple Access), WCDMA (Wideband Code Division Multiple Access), LTE (Long Term Evolution), email, and SMS (Short Messaging Service).

[0155] The memory 1220 can be used to store software programs and modules. The processor 1280 executes various functional applications and data processing by running the software programs and modules stored in the memory 1220. The memory 1220 may mainly include a program storage area and a data storage area. The program storage area may store an operating system and at least one application required for a function (such as a sound playback function, an image playback function, etc.); the data storage area may store data generated based on the use of the device 1200 (such as audio data, a phone book, etc.). In addition, the memory 1220 may include high-speed random access memory and non-volatile memory, such as at least one disk storage device, a flash memory device, or other volatile solid-state storage device. Accordingly, the memory 1220 may also include a memory controller to provide access to the memory 1220 by the processor 1280 and the input unit 1230. Although FIG12 shows the RF circuit 1210, it will be understood that it is not a required component of the device 1200 and can be omitted as needed without changing the essence of the invention.

[0156] The input unit 1230 can be used to receive input digital or character information and generate keyboard, mouse, joystick, optical, or trackball signal input related to user settings and function control. Specifically, the input unit 1230 may include a touch-sensitive surface 1231 and other input devices 1232. The touch-sensitive surface 1231, also known as a touch display or touchpad, can detect user touch operations on or near it (for example, operations performed by a user using a finger, stylus, or any other suitable object or accessory on or near the touch-sensitive surface 1231) and drive corresponding connected devices according to a pre-set program. Optionally, the touch-sensitive surface 1231 may include a touch detection device and a touch controller. The touch detection device detects the user's touch position and detects signals generated by the touch operation, transmitting the signals to the touch controller. The touch controller receives the touch information from the touch detection device, converts it into touch point coordinates, and then sends it to the processor 1280. It can also receive and execute commands from the processor 1280. In addition, the touch-sensitive surface 1231 can be implemented using various types such as resistive, capacitive, infrared, and surface acoustic wave. In addition to the touch-sensitive surface 1231, the input unit 1230 can also include other input devices 1232. Specifically, the other input devices 1232 can include, but are not limited to, one or more of a physical keyboard, function keys (such as volume control keys, power keys, etc.), a trackball, a mouse, a joystick, and the like.

[0157] The display unit 1240 can be used to display information input by the user or information provided to the user, as well as various graphical user interfaces (GUIs) for controlling 1200. These GUIs can be composed of graphics, text, icons, videos, or any combination thereof. The display unit 1240 may include a display panel 1241. Optionally, the display panel 1241 may be configured in the form of an LCD (Liquid Crystal Display), an OLED (Organic Light-Emitting Diode), or the like. Furthermore, a touch-sensitive surface 1231 may be overlaid on the display panel 1241. When the touch-sensitive surface 1231 detects a touch operation on or near it, the touch-sensitive surface 1231 transmits the information to the processor 1280 to determine the type of touch event. The processor 1280 then provides a corresponding visual output on the display panel 1241 based on the type of touch event. Although in FIG12 , the touch-sensitive surface 1231 and the display panel 1241 are shown as two separate components to implement input and output functions, in some embodiments, the touch-sensitive surface 1231 and the display panel 1241 may be integrated to implement input and output functions.

[0158] The computer device 1200 may also include at least one sensor 1250, such as a light sensor, a motion sensor, and other sensors. Specifically, the light sensor may include an ambient light sensor and a proximity sensor, wherein the ambient light sensor may adjust the brightness of the display panel 1241 according to the brightness of the ambient light, and the proximity sensor may turn off the display panel 1241 and / or the backlight when the device 1200 is moved to the ear. As a type of motion sensor, the gravity acceleration sensor can detect the magnitude of acceleration in all directions (generally three axes), and can detect the magnitude and direction of gravity when stationary. It can be used for applications that recognize the posture of the mobile phone (such as switching between horizontal and vertical screens, related games, magnetometer posture calibration), vibration recognition related functions (such as pedometer, tapping), etc.; as for other sensors that can be configured in the device 1200, such as gyroscopes, barometers, hygrometers, thermometers, infrared sensors, etc., they will not be described in detail here.

[0159] Audio circuit 1260, speaker 1261, and microphone 1262 provide an audio interface between the user and device 1200. Audio circuit 1260 converts received audio data into electrical signals and transmits them to speaker 1261, which then converts them into sound signals for output. Microphone 1262, on the other hand, converts collected sound signals into electrical signals, which are then received by audio circuit 1260 and converted into audio data. The audio data is then processed by output processor 1280 and sent to another control device via RF circuit 1210, or the audio data is output to memory 1220 for further processing. Audio circuit 1260 may also include an earphone jack to allow communication between external headphones and device 1200.

[0160] The short-range wireless transmission module 1270 may be a WIFI (wireless fidelity) module, a Bluetooth module, an infrared module, etc. The device 1200 may transmit information to a wireless transmission module provided on a competing device via the short-range wireless transmission module 1270 .

[0161] Processor 1280 is the control center of device 1200. It connects the various components of the entire control device using various interfaces and circuits. By running or executing software programs and / or modules stored in memory 1220 and accessing data stored in memory 1220, it performs various functions of device 1200 and processes data, thereby providing overall monitoring of the control device. Optionally, processor 1280 may include one or more processing cores. Alternatively, processor 1280 may integrate an application processor and a modem processor, with the application processor primarily handling the operating system, user interface, and application programs, while the modem processor primarily handles wireless communications. It is understood that the modem processor may not be integrated into processor 1250.

[0162] Device 1200 also includes a power supply 1290 (e.g., a battery) for supplying power to various components. Preferably, the power supply can be logically connected to processor 1280 via a power management system, thereby enabling the power management system to manage charging, discharging, and power consumption. Power supply 1290 can also include one or more DC or AC power supplies, a recharging system, a power failure detection circuit, a power converter or inverter, a power status indicator, and other arbitrary components.

[0163] Although not shown, the device 1200 may also include a camera, a Bluetooth module, etc., which will not be described in detail here.

[0164] It is understood that all or some steps, systems in the disclosed method above can be implemented as software, firmware, hardware and appropriate combinations thereof. Some physical components or all physical components can be implemented as software by a processor, such as a central processing unit, a digital signal processor or a microprocessor, or implemented as hardware, or implemented as an integrated circuit, such as an application specific integrated circuit. Such software can be distributed on a computer-readable medium, and the computer-readable medium can include computer storage media (or non-transitory media) and communication media (or temporary media). As known to those of ordinary skill in the art, the term computer storage medium is included in any method or technology for storing information (such as computer-readable instructions, data structures, program modules or other data) and is volatile and non-volatile, removable and non-removable media. Computer storage media includes but is not limited to RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disk (DVD) or other optical disk storage, magnetic cassette, magnetic tape, disk storage or other magnetic storage device, or can be used to store desired information and any other medium that can be accessed by a computer. Furthermore, as is well known to those skilled in the art, communication media typically embodies computer-readable instructions, data structures, program modules, or other data in a modulated data signal such as a carrier wave or other transport mechanism, and may include any information delivery media.

[0165] 1 , an embodiment of the present invention provides a video re-recording system, including a video acquisition device and a cloud storage platform connected to each other; wherein,

[0166] A video acquisition device, configured to execute a video supplementary recording method applied to a video acquisition device;

[0167] A cloud storage platform is used to execute a video re-recording method applied to a cloud storage platform.

[0168] Specifically, for the video acquisition equipment, it is mainly realized through a camera, etc., and it may specifically include at least one imaging device; and for the cloud storage platform, it may be different types of electronic devices, including but not limited to cloud servers, cloud computers, cloud storage, etc.

[0169] It can be seen that the contents of the above method embodiments are all applicable to the present system embodiments. The functions specifically implemented by the present system embodiments are the same as those of the above method embodiments, and the beneficial effects achieved are also the same as those achieved by the above method embodiments.

[0170] It should be understood that in this application, "at least one (item)" means one or more, and "plurality" means two or more. "And / or" is used to describe the association relationship of associated objects, indicating that three relationships may exist. For example, "A and / or B" can mean: only A exists, only B exists, and A and B exist at the same time, where A and B can be singular or plural. The character " / " generally indicates that the previous and next associated objects are in an "or" relationship. "At least one of the following items" or similar expressions refers to any combination of these items, including any combination of single items or plural items. For example, at least one of a, b or c can mean: a, b, c, "a and b", "a and c", "b and c", or "a and b and c", where a, b, c can be single or multiple.

[0171] In the several embodiments provided in this application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are merely schematic. For example, the division of the units is merely a logical function division. In actual implementation, there may be other division methods, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be an indirect coupling or communication connection through some interfaces, devices or units, which can be electrical, mechanical or other forms.

[0172] The units described as separate components may or may not be physically separate, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed across multiple network units. Some or all of these units may be selected to achieve the purpose of this embodiment according to actual needs.

[0173] The above is a specific description of the preferred implementation of the present invention, but the invention is not limited to the embodiments. Those skilled in the art can make various equivalent modifications or substitutions without violating the spirit of the present invention. These equivalent modifications or substitutions are all included in the scope defined by the claims of this application.

Claims

1. A video supplementary recording method, characterized in that: Applied to video acquisition equipment, including: Collecting video content, encoding the video content according to a preset block duration and a collection start time to obtain a coded video; the coded video includes the international standard time when the block data starts to be collected; Sending a recording start request to the cloud storage platform, so that the cloud storage platform determines a recording response according to the recording start request; the recording start request includes an encoding method, a duration of encoded video segments, and a frame rate; the recording response includes a storage address; Receiving a recording response sent by the cloud storage platform, and sending the encoded video to the cloud storage platform according to the recording response, so that the cloud storage platform records the encoded video; When a re-recording request is received from the cloud storage platform, the encoded video corresponding to the first start and end time is located and marked as not to be cleaned up in the cache according to the re-recording request, and the encoded video corresponding to the first start and end time is re-sent to the cloud storage platform for recording until the recording is completed and the mark is cancelled; the re-recording request is determined according to the first start and end time of a first business problem occurring during the recording process; the first business problem includes a network transmission problem or a business quality problem; the first start and end time is determined according to the first start time and the first end time, the first start time represents the start time of the first business problem, and the first end time represents the end time of the first business problem.

2. The video supplementary recording method according to claim 1, characterized in that: The video supplementary recording method further includes: During the transmission process, detect network transmission problems; When a second service problem occurs, a second start and end time of the second service problem is recorded; the second service problem includes network retransmission or network interruption; the second start and end time are determined according to the second start time and the second end time, the second start time represents the start time of the second service problem, and the second end time represents the end time of the second service problem; The encoded video corresponding to the second start and end time is located and marked as cache not to be cleared, and the encoded video corresponding to the second start and end time is resent to the cloud storage platform for recording until the recording is completed and the mark is canceled.

3. The video supplementary recording method according to claim 1, characterized in that: Encoding the video content according to the preset block duration and the acquisition start time to obtain the encoded video specifically includes: Dividing the video content into blocks according to preset block durations; The video content is encoded according to the international standard time when each data block starts to be collected and a preset encoding method to obtain an encoded video.

4. A video supplementary recording method, characterized in that: Applied to cloud storage platforms, including: Receive a recording start request sent by a video acquisition device, determine a recording response according to the recording start request, and send the recording response to the video acquisition device, so that the video acquisition device sends a coded video according to the recording response; the recording start request includes a coding mode, a coded video block length and a frame rate; the recording response includes a storage address; Receiving the encoded video sent by the video acquisition device, and recording the encoded video; During the recording process, a first service problem is detected; when the first service problem occurs, a first start and end time of the first service problem is determined; the first service problem includes a network transmission problem or a service quality problem; the first start and end time are determined according to the first start time and the first end time, the first start time represents the start time when the first service problem occurs, and the first end time represents the end time of the first service problem; A supplementary recording request is determined according to the first start and end times, and the supplementary recording request is sent to a video acquisition device, so that the video acquisition device resends the encoded video corresponding to the first start and end times until the recording is completed.

5. The video supplementary recording method according to claim 4, characterized in that: Determine the first start and end time of the first business issue, including: Determine the start time of the block data where the first service problem occurs and the first coding sequence number, and determine the first start time according to the start time of the block data, the first coding sequence number and the frame rate; Determine the end time and the second coding sequence number of the block data at which the first service problem ends, and determine the first end time according to the end time of the block data, the second coding sequence number and the frame rate; The first start and end times are determined according to the first start time and the first end time.

6. The video supplementary recording method according to claim 5, characterized in that: The calculation formula of the first starting time is as follows: T1 = t1 + (N1-1) * L / m + n1 / m Among them, T1 represents the first starting time, t1 represents the collection start time corresponding to the block data where the first business problem occurs, N1 represents the coding sequence number of the video coding image group where the first business problem occurs, L represents the length of the video coding image group, m represents the frame rate, and n1 represents the frame sequence number where the first business problem occurs.

7. The video supplementary recording method according to claim 5, characterized in that: The calculation formula of the first termination time is as follows: T2 = t2 + (N2-1) * L / m + n2 / m Among them, T2 represents the first termination time, t2 represents the collection start time corresponding to the block data at the end of the first business problem, N2 represents the coding sequence number of the video coding image group at the end of the first business problem, L represents the length of the video coding image group, m represents the frame rate, and n2 represents the frame sequence number at the end of the first business problem.

8. A video supplementary recording device, characterized in that: include: at least one processor; at least one memory for storing at least one program; When the at least one program is executed by the at least one processor, the at least one processor implements the video supplementary recording method as described in any one of claims 1 to 7.

9. A computer-readable storage medium storing a program executable by a processor, characterized in that: The processor-executable program is used to execute the video supplementary recording method as described in any one of claims 1-7 when executed by the processor.

10. A video supplementary recording system, characterized in that: It includes interconnected video acquisition devices and cloud storage platforms; among which, The video acquisition device is used to execute the video supplement recording method according to any one of claims 1 to 3; The cloud storage platform is used to execute the video re-recording method described in any one of claims 4-7.

Images