Video data processing method and apparatus, electronic device, and storage medium
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-02-11
- Publication Date
- 2026-08-11
AI Technical Summary
然而,无人机拍摄得到的视频图像,往往数据量非常大,共享数据非常耗时
[0030]According to a sixth aspect of certain exemplary embodiments of the present disclosure, a computer-readable storage medium is provided having a computer program stored thereon, which, when executed by a processor, implements the steps of any of the above methods.
Smart Images

Figure CN122554585A_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of data processing technology, and in particular to a video data processing method, apparatus, electronic device, and storage medium. Background Technology
[0002] With the development and widespread adoption of various smart devices, multi-device interconnection and interaction is a trend, providing users with a more convenient and richer experience. Acquiring content captured by the cameras of linked devices and processing the acquired image data like local camera data has many practical application needs.
[0003] For example, as drone photography technology matures, drone-captured videos, with their wide field of view, unique angles, and lack of physical limitations imposed by the shooting location, deliver a powerful and impactful visual experience. However, in some scenarios, while a drone user is filming, others may need to edit the footage. This requires the drone user to download the high-resolution data first and then send it to the other user. However, drone videos are often very large in size, making data sharing time-consuming. Furthermore, others can only edit the received drone video data according to their preferences after obtaining the high-resolution data, failing to meet their need for real-time viewing of the drone footage during filming and the ability to select the data they need. Summary of the Invention
[0004] Therefore, it is necessary to address the aforementioned technical problems by providing a video data processing method, apparatus, electronic device, and storage medium that allows users of a second device to view the footage captured by a third device in real time on the second device while the third device is shooting, and to select the video shooting data they need according to their personal preferences.
[0005] According to a first aspect of certain exemplary embodiments of the present disclosure, a video data processing method is provided, wherein a first device acquires video shooting data of a third device during shooting by a third device, the method being applied to a second device that has established a communication connection with the first device, the method comprising: launching a video recording application of the second device and selecting the first device to provide video source data to the second device; receiving video shooting data shared by the first device, using the video shooting data as input to the video recording application to cause the video recording application to display a shooting screen; recording the shooting screen in response to a recording instruction on the shooting screen displayed in the video recording application to obtain a video recording file, and recording video recording time information corresponding to the video recording file; and creating a specified tag for the video recording file, the specified tag being used to trigger a request for the first device to return high-definition video data corresponding to the video recording file based on the video recording time information.
[0006] Optionally, the aforementioned video recording file includes at least one video recording segment, and the video recording time information includes at least the timestamp information of the start video frame and the timestamp information of the end video frame of the video recording segment.
[0007] Optionally, the above-mentioned response to a recording instruction on the shooting screen displayed in the video recording application, recording the shooting screen to obtain a video recording file, and recording the video recording time information corresponding to the video recording file includes: responding to user operation of the video recording control displayed in the video recording application, recording the shooting screen to obtain a video recording file, the video recording control including a recording control, and further including a pause recording control and / or a stop recording control; responding to user operation of the recording control, pause recording control, or stop recording control, recording the timestamp information of the video frames displayed in the video recording application when the user operates the control.
[0008] Optionally, the video recording time information mentioned above is recorded in a video timestamp parameter file. The filename of the video timestamp parameter file, the filename of the video recording file, and the value of the specified tag are all the same as the video name corresponding to the video shooting data.
[0009] Optionally, the above method further includes: in response to a file browsing command, if the value of a specified tag in the file-related information of the video recording file is not empty, then displaying the specified tag for the video recording file.
[0010] Optionally, the above method further includes: in response to a user operation on a specified label, sending a high-definition video data acquisition request to a first device; after receiving specified status information returned by the first device, sending a video timestamp parameter file to the first device; and receiving high-definition video data corresponding to a video recording file returned by the first device based on the video timestamp parameter file.
[0011] According to a second aspect of certain exemplary embodiments of this disclosure, a video data processing method is provided, the method being applied to a first device, the method comprising: acquiring video capture data of a third device during a shooting process of a third device, and sharing the video capture data with a second device; receiving a request from the second device in response to a user operation on a designated tag to acquire corresponding high-definition video data and video recording time information; the designated tag being created by the second device for a video recording file, the video recording file being obtained by the second device recording the shooting screen displayed in a video recording application of the second device based on the video capture data, the video recording time information being obtained by the second device recording the recording time of the video shooting screen; and returning the high-definition video data to the second device based on the video recording time information.
[0012] Optionally, the aforementioned video recording file includes at least one video recording segment, and the video recording time information includes at least the timestamp information of the start video frame and the timestamp information of the end video frame of the video recording segment.
[0013] Optionally, the above-mentioned process of returning high-definition video data to the second device based on video recording time information includes: obtaining the original high-definition video file; retrieving the corresponding high-definition video segment from the original high-definition video file based on the timestamp information of the start and end video frames of the video recording segment; and returning the retrieved high-definition video segment to the second device.
[0014] Optionally, the above-mentioned retrieval of the corresponding high-definition video segment in the original high-definition video file based on the timestamp information of the start and end video frames of the video recording segment includes: subtracting a first specified frame number of time from the start timestamp of the video recording segment to obtain a new start timestamp based on the timestamp information of the start video frame; adding a second specified frame number of time to the end timestamp of the video recording segment to obtain a new end timestamp based on the timestamp information of the end video frame; and retrieving the corresponding high-definition video segment in the original high-definition video file based on the new start timestamp and the new end timestamp.
[0015] Optionally, the above-mentioned process of returning the retrieved high-definition video clips to the second device includes: performing frame interpolation processing on the retrieved high-definition video clips; and returning the interpolated high-definition video clips to the second device.
[0016] Optionally, the above method further includes recording the video footage displayed on the first device.
[0017] According to a third aspect of certain exemplary embodiments of the present disclosure, a video data processing apparatus is provided, in which a first device acquires video capture data of a third device during a shooting process of the third device. The apparatus is applied to a second device that establishes a communication connection with the first device. The apparatus includes: a startup module configured to launch a video recording application of the second device; a display module configured to receive video capture data shared by the first device and use the video capture data as input to the video recording application, so that the video recording application displays the captured image in a preview interface; a first recording module configured to record the captured image in response to a recording instruction on the captured image displayed in the video recording application, obtain a video recording file, and record video recording time information corresponding to the video recording file; and an adding module configured to create a specified tag for the video recording file, the specified tag being used to trigger a request for the first device to return high-definition video data corresponding to the video recording file based on the video recording time information.
[0018] Optionally, the aforementioned video recording file includes at least one video recording segment, and the video recording time information includes at least the timestamp information of the start video frame and the timestamp information of the end video frame of the video recording segment.
[0019] Optionally, the first recording module, in response to user operation of the video recording controls displayed in the video recording application, records the captured image to obtain a video recording file. The video recording controls include a recording control, a pause recording control, and / or a stop recording control. In response to user operation of the recording control, the pause recording control, or the stop recording control, the module records the timestamp information of the video frames displayed in the video recording application when the user operates the controls.
[0020] Optionally, the video recording time information mentioned above is recorded in a video timestamp parameter file. The filename of the video timestamp parameter file, the filename of the video recording file, and the value of the specified tag are all the same as the video name corresponding to the video shooting data.
[0021] Optionally, the above-mentioned adding module is also configured to display the specified tag for the video recording file in response to a file browsing command if the value of the specified tag in the file-related information of the video recording file is not empty.
[0022] Optionally, the above-described apparatus further includes a request module configured to, in response to a user operation on a specified label displayed, send a high-definition video data acquisition request to the first device, and after receiving specified status information returned by the first device, send a video timestamp parameter file to the first device and receive high-definition video data corresponding to the video recording file returned by the first device based on the video timestamp parameter file.
[0023] According to a fourth aspect of certain exemplary embodiments of the present disclosure, a video data processing apparatus is provided, applied to a first device, the apparatus comprising: a sharing module configured to acquire video capture data of a third device during a shooting process of a third device, and to share the video capture data with a second device; a receiving module configured to receive a request from the second device, sent in response to a user operation on a designated tag, for acquiring corresponding high-definition video data and video recording time information; the designated tag is created by the second device for a video recording file, the video recording file is obtained by the second device recording a shooting scene displayed in a video recording application of the second device based on the video capture data, and the video recording time information is obtained by the second device recording the recording time of the video shooting scene; and a returning module configured to return the high-definition video data to the second device based on the video recording time information.
[0024] Optionally, the aforementioned video recording file includes at least one video recording segment, and the video recording time information includes at least the timestamp information of the start video frame and the timestamp information of the end video frame of the video recording segment.
[0025] Optionally, the aforementioned return module obtains the original high-definition video file, retrieves the corresponding high-definition video segment in the original high-definition video file based on the timestamp information of the start and end video frames of the video recording segment, and returns the retrieved high-definition video segment to the second device.
[0026] Optionally, the aforementioned return module subtracts a first specified frame number of time from the start timestamp of the video recording segment based on the timestamp information of the start video frame to obtain a new start timestamp, and adds a second specified frame number of time to the end timestamp of the video recording segment based on the timestamp information of the end video frame to obtain a new end timestamp, and retrieves the corresponding high-definition video segment in the original high-definition video file based on the new start timestamp and the new end timestamp.
[0027] Optionally, the aforementioned return module performs frame interpolation on the retrieved high-definition video clips and returns the interpolated high-definition video clips to the second device.
[0028] Optionally, the above-described apparatus further includes a second recording module configured to record video footage displayed in the first device.
[0029] According to a fifth aspect of certain exemplary embodiments of the present disclosure, an electronic device is provided, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the computer program to implement the steps of any of the methods described above.
[0030] According to a sixth aspect of certain exemplary embodiments of the present disclosure, a computer-readable storage medium is provided having a computer program stored thereon, which, when executed by a processor, implements the steps of any of the above methods.
[0031] The aforementioned video data processing method, apparatus, electronic device, and storage medium involve a first device acquiring video shooting data from a third device during the third device's shooting process. A second device, having established a communication connection with the first device, initiates its video recording application and selects the first device to provide video source data. The second device receives the shared video shooting data from the first device and uses this data as input to its video recording application, allowing the application to display the third device's shooting footage. Thus, the user of the second device can view the third device's shooting footage in real-time on the second device. Furthermore, in response to recording instructions displayed in the video recording application, the second device records the footage, obtaining a video recording file. It also records the corresponding video recording time information and creates a designated tag for the video recording file. This designated tag triggers a request for the first device to return the corresponding high-definition video data based on the video recording time information. In other words, the editing work of the video shot by the third device is brought forward to the third device's shooting process. Therefore, the user of the second device can select the desired video shooting data according to personal preference during the third device's shooting process, and only needs to acquire the high-definition video data of interest, rather than the complete high-definition video data, reducing data transmission time. Attached Figure Description
[0032] Figure 1 This is a diagram illustrating the application environment of the video data processing method in some exemplary embodiments of this disclosure;
[0033] Figure 2 This is a flowchart illustrating a video data processing method in some exemplary embodiments of this disclosure;
[0034] Figure 3 A flowchart illustrating the label display steps specified in some exemplary embodiments of this disclosure;
[0035] Figure 4 This is a flowchart illustrating the high-definition video data acquisition steps in some exemplary embodiments of this disclosure;
[0036] Figure 5 This is a flowchart illustrating a video data processing method in some other exemplary embodiments of this disclosure;
[0037] Figure 6 This is a flowchart illustrating the step of returning high-definition video data to a second device in some exemplary embodiments of this disclosure;
[0038] Figure 7 This is a flowchart illustrating a video data processing method in some other exemplary embodiments of this disclosure;
[0039] Figure 8 This is an example of an interface diagram showing video capture data in a preview interface of a camera application in some exemplary embodiments of this disclosure;
[0040] Figure 9 This is a schematic diagram illustrating the recording of timestamp information for video segments in some exemplary embodiments of this disclosure;
[0041] Figure 10 This is a schematic diagram of the display interface of a third device video (video recording file) in some exemplary embodiments of this disclosure;
[0042] Figure 11 This is a flowchart illustrating the process of a second device requesting and obtaining high-definition video data in some exemplary embodiments of this disclosure;
[0043] Figure 12 This is a structural block diagram of a video data processing apparatus applied to a second device in some exemplary embodiments of this disclosure;
[0044] Figure 13 This is a structural block diagram of a video data processing apparatus for a first device in some exemplary embodiments of the present disclosure;
[0045] Figure 14 This is a diagram illustrating the internal structure of an electronic device in some exemplary embodiments of this disclosure. Detailed Implementation
[0046] To make the objectives, technical solutions, and advantages of this application clearer, the following detailed description is provided in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative and not intended to limit the scope of this application.
[0047] The following detailed descriptions are provided to aid the reader in gaining a comprehensive understanding of the methods, apparatuses, electronic devices, and / or storage media described herein. However, upon understanding the disclosure of this disclosure, various changes, modifications, and equivalents of the methods, apparatuses, electronic devices, and / or storage media described herein will become apparent. For example, the order of operations described herein is merely illustrative and is not limited to those orders set forth herein, but may be changed as will become clear upon understanding the disclosure of this disclosure, except for operations that must occur in a specific order. Furthermore, for clarity and conciseness, descriptions of features known in the art may be omitted.
[0048] The features described herein may be implemented in different forms and should not be construed as limited to the examples described herein. Rather, the examples described herein are provided only to illustrate some of the many feasible ways of implementing the methods, electronic devices, and / or storage media described herein, many of which will become clear upon understanding this disclosure.
[0049] The terminology used herein is for the purpose of describing various examples only and is not intended to limit disclosure. Unless the context clearly indicates otherwise, the singular form is intended to include the plural form as well. The terms “comprising,” “including,” and “having” indicate the presence of the described features, quantities, operations, components, elements, and / or combinations thereof, but do not exclude the presence or addition of one or more other features, quantities, operations, components, elements, and / or combinations thereof. Unless otherwise stated, “ / ” means “or,” for example, A / B can mean A or B; “and / or” in the text is merely a description of the relationship between related objects, indicating that three relationships can exist, for example, A and / or B can mean: A alone, A and B simultaneously, and B alone. Furthermore, in the description of embodiments of the invention, “multiple” means two or more.
[0050] Unless otherwise defined, all terms used herein (including technical and scientific terms) shall have the same meaning as commonly understood by one of ordinary skill in the art to which this disclosure pertains upon understanding this disclosure. Unless expressly defined herein, terms (such as those defined in a general dictionary) shall be interpreted as having a meaning consistent with their meaning in the context of the relevant field and in this disclosure, and shall not be interpreted in an idealized or overly formalistic manner.
[0051] It should be noted that the terms "first," "second," etc., used in the specification, claims, and accompanying drawings of this disclosure are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments of this disclosure described herein can be implemented in orders other than those illustrated or described herein. The embodiments described in some of the following exemplary embodiments do not represent all embodiments consistent with this disclosure. Rather, they are merely examples of apparatuses and methods consistent with some aspects of this disclosure as detailed in the appended claims.
[0052] Furthermore, in the description of the examples, detailed descriptions of well-known related structures or functions will be omitted when it is believed that such detailed descriptions would lead to a vague interpretation of this disclosure.
[0053] In the following description, embodiments will be described in detail with reference to the accompanying drawings. However, embodiments may be implemented in various forms and are not limited to the examples described herein.
[0054] The video data processing method provided in this application can be applied to, for example... Figure 1 The video data processing method can be applied to the application environment shown. Figure 1 The video data processing system shown may include a third device 102, a controller 104 for the third device, a first device 106, and a second device 108. The first device 106 may be, but is not limited to, various personal computers, laptops, smartphones, tablets, and portable wearable devices. Similarly, the second device 108 may also be, but is not limited to, various personal computers, laptops, smartphones, tablets, and portable wearable devices. The third device 102 may be… Figure 1 The drone shown can also be other electronic devices with shooting capabilities. The third device 102, the controller 104 of the third device, the first device 106, and the second device 108 can communicate via wired or wireless means. The first device 106 can communicate directly with the third device 102, or it can communicate with the third device 102 through the controller 104. Furthermore, the video data processing method provided in this application can also be applied to video data processing systems that do not include the controller 104 of the third device. In this case, the first device 106 can communicate directly with the third device 102, or it can communicate with the third device 102 through other devices.
[0055] The following uses the third device as a drone, for reference Figure 1 Let's illustrate the technical problems with existing technologies with an example. For instance, User A goes on a spring outing with friends, bringing a drone. At a scenic spot, User A launches the drone to film. User A sets the drone's flight parameters, controls its flight, and previews the footage using the drone's controller. If User A's friend (hereinafter referred to as User B) wants to see the drone footage, User B needs to stand around User A and view it through the drone's controller. After the drone video is filmed, if someone wants the video, they need to request it from User A, edit the footage, and select the scenes they are interested in. However, because drone footage is often very large, sharing the data is very time-consuming. Furthermore, others can only edit the received drone video data according to their preferences after obtaining high-definition data, which does not meet their need to view the drone footage in real-time and select the drone data according to their personal preferences while it is filming.
[0056] In some exemplary embodiments of this disclosure, such as Figure 2As shown, a video data processing method is provided, in which a first device acquires video shooting data from a third device during the shooting process of the third device. Specifically, the first device can act as a HOST device (also known as a master device) in a multi-device linkage, and the second device can act as a Client device (also known as a slave device) in a multi-device linkage. The first device can connect to the third device or related devices of the third device (e.g., a drone controller). In the case where the third device is a drone, a drone controller application installed on the first device can be launched. The first device sets the drone's flight parameters through the drone controller application and previews the video footage transmitted back by the drone in the drone controller application. The following description uses the application of the video data processing method to a second device that has established a communication connection with the first device as an example. The method includes the following steps:
[0057] Step 202: Launch the video recording application on the second device and select the first device to provide video source data for the second device.
[0058] Specifically, the second device launches a video recording application installed on the second device. This video recording application can be a camera application or other applications capable of displaying and recording video. After launching the video recording application on the second device, the first device can be automatically selected to provide video source data to the second device, or, in response to a user operation, the first device can be selected to provide video source data to the second device.
[0059] Step 204: Receive video capture data shared by the first device, and use the video capture data as input to the video recording application so that the video recording application can display the captured screen.
[0060] Here, the video capture data is the real-time video data transmitted back during the shooting process of the third device. The resolution of this video capture data is lower than the resolution of the video captured by the third device and stored locally (e.g., the video saved on the memory card of the third device). The video captured locally by the third device will be referred to as high-definition video data below.
[0061] Specifically, the second device can receive video capture data shared by the first device based on the communication connection established with the first device. This video capture data can typically be displayed on the preview interface of a video recording application. In this way, the user of the second device can view the footage captured by the third device in real time on the second device without needing to view the display screen of the third device's related equipment (such as a drone controller).
[0062] Step 206: In response to the recording instruction of the shooting screen displayed in the video recording application, record the shooting screen to obtain a video recording file, and record the video recording time information corresponding to the video recording file.
[0063] Here, recording commands can be triggered based on user interaction with controls, user voice or text commands, or specified conditions or events. Recording commands can include one or more of the following: start recording, pause recording, and end recording.
[0064] The video recording time information may include timestamps of multiple key video frames, which may include the start and end video frames of each video segment.
[0065] In some exemplary embodiments of this disclosure, step 206 may further include: recording the captured image in response to user operation of a video recording control displayed in a video recording application to obtain a video recording file, wherein the video recording control includes a recording control and further includes a pause recording control and / or a stop recording control; and recording the timestamp information of the video frames displayed in the video recording application when the user operates the control in response to user operation of the recording control, the pause recording control, or the stop recording control.
[0066] Specifically, clicking the recording control triggers the second device to start recording the footage displayed in the video recording application; clicking the pause recording control triggers the second device to pause recording the footage displayed in the video recording application; clicking the stop recording control triggers the second device to stop recording the footage displayed in the video recording application. In some examples, the video recording control may include a recording control, a pause recording control, and a stop recording control; in other examples, the video recording control may include a recording control and a stop recording control.
[0067] In some exemplary embodiments of this disclosure, the video recording file includes at least one video recording segment, and the video recording time information includes at least the timestamp information of the start video frame and the timestamp information of the end video frame of the video recording segment. For example, at time t1, the user starts recording the captured scene by clicking the recording control, at time t2, the user pauses the recording by clicking the pause recording control, at time t3, the user starts recording the captured scene by clicking the recording control again, and at time t4, the user pauses the recording by clicking the pause recording control again. At this time, two video recording segments have been generated. The first video recording segment is the video segment recorded between time t1 and time t2, and the second video recording segment is the video segment recorded between time t3 and time t4. It is necessary to record the timestamp information of the start video frame and the timestamp information of the end video frame of these two video recording segments respectively.
[0068] Those skilled in the art will understand that video recording time information is not limited to being represented by the timestamps of the start and end video frames of the recorded video segment. Furthermore, user operations on the video recording control are not limited to clicks; they can also be touch operations such as swiping or pressing, or operations performed by the user using an input device such as a keyboard, touchpad, or mouse.
[0069] Specifically, the user of the second device can choose to record footage captured by the third device that interests them. If they are not interested in the footage currently being captured by the third device, the user of the second device can choose to pause recording. When they want to continue recording, they can operate the video recording control (e.g., click the record control) to resume recording. When the user of the second device wants to stop recording, they can operate the video recording control (e.g., click the stop recording control) to end recording. After ending recording, a video recording file is obtained. This recording file can be associated with the corresponding high-definition video data in any feasible way, for example, by using the same filename.
[0070] In addition, when the second device records the footage captured by the third device, it can also simultaneously record the audio or voice around the second device or the audio played on the second device (e.g., music, songs), so that the recorded video file includes sound data, which also overcomes the defect of traditional methods that cannot record sound data in real time in video shooting data.
[0071] Specifically, after receiving the video capture data shared by the first device, the second device can replace the video data of the video recording application with the received video capture data at the Hardware Abstraction Layer (HAL). When the user of the second device operates the second device to trigger recording of the footage captured by the third device, the video source used by the video recording application is the received video capture data, and the sound can be the sound captured by the audio acquisition device (e.g., a microphone) of the second device, thereby achieving the purpose of recording the user's voice or other sounds into the video capture data in real time. However, the recorded sound is not limited to the sound from the audio acquisition device of the second device; it can also be other audio sources, such as audio played on the second device or audio transmitted to the second device from other devices.
[0072] Step 208: Create a specified tag for the video recording file. The specified tag is used to trigger a request for the first device to return the high-definition video data corresponding to the video recording file based on the video recording time information.
[0073] Specifically, when a user of the second device stops video recording by operating the video recording control of the second device (e.g., clicking the stop recording control), a designated label can be created for the video recording file. This designated label can be named as needed, for example, "High-definition video available". When displaying the list of video files, since this designated label has been set for the aforementioned video recording file, it can be displayed at a certain position around the identifier of the video recording file. The video file displaying the designated label indicates that the corresponding high-definition video data can be obtained. For example, after the designated label is operated by the user (e.g., clicked), it can trigger the second device to request the high-definition video data corresponding to the video recording file from the first device. The first device can then retrieve the high-definition video data corresponding to the video recording file based on the video recording time information.
[0074] In the aforementioned video data processing method, the first device acquires the video shooting data of the third device during the third device's shooting process. The second device, which establishes a communication connection with the first device, starts its video recording application and selects the first device to provide video source data. The second device receives the shared video shooting data from the first device and uses this data as input to the video recording application, enabling the application to display the shooting screen. Thus, the user of the second device can view the third device's shooting screen in real time on the second device. Furthermore, the second device responds to the recording command of the shooting screen displayed in the video recording application, records the shooting screen, obtains a video recording file, records the video recording time information corresponding to the video recording file, and creates a designated tag for the video recording file. This designated tag is used to trigger a request for the first device to return the high-definition video data corresponding to the video recording file based on the video recording time information. In other words, the editing work of the video shot by the third device is brought forward to the third device's shooting process. Thus, the user of the second device can select the video shooting data according to personal preferences during the third device's shooting process, and only needs to obtain the high-definition video data of the part of interest, rather than the complete high-definition video data, which can reduce the time consumption of data transmission.
[0075] In some exemplary embodiments of this disclosure, video recording time information can be recorded in a video timestamp parameter file. The filename of the video timestamp parameter file, the filename of the video recording file, and the value of the specified tag are all the same as the video name corresponding to the video shooting data. In this way, an association is established between the video timestamp parameter file, the video recording file, the specified tag, and the video name corresponding to the video shooting data. Based on this association, the other three can be queried from any one of these four.
[0076] In some exemplary embodiments of this disclosure, the video data processing method applied to the second device may further include the step of: in response to a file browsing instruction, if the value of a specified tag in the file-related information of the video recording file is not empty, then displaying the specified tag for the video recording file.
[0077] Here, the file browsing command can be an open command from a file browser application or an image browsing application. Once the file browsing command is triggered, the file information of the corresponding multimedia file will be displayed. Specifically, if the value of the specified tag in the file information of the aforementioned video recording file is not empty, then the specified tag will be displayed for that video recording file.
[0078] Specifically, such as Figure 3 As shown, in some exemplary embodiments of this disclosure, the video data processing method applied to the second device may further include the following steps:
[0079] Step 302: Add a new data column to the multimedia database of the second device. The new data column is used to store the value of the specified tag.
[0080] Here, the multimedia database is used to store information about multimedia files, which include one or more of the following: video files, audio files, and image files.
[0081] Specifically, the second device can add a new data column to the existing multimedia database, which is used to store the value of a specified tag.
[0082] Step 304: Read the relevant information of the video recording file, including the file name, storage path, file format, and the value of the specified tag.
[0083] Specifically, the second device reads metadata such as the filename, storage path, file format, and value of specified tags of the video recording file.
[0084] Step 306: Write the relevant information into the multimedia database.
[0085] Specifically, the second device reads the metadata of the video recording file, such as the file name, storage path, file format, and the value of a specified tag, and writes it into the multimedia database.
[0086] Step 308: In response to an open command from a file browser application or an image browser application, read information about the multimedia file from the multimedia database.
[0087] Generally, when a user on the second device opens a file browser application or an image browser application, the second device will respond to the open command by displaying a list of files, such as a list of multimedia files.
[0088] Step 310: If the value of the new data column of the video recording file is not empty, display the specified label for the video recording file.
[0089] Specifically, the second device reads information about multimedia files from the multimedia database. If the value of the new data column (i.e., the column used to store the value of the specified tag) of a certain multimedia file is not empty, the specified tag is displayed for the multimedia file. For example, for the video recording file, since a specified tag has been added, the value of the specified tag stored in the multimedia database is not empty, so the specified tag is displayed for the video recording file.
[0090] In some exemplary embodiments of this disclosure, the video data processing method applied to the second device may further include a high-definition video data acquisition step. Specifically, as... Figure 4 As shown, the high-definition video data acquisition process includes the following steps:
[0091] Step 402: In response to a user action on the specified label displayed, send a high-definition video data acquisition request to the first device.
[0092] Here, user operation can be a touch operation on the user interface element caused by the user touching the touch layer covering the terminal display screen, or an operation on the user interface element caused by the user manipulating the terminal's input device such as a keyboard, touchpad, or mouse. Touch operation can be any of the following: click, swipe, or press.
[0093] Here, a high-definition video data acquisition request refers to a request to obtain the corresponding high-definition video data.
[0094] Step 404: After receiving the specified status information returned by the first device, send the video timestamp parameter file to the first device.
[0095] In this process, after receiving a request to acquire high-definition video data, the first device can first check the status of the third device. If the third device is in a state where it cannot transmit high-definition video data to the first device (e.g., when the drone is in flight), it returns a waiting message to the second device. If the third device is in a state where it can transmit high-definition video data to the first device (e.g., when the drone is landing), it returns a ready status message to the second device. If the third device is in a connection failure state, it returns a connection failure message to the second device. The specified status information in step 404 generally refers to the returned ready status information, that is, the third device is in a state where it can transmit high-definition video data to the first device. In addition, the specified status information in step 404 can also represent the current status information of being able to request and obtain high-definition video data from the first device, for example, the first device has already obtained high-definition video data or the first device is currently in a state where it can request and obtain high-definition video data from the third device. The specified status information can also be distinguished from other types of status information using different symbols and identifiers.
[0096] If the second device receives the specified status information returned by the first device, it can send a video timestamp parameter file to the first device to instruct the first device to obtain high-definition video data for the corresponding time period based on the video recording time information recorded in the video timestamp parameter file.
[0097] Step 406: Receive the high-definition video data corresponding to the video recording file returned by the first device based on the video timestamp parameter file.
[0098] Specifically, the first device can obtain the original high-definition video file from the storage card of the third device, and then retrieve the corresponding high-definition video segment from the original high-definition video file according to the video recording time information recorded in the video time parameter file. The retrieved high-definition video segment is then returned to the second device, which receives the high-definition video segment, i.e., the high-definition video data corresponding to the video recording file. If the video recording file involves multiple video recording segments, the first device can sequentially query the high-definition video segments corresponding to each video recording segment, and send all the retrieved high-definition video segments to the second device together, or it can return one high-definition video segment at a time. Correspondingly, the second device can receive the high-definition video segments corresponding to each video recording segment uniformly, or it can receive them sequentially.
[0099] According to the video data processing method applied to the second device disclosed in some of the above exemplary embodiments, in some exemplary embodiments of this disclosure, such as Figure 5 As shown, a video data processing method applied to a first device is provided, the method comprising the following steps:
[0100] Step 502: Acquire video shooting data from the third device during the shooting process, and share the video shooting data with the second device.
[0101] Specifically, when the user of the second device selects the first device as the video source, the second device can send a data acquisition request to the first device. Upon receiving the request, the first device establishes a communication connection with the second device for data sharing. The user of the first device can choose the currently connected third device as the shared data source. In some scenarios, the shared data source for the first device can be the data currently displayed on its own device or data from its connected smart devices. After the user of the first device selects the currently connected third device as the shared data source, the first device will transmit the video data captured during the third device's recording process to the second device.
[0102] Step 504: Receive the request from the second device to obtain the corresponding high-definition video data and video recording time information in response to the user operation on the specified tag; the specified tag is created by the second device for the video recording file, the video recording file is obtained by the second device recording the shooting screen when the shooting screen is displayed in the video recording application of the second device according to the video shooting data, and the video recording time information is obtained by the second device recording the recording time of the shooting screen.
[0103] The process of creating the specified tag, generating the video recording file (or obtaining the video recording file), and recording the video recording time information can be found in the description of the exemplary embodiment of the video data processing method applied to the second device described above, and will not be repeated here.
[0104] Here, the request to obtain the corresponding high-definition video data and the video recording time information can be received together or separately. For example, the request to obtain the corresponding high-definition video data can be received first, followed by the video recording time information.
[0105] In some exemplary embodiments of this disclosure, the video recording file includes at least one video recording segment, and the video recording time information includes the timestamp information of the start video frame and the timestamp information of the end video frame of at least the video recording segment. For example, when the video recording file includes three video recording segments, the video recording time information includes the timestamp information of the start video frame and the timestamp information of the end video frame of each of the three video recording segments.
[0106] Step 506: Return the high-definition video data corresponding to the video recording file to the second device based on the video recording time information.
[0107] In some exemplary embodiments of this disclosure, such as Figure 6 As shown, the step of returning high-definition video data to the second device based on video recording time information may include the following steps:
[0108] Step 602: Obtain the original high-definition video file.
[0109] Specifically, when the first device is able to acquire high-definition video data from the third device, such as when the drone is landing, it can establish a wired or wireless communication connection with the third device and obtain the original high-definition video file from the third device (or its memory card). The third device's memory card stores multiple video files it has captured, such as video files from multiple dates. The first device can also first search for and determine the original high-definition video file corresponding to the video recording file based on the filename of the video timestamp parameter file containing the video recording time information.
[0110] Step 604: Retrieve the corresponding high-definition video segment from the original high-definition video file based on the timestamp information of the start and end video frames of the video recording segment.
[0111] Specifically, the first device can retrieve the corresponding high-definition video segment from the original high-definition video file based on the timestamp information of the start and end video frames of the video recording segment, and obtain at least one high-definition video segment.
[0112] To address the issues of frame loss during data transmission and video mismatch caused by rapid switching during user recording operations (i.e., a discrepancy between the timestamp of the video segment recorded by the second device and the timestamp of the video actually recorded by the third device), in some exemplary embodiments of this disclosure, the step of retrieving the corresponding high-definition video segment in the original high-definition video file based on the timestamp information of the start and end video frames of the video recording segment may include the following steps: subtracting a first specified frame number of time from the start timestamp of the video recording segment to obtain a new start timestamp based on the timestamp information of the start video frame; adding a second specified frame number of time to the end timestamp of the video recording segment to obtain a new end timestamp based on the timestamp information of the end video frame; and retrieving the corresponding high-definition video segment in the original high-definition video file based on the new start timestamp and the new end timestamp.
[0113] The first specified frame time and the second specified frame time can be the same or different. The specific values can be set according to actual needs. For example, both can be 3 frames, or the first specified frame time can be 5 frames and the second specified frame time can be 3 frames.
[0114] Step 606: Return the retrieved high-definition video clips to the second device.
[0115] The high-definition video data corresponding to the aforementioned video recording files includes all retrieved high-definition video clips.
[0116] Specifically, the first device can return all the high-definition video clips to the second device at once, or it can return one high-definition video clip to the second device as soon as it receives one clip, or it can use other feasible return methods.
[0117] To address the issue of unsmooth video playback caused by rapid user switching or jitter, in some exemplary embodiments of this disclosure, the step of returning the retrieved high-definition video clip to the second device may include the steps of: performing frame interpolation processing on the retrieved high-definition video clip; and returning the interpolated high-definition video clip to the second device. The frame interpolation algorithm used can be selected according to actual needs and may be an optical flow-based frame interpolation algorithm, such as TOFlow, MEMC-Net, or RIFE-Large.
[0118] In some exemplary embodiments of this disclosure, the video data processing method applied to the first device may further include the step of recording a video frame displayed on the first device.
[0119] Specifically, when the user of the first device previews the footage captured by the third device, they can also, according to their own interests, operate the first device to record the displayed video footage. This recording can be full-time or, depending on the user's operation, only a portion of the footage can be recorded. Similarly, the first device can also record the time information corresponding to the recorded video files. This time information is used to search for corresponding high-definition video segments from the original high-definition video files. Furthermore, the first device can add a tag to the recorded video files that triggers the retrieval of high-definition video data. For details, please refer to the explanation of the video recording process, video recording time information recording process, and tag addition process of the second device above; these will not be repeated here.
[0120] To facilitate understanding of the solutions in the embodiments of this application, the following uses the interaction between a first device and a second terminal as an example to illustrate the video data processing method of this disclosure. In the following description, a drone is used as the third device, and the example is the recording of drone footage by launching a camera application. However, this does not constitute a limitation on the solutions in the embodiments of this disclosure. Figure 7 As shown, in some exemplary embodiments of this disclosure, the video data processing method includes the following steps:
[0121] Step 702: The first device controls the drone to fly and receives drone data.
[0122] Specifically, the first device connects to the drone controller and launches the drone controller application installed on the first device. The first device sets the drone's flight parameters through the drone controller application and can preview and record video footage transmitted by the drone within the application. The video captured by the drone has a relatively high resolution; currently, the resolution of drone-captured video is at least 1080P (1080P is a video display format, typically with a screen resolution of 1920×1080). However, due to transmission distance limitations, the resolution of the drone data transmitted back during the recording process, such as the data sent back to the drone controller, will decrease, generally not exceeding 1080P.
[0123] Step 704: The second device starts the camera application to record video.
[0124] Specifically, the second device launches its camera application. The user of the second device can click the video recording control to record video using the camera application. Furthermore, the user can switch the video source for recording; for example, they can set a video source selection control in the video recording interface. In response to user interaction with this control, the camera application of the second device calls Remote Data Services (RDDs) to query electronic devices (such as smartphones, drones, smart TVs, and surveillance equipment) that can serve as camera data sources. The user can then select the data source for recording in this data source selection interface. The RDDs service is responsible for establishing communication connections between electronic devices and sending and receiving data based on these connections. RDDs services typically use the Wi-Fi Direct standard, employing TCP (Transmission Control Protocol) or UDP (User Datagram Protocol) at the transport layer. At the application layer, RTSP (Real-Time Streaming Protocol) or RTP (Real-Time Transport Protocol) can be used to initiate and control the flow for data transmission.
[0125] When a user selects the first device as the video source, the second device's RDDs service initiates a data retrieval request to the first device. Upon receiving this request, the first device starts its own RDDs service and establishes a data sharing connection with the second device's RDDs service. At this point, the user of the first device can choose the currently connected drone device as the shared data source. The shared data source for the first device can be the data currently displayed on its own device or data from its connected smart devices.
[0126] The first device's RDDs service transmits drone data to the second device. The second device's RDDs service then uses the received drone data as input data for a camera application. For example... Figure 8 As shown, assume that the camera application can display the received drone data in the preview interface.
[0127] Step 706: The second device records data, including the time information of the drone data.
[0128] Users of the second device can choose to record footage captured by the drone that interests them. For example... Figure 9 As shown, in the camera application's preview interface, one or more of the following controls can be displayed under different conditions: recording control 902, pause recording control 904, and stop recording control 906. The user of the second device can trigger recording of the drone's footage by clicking the recording control 902. If they are not interested in the current drone footage, the user can pause recording by clicking the pause recording control 904. When they want to continue recording, the user can click the recording control 902 to resume recording.
[0129] Since the user of the second device may have only recorded a portion of the video footage captured by the drone, in order to quickly locate the corresponding positions of the video frame data recorded by the second device within the video frame data captured by the drone, such as... Figure 9 As shown, each time the user clicks the recording control 902, pause recording control 904, or stop recording control 906, the second device records the timestamp information of the corresponding video frame and writes it to a timestamp parameter file with the same name as the video.
[0130] Step 708: The second device marks the video file containing the drone data source.
[0131] When the user of the second device clicks the stop recording control 906, a "High-definition video available" label is created for the video file, the value of which is set to the video timestamp parameter file name, and then the recorded video file (i.e. the video recording file mentioned above) is saved.
[0132] After the recorded video file is saved, the media scanner service of the second device will scan the video file, read relevant information about the video file (such as video file name, storage path, file format, metadata information such as available high-definition video), and write this information into the multimedia database of the second device. The multimedia database of the second device needs to add a "available high-definition data" column, which is the new data column mentioned above.
[0133] When a user on the second device opens a file browser application (my-files) or an image browser application (gallery), the corresponding application reads information about the multimedia files from the multimedia database. For example... Figure 10 As shown, if the value of the "High-definition video available" column of the video file is not empty, the "High-definition video available" label 1002 of the video file is displayed.
[0134] Step 710: The second device requests and acquires high-definition video data from the drone.
[0135] When the user on the second device clicks the "High-definition video available" tab on the video file, the second device starts the RDDs service, which requests the high-definition video source file from the first device. For example... Figure 11 As shown, the specific process includes:
[0136] Step 1102: The second device sends a request to the first device to acquire high-definition video data from the drone.
[0137] Specifically, the RDDs service of the second device sends a request to the first device to acquire high-definition video data from the drone.
[0138] Step 1104: After receiving the request to acquire high-definition video data from the drone, the first device detects the drone's status.
[0139] Specifically, after receiving the request to acquire high-definition video data from the drone, the RDDs service of the first device checks the drone's status, which generally includes three states: in flight, landing, and unable to connect. If the drone is in flight, it returns a waiting message to the second device; if the drone is landing, it returns a message indicating that it is ready (corresponding to the specified status information) to the second device; if the drone is unable to connect, it returns a message indicating that the connection has failed to connect to the second device.
[0140] Next, the RDDs service of the second device processes the messages returned by the first device. If it is a waiting message, the RDDs service of the second device sends a request to the first device to acquire high-definition video data of the drone at a certain frequency (e.g., every 10 seconds); if it is a message indicating a connection failure, the RDDs service of the second device displays the message indicating a connection failure and prompts the user "The drone cannot connect"; if it is a message indicating that the drone is ready, the RDDs service of the second device sends the high-definition video file information to be acquired (command + video timestamp parameter file) to the first device.
[0141] Step 1106: The first device acquires the original high-definition video file.
[0142] Specifically, after receiving the information about the required high-definition video file, the RDDs service of the first device parses the information to obtain the filename of the high-definition video, the timestamp of the video segment, and other information. Based on the high-definition video filename information, the RDDs service of the first device retrieves the high-definition video v0 (corresponding to the original high-definition video file mentioned above) from the drone's storage card.
[0143] Step 1108: The first device retrieves high-definition video clips.
[0144] Specifically, the RDDs service of the first device retrieves the corresponding high-definition video segment p in the high-definition video v0 based on the timestamp information of each video recording segment (timestamp information of the start video frame and the timestamp information of the end video frame).
[0145] Step 1110: The first device performs frame interpolation on the retrieved high-definition video clips.
[0146] To address the issues of frame drops during data transmission and video mismatch caused by rapid switching during user recording (i.e., a discrepancy between the timestamp of the video segment recorded by the second device and the timestamp of the video actually recorded by the drone), it is necessary to detect the smoothness of the video (discontinuous movement of people and objects) and perform frame interpolation.
[0147] The frame interpolation process includes:
[0148] 1) To address the video frame data mismatch issue caused by frame loss during transmission, the search range in HD video v0 can be expanded by modifying the start and end timestamps of the corresponding video recording segment (based on the time of three frames, such as subtracting three frames from the start timestamp of the corresponding video recording segment and adding three frames to the end timestamp of the corresponding video recording segment).
[0149] 2) To address the issue of unsmooth visuals caused by users switching between screens too quickly or jitter, frame interpolation algorithms (such as optical flow-based frame interpolation algorithms TOFlow, MEMC-Net, and RIFE-Large) can be used for frame interpolation.
[0150] Step 1112: The first device writes the high-definition video clip after the frame interpolation operation into a new video file.
[0151] Specifically, after the first device completes the frame interpolation operation, the video clip is written to a new video file v1.
[0152] Repeat steps 1108-1112 until all recorded video clips requested by the second device have been processed.
[0153] Step 1114: The first device sends a "Data preparation complete" message to the second device.
[0154] Specifically, the RDDs service of the first device sends a "data ready" message to the second device.
[0155] Step 1116: After receiving the "Data preparation complete" message sent by the first device, the second device prompts the user to accept it.
[0156] Specifically, after receiving the "Data preparation complete" message from the first device, the RDDs service of the second device prompts the user to receive the data. After the user selects to receive the high-definition data from the drone, the RDDs service of the second device sends a receive-ready message to the first device.
[0157] Step 1118: After receiving the ready-to-receive message from the second device, the first device sends the completed high-definition replacement video file to the second device.
[0158] Specifically, after receiving the ready-to-receive message from the second device, the RDDs service of the first device sends the current video file v1 to the second device.
[0159] Step 1120: The second device receives the video file after the high-definition replacement is completed.
[0160] Specifically, the RDDs service of the second device receives video file v1, which is a video file that has been replaced with high definition.
[0161] Step 712: The second device completes the high-definition data replacement of the drone video.
[0162] Specifically, after receiving the high-definition video data from the drone, the second device deletes the corresponding low-resolution video and video clip timestamp files (corresponding to the video recording file and video timestamp parameter file mentioned above) to complete the replacement of the drone video with high-definition data. For example, after receiving video file v1, the corresponding video recording file and video timestamp parameter file are deleted.
[0163] It should be understood that, although Figure 2-7 The steps in flowchart 11 are shown sequentially as indicated by the arrows; however, these steps are not necessarily executed in the order indicated by the arrows. Unless otherwise explicitly stated herein, there is no strict order in which these steps are performed, and they can be executed in other orders. Furthermore, Figure 2-7 At least some of the steps in 11 may include multiple sub-steps or multiple stages. These sub-steps or stages are not necessarily completed at the same time, but may be executed at different times. The execution order of these sub-steps or stages is not necessarily sequential, but may be executed in turn or alternately with other steps or at least some of the sub-steps or stages of other steps.
[0164] In some exemplary embodiments of this disclosure, such as Figure 12 As shown, a video data processing device for a second device that establishes a communication connection with the first device is provided, in which the first device acquires video shooting data from the third device during the shooting process. The device includes: a startup module 1202, a display module 1204, a first recording module 1206, and an adding module 1208. The startup module 1202 is configured to launch a video recording application on the second device. The display module 1204 is configured to receive shared video shooting data from the first device and use the video shooting data as input to the video recording application, so that the video recording application displays the shooting screen in a preview interface. The first recording module 1206 is configured to record the shooting screen in response to a recording command on the shooting screen displayed in the video recording application, obtain a video recording file, and record the video recording time information corresponding to the video recording file. The adding module 1208 is configured to create a specified tag for the video recording file, and the specified tag is used to trigger a request for the first device to return high-definition video data corresponding to the video recording file based on the video recording time information.
[0165] In some exemplary embodiments of this disclosure, the video recording file obtained by the first recording module 1206 includes at least one video recording segment, and the video recording time information includes at least the timestamp information of the start video frame and the timestamp information of the end video frame of the video recording segment.
[0166] In some exemplary embodiments of this disclosure, the first recording module 1206 records the human-machine shooting scene in response to user operation of the video recording control displayed in the video recording application to obtain a video recording file. The video recording control includes a recording control, and also includes a pause recording control and / or a stop recording control. In response to user operation of the recording control, the pause recording control, or the stop recording control, the first recording module 1206 records the timestamp information of the video frames displayed in the video recording application when the user operates the control.
[0167] In some exemplary embodiments of this disclosure, video recording time information is recorded in a video timestamp parameter file, and the filename of the video timestamp parameter file, the filename of the video recording file, and the value of the specified tag are all the same as the video name corresponding to the video shooting data.
[0168] In some exemplary embodiments of this disclosure, the adding module 1208 is further configured to display the specified tag for the video recording file in response to a file browsing instruction if the value of the specified tag in the file-related information of the video recording file is not empty.
[0169] In some exemplary embodiments of this disclosure, the above-described apparatus further includes a request module 1210, which is configured to send a high-definition video data acquisition request to a first device in response to a user operation on a specified label displayed, and after receiving specified status information returned by the first device, send a video timestamp parameter file to the first device and receive high-definition video data corresponding to a video recording file returned by the first device based on the video timestamp parameter file.
[0170] In some exemplary embodiments of this disclosure, such as Figure 12 As shown, the video data processing device applied to the second device may further include a request module 1210. The request module 1210 is configured to send a high-definition video data acquisition request to the first device in response to a user operation on a specified label; after receiving the specified status information returned by the first device, send a video timestamp parameter file to the first device; and receive the high-definition video data corresponding to the video recording file returned by the first device according to the video timestamp parameter file.
[0171] In some exemplary embodiments of this disclosure, such as Figure 13 As shown, a video data processing apparatus is provided, which is applied to a first device. The apparatus includes a sharing module 1302, a receiving module 1304, and a returning module 1306, wherein: the sharing module 1302 is configured to acquire video shooting data of the third device during the shooting process of the third device and share the video shooting data with the second device; the receiving module 1304 is configured to receive a request from the second device in response to a user operation on a specified tag to acquire corresponding high-definition video data and video recording time information; the specified tag is created by the second device for the video recording file, the video recording file is obtained by the second device recording the shooting screen when the shooting screen is displayed in the video recording application of the second device according to the video shooting data, and the video recording time information is obtained by the second device recording the recording time of the video shooting screen; the returning module 1306 is configured to return high-definition video data to the second device according to the video recording time information.
[0172] In some exemplary embodiments of this disclosure, the video recording file described above includes at least one video recording segment, and the video recording time information includes at least the timestamp information of the start video frame and the timestamp information of the end video frame of the video recording segment.
[0173] In some exemplary embodiments of this disclosure, the return module 1306 obtains the original high-definition video file, retrieves the corresponding high-definition video segment in the original high-definition video file according to the timestamp information of the start video frame and the timestamp information of the end video frame of the video recording segment, and returns the retrieved high-definition video segment to the second device.
[0174] In some exemplary embodiments of this disclosure, the return module 1306 subtracts a first specified frame number of time from the start timestamp of the video recording segment based on the timestamp information of the start video frame to obtain a new start timestamp, adds a second specified frame number of time to the end timestamp of the video recording segment based on the timestamp information of the end video frame to obtain a new end timestamp, and retrieves the corresponding high-definition video segment in the original high-definition video file based on the new start timestamp and the new end timestamp.
[0175] In some exemplary embodiments of this disclosure, the return module 1306 performs frame interpolation processing on the retrieved high-definition video clips and returns the interpolated high-definition video clips to the second device.
[0176] In some exemplary embodiments of this disclosure, the apparatus applied to the first device further includes a second recording module (not shown in the figures), which is configured to record video footage displayed on the first device.
[0177] Specific limitations regarding the video data processing device can be found in the limitations of the video data processing method described above, and will not be repeated here. Each module in the aforementioned video data processing device can be implemented entirely or partially through software, hardware, or a combination thereof. These modules can be embedded in hardware or independently of the processor in the electronic device, or stored in software in the memory of the electronic device, so that the processor can call and execute the operations corresponding to each module.
[0178] In some exemplary embodiments of this disclosure, an electronic device is provided, which may be a terminal, and its internal structure diagram may be as follows: Figure 14 As shown, the electronic device includes a processor, memory, network interface, display screen, and input devices connected via a system bus. The processor provides computing and control capabilities. The memory includes a non-volatile storage medium and internal memory. The non-volatile storage medium stores the operating system and computer programs. The internal memory provides an environment for the operation of the operating system and computer programs stored in the non-volatile storage medium. The network interface is used to communicate with external terminals via a network connection. When the computer program is executed by the processor, it implements a video data processing method. The display screen can be a liquid crystal display (LCD) or an e-ink display. The input devices can be a touch layer covering the display screen, buttons, a trackball, or a touchpad mounted on the device's casing, or an external keyboard, touchpad, or mouse.
[0179] Those skilled in the art will understand that Figure 14The structure shown is merely a block diagram of a portion of the structure related to the present application and does not constitute a limitation on the electronic device to which the present application is applied. The specific electronic device may include more or fewer components than shown in the figure, or combine certain components, or have different component arrangements.
[0180] In some exemplary embodiments of this disclosure, an electronic device is provided, including a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, it implements the steps of the video data processing method in any of the exemplary embodiments described above.
[0181] In some exemplary embodiments of this disclosure, a computer-readable storage medium is provided having a computer program stored thereon, which, when executed by a processor, implements the steps of the video data processing method in any of the exemplary embodiments described above.
[0182] Those skilled in the art will understand that all or part of the processes in the methods of the above embodiments can be implemented by a computer program instructing related hardware. The computer program can be stored in a non-volatile computer-readable storage medium. When executed, the computer program can include the processes of the embodiments of the above methods. Any references to memory, storage, databases, or other media used in the embodiments provided in this application can include non-volatile and / or volatile memory. Non-volatile memory can include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), or flash memory. Volatile memory can include random access memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in various forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), dual data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous link DRAM (SLDRAM), RAMbus direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and RAMbus dynamic RAM (RDRAM), etc.
[0183] The technical features of the above embodiments can be combined in any way. For the sake of brevity, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.
[0184] The above embodiments merely illustrate several implementation methods of this application, and while the descriptions are relatively specific and detailed, they should not be construed as limiting the scope of the invention patent. It should be noted that those skilled in the art can make various modifications and improvements without departing from the concept of this application, and these all fall within the protection scope of this application. Therefore, the protection scope of this patent application should be determined by the appended claims.
Claims
1. A video data processing method, characterized in that, The method involves acquiring video recording data from a third device via a first device during the recording process of a third device. The method is applied to a second device that has established a communication connection with the first device. The method includes: Launch the video recording application on the second device, and select the first electronic device to provide video source data to the second electronic device; Receive the video capture data shared by the first device, and use the video capture data as input to the video recording application so that the video recording application displays the captured screen; In response to a recording command for the shooting screen displayed in the video recording application, the shooting screen is recorded to obtain a video recording file, and the video recording time information corresponding to the video recording file is recorded. A specified tag is created for the video recording file. The specified tag is used to trigger a request to the first device to return the high-definition video data corresponding to the video recording file based on the video recording time information.
2. The method according to claim 1, characterized in that, The video recording file includes at least one video recording segment, and the video recording time information includes at least the timestamp information of the start video frame and the timestamp information of the end video frame of the video recording segment.
3. The method according to claim 2, characterized in that, The step of responding to a recording command on the shooting screen displayed in the video recording application, recording the shooting screen to obtain a video recording file, and recording the video recording time information corresponding to the video recording file includes: In response to a user operation on the video recording controls displayed in the video recording application, the captured screen is recorded to obtain a video recording file. The video recording controls include recording controls, as well as pause recording controls and / or stop recording controls. In response to user operations on the recording control, the pause recording control, or the stop recording control, timestamp information of the video frames displayed in the video recording application when the user operates the control is recorded.
4. The method according to claim 2, characterized in that, The video recording time information is recorded in a video timestamp parameter file. The filename of the video timestamp parameter file, the filename of the video recording file, and the value of the specified tag are all the same as the video name corresponding to the video shooting data.
5. The method according to any one of claims 1 to 4, characterized in that, The method further includes: In response to a file browsing command, if the value of the specified tag in the file-related information of the video recording file is not empty, then the specified tag is displayed for the video recording file.
6. The method according to claim 5, characterized in that, The method further includes: In response to a user action on the displayed specified label, a high-definition video data acquisition request is sent to the first device; After receiving the specified status information returned by the first device, the video timestamp parameter file is sent to the first device; Receive the high-definition video data corresponding to the video recording file returned by the first device based on the video timestamp parameter file.
7. A video data processing method, characterized in that, The method is applied to a first device, and the method includes: During the shooting process of the third device, the video shooting data of the third device is acquired and shared with the second device; The device receives a request from the second device in response to a user operation on a specified tag to obtain corresponding high-definition video data and video recording time information; the specified tag is created by the second device for the video recording file, the video recording file is obtained by the second device recording the shooting screen when the shooting screen is displayed in the video recording application of the second device according to the video shooting data, and the video recording time information is obtained by the second device recording the recording time of the video shooting screen; The high-definition video data is returned to the second device based on the video recording time information.
8. The method according to claim 7, characterized in that, The video recording file includes at least one video recording segment, and the video recording time information includes at least the timestamp information of the start video frame and the timestamp information of the end video frame of the video recording segment.
9. The method according to claim 8, characterized in that, The step of returning the high-definition video data to the second device based on the video recording time information includes: Obtain the original high-definition video file; Based on the timestamp information of the start and end video frames of the recorded video segment, the corresponding high-definition video segment is retrieved from the original high-definition video file; The retrieved high-definition video clips are returned to the second device.
10. The method according to claim 9, characterized in that, The step of retrieving the corresponding high-definition video segment from the original high-definition video file based on the timestamp information of the start and end video frames of the recorded video segment includes: Based on the timestamp information of the starting video frame, subtract the first specified frame number of time from the starting timestamp of the video recording segment to obtain a new starting timestamp; Based on the timestamp information of the end video frame, add the second specified frame number time to the end timestamp of the video recording segment to obtain a new end timestamp; Based on the new start timestamp and the new end timestamp, the corresponding high-definition video segment is retrieved from the original high-definition video file.
11. The method according to claim 10, characterized in that, The step of returning the retrieved high-definition video clips to the second device includes: The retrieved high-definition video clips are then subjected to frame interpolation. The high-definition video clip processed by the pins is returned to the second device.
12. The method according to any one of claims 7 to 11, characterized in that, Also includes: Record the video footage displayed on the first device.
13. A video data processing device, comprising: The device acquires video recording data from the third device during the recording process of the third device using a first device. The device is applied to a second device that establishes a communication connection with the first device. The device includes: The startup module is configured to launch the video recording application on the second device; The display module is configured to receive the video capture data shared by the first device, and use the video capture data as input to the video recording application, so that the video recording application displays the captured screen in the preview interface; The first recording module is configured to record the shooting screen in response to a recording instruction displayed in the video recording application, obtain a video recording file, and record the video recording time information corresponding to the video recording file; An add module is configured to create a specified tag for the video recording file. The specified tag is used to trigger a request to the first device to return the high-definition video data corresponding to the video recording file based on the video recording time information.
14. A video data processing device, comprising: The device is applied to the first apparatus, the device comprising: The sharing module is configured to acquire video capture data from the third device during the shooting process of the third device, and share the video capture data with the second device. The receiving module is configured to receive a request from the second device in response to a user operation on a specified tag, requesting the acquisition of corresponding high-definition video data and video recording time information; the specified tag is created by the second device for a video recording file, the video recording file is obtained by the second device recording the shooting screen when the shooting screen is displayed in the video recording application of the second device according to the video shooting data, and the video recording time information is obtained by the second device recording the recording time of the video shooting screen; The return module is configured to return the high-definition video data to the second device based on the video recording time information.
15. An electronic device comprising a memory, a processor, and a computer program stored on the memory and executable on the processor, characterized in that, When the processor executes the computer program, it implements the steps of the method according to any one of claims 1 to 12.
16. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by a processor, it implements the steps of the method according to any one of claims 1 to 12.