Video processing method, camera device and image processing device

Abstract

The application relates to a video processing method, a camera device and an image processing device. The method comprises the following steps: being suitable for the camera device, first, generating or labeling at least one highlight segment of a target video during recording of the target video, then, after recording the target video, if a playback instruction for the target video is received, displaying a playback interface of the target video, and receiving and responding to an operation instruction for the highlight segment according to the playback interface. According to the method, a video after editing can be automatically generated according to the highlight segment, and a user does not need to manually edit the target video, so that the operation is more convenient, and the video processing efficiency is higher.

Description

Video processing method, camera device, and image processing device Technical Field

[0001] The present application relates to the field of video processing technology, and in particular to a video processing method, a camera device, and an image processing device. Background Art

[0002] With the development of Internet technology and the advent of the new media era, the video industry has also become one of the important fields in modern society. Video processing technology is an important link in the video production process. Through video processing technology, users can edit the original video content into the video content they want.

[0003] However, current video processing generally requires users to complete it manually, and the video processing process is relatively complicated.

[0004] Summary of the Invention

[0005] Based on this, it is necessary to provide a video processing method, camera device and image processing device that can automatically edit the video in order to solve the above technical problems.

[0006] In a first aspect, the present application provides a video processing method suitable for a camera device, the method comprising: generating or marking at least one highlight segment of a target video during recording of a target video; after recording the target video, if a playback instruction for the target video is received, displaying a playback interface of the target video; and receiving and responding to operation instructions for the highlight segment according to the playback interface.

[0007] In one embodiment, the playback interface includes a highlight clip display control, and the playback interface receives and responds to operation instructions for the highlight clip, including:

[0008] If a trigger operation for the highlight display control is detected, the highlight playback interface is displayed, and the highlight is played in a loop based on the highlight playback interface.

[0009] In one embodiment, the highlight segment display control includes quantity indication information, where the quantity indication information indicates the number of highlight segments in the target video.

[0010] In one embodiment, the highlight segment playback interface further includes a summary information list of the highlight segments, the summary information list includes at least one summary indicator control of the highlight segment, the summary indicator control indicates summary information of the corresponding highlight segment, and looping the highlight segments based on the highlight segment playback interface includes:

[0011] In the process of looping the highlight clips based on the highlight clip playback interface, the summary indicator control corresponding to the currently playing highlight clip is displayed based on the target display effect. The target display effect is used to distinguish the summary indicator control of the currently playing highlight clip from the summary indicator controls of other highlight clips.

[0012] In one embodiment, the highlight playback interface further includes a highlight export control, and the method further includes:

[0013] If a trigger operation for the highlight segment export control is detected, the highlight segment corresponding to the selected summary indicator control will be exported.

[0014] In one embodiment, if a trigger operation for a highlight segment export control is detected, the highlight segment corresponding to the selected summary indicator control is exported, including:

[0015] If a trigger operation for the highlight export control is detected, the export interface is displayed, and the export interface includes at least one export type control; according to the export type corresponding to the selected export type control, the highlight corresponding to the selected summary indication control is exported.

[0016] In one embodiment, the export type includes a segmented export type and a merged export type; according to the export type corresponding to the selected export type control, the highlight clip corresponding to the selected summary indicator control is exported, including:

[0017] If the export type corresponding to the selected export type control is the segmented export type, the highlights corresponding to the selected summary indicator control will be exported separately; if the export type corresponding to the selected export type control is the merged export type, the highlights corresponding to the selected summary indicator control will be merged and then exported.

[0018] In one embodiment, the playback interface further includes video playback controls, and the method further includes:

[0019] If a trigger operation for the video playback control is detected, the target video is played, and during the playback of the target video, the playback position interval corresponding to the wonderful clip in the target video is displayed on the first progress bar of the target video.

[0020] In one embodiment, the playback interface further includes a highlight editing control, and the method further includes:

[0021] If a trigger operation for the highlight clip editing control is detected during the playback of the target video, the current playback progress of the target video will be displayed in real time on the second progress bar of the target video, wherein the second progress bar is used to display the playback position interval corresponding to the highlight clip in the target video, and the size of the second progress bar is larger than the size of the first progress bar.

[0022] In one embodiment, a playback progress indicator control is provided at a preset position of the second progress bar, and the playback progress indicator control indicates the current playback progress of the target video. The method further includes:

[0023] If the playback progress indicator control indicates that the currently playing video segment interval is the playback position interval corresponding to the highlight segment, and a highlight segment deletion operation for the playback progress indicator control is detected, the currently playing highlight segment is modified to a non-highlight segment; if the playback progress indicator control indicates that the currently playing video segment interval is the playback position interval corresponding to the non-highlight segment, and a highlight segment generation operation for the playback progress indicator control is detected, a highlight segment is generated based on the current playback position interval of the second progress bar.

[0024] In one embodiment, generating a highlight segment based on the current playback position interval of the second progress bar includes:

[0025] If there is no highlight segment within the current playback position interval of the second progress bar within the preset interval threshold, a separate highlight segment is generated based on the current playback position interval.

[0026] In one embodiment, generating a highlight segment based on the current playback position interval of the second progress bar includes:

[0027] If there are highlights within the preset interval threshold in the current playback position interval of the second progress bar, a merged highlight is generated based on the current playback position interval and the highlights within the preset interval threshold, and the merged highlight includes the highlights within the preset interval threshold.

[0028] In one embodiment, during the process of recording a target video, generating or marking at least one highlight segment of the target video includes:

[0029] During the process of recording the target video, if a highlight segment marking operation for the target video is detected, at least one highlight segment of the target video is generated or marked based on the video recording screen corresponding to the highlight segment marking operation.

[0030] In one embodiment, the video recording interface of the target video includes a highlight segment marking control. If a highlight segment marking operation is detected for the target video, at least one highlight segment of the target video is generated or marked based on the video recording screen corresponding to the highlight segment marking operation, including:

[0031] If a trigger operation for the highlight segment marking control is detected, at least one highlight segment of the target video is generated or marked based on the video recording screen corresponding to the trigger operation.

[0032] In one embodiment, during the process of recording a target video, generating or marking at least one highlight segment of the target video includes:

[0033] During the process of recording the target video, the highlight segment analysis information of the target video is generated; and according to the highlight segment analysis information, at least one highlight segment of the target video is generated or marked.

[0034] In one embodiment, the method further comprises:

[0035] The highlight segment analysis information is sent to the terminal, so that the terminal generates a highlight segment of the target video based on the highlight segment analysis information.

[0036] In one embodiment, the method further comprises:

[0037] Generate highlight clip prompt information of the target video according to the highlight clip;

[0038] The highlight clip prompt information is pushed to the target client of the terminal, so as to prompt the object with the highlight clip of the target video through the target client.

[0039] In one embodiment, during the process of recording a target video, generating analysis information of a highlight segment of the target video includes:

[0040] During the process of recording a target video, a highlight analysis process is performed on sampled video frames of the target video from at least one analysis dimension to obtain initial analysis results of the sampled video frames in different analysis dimensions; the initial analysis results are standardized to obtain target score information of the sampled video frames in different analysis dimensions; and based on the target score information of the sampled video frames in different analysis dimensions, highlight analysis information of the sampled video frames in the target video is determined.

[0041] In one embodiment, generating or marking at least one highlight segment of a target video based on the highlight segment analysis information includes:

[0042] The method comprises the following steps: taking a sampled video frame whose highlight segment analysis information is greater than a preset score threshold as a target video frame; determining an initial highlight segment based on the target video frame; performing segment processing on the initial highlight segment to obtain a processing result; and generating or marking at least one highlight segment of the target video based on the processing result.

[0043] In one embodiment, performing segment processing on the initial highlight segment to obtain the highlight segment includes:

[0044] The time intervals between the initial highlight segments are calculated; and the initial highlight segments whose time intervals are less than a preset time threshold are merged to obtain highlight segments.

[0045] In one embodiment, performing segment processing on the initial highlight segment to obtain the highlight segment includes:

[0046] Determine the total duration of each initial highlight segment; determine a total duration threshold of the highlight segments based on the duration of the target video; if the total duration is greater than the total duration threshold, perform segment processing on the initial highlight segments so that the total duration is no greater than the total duration threshold.

[0047] In one embodiment, if there are multiple initial highlight segments, the segment processing includes discarding the initial highlight segments so that the total duration is not greater than the total duration threshold, including:

[0048] Determine the priority of each initial highlight segment; determine the initial highlight segment to be discarded according to the priority; and discard the initial highlight segment to be discarded.

[0049] In one embodiment, if there is only one initial highlight segment, the segment processing includes a cropping process, in which the initial highlight segment is processed so that the total duration is not greater than a total duration threshold, including:

[0050] The number of sampled video frames that need to be cropped is determined according to the total duration and the total duration threshold; and the sampled video frames at the start position and the end position of the initial highlight segment are cropped according to the number of sampled video frames.

[0051] In a second aspect, the present application further provides a camera device, comprising:

[0052] A camera, configured to record target video;

[0053] at least one processor;

[0054] a display connected to the processor;

[0055] and a memory communicatively connected to the processor, the memory storing one or more computer programs including instructions; when the instructions are executed by the processor, the processor is configured to:

[0056] During the process of recording the target video by the camera, generating or marking at least one wonderful segment of the target video;

[0057] After the camera records the target video, upon receiving a playback instruction for the target video, controlling the display to display a playback interface of the target video;

[0058] Receive and respond to operation instructions for the highlight segment according to the playback interface.

[0059] In a third aspect, the present application further provides an image processing device, wherein the image processing device is communicatively connected to a camera device, and comprises:

[0060] one or more processors;

[0061] a display connected to the processor;

[0062] and a memory communicatively connected to the processor, the memory storing one or more computer programs including instructions; when the instructions are executed by the processor, the processor is configured to:

[0063] Acquire a target video recorded by the camera device, where the target video includes at least one highlight segment generated or marked during the recording of the target video;

[0064] When a playback instruction for the target video is received, controlling the display to display a playback interface of the target video;

[0065] Receive and respond to operation instructions for the highlight segment according to the playback interface.

[0066] In a fourth aspect, the present application further provides a video processing device, applicable to a camera device, comprising:

[0067] A generating module, configured to generate or mark at least one highlight segment of the target video during the process of recording the target video;

[0068] A display module is configured to display a playback interface of the target video after recording the target video if a playback instruction for the target video is received;

[0069] The response module is used to receive and respond to operation instructions for the highlight clips according to the playback interface.

[0070] In a fifth aspect, the present application further provides a computer device comprising a memory and a processor, wherein the memory stores a computer program, and the processor implements any of the video processing methods described in the first aspect when executing the computer program.

[0071] In a sixth aspect, the present application further provides a computer-readable storage medium having a computer program stored thereon, and when the computer program is executed by a processor, the video processing method described in any one of the first aspects above is implemented.

[0072] In a seventh aspect, the present application further provides a computer program product, comprising a computer program, which, when executed by a processor, implements the video processing method described in any one of the first aspects above.

[0073] The above-mentioned video processing method, camera device and image processing device are applicable to camera devices. First, during the process of recording the target video, at least one highlight segment of the target video is generated or marked. Then, after recording the target video, if a playback instruction for the target video is received, the playback interface of the target video is displayed, and the operation instruction for the highlight segment is received and responded to according to the playback interface. In this way, during the video recording, the target video is processed to obtain at least one highlight segment. After the target video is recorded, when the user triggers the playback instruction, the highlight segment can be displayed through the playback interface. The user can operate the highlight segment on the playback interface to complete the video processing of the target video. In this way, the user does not need to manually edit the target video, which is more convenient to operate. At the same time, the time-consuming processing process of the target video is completed synchronously during the video recording by generating or marking, which saves the time of video processing and improves the efficiency of video processing. BRIEF DESCRIPTION OF THE DRAWINGS

[0074] In order to more clearly illustrate the technical solutions in the embodiments of the present application or related technologies, the following briefly introduces the drawings required for use in the embodiments or related technical descriptions. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0075] FIG1 is a diagram illustrating an application environment of a video processing method according to an embodiment;

[0076] FIG2 is a schematic flow chart of a video processing method according to an embodiment;

[0077] FIG3 is a schematic flow chart of a video processing method in another embodiment;

[0078] FIG4 is a schematic diagram of an interface of a video processing method in another embodiment;

[0079] FIG5 is a schematic diagram of an interface of a video processing method in another embodiment;

[0080] FIG6 is a schematic flow chart of a video processing method in another embodiment;

[0081] FIG7 is a schematic diagram of an interface of a video processing method in another embodiment;

[0082] FIG8 is a schematic flow chart of a video processing method in another embodiment;

[0083] FIG9 is a schematic diagram of an interface of a video processing method in another embodiment;

[0084] FIG10 is a schematic diagram of an interface of a video processing method in another embodiment;

[0085] FIG11 is a schematic diagram of an interface of a video processing method in another embodiment;

[0086] FIG12 is a schematic diagram of an interface of a video processing method in another embodiment;

[0087] FIG13 is a schematic diagram of an interface of a video processing method in another embodiment;

[0088] FIG14 is a schematic flow chart of a video processing method in another embodiment;

[0089] FIG15 is a schematic flow chart of a video processing method in another embodiment;

[0090] FIG16 is a schematic flow chart of a video processing method in another embodiment;

[0091] FIG17 is a structural block diagram of a video processing device according to an embodiment;

[0092] FIG18 is a diagram showing the internal structure of a computer device in one embodiment. DETAILED DESCRIPTION

[0093] In order to make the purpose, technical solutions and advantages of this application more clear, the following further describes this application in detail with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain this application and are not intended to limit this application.

[0094] The video processing method provided in the embodiment of the present application can be applied to the application environment shown in Figure 1. For example, the terminal 102 can communicate with the camera 104 through a network, a card reader, a Universal Serial Bus (USB), etc. The terminal 102 can be, but is not limited to, various personal computers, laptops, smart phones, tablet computers, Internet of Things devices, and portable wearable devices. The Internet of Things devices can be smart TVs, smart car devices, etc. The portable wearable devices can be smart watches, etc. The terminal 102 can be installed with a target client program that can control the camera 104. The camera 104 can be, but is not limited to, various devices that can realize the shooting function, such as cameras, video cameras, drones, and other devices that can be used to capture images.

[0095] The camera 104 may include a display, for example, a touch screen. In some embodiments, the touch screen may be less than or equal to 3 inches in size, for example, less than or equal to 2.5 inches in size, for example, 1.5 inches, 2.0 inches, 2.25 inches, 2.27 inches, 2.3 inches, etc.

[0096] In one embodiment, as shown in FIG2 , a video processing method is provided, which is described by taking the method applied to the camera 104 in FIG1 as an example, and includes the following steps 201 to 203 . Among them:

[0097] Step 201: During the process of recording a target video, generate or mark at least one highlight segment of the target video.

[0098] The target video is a video recorded by the user, and the highlight clips can be high-quality clips from the target video. Through the highlight clips, the user can quickly understand the content of the target video. They can also be used to generate new videos and edit the target video. Optionally, the highlight clips can be automatically generated during the recording of the target video or manually annotated by the user during the recording of the target video.

[0099] For example, the highlight clips of the target video may include video clips of highlight moments in the target video, such as smiling faces, cheering, shaking arms, sports close-ups, interesting objects, high artistic sense, and interesting actions.

[0100] For example, when a camera device is recording a target video, it can edit out at least one wonderful segment of the target video; for another example, when a camera device is recording a target video, it can mark out at least one wonderful segment of the target video, so that after recording the target video, if a playback instruction for the target video is received, the playback interface of the target video is displayed, and the operation instruction for the wonderful segment is received and responded to according to the playback interface.

[0101] Step 202: After recording the target video, if a playback instruction for the target video is received, a playback interface of the target video is displayed.

[0102] The playback instruction for the target video can be a user entering a playback page, for example, by swiping left on the current interface to enter the playback page. After recording the target video, if a playback instruction for the target video is received, the highlight clips of the target video can be obtained, and at least one of the position of the highlight clips in the target video and the number of highlight clips can be further determined. The playback interface can display information about the highlight clips of the target video, and optionally, the number of highlight clips or the position of the highlight clips in the target video.

[0103] The process of obtaining the number and positions of the highlight clips of the target video may be shown in FIG3 .

[0104] S301, GUI (Graphical User Interface) sends a request for obtaining wonderful information to GUI middleware.

[0105] S302: The GUI middleware sends a request for obtaining the number of highlight clips to the highlight service module.

[0106] S303, the wonderful business module obtains wonderful information.

[0107] S304, the highlight service module returns the number of highlight clips to the GUI middleware.

[0108] S305: The GUI middleware returns the number of highlight clips to the GUI.

[0109] S306: The GUI sends a request to obtain the location of the highlight clip to the GUI middleware.

[0110] S307: The GUI middleware sends a request for obtaining the location of the highlight segment to the highlight service module.

[0111] S308, the wonderful business module obtains wonderful information.

[0112] S309, the highlight service module returns the location of the highlight segment to the GUI middleware.

[0113] S310: The GUI middleware returns the location of the highlight clip to the GUI.

[0114] S311, the GUI displays the highlight clip in the play progress bar according to the position of the highlight clip.

[0115] Step 203: Receive and respond to operation instructions for the highlight clip according to the playback interface.

[0116] Optionally, you can operate on the highlight clips in the playback interface. For example, you can click the highlight clip display control of the highlight clip to play the highlight clip in the target video, thereby quickly replaying the target video. You can also export the highlight clips through operating instructions.

[0117] It is worth noting that the controls in this application may be in the form of icons, input boxes, buttons, etc. This application does not limit this and will not be elaborated on later.

[0118] In the above embodiment, which is applicable to camera devices, first, during the process of recording the target video, at least one highlight segment of the target video is generated or marked. Then, after recording the target video, if a playback instruction for the target video is received, the playback interface of the target video is displayed, and the operation instruction for the highlight segment is received and responded to according to the playback interface. In this way, during the video recording, the target video is processed to obtain at least one highlight segment. After the target video is recorded, when the user triggers the playback instruction, the highlight segment can be displayed through the playback interface. The user can operate the highlight segment on the playback interface to complete the video processing of the target video. In this way, the user does not need to manually edit the target video, which is more convenient to operate. At the same time, the time-consuming processing process of the target video is completed synchronously during the video recording by generating or marking, which saves the time of video processing and makes the video processing more efficient.

[0119] In one embodiment, the playback interface may include a highlight display control, and receiving and responding to operation instructions for the highlight according to the playback interface may include: if a trigger operation for the highlight display control is detected, then displaying the highlight playback interface, and playing the highlight based on the highlight playback interface in a loop.

[0120] It is worth noting that the trigger operation in this application can be a specific touch operation, such as a single-click operation, a long-press operation, a double-click operation, and a sliding operation, etc., or it can be triggered by voice; optionally, the trigger operation can also be a combination of a series of operations, and this application has no restrictions on this.

[0121] In one embodiment, the highlight segment display control may include quantity indication information, where the quantity indication information indicates the number of highlight segments in the target video.

[0122] For example, the highlight display control is shown as 401 in FIG4 . If a user clicks the highlight display control and a trigger operation is detected for the highlight display control, the highlight playback interface is entered and the highlight clips in the target video are played. The target video can have one or more highlight clips. After a highlight clip is played, the user can directly jump to the next one, and the playback is automatically looped. The quantity indication information is shown as 402 in FIG4 . For example, if the quantity indication information is 3, it means that there are three highlight clips in the target video, and all three highlight clips are played in a loop.

[0123] In the above embodiment, if a triggering operation of the highlight segment display control is detected, the highlight segments can be played in a loop and the number of highlight segments can be displayed at the same time to facilitate browsing by the user.

[0124] In one embodiment, the highlight playback interface may further include a summary information list of the highlight clips, the summary information list may include a summary indicator control of at least one highlight clip, the summary indicator control indicates the summary information of the corresponding highlight clip, and the loop playback of the highlight clips based on the highlight playback interface may include: in the process of loop playback of the highlight clips based on the highlight playback interface, displaying the summary indicator control corresponding to the currently playing highlight clip based on the target display effect, the target display effect is used to distinguish the summary indicator control of the currently playing highlight clip from the summary indicator controls of other highlight clips.

[0125] To facilitate the user's preview of highlights, the highlight playback interface may further include a summary information list of the highlights. The summary information list may include summary indicator controls corresponding to each highlight. The summary indicator controls may display summary information of the corresponding highlight. The summary information may serve as a simple summary of the highlight. For example, the summary information may be the duration of each highlight, the number of each highlight, a thumbnail of each highlight, a partial screenshot of a video frame in each highlight, or user-defined settings for each highlight, etc. During loop playback of the highlight, the summary indicator control of the currently playing highlight is displayed according to the target display effect. The target display effect may distinguish the summary indicator control of the currently playing highlight from the summary indicator controls of other highlight clips, making it easier for the user to confirm which highlight clip is currently playing. Optionally, the target display effect may be highlighting the summary indicator control, framing the summary indicator control, changing the color of the summary indicator control, or changing the size of the summary indicator control.

[0126] Optionally, you can use the summary indicator control for a highlight segment to switch between them, triggering the summary indicator control to play the highlight segment corresponding to the summary indicator control. As shown in Figure 5, 501 in the figure shows one implementation of the summary indicator control for a highlight segment. Three summary indicator controls correspond to three highlight segments, and each summary indicator control specifically displays summary information about the duration of the corresponding highlight segment. As shown in Figure 5, the currently playing highlight segment is Highlight 2, and the summary indicator control corresponding to the second highlight segment is framed, prompting the user that the currently playing highlight segment is Highlight 2.

[0127] Optionally, the playback process of the highlight clips may be as shown in FIG6 .

[0128] S601, enter the player.

[0129] S602: The user sends a play instruction through the GUI.

[0130] For example, trigger the highlight clip display control.

[0131] S603: The highlight service module sends a command to search for the first highlight segment to the player.

[0132] S604: The player plays the first highlight clip and returns to the highlight service module after the playback is completed.

[0133] S605: The highlight service module sends a command to the GUI to update the playback status and then automatically switches to the next highlight segment.

[0134] S606: The highlight service module sends a command to search for the second highlight segment to the player.

[0135] S607, the player plays the second highlight clip, and after the playback is completed, returns to the highlight service module.

[0136] S608: The highlight service module sends an instruction to the GUI to update the index of the highlight segment.

[0137] S609: The user triggers a play pause operation in the GUI.

[0138] S610: The exciting service module forwards the pause operation to the player.

[0139] S611: The player stops playing and returns to the pause completion module.

[0140] S612: The exciting service module returns to the GUI to update the playback status.

[0141] S613: The user triggers the playback start operation in the GUI.

[0142] S614: The exciting service module forwards the message to the player again.

[0143] S615: The player restarts the playback and returns a message indicating that the restart was successful to the exciting service module.

[0144] S616, the exciting service module sends a command to the GUI to update the playback status.

[0145] There are many ways to switch highlight clips. For example, one way is to switch highlight clips during playback, and another way is to switch highlight clips after pausing. The process of switching highlight clips during playback is shown in steps S617 to S620 below.

[0146] S617, the user sends a switch highlight segment instruction to the highlight service module through the GUI.

[0147] Optionally, this can be toggled via the highlight summary indicator control.

[0148] S618: The highlight service module sends the nth highlight clip after the search and switching to the player.

[0149] S619: The player plays the nth wonderful clip and returns to the wonderful service module after the playback is completed.

[0150] S620: The highlight service module sends an instruction to the GUI to update the index of the highlight segment.

[0151] The process of switching segments after pausing is shown in steps S621 to S632 below.

[0152] S621: The user triggers the play pause operation in the GUI.

[0153] S622: The exciting service module forwards the pause operation to the player.

[0154] S623: The player stops playing and returns to the pause completion module.

[0155] S624, the exciting service module returns to the GUI to update the playback status.

[0156] S625, the user sends a switching segment instruction to the exciting business module in the GUI.

[0157] S626, the wonderful service module sends the nth wonderful clip after the switch to the player.

[0158] S627: The player finds the nth wonderful clip and then returns to the wonderful service module.

[0159] S628: The wonderful service module returns to the GUI to update the index of the wonderful segment to be played.

[0160] S629: If the user triggers the play start operation in the GUI.

[0161] S630: The highlight service module sends a request to find the nth highlight segment to the player.

[0162] S631: The player plays the nth highlight clip and returns to the highlight service module after the playback is completed.

[0163] S632: The exciting service module returns to the GUI to update the playback status.

[0164] In one embodiment, to automatically edit a target video, generated highlight clips can be automatically exported. The highlight clip playback interface can further include a highlight clip export control. The method can further include: upon detecting a trigger operation on the highlight clip export control, exporting the highlight clip corresponding to the selected summary indicator control. The user can export the highlight clip by triggering the highlight clip export control. The highlight clip export control can be shown as 701 in FIG. 7 .

[0165] For example, the highlight playback interface may further include a highlight selection control. During loop playback of highlight clips based on the highlight playback interface, if a trigger operation on the highlight selection control is detected, a selection box may be displayed on the summary indicator control corresponding to each highlight clip. The highlight clip corresponding to the summary indicator control may be selected by triggering the selection box. After the selection is completed, the highlight clip corresponding to the selected summary indicator control may be exported by triggering the highlight export control.

[0166] Optionally, considering that the target video may include at least one highlight segment, there may be multiple ways to export the highlight segments. That is, after the selection is completed, the highlight segment export control is triggered to export the highlight segment corresponding to the selected summary indicator control. Specifically, the following methods may be used:

[0167] If a trigger operation for the highlight clip export control is detected, the export interface is displayed.

[0168] The export interface includes at least one export type control.

[0169] According to the export type corresponding to the selected export type control, the highlight clip corresponding to the selected summary indicator control is exported.

[0170] There are many ways to export highlight clips. For example, multiple highlight clips can be exported separately to obtain video files corresponding to each highlight clip. The export type corresponding to this highlight clip export method can be a segmented export type.

[0171] For example, multiple highlight clips can be merged to obtain at least one merged highlight clip, and then each merged highlight clip can be exported separately to obtain a video file corresponding to each merged highlight clip. The export type corresponding to this highlight clip export method can specifically be a merged export type.

[0172] It is worth noting that in actual applications, there are various ways to merge multiple highlight clips. As an example, multiple highlight clips can be merged into a single merged highlight clip. As another example, multiple highlight clips can be merged according to different strategies to obtain multiple merged highlight clips: for example, based on the highlight clip analysis information of each highlight clip, highlight clips with similar scores corresponding to the highlight clip analysis information can be merged; for example, based on the objects of interest in each highlight clip, highlight clips with the same objects of interest can be merged; for example, based on the image parameters such as brightness and color distribution of each highlight clip, highlight clips with similar image attributes can be merged; and so on.

[0173] Optionally, the export type may include a segmented export type and a merged export type. According to the export type corresponding to the selected export type control, the highlight clip corresponding to the selected summary indicator control is exported, which may include:

[0174] If the export type corresponding to the selected export type control is the segmented export type, the highlight segments corresponding to the selected summary indicator control will be exported separately. In other words, the highlight segments corresponding to the selected summary indicator control will be exported as independent video files.

[0175] If the selected export type control corresponds to the merge export type, the highlight clips corresponding to the selected summary indicator control are merged and exported. In other words, the highlight clips corresponding to the selected summary indicator control are merged into at least one, and then the at least one video file is exported.

[0176] It is worth noting that there are many ways to implement the export processing of relevant highlight clips. For example, the camera can edit the relevant highlight clips from the target video. For another example, the camera can edit the relevant highlight clips from the target video through the terminal device.

[0177] For example, the export process of highlight clips is shown in FIG8 .

[0178] S801: The user selects to export a file through the GUI and sends it to the player.

[0179] S802: The player sends a disk space query request to the file manager.

[0180] S803: The file manager returns the created file name.

[0181] S804: The player creates a Muxer through the encapsulation module Muxer.

[0182] S805, Muxer returns a handle.

[0183] S806: The player sends a decapsulation request to the decapsulation module Demux.

[0184] S807, Demux determines the exciting interval.

[0185] S808, then write the media data to the Muxer.

[0186] S809: The Muxer writes the completed frame until the Demux requests the next frame.

[0187] S810, until the writing of the highlight clip is completed.

[0188] S811, the Muxer returns the completion status to notify the player.

[0189] S812: The player notifies the UI that the export is complete.

[0190] In the above embodiment, by selecting and exporting the highlight clips, the user can easily complete the editing of the target video, thereby reducing the complexity of video processing.

[0191] In one embodiment, the playback interface may further include video playback controls, and the method may further include:

[0192] If a trigger operation for the video playback control is detected, the target video is played, and during the playback of the target video, the playback position interval corresponding to the wonderful clip in the target video is displayed on the first progress bar of the target video.

[0193] The video playback control can be used to trigger the playback of the target video. The playback page can simultaneously display the video playback control and the highlight playback control so that the user can choose to view the target video or the highlight. For example, the video playback control can be shown as 901 in Figure 9. During the playback of the target video, a first progress bar of the target video is displayed. The first progress bar can display the playback position intervals corresponding to the highlight and non-highlight segments included in the target video. In this way, during the playback of the target video, the playback progress indicator control on the first progress bar can move to different positions on the first progress bar corresponding to the video playback progress, so as to indicate the current playback progress of the target video.

[0194] Optionally, the playback position interval corresponding to the wonderful clip can be distinguished by highlighting the first progress bar, changing the display color, adjusting the display transparency, or adjusting the display size. For example, the first progress bar can be as shown as 1001 in Figure 10, where there are two wonderful clips in the first progress bar 1001, such as the white part in the first progress bar 1001.

[0195] Optionally, the playback interface may further include a highlight clip editing control, and the highlight clip may be edited during the playback of the target video. The steps may include:

[0196] If a trigger operation for the highlight editing control is detected during the playback of the target video, the current playback progress of the target video is displayed in real time on the second progress bar of the target video. For example, the highlight editing control can be shown as 1002 in Figure 10.

[0197] Among them, the second progress bar is used to display the playback position interval corresponding to the wonderful clips in the target video. Specifically, the second progress bar can be used to display the playback position interval corresponding to the local video clips in the target video. The local video clips include the currently playing video clips and some video clips adjacent to the currently playing video clips. In this way, as the target video is played, the playback position interval displayed on the second progress bar will also change in real time.

[0198] The size of the second progress bar can be set to be larger than the size of the first progress bar so that the user can more conveniently edit the video segment currently playing in the target video on the camera device. For example, the width of the second progress bar can be larger than the width of the first progress bar, which makes it more convenient for the user to edit the video segment of the target video on the camera device. For example, the second progress bar can be shown as 1101 in Figure 11.

[0199] Optionally, a playback progress indicator control may be provided at a preset position of the second progress bar, and the playback progress indicator control indicates the current playback progress of the target video. The method may further include:

[0200] If the play progress indicator control indicates that the currently played video segment interval is the play position interval corresponding to the highlight segment, and a highlight segment deletion operation for the play progress indicator control is detected, the currently played highlight segment is modified to a non-highlight segment.

[0201] For example, the preset position can be a fixed position. For example, a play progress indicator control can be set in the middle of the second progress bar, and as the target video is played, the play position intervals corresponding to different local video clips in the target video can be scrolled in real time on the second progress bar. Since the play progress indicator control is fixedly displayed in the middle of the second progress bar, during the playback of the target video, if the play position interval of the video clip overlaps with the position of the play progress indicator control, the video clip indicated by the play progress indicator control can be determined as the video clip currently playing in the target video.

[0202] For example, the preset position can be a position specified by the user. For example, the user can set the position of the playback progress indicator control on the second progress bar by dragging, double-clicking, single-clicking, long pressing, etc., so that when the user holds the camera device with one hand, he can still conveniently use the playback progress indicator control to edit the wonderful clips in the target video.

[0203] The target video may include multiple highlight segments and multiple non-highlight segments. For example, video segments other than the highlight segments in the target video may be determined as non-highlight segments. The play progress indicator control indicates whether the currently playing video segment is a highlight segment or a non-highlight segment. When the current play position segment is a highlight segment, the play progress indicator control may be displayed in a first state as shown in 1102 in FIG. 11. If a highlight segment deletion operation is detected for the play progress indicator control, for example, if a user triggering operation is detected for the play progress indicator control in the first state, the currently playing video segment may be modified from a highlight segment to a non-highlight segment.

[0204] If the playback progress indicator control indicates that the currently played video segment interval is a playback position interval corresponding to a non-highlight segment, and a highlight segment generation operation for the playback progress indicator control is detected, a highlight segment can be generated based on the current playback position interval of the second progress bar.

[0205] As an example, if the currently playing segment corresponds to a playback position interval corresponding to a non-highlight segment, the playback progress indicator control may be displayed in the second state as shown in 1201 in FIG. 12 . If a highlight segment generation operation for the playback progress indicator control is detected, for example, if a user triggering operation for the playback progress indicator control in the second state is detected, a highlight segment may be generated based on the currently playing non-highlight segment. Optionally, to prevent the selected segments from being overly fragmented, generating a highlight segment based on the current playback position interval of the second progress bar may include:

[0206] In the first case, if there is no highlight segment within the current playback position interval of the second progress bar within the preset interval threshold, a separate highlight segment is generated based on the current playback position interval.

[0207] If there are no other highlights within the preset interval threshold of the current playback position interval when the user triggers the playback progress indicator control, a separate highlight segment can be generated in the current playback position interval. Optionally, a highlight segment of preset length can be generated, or a highlight segment can be generated based on the user's operation of the playback progress indicator control. For example, the time from the user long pressing the playback progress indicator control to the user releasing the playback progress indicator control is used as the time of the generated highlight segment.

[0208] In the second case, if there are highlights within the preset interval threshold in the current playback position interval of the second progress bar, a merged highlight can be generated based on the current playback position interval and the highlights within the preset interval threshold, and the merged highlight includes the highlights within the preset interval threshold.

[0209] If there is a highlight segment within the preset interval threshold in the current playback position interval, the current playback position interval and the highlight segment within the preset interval threshold can be merged into one highlight segment, and the information of the modified highlight segment can be saved in the target video.

[0210] In the above embodiment, a first progress bar is displayed during the playback of the target video, and a second progress bar is displayed when the highlight clip editing control is triggered. The playback progress indicator control of the second progress bar can edit the highlight clips, which is more flexible to use. At the same time, during the editing process, the highlight clips within the preset interval threshold are judged to avoid the generated highlight clips being too fragmented.

[0211] In one embodiment, during the process of recording a target video, generating or marking at least one highlight segment of the target video may include:

[0212] During the process of recording the target video, if a highlight segment marking operation for the target video is detected, at least one highlight segment of the target video is generated or marked based on the video recording screen corresponding to the highlight segment marking operation.

[0213] The highlight segment marking operation can be performed by a specific touch operation, such as a single-click operation, a long-press operation, a double-click operation, and a sliding operation, etc., or it can be triggered by voice; optionally, the highlight segment marking operation can also be a combination of a series of operations.

[0214] For example, detecting a highlight mark operation for a target video may be detecting that a user has marked a highlight by triggering a control or other operation, thereby enabling the user to customize the highlight segments in the target video. After detecting a highlight mark operation for the target video, the highlight segments are obtained based on the video recording frame currently corresponding to the highlight mark operation.

[0215] Optionally, the video recording interface of the target video may include a highlight marking control. For example, the highlight marking control may be shown as 1301 in FIG. 13 . If a highlight marking operation for the target video is detected, then generating or marking at least one highlight segment of the target video based on the video recording screen corresponding to the highlight marking operation may include:

[0216] If a trigger operation for the highlight segment marking control is detected, at least one highlight segment of the target video is generated or marked based on the video recording screen corresponding to the trigger operation.

[0217] Optionally, a method of detecting a trigger operation for a highlight marking control and generating or marking at least one highlight segment of the target video may include generating a highlight segment of a preset length after detecting one operation for the highlight marking control, or generating a highlight segment based on a video recording screen corresponding to the time between the two operations after detecting two operations for the highlight marking control.

[0218] In the above embodiment, during the recording process of the target video, the user can mark the target video through the highlight segment marking control to generate or annotate at least one highlight segment of the target video, thereby facilitating subsequent video editing based on the highlight segment and making the generation of highlight segments more convenient.

[0219] In one embodiment, during the process of recording a target video, generating or marking at least one highlight segment of the target video may include:

[0220] During the process of recording the target video, the highlight segment analysis information of the target video is generated; and according to the highlight segment analysis information, at least one highlight segment of the target video is generated or marked.

[0221] The highlight analysis information is generated based on a highlight analysis process performed on the target video during video recording. Optionally, during the recording process of the target video, a preset algorithm can be used to analyze and determine highlight analysis information for the highlight segments in the target video. Based on the highlight analysis information, at least one highlight segment of the target video can be generated or annotated. In this way, the camera device can generate or annotate at least one highlight segment of the target video while recording the target video.

[0222] In one embodiment, after performing highlight analysis on a target video during video recording and generating highlight analysis information of the target video, the camera device may further transmit the highlight analysis information to the terminal, so that the terminal can also generate at least one highlight segment of the target video based on the highlight analysis information. Specifically, the method may further include:

[0223] The highlight analysis information is sent to the terminal, so that the terminal generates highlight clips of the target video based on the highlight analysis information. The camera sends the highlight analysis information generated during video recording to the terminal, which is installed with a target client. The terminal can generate highlight clips of the target video based on the received highlight analysis information through the target client. For example, the terminal can edit highlight clips from the target video based on the received highlight analysis information through the target client.

[0224] Optionally, after the camera automatically generates a highlight clip, it can also prompt the user to view it, including:

[0225] Generate highlight clip prompt information of the target video based on the highlight clip, and push the highlight clip prompt information to the target client of the terminal so as to prompt the target video highlight clip to the object through the target client.

[0226] The highlight clip prompt information can be a message notification, etc. After the camera generates or marks a highlight clip, it can generate a highlight clip prompt information corresponding to the target video, and then send the highlight clip prompt information to the target client of the terminal, so that the user can view the highlight clip of the target video through the target client. After receiving the highlight clip prompt information, the user can choose to view the highlight clip of the target video according to the highlight clip prompt information, or not to view it.

[0227] In the above embodiment, the camera can generate or mark highlight clips based on the target video, or communicate with the terminal, and the terminal generates highlight clips. After generating the highlight clips, it can also generate highlight clip prompt information and send it to the target client of the terminal to remind the user to view it, which is more flexible to use.

[0228] In an embodiment of the present application, in order to automatically edit a target video using highlight clips, it is necessary to first determine the highlight clips in the target video, that is, perform highlight clip analysis processing on the target video. As shown in FIG14 , during the recording of the target video, the highlight clip analysis information of the target video is generated, which may include:

[0229] Step 1401 : During the process of recording a target video, a highlight segment analysis process is performed on a sampled video frame of the target video from at least one analysis dimension to obtain initial analysis results of the sampled video frame in different analysis dimensions.

[0230] Video analysis is generally performed by sampling video frames, such as analyzing five frames per second. The analysis dimensions can include performing highlight segment analysis on the sampled video frames of the target video using different analysis algorithms, which may include at least one of an object detection algorithm, an action recognition algorithm, and an aesthetic evaluation algorithm. The initial analysis results are those obtained based on the different analysis dimensions. Optionally, the object detection algorithm can detect objects in the sampled video frames, the action recognition algorithm can identify actions in the sampled video frames, such as arm waving and various sports movements, and the aesthetic evaluation algorithm can extract image features from the sampled video frames to score the aesthetic results of the sampled video frames. Optionally, an expression recognition algorithm can also be included to identify expressions in the sampled video frames, such as smiling faces and crying expressions. A sound recognition algorithm can also be included to detect sounds in the target video, such as cheering, laughter, and singing, and determine the sampled video frames where the sounds occur.

[0231] Step 1402 : normalize the initial analysis results to obtain target score information of the sampled video frames in different analysis dimensions.

[0232] The initial analysis results for different analysis dimensions are standardized separately to obtain target score information for the sampled video frames corresponding to the different analysis dimensions. For example, an object detection algorithm can detect objects in a sampled video frame and assign a higher score (e.g., 10) to interesting objects, such as artistic sculptures, while assigning a lower score (e.g., 1) to common objects, such as chairs. In other words, the initial analysis results are standardized to convert them into a unified score. The same standardization is performed on different analysis dimensions to obtain target score information for the sampled video frames corresponding to the different analysis dimensions. For example, if an object detection algorithm recognizes three frames of a 1-second sampled video frame on a 2-second video, the target score information for the object detection algorithm may be in the format [0, 1, 0, 2, 4, 9].

[0233] Step 1403 : Determine the highlight analysis information of the sampled video frames in the target video based on the target score information of the sampled video frames in different analysis dimensions.

[0234] For each sampled video frame, the initial scores corresponding to different types of highlight segment analysis algorithms are statistically processed to obtain the analysis score of the sampled video frame.

[0235] The target score information of the sampled video frames in different analysis dimensions is statistically processed to determine highlight analysis information of the sampled video frames in the target video. The statistical processing can be weighted calculation of the initial scores obtained by different types of highlight analysis algorithms according to the importance of the highlight analysis algorithms, with more important highlight analysis algorithms being given higher weights. After the weighted calculation, the analysis scores of the sampled video frames are obtained, and the analysis scores are then used as the highlight analysis information.

[0236] Optionally, you can save the highlight analysis information to the target video or other configuration files, so that you can analyze the highlight analysis information when you need to replay the target video. Optionally, you can use the Analysis Assistant control to determine whether to perform highlight analysis on the target video while recording it. If you need to perform highlight analysis on the target video before recording it, open the Analysis Assistant control. If you do not need to perform highlight analysis during recording, close the Analysis Assistant control.

[0237] In one embodiment, the steps of displaying the playback interface of the target video according to the highlight segment analysis information are shown in FIG15 and include:

[0238] Step 1501: The sampled video frames whose highlight segment analysis information is greater than a preset score threshold are used as target video frames.

[0239] The preset score threshold may be set by the user, and the sampled video frames whose highlight segment analysis scores are greater than the preset score threshold are determined as target video frames.

[0240] Step 1502: Determine an initial highlight segment based on the target video frame.

[0241] Multiple target video frames are combined to form initial highlight clips. For example, if the preset score threshold is set to 3, all sampled video frames with an analysis score greater than 3 are selected as target video frames. When the highlight clip analysis information is [(1,1), (2,3), (3,5), (4,3), (5,2), (6,3)], where the first number is the sampled video frame number and the second number is the analysis score, the target video frames can be determined to be [(2,3), (3,5), (4,3)] and [(6,3)]. Based on the target video frames, two initial highlight clips can be determined.

[0242] Step 1503: perform segment processing on the initial highlight segment to obtain a processing result.

[0243] Step 1504: Generate or mark at least one highlight segment of the target video based on the processing result.

[0244] If the initial highlights are too fragmented or the total duration is too long, you need to process the initial highlights. There are two cases for fragment processing:

[0245] In the first case, the time intervals between the initial highlight segments are calculated; the initial highlight segments whose time intervals are less than a preset time threshold are merged to obtain highlight segments.

[0246] To improve the continuity of highlight clips, similar initial highlight clips can be merged. The time interval between each initial highlight clip is calculated. If the time interval is less than a preset time threshold, indicating that the two initial highlight clips are very close together, they can be merged to ensure the continuity of the highlight clips. The preset time threshold can be set by the user. For example, if the preset time threshold is set to 0.5 seconds, all initial highlight clips with a time interval less than 0.5 seconds will be merged into a single highlight clip.

[0247] In the second case, the total duration of each initial highlight segment is determined; based on the duration of the target video, a total duration threshold of the highlight segments is determined; if the total duration is greater than the total duration threshold, the initial highlight segments are segmented so that the total duration is no greater than the total duration threshold.

[0248] If the duration of a highlight clip is too long and not nearly as long as the target video, then the highlight clip's purpose has not been achieved, and therefore fragment processing is required. The total duration threshold is determined based on the target video's duration and can optionally be calculated by dividing the target video's duration by a ratio. The total duration of each initial highlight clip cannot exceed the total duration threshold. If the total duration exceeds the total duration threshold, meaning the total duration of each initial highlight clip is too long and fails to help users improve the efficiency of editing and playback of the target video, fragment processing can be performed on the initial highlight clips to bring the total duration within the required range.

[0249] Optionally, the fragment processing may include discarding or cropping. If there are multiple initial highlight fragments, the fragment processing includes discarding, and the initial highlight fragments are fragmented so that the total duration is not greater than the total duration threshold, including: determining the priority of each initial highlight fragment; determining the initial highlight fragment that needs to be discarded based on the priority; and discarding the initial highlight fragment that needs to be discarded.

[0250] When there are multiple initial highlight segments, the average score of each is calculated and the priority of each initial highlight segment is determined based on the average score: a higher average score is given a higher priority, and a lower average score is given a lower priority. Optionally, initial highlight segments with lower priorities are identified as initial highlight segments to be discarded, and these initial highlight segments are discarded until the total duration of each initial highlight segment does not exceed the total duration threshold. For example, when the preset duration is three sampled video frames, there are two initial highlight segments, [(1,3), (2,3)] and [(4,3), (5,4)], with a total length of four sampled video frames, exceeding the length limit of three. Therefore, one initial highlight segment needs to be discarded. The average score of the first initial highlight segment is (3+3) / 2=3, and the average score of the second initial highlight segment is (3+4) / 2=3.5. The first initial highlight segment has a lower average score, which means it has a lower priority. Therefore, the first initial highlight segment is discarded, while the second initial highlight segment is retained. At this point, the duration limit is met.

[0251] Optionally, if there is only one initial highlight segment, the segment processing includes cropping processing, and the initial highlight segment is segmented so that the total duration is not greater than the total duration threshold, including: determining the number of sampled video frames that need to be cropped based on the total duration and the total duration threshold; and cropping the sampled video frames at the start position and the end position of the initial highlight segment based on the number of sampled video frames cropped.

[0252] Among them, if there is only one initial highlight segment and it cannot be discarded, the initial highlight segment can be cropped. The number of sample video frames to be cropped is determined according to the total duration and the total duration threshold. For example, when the total duration threshold is 3 sample video frames, there is only one initial highlight segment, which is [(2,3), (3,5), (4,3), (5,2), (6,3)]. It can be determined that the number of sample video frames to be cropped is 2, that is, 2 sample video frames need to be cropped. Through the center cropping method, 1 sample video frame is cropped at each end of the initial highlight segment, that is, the sample video frames at the starting position and the end position of the initial highlight segment are cropped to obtain the initial highlight segment [(3,5), (4,3), (5,2)]. At this time, the initial highlight segment meets the duration limit.

[0253] After the highlight segments are determined, the playback interface of the target video may be displayed according to the information of the highlight segments, and the number of the highlight segments and the positions of the highlight segments in the target video may be displayed.

[0254] In the above embodiment, during the recording process of the target video, the target video is analyzed through at least one analysis dimension, and then the highlight segments are determined when the user plays back the video. Since the long-term operation of analysis is placed in the recording process of the target video, the highlight segments can be quickly determined during playback, thereby improving the efficiency of generating highlight segments.

[0255] In an embodiment of the present application, please refer to FIG16 , which shows a flow chart of a video processing method provided in an embodiment of the present application. The video processing method includes the following steps:

[0256] Step 1601 : During the process of recording a target video, a highlight segment analysis process is performed on a sampled video frame of the target video from at least one analysis dimension to obtain initial analysis results of the sampled video frame in different analysis dimensions.

[0257] Step 1602 : normalize the initial analysis results to obtain target score information of the sampled video frames in different analysis dimensions.

[0258] Step 1603 : Determine the highlight analysis information of the sampled video frames in the target video based on the target score information of the sampled video frames in different analysis dimensions.

[0259] Step 1604 : The sampled video frames whose highlight segment analysis information is greater than a preset score threshold are used as target video frames.

[0260] Step 1605: Determine an initial highlight segment based on the target video frame.

[0261] Step 1606: perform segment processing on the initial highlight segment to obtain a processing result.

[0262] Step 1607: Generate or mark at least one highlight segment of the target video based on the processing result.

[0263] Step 1608: After recording the target video, if a playback instruction for the target video is received, the playback interface of the target video is displayed.

[0264] Step 1609: Receive and respond to operation instructions for the highlight clip according to the playback interface.

[0265] It should be understood that, although the various steps in the flowcharts involved in the various embodiments described above are displayed in sequence according to the instructions of the arrows, these steps are not necessarily executed in sequence in the order indicated by the arrows. Unless otherwise specified herein, there is no strict order restriction on the execution of these steps, and these steps can be executed in other orders. Moreover, at least a portion of the steps in the flowcharts involved in the various embodiments described above can include multiple steps or multiple stages, and these steps or stages are not necessarily executed and completed at the same time, but can be executed at different times, and the execution order of these steps or stages is not necessarily to be carried out in sequence, but can be executed in turn or alternately with other steps or at least a portion of steps or stages in other steps.

[0266] Based on the same inventive concept, the embodiments of the present application further provide a video processing device for implementing the aforementioned video processing method. The implementation solution provided by the device is similar to the implementation solution described in the aforementioned method. Therefore, the specific limitations in one or more video processing device embodiments provided below can be found in the above-mentioned limitations on the video processing method and will not be repeated here.

[0267] In an exemplary embodiment, as shown in FIG17 , a video processing apparatus is provided, which is applicable to a camera device and includes: a generating module, a display module, and a responding module, wherein:

[0268] An acquisition module, configured to generate or mark at least one highlight segment of a target video during the process of recording the target video;

[0269] A display module is configured to display a playback interface of the target video after recording the target video if a playback instruction for the target video is received;

[0270] The response module is used to receive and respond to operation instructions for the highlight clips according to the playback interface.

[0271] In one embodiment, the playback interface includes a highlight display control, and a response module, which is specifically used to display a highlight playback interface if a trigger operation on the highlight display control is detected, and to loop the highlight based on the highlight playback interface.

[0272] In one embodiment, the highlight segment display control includes quantity indication information, where the quantity indication information indicates the number of highlight segments in the target video.

[0273] In one embodiment, the highlight playback interface also includes a summary information list of the highlight clips, the summary information list includes at least one summary indicator control of the highlight clip, the summary indicator control indicates the summary information of the corresponding highlight clip, and the response module is specifically used to display the summary indicator control corresponding to the currently playing highlight clip based on the target display effect during the process of looping the highlight clips based on the highlight playback interface, and the target display effect is used to distinguish the summary indicator control of the currently playing highlight clip from the summary indicator controls of other highlight clips.

[0274] In one embodiment, the highlight playback interface also includes a highlight export control, and the device also includes an export module, which is used to export the highlight corresponding to the selected summary indicator control if a trigger operation for the highlight export control is detected.

[0275] In one embodiment, the export module is specifically used to display an export interface if a trigger operation for a highlight export control is detected, and the export interface includes at least one export type control; according to the export type corresponding to the selected export type control, the highlight corresponding to the selected summary indication control is exported.

[0276] In one embodiment, the export type includes a segmented export type and a merged export type; the export module is specifically used to export the highlights corresponding to the selected summary indicator control separately if the export type corresponding to the selected export type control is a segmented export type; if the export type corresponding to the selected export type control is a merged export type, the highlights corresponding to the selected summary indicator control are merged and then exported.

[0277] In one embodiment, the playback interface also includes a video playback control, and the device also includes a playback module, which is used to play the target video if a trigger operation for the video playback control is detected, and during the playback of the target video, display the playback position interval corresponding to the wonderful clip in the target video on the first progress bar of the target video.

[0278] In one embodiment, the playback interface also includes a highlight editing control, and the device also includes a progress display module. If a trigger operation for the highlight editing control is detected during the playback of the target video, the progress display module is used to display the current playback progress of the target video in real time on the second progress bar of the target video, wherein the second progress bar is used to display the playback position interval corresponding to the highlight in the target video, and the size of the second progress bar is larger than the size of the first progress bar.

[0279] In one embodiment, a playback progress indicator control is provided at a preset position of the second progress bar, and the playback progress indicator control indicates the current playback progress of the target video. The device also includes a modification module, which is used to modify the currently playing highlight segment to a non-highlight segment if the playback progress indicator control indicates that the currently playing video segment interval is the playback position interval corresponding to the highlight segment, and a highlight segment deletion operation for the playback progress indicator control is detected; if the playback progress indicator control indicates that the currently playing video segment interval is the playback position interval corresponding to the non-highlight segment, and a highlight segment generation operation for the playback progress indicator control is detected, generate a highlight segment based on the current playback position interval of the second progress bar.

[0280] In one embodiment, the modification module is specifically configured to generate a separate highlight segment based on the current playback position interval of the second progress bar if no highlight segment exists within a preset interval threshold.

[0281] In one embodiment, the modification module is specifically used to generate a merged highlight segment based on the current playback position interval and the highlight segments within the preset interval threshold if there are highlight segments within the preset interval threshold of the current playback position interval of the second progress bar, and the merged highlight segment includes the highlight segments within the preset interval threshold.

[0282] In one embodiment, the generation module is specifically used to generate or mark at least one highlight segment of the target video based on the video recording screen corresponding to the highlight segment marking operation if a highlight segment marking operation for the target video is detected during the recording process of the target video.

[0283] In one embodiment, the video recording interface of the target video includes a highlight segment marking control, and the generation module is specifically used to generate or mark at least one highlight segment of the target video based on the video recording screen corresponding to the trigger operation if a trigger operation for the highlight segment marking control is detected.

[0284] In one embodiment, the generating module is specifically configured to generate highlight segment analysis information of the target video during the process of recording the target video; and generate or mark at least one highlight segment of the target video according to the highlight segment analysis information.

[0285] In one embodiment, the apparatus further includes a first sending module, configured to send the highlight segment analysis information to a terminal, so that the terminal generates a highlight segment of the target video based on the highlight segment analysis information.

[0286] In one embodiment, the device also includes a second sending module, which is used to generate highlight clip prompt information of the target video based on the highlight clip; and push the highlight clip prompt information to the target client of the terminal to prompt the object of the highlight clip of the target video through the target client.

[0287] In one embodiment, the device also includes a processing module, which is used to perform highlight segment analysis processing on the sampled video frames of the target video from at least one analysis dimension during the process of recording the target video, and obtain initial analysis results of the sampled video frames in different analysis dimensions; standardize the initial analysis results to obtain target score information of the sampled video frames in different analysis dimensions; and determine the highlight segment analysis information of the sampled video frames in the target video based on the target score information of the sampled video frames in different analysis dimensions.

[0288] In one embodiment, the display module is specifically configured to use a sampled video frame whose highlight analysis information is greater than a preset score threshold as a target video frame; determine an initial highlight segment based on the target video frame; perform segment processing on the initial highlight segment to obtain a processing result; and generate or label at least one highlight segment of the target video based on the processing result.

[0289] In one embodiment, the display module is specifically configured to calculate the time interval between each initial highlight segment; and merge the initial highlight segments whose time interval is less than a preset time threshold to obtain a highlight segment.

[0290] In one embodiment, the display module is specifically used to determine the total duration of each initial highlight segment; based on the duration of the target video, determine the total duration threshold of the highlight segments; if the total duration is greater than the total duration threshold, perform segment processing on the initial highlight segments so that the total duration is not greater than the total duration threshold.

[0291] In one embodiment, if there are multiple initial highlight segments, the segment processing includes discarding the segments, and the display module is specifically used to determine the priority of each initial highlight segment; determine the initial highlight segment that needs to be discarded based on the priority; and discard the initial highlight segment that needs to be discarded.

[0292] In one of the embodiments, if there is only one initial highlight segment, the segment processing includes cropping processing, and the display module is specifically used to determine the number of sampled video frames that need to be cropped based on the total duration and the total duration threshold; and crop the sampled video frames at the starting position and the ending position of the initial highlight segment according to the number of sampled video frames to be cropped.

[0293] Each module in the above-mentioned video processing device can be implemented in whole or in part through software, hardware, or a combination thereof. Each module can be embedded in or independent of a processor in a computer device in the form of hardware, or can be stored in a memory in the computer device in the form of software, so that the processor can call and execute the corresponding operations of each module.

[0294] Based on the same inventive concept, the present application also provides a camera device for implementing the aforementioned video processing method. The solution provided by this camera device is similar to the solution described in the aforementioned method. Therefore, the specific limitations in one or more camera device embodiments provided below can be found in the above-mentioned limitations on the video processing method and will not be repeated here.

[0295] A camera device comprising:

[0296] A camera, configured to record target video;

[0297] at least one processor;

[0298] A display, the display is connected to the processor;

[0299] and a memory communicatively connected to the processor, the memory storing one or more computer programs including instructions; when the instructions are executed by the processor, the processor is configured to: generate or mark at least one highlight segment of the target video while the camera is recording the target video; after the camera records the target video, upon receiving a playback instruction for the target video, control the display to display a playback interface of the target video; and receive and respond to operation instructions for the highlight segment according to the playback interface.

[0300] In one embodiment, the playback interface includes a highlight display control. When the processor receives and responds to operation instructions for highlights based on the playback interface, the processor is configured to: when a trigger operation for the highlight display control is detected, control the display to display the highlight playback interface, and control the display to play the highlights in a loop based on the highlight playback interface.

[0301] In one embodiment, the highlight segment display control includes quantity indication information, where the quantity indication information indicates the number of highlight segments in the target video.

[0302] In one embodiment, the highlight playback interface also includes a summary information list of the highlight clips, the summary information list includes a summary indicator control of at least one highlight clip, the summary indicator control indicates the summary information of the corresponding highlight clip, and when the processor plays the highlight clips in a loop based on the highlight playback interface, the processor is configured to: in the process of the display playing the highlight clips in a loop based on the highlight playback interface, control the display to display the summary indicator control corresponding to the currently playing highlight clip based on the target display effect, and the target display effect is used to distinguish the summary indicator control of the currently playing highlight clip from the summary indicator controls of other highlight clips.

[0303] In one embodiment, the highlight playback interface further includes a highlight export control, and the processor is further configured to: upon detecting a trigger operation for the highlight export control, export the highlight corresponding to the selected summary indication control.

[0304] In one embodiment, when the processor detects a trigger operation for a highlight export control, when the processor exports the highlight corresponding to the selected summary indication control, the processor is configured to: when the trigger operation for the highlight export control is detected, control the display to display an export interface, the export interface includes at least one export type control; and export the highlight corresponding to the selected summary indication control according to the export type corresponding to the selected export type control.

[0305] In one embodiment, the export type includes a segmented export type and a merged export type; when the processor exports the highlight clips corresponding to the selected summary indicator control according to the export type corresponding to the selected export type control, the processor is configured to: when the export type corresponding to the selected export type control is a segmented export type, export the highlight clips corresponding to the selected summary indicator control separately; when the export type corresponding to the selected export type control is a merged export type, merge the highlight clips corresponding to the selected summary indicator control and then export them.

[0306] In one embodiment, the playback interface also includes a video playback control, and the processor is further configured to: when a trigger operation for the video playback control is detected, control the display to play the target video, and during the playback of the target video, control the display to display the playback position interval corresponding to the wonderful clips in the target video on the first progress bar of the target video.

[0307] In one embodiment, the playback interface also includes a highlight editing control, and the processor is further configured to: during the playback of the target video, when a trigger operation for the highlight editing control is detected, control the display to display the current playback progress of the target video in real time on the second progress bar of the target video, wherein the second progress bar is used to display the playback position interval corresponding to the highlight in the target video, and the size of the second progress bar is larger than the size of the first progress bar.

[0308] In one embodiment, a playback progress indicator control is provided at a preset position of the second progress bar, and the playback progress indicator control indicates the current playback progress of the target video. The processor is further configured to: when the playback progress indicator control indicates that the currently played video segment interval is the playback position interval corresponding to the highlight segment, and a highlight segment deletion operation for the playback progress indicator control is detected, modify the currently played highlight segment to a non-highlight segment; when the playback progress indicator control indicates that the currently played video segment interval is the playback position interval corresponding to the non-highlight segment, and a highlight segment generation operation for the playback progress indicator control is detected, generate a highlight segment based on the current playback position interval of the second progress bar.

[0309] In one embodiment, when the processor generates a highlight segment based on the current playback position interval of the second progress bar, the processor is configured to: if there is no highlight segment within the preset interval threshold of the current playback position interval of the second progress bar, then generate a separate highlight segment based on the current playback position interval.

[0310] In one embodiment, when the processor generates a highlight segment based on the current playback position interval of the second progress bar, the processor is configured to: when there is a highlight segment within the preset interval threshold in the current playback position interval of the second progress bar, generate a merged highlight segment based on the current playback position interval and the highlight segments within the preset interval threshold, and the merged highlight segment includes the highlight segments within the preset interval threshold.

[0311] In one embodiment, during the process of the camera recording the target video, when the processor generates or marks at least one highlight segment of the target video, the processor is configured to: during the process of the camera recording the target video, when a highlight segment marking operation for the target video is detected, generate or mark at least one highlight segment of the target video based on the video recording screen corresponding to the highlight segment marking operation.

[0312] In one embodiment, the video recording interface of the target video includes a highlight marking control. When the processor detects a highlight marking operation for the target video, and when the processor generates or marks at least one highlight segment of the target video based on the video recording screen corresponding to the highlight marking operation, the processor is configured to: when a trigger operation for the highlight marking control is detected, generate or mark at least one highlight segment of the target video based on the video recording screen corresponding to the trigger operation.

[0313] In one embodiment, when the camera is recording the target video, when the processor generates or marks at least one highlight segment of the target video, the processor is configured to: generate highlight segment analysis information of the target video during the camera recording the target video; and generate or mark at least one highlight segment of the target video based on the highlight segment analysis information.

[0314] In one embodiment, the processor is further configured to: send the highlight segment analysis information to the terminal, so that the terminal generates a highlight segment of the target video based on the highlight segment analysis information.

[0315] In one embodiment, the processor is further configured to: generate highlight clip prompt information of the target video based on the highlight clip; push the highlight clip prompt information to the target client of the terminal to prompt the object of the highlight clip of the target video through the target client.

[0316] In one embodiment, during the process of the camera recording the target video, when the processor generates the highlight analysis information of the target video, the processor is configured to: during the process of the camera recording the target video, perform highlight analysis processing on the sampled video frames of the target video from at least one analysis dimension to obtain initial analysis results of the sampled video frames in different analysis dimensions; standardize the initial analysis results to obtain target score information of the sampled video frames in different analysis dimensions; and determine the highlight analysis information of the sampled video frames in the target video based on the target score information of the sampled video frames in different analysis dimensions.

[0317] In one embodiment, when the processor generates or labels at least one highlight segment of the target video based on the highlight segment analysis information, the processor is configured to: use the sampled video frame whose highlight segment analysis information is greater than a preset score threshold as the target video frame; determine the initial highlight segment based on the target video frame; perform segment processing on the initial highlight segment to obtain a processing result; and generate or label at least one highlight segment of the target video based on the processing result.

[0318] In one embodiment, when the processor performs segment processing on the initial highlight segments, the processor is configured to: calculate the time intervals between the initial highlight segments; and merge the initial highlight segments whose time intervals are less than a preset time threshold.

[0319] In one embodiment, when the processor performs fragment processing on the initial highlight clips, the processor is configured to: determine the total duration of each initial highlight clip; determine a total duration threshold of the highlight clips based on the duration of the target video; if the total duration is greater than the total duration threshold, fragment process the initial highlight clips so that the total duration is not greater than the total duration threshold.

[0320] In one embodiment, when there are multiple initial highlight segments, the segment processing includes discarding processing. When the processor performs segment processing on the initial highlight segments so that the total duration is not greater than the total duration threshold, the processor is configured to: determine the priority of each initial highlight segment; determine the initial highlight segment that needs to be discarded based on the priority; and discard the initial highlight segment that needs to be discarded.

[0321] In one embodiment, when there is only one initial highlight segment, the segment processing includes cropping processing. When the processor performs segment processing on the initial highlight segment so that the total duration is not greater than the total duration threshold, the processor is configured to: determine the number of sampled video frames that need to be cropped based on the total duration and the total duration threshold; and crop the sampled video frames at the starting position and the ending position of the initial highlight segment based on the number of sampled video frames to be cropped.

[0322] Based on the same inventive concept, embodiments of the present application further provide an image processing device for implementing the aforementioned video processing method. The implementation solution provided by the image processing device is similar to the implementation solution described in the aforementioned method. Therefore, the specific limitations in one or more of the following image processing device embodiments can be found in the above-mentioned limitations on the video processing method and will not be further elaborated here.

[0323] An image processing device, the image processing device being communicatively connected to a camera device, comprising:

[0324] one or more processors;

[0325] A display, the display is connected to the processor;

[0326] and a memory communicatively connected to the processor, the memory storing one or more computer programs including instructions; when the instructions are executed by the processor, the processor is configured to: obtain a target video recorded by the camera device, the target video including at least one highlight segment generated or marked during the recording of the target video; upon receiving a playback instruction for the target video, control the display to display a playback interface of the target video; and receive and respond to operation instructions for the highlight segment according to the playback interface.

[0327] The image processing device may include a terminal, on which a target client program may be deployed. The terminal acquires a target video recorded by a camera device. Upon receiving a playback instruction for the target video, the terminal controls a display to display a playback interface for the target video, and receives and responds to operation instructions for highlight clips based on the playback interface. The communication connection may be via a wired or wireless method such as a network, a card reader, Wi-Fi, or a Universal Serial Bus (USB).

[0328] In one embodiment, the playback interface includes a highlight display control. When the processor receives and responds to operation instructions for highlights based on the playback interface, the processor is configured to: when a trigger operation for the highlight display control is detected, control the display to display the highlight playback interface, and play the highlights in a loop based on the highlight playback interface.

[0329] In one embodiment, the highlight segment display control includes quantity indication information, where the quantity indication information indicates the number of highlight segments in the target video.

[0330] In one embodiment, the highlight playback interface also includes a summary information list of the highlight clips, the summary information list includes a summary indicator control of at least one highlight clip, the summary indicator control indicates the summary information of the corresponding highlight clip, and when the processor plays the highlight clips in a loop based on the highlight playback interface, the processor is configured to: in the process of the display playing the highlight clips in a loop based on the highlight playback interface, control the display to display the summary indicator control corresponding to the currently playing highlight clip based on the target display effect, and the target display effect is used to distinguish the summary indicator control of the currently playing highlight clip from the summary indicator controls of other highlight clips.

[0331] In one embodiment, the highlight playback interface further includes a highlight export control, and the processor is further configured to: upon detecting a trigger operation for the highlight export control, export the highlight corresponding to the selected summary indication control.

[0332] In one embodiment, when the processor detects a trigger operation for a highlight export control and exports the highlight corresponding to the selected summary indication control, the processor is configured to: when a trigger operation for the highlight export control is detected, control the display to display an export interface, the export interface includes at least one export type control; and export the highlight corresponding to the selected summary indication control according to the export type corresponding to the selected export type control.

[0333] In one embodiment, the export type includes a segmented export type and a merged export type; when the processor exports the highlight clips corresponding to the selected summary indicator control according to the export type corresponding to the selected export type control, the processor is configured to: when the export type corresponding to the selected export type control is a segmented export type, export the highlight clips corresponding to the selected summary indicator control separately; when the export type corresponding to the selected export type control is a merged export type, merge the highlight clips corresponding to the selected summary indicator control and then export them.

[0334] In one embodiment, the playback interface also includes a video playback control, and the processor is further configured to: when a trigger operation for the video playback control is detected, control the display to play the target video, and during the playback of the target video, control the display to display the playback position interval corresponding to the wonderful clips in the target video on the first progress bar of the target video.

[0335] In one embodiment, the playback interface also includes a highlight editing control, and the processor is further configured to: during the playback of the target video, when a trigger operation for the highlight editing control is detected, control the display to display the current playback progress of the target video in real time on the second progress bar of the target video, wherein the second progress bar is used to display the playback position interval corresponding to the highlight in the target video, and the size of the second progress bar is larger than the size of the first progress bar.

[0336] In one embodiment, a playback progress indicator control is provided at a preset position of the second progress bar, and the playback progress indicator control indicates the current playback progress of the target video. The processor is further configured to: when the playback progress indicator control indicates that the currently played video segment interval is the playback position interval corresponding to the highlight segment, and a highlight segment deletion operation for the playback progress indicator control is detected, modify the currently played highlight segment to a non-highlight segment; when the playback progress indicator control indicates that the currently played video segment interval is the playback position interval corresponding to the non-highlight segment, and a highlight segment generation operation for the playback progress indicator control is detected, generate a highlight segment based on the current playback position interval of the second progress bar.

[0337] In one embodiment, when the processor generates a highlight segment based on the current playback position interval of the second progress bar, the processor is configured to: if there is no highlight segment within a preset interval threshold of the current playback position interval of the second progress bar, generate a separate highlight segment based on the current playback position interval.

[0338] In one embodiment, when the processor generates a highlight segment based on the current playback position interval of the second progress bar, the processor is configured to: when there is a highlight segment within the preset interval threshold in the current playback position interval of the second progress bar, generate a merged highlight segment based on the current playback position interval and the highlight segments within the preset interval threshold, and the merged highlight segment includes the highlight segments within the preset interval threshold.

[0339] In an exemplary embodiment, a computer device is provided, which may be a terminal. A diagram of its internal structure may be shown in FIG18 . The computer device includes a processor, memory, an input / output interface, a communication interface, a display unit, and an input device. The processor, memory, and input / output interface are connected via a system bus, and the communication interface, display unit, and input device are connected to the system bus via the input / output interface. The processor of the computer device is configured to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of the operating system and computer program in the non-volatile storage medium. The input / output interface of the computer device is configured to exchange information between the processor and an external device. The communication interface of the computer device is configured to communicate with an external terminal via wired or wireless communication, where the wireless communication may be achieved via Wi-Fi, a mobile cellular network, NFC (near-field communication), or other technologies. When executed by the processor, the computer program implements a video processing method. The display unit of the computer device is configured to produce a visually visible image and may be a display screen, a projection device, or a virtual reality imaging device. The display screen can be a liquid crystal display screen or an electronic ink display screen, and the input device of the computer device can be a touch layer covering the display screen, or a button, trackball or touchpad set on the computer device casing, or an external keyboard, touchpad or mouse.

[0340] Those skilled in the art will understand that the structure shown in Figure 18 is merely a block diagram of a portion of the structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may include more or fewer components than shown in the figure, or combine certain components, or have a different component arrangement.

[0341] In an exemplary embodiment, a computer device is provided, including a memory and a processor. The memory stores a computer program, and the processor implements the steps in the above method embodiments when executing the computer program.

[0342] In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the steps in the above-mentioned method embodiments are implemented.

[0343] In one embodiment, a computer program product is provided, including a computer program, which implements the steps in the above method embodiments when executed by a processor.

[0344] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with relevant regulations.

[0345] Those skilled in the art will appreciate that all or part of the processes in the above-mentioned embodiment methods can be implemented by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to memory, database or other media used in the embodiments provided in this application may include at least one of non-volatile and volatile memory. Non-volatile memory may include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetic random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory may include random access memory (RAM) or external cache memory, etc. By way of illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM). The database involved in the various embodiments provided herein may include at least one of a relational database and a non-relational database. Non-relational databases may include, but are not limited to, distributed databases based on blockchains. The processor involved in the various embodiments provided herein may be, but are not limited to, a general-purpose processor, a central processing unit, a graphics processing unit, a digital signal processor, a programmable logic unit, a data processing logic unit based on quantum computing, and the like.

[0346] The technical features of the above embodiments can be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0347] The above-described embodiments merely represent several implementation methods of the present application. While the descriptions are relatively specific and detailed, they should not be construed as limiting the scope of the present application. It should be noted that a person of ordinary skill in the art may make various modifications and improvements without departing from the spirit of the present application, and these modifications and improvements fall within the scope of protection of the present application. Therefore, the scope of protection of the present application shall be determined by the appended claims.

Claims

1. A video processing method, characterized in that, it is applicable to a camera device, and the method includes: During the recording of the target video, generating or annotating at least one exciting segment of the target video; After the recording of the target video, if a playback instruction for the target video is received, then displaying a playback interface of the target video; Receiving and responding to an operation instruction for the exciting segment according to the playback interface.

2. The method according to claim 1, characterized in that, the playback interface includes an exciting segment display control, and the receiving and responding to an operation instruction for the exciting segment according to the playback interface includes: If a trigger operation for the exciting segment display control is detected, then displaying an exciting segment playback interface and circularly playing the exciting segment based on the exciting segment playback interface.

3. The method according to claim 2, characterized in that, the exciting segment display control includes quantity indication information, and the quantity indication information indicates the quantity of exciting segments in the target video.

4. The method according to claim 2, characterized in that, the exciting segment playback interface further includes a summary information list of the exciting segments, the summary information list includes at least one summary indication control of the exciting segments, the summary indication control indicates the summary information of the corresponding exciting segment, and the circularly playing the exciting segment based on the exciting segment playback interface includes: During the process of circularly playing the exciting segment based on the exciting segment playback interface, displaying the summary indication control corresponding to the currently played exciting segment based on a target display effect, and the target display effect is used to distinguish the summary indication control of the currently played exciting segment from the summary indication controls of other exciting segments.

5. The method according to claim 4, characterized in that, the exciting segment playback interface further includes an exciting segment export control, and the method further includes: If a trigger operation for the exciting segment export control is detected, then performing an export process on the exciting segment corresponding to the selected summary indication control.

6. The method according to claim 5, characterized in that, the if a trigger operation for the exciting segment export control is detected, then performing an export process on the exciting segment corresponding to the selected summary indication control includes: If a trigger operation for the exciting segment export control is detected, then displaying an export interface, and the export interface includes at least one export type control; Performing an export process on the exciting segment corresponding to the selected summary indication control according to the export type corresponding to the selected export type control.

7. The method according to claim 6, characterized in that, the export type includes a segmented export type and a merged export type; the performing an export process on the exciting segment corresponding to the selected summary indication control according to the export type corresponding to the selected export type control includes: If the export type corresponding to the selected export type control is the segmented export type, then performing an export process on the exciting segments corresponding to the selected summary indication control respectively; If the export type corresponding to the selected export type control is the merged export type, then the highlights corresponding to the selected summary indication control are merged and then exported.

8. The method according to claim 1, wherein, the playback interface further includes a video playback control, and the method further includes: If a trigger operation on the video playback control is detected, then play the target video, and during the playback of the target video, display the playback position interval corresponding to the highlight in the target video on the first progress bar of the target video.

9. The method according to claim 8, wherein, the playback interface further includes a highlight editing control, and the method further includes: If a trigger operation on the highlight editing control is detected during the playback of the target video, then display the current playback progress of the target video in real time on the second progress bar of the target video, wherein the second progress bar is used to display the playback position interval corresponding to the highlights in the target video, and the size of the second progress bar is larger than the size of the first progress bar.

10. The method according to claim 9, wherein, a playback progress indication control is provided at a preset position of the second progress bar, and the playback progress indication control indicates the current playback progress of the target video, and the method further includes: If the playback progress indication control indicates that the currently played video segment interval is the playback position interval corresponding to the highlight, and a highlight deletion operation on the playback progress indication control is detected, then modify the currently played highlight to a non-highlight; If the playback progress indication control indicates that the currently played video segment interval is not the playback position interval corresponding to the highlight, and a highlight generation operation on the playback progress indication control is detected, then generate a highlight based on the current playback position interval of the second progress bar.

11. The method according to claim 10, wherein, generating the highlight based on the current playback position interval of the second progress bar includes: If there is no highlight in the current playback position interval of the second progress bar within a preset interval threshold, then generate a separate highlight based on the current playback position interval.

12. The method according to claim 10, wherein, generating the highlight based on the current playback position interval of the second progress bar includes: If there is a highlight in the current playback position interval of the second progress bar within a preset interval threshold, then generate a merged highlight based on the current playback position interval and the highlights within the preset interval threshold, and the merged highlight includes the highlights within the preset interval threshold.

13. The method according to claim 1, wherein, generating or annotating at least one highlight of the target video during the recording of the target video includes: During the process of recording the target video, if a highlight segment marking operation for the target video is detected, at least one highlight segment of the target video is generated or labeled based on the video recording screen corresponding to the highlight segment marking operation.

14. The method according to claim 13, wherein, the video recording interface of the target video includes a highlight segment marking control, and the step of if a highlight segment marking operation for the target video is detected, at least one highlight segment of the target video is generated or labeled based on the video recording screen corresponding to the highlight segment marking operation, includes: if a trigger operation for the highlight segment marking control is detected, at least one highlight segment of the target video is generated or labeled based on the video recording screen corresponding to the trigger operation.

15. The method according to claim 1, wherein, the step of generating or labeling at least one highlight segment of the target video during the process of recording the target video, includes: generating highlight segment analysis information of the target video during the process of recording the target video; generating or labeling at least one highlight segment of the target video according to the highlight segment analysis information.

16. The method according to claim 15, wherein, the method further includes: sending the highlight segment analysis information to a terminal, so that the terminal generates highlight segments of the target video based on the highlight segment analysis information.

17. The method according to claim 16, wherein, the method further includes: generating highlight segment prompt information of the target video according to the highlight segments; pushing the highlight segment prompt information to a target client of the terminal, so that the target client prompts an object of the highlight segments of the target video.

18. The method according to claim 15, wherein, the step of generating highlight segment analysis information of the target video during the process of recording the target video, includes: during the process of recording the target video, performing highlight segment analysis processing on sampled video frames of the target video from at least one analysis dimension to obtain initial analysis results of the sampled video frames in different analysis dimensions; performing normalization processing on the initial analysis results to obtain target score information of the sampled video frames in different analysis dimensions; determining the highlight segment analysis information of the sampled video frames in the target video based on the target score information of the sampled video frames in different analysis dimensions.

19. The method according to claim 18, wherein, the step of generating or labeling at least one highlight segment of the target video according to the highlight segment analysis information, includes: taking the sampled video frames with the highlight segment analysis information greater than a preset score threshold as target video frames; determining initial highlight segments based on the target video frames; performing segment processing on the initial highlight segments to obtain a processing result; generating or labeling at least one highlight segment of the target video based on the processing result.

20. The method according to claim 19, wherein, the step of performing segment processing on the initial highlight segments, includes: Calculate the time intervals between the initial highlight clips; Merge the initial highlight clips with time intervals less than a preset time threshold.

21. The method according to claim 19, wherein, the processing of the initial highlight clips includes: Determine the total duration of each of the initial highlight clips; Based on the duration of the target video, determine the total duration threshold of the highlight clips; If the total duration is greater than the total duration threshold, perform clip processing on the initial highlight clips so that the total duration is not greater than the total duration threshold.

22. The method according to claim 21, wherein, If there are multiple initial highlight clips, the clip processing includes discard processing. Performing clip processing on the initial highlight clips so that the total duration is not greater than the total duration threshold includes: Determine the priority of each of the initial highlight clips; Based on the priority, determine the initial highlight clips to be discarded; Discard the initial highlight clips to be discarded.

23. The method according to claim 21, wherein, If there is one initial highlight clip, the clip processing includes cropping processing. Performing clip processing on the initial highlight clip so that the total duration is not greater than the total duration threshold includes: Determine the number of sampled video frames to be cropped for the clip processing based on the total duration and the total duration threshold; Perform cropping processing on the sampled video frames at the start position and the end position of the initial highlight clip according to the number of sampled video frames to be cropped.

24. A camera device, wherein, includes: A camera configured to record a target video; At least one processor; A display, the display being connected to the processor; And a memory communicatively connected to the processor, the memory storing one or more computer programs including instructions; when the instructions are executed by the processor, the processor is configured to: During the process of the camera recording the target video, generate or annotate at least one highlight clip of the target video; After the camera records the target video, in the case of receiving a playback instruction for the target video, control the display to display a playback interface of the target video; Receive and respond to operation instructions for the highlight clip according to the playback interface.

25. The camera device according to claim 24, wherein, The playback interface includes a highlight clip display control. When the processor receives and responds to operation instructions for the highlight clip according to the playback interface, the processor is configured to: In the case of detecting a trigger operation for the highlight clip display control, control the display to display a highlight clip playback interface and control the display to loop-play the highlight clip based on the highlight clip playback interface.

26. The camera device according to claim 25, wherein, The highlight clip display control includes quantity indication information, and the quantity indication information indicates the number of highlight clips in the target video.

27. The camera device according to claim 25, wherein, the highlight playback interface further includes a summary information list of highlights, the summary information list includes at least one summary indication control for a highlight, the summary indication control indicates the summary information of the corresponding highlight, and when the processor circularly plays the highlights based on the highlight playback interface, the processor is configured to: during the process that the display circularly plays the highlights based on the highlight playback interface, control the display to display the summary indication control corresponding to the currently played highlight based on a target display effect, and the target display effect is used to distinguish the summary indication control of the currently played highlight from the summary indication controls of other highlights.

28. The camera device according to claim 27, wherein, the highlight playback interface further includes a highlight export control, and the processor is further configured to: in the case where a trigger operation for the highlight export control is detected, export the highlight corresponding to the selected summary indication control.

29. The camera device according to claim 28, wherein, when the processor detects a trigger operation for the highlight export control and exports the highlight corresponding to the selected summary indication control, the processor is configured to: in the case where a trigger operation for the highlight export control is detected, control the display to display an export interface, and the export interface includes at least one export type control; export the highlight corresponding to the selected summary indication control according to the export type corresponding to the selected export type control.

30. The camera device according to claim 29, wherein, the export types include a segmented export type and a merged export type; when the processor exports the highlight corresponding to the selected summary indication control according to the export type corresponding to the selected export type control, the processor is configured to: in the case where the export type corresponding to the selected export type control is the segmented export type, export the highlights corresponding to the selected summary indication control separately; in the case where the export type corresponding to the selected export type control is the merged export type, merge the highlights corresponding to the selected summary indication control and then export.

31. The camera device according to claim 24, wherein, the playback interface further includes a video playback control, and the processor is further configured to: in the case where a trigger operation for the video playback control is detected, control the display to play the target video, and during the playback of the target video, control the display to display the playback position interval corresponding to the highlight in the target video on the first progress bar of the target video.

32. The camera device according to claim 31, wherein, ​ The playback interface further includes a highlight editing control, and the processor is further configured to: During the playback of the target video, when a trigger operation on the highlight editing control is detected, control the display to display the current playback progress of the target video in real time on a second progress bar of the target video, where the second progress bar is used to display the playback position interval corresponding to the highlight in the target video, and the size of the second progress bar is larger than the size of the first progress bar.

33. The camera device according to claim 32, wherein, A playback progress indication control is provided at a preset position of the second progress bar, and the playback progress indication control indicates the current playback progress of the target video. The processor is further configured to: When the playback progress indication control indicates that the video segment interval currently being played is the playback position interval corresponding to the highlight, and a highlight deletion operation on the playback progress indication control is detected, modify the currently played highlight to a non-highlight; When the playback progress indication control indicates that the video segment interval currently being played is not the playback position interval corresponding to the highlight, and a highlight generation operation on the playback progress indication control is detected, generate a highlight based on the current playback position interval of the second progress bar.

34. The camera device according to claim 33, wherein, When the processor generates a highlight based on the current playback position interval of the second progress bar, the processor is configured to: When there is no highlight within a preset interval threshold in the current playback position interval of the second progress bar, generate a separate highlight based on the current playback position interval.

35. The camera device according to claim 33, wherein, When the processor generates a highlight based on the current playback position interval of the second progress bar, the processor is configured to: When there is a highlight within a preset interval threshold in the current playback position interval of the second progress bar, generate a merged highlight based on the current playback position interval and the highlight within the preset interval threshold, and the merged highlight includes the highlight within the preset interval threshold.

36. The camera device according to claim 24, wherein, During the process of the camera capturing the target video, when the processor generates or marks at least one highlight of the target video, the processor is configured to: During the process of the camera capturing the target video, when a highlight marking operation on the target video is detected under the condition, generate or mark at least one highlight of the target video based on the video capture screen corresponding to the highlight marking operation.

37. The camera device according to claim 36, wherein, The video recording interface of the target video includes a highlight marking control. When the processor detects a highlight marking operation for the target video, and when the processor generates or annotates at least one highlight segment of the target video based on the video recording screen corresponding to the highlight marking operation, the processor is configured to: When detecting a trigger operation for the highlight marking control, generate or annotate at least one highlight segment of the target video based on the video recording screen corresponding to the trigger operation.

38. The camera device according to claim 24, wherein, During the process of the camera capturing the target video, when the processor generates or annotates at least one highlight segment of the target video, the processor is configured to: During the process of the camera capturing the target video, generate highlight segment analysis information of the target video; According to the highlight segment analysis information, generate or annotate at least one highlight segment of the target video.

39. The camera device according to claim 38, wherein, The processor is further configured to: Send the highlight segment analysis information to the terminal, so that the terminal generates the highlight segment of the target video based on the highlight segment analysis information.

40. The camera device according to claim 39, wherein, The processor is further configured to: Generate highlight segment prompt information of the target video according to the highlight segment; Push the highlight segment prompt information to the target client of the terminal, so that the target client prompts the object of the highlight segment of the target video.

41. The camera device according to claim 38, wherein, During the process of the camera capturing the target video, when the processor generates the highlight segment analysis information of the target video, the processor is configured to: During the process of the camera capturing the target video, perform highlight segment analysis processing on the sampled video frames of the target video from at least one analysis dimension to obtain the initial analysis results of the sampled video frames in different analysis dimensions; Perform normalization processing on the initial analysis results to obtain the target score information of the sampled video frames in different analysis dimensions; Based on the target score information of the sampled video frames in different analysis dimensions, determine the highlight segment analysis information of the sampled video frames in the target video.

42. The camera device according to claim 41, wherein, When the processor generates or annotates at least one highlight segment of the target video according to the highlight segment analysis information, the processor is configured to: Regard the sampled video frames with the highlight segment analysis information greater than the preset score threshold as target video frames; Determine the initial highlight segments based on the target video frames; Perform segment processing on the initial highlight segments to obtain a processing result; Based on the processing result, generate or annotate at least one highlight segment of the target video.

43. The camera device according to claim 42, wherein, When the processor performs segment processing on the initial highlight clips, the processor is configured to: Calculate the time intervals between the initial highlight clips; Merge the initial highlight clips with time intervals less than a preset time threshold.

44. The camera device according to claim 42, wherein, When the processor performs segment processing on the initial highlight clips, the processor is configured to: Determine the total duration of each of the initial highlight clips; Based on the duration of the target video, determine a total duration threshold for the highlight clips; If the total duration is greater than the total duration threshold, perform segment processing on the initial highlight clips so that the total duration is not greater than the total duration threshold.

45. The camera device according to claim 44, wherein, In the case where there are multiple initial highlight clips, the segment processing includes discard processing. When the processor performs segment processing on the initial highlight clips so that the total duration is not greater than the total duration threshold, the processor is configured to: Determine the priority of each of the initial highlight clips; Based on the priority, determine the initial highlight clips to be discarded; Discard the initial highlight clips to be discarded.

46. The camera device according to claim 44, wherein, In the case where there is one initial highlight clip, the segment processing includes cropping processing. When the processor performs segment processing on the initial highlight clip so that the total duration is not greater than the total duration threshold, the processor is configured to: Determine the number of sampled video frames to be cropped for the cropping processing according to the total duration and the total duration threshold; Crop the sampled video frames at the start position and the end position of the initial highlight clip according to the number of sampled video frames to be cropped.

47. An image processing device, wherein, The image processing device is communicatively connected to the camera device and includes: One or more processors; A display, the display being connected to the processor; And a memory communicatively connected to the processor, the memory storing one or more computer programs including instructions; when the instructions are executed by the processor, the processor is configured to: Obtain the target video recorded by the camera device, the target video including at least one highlight clip generated or marked during the recording of the target video; When a playback instruction for the target video is received, control the display to display a playback interface for the target video; Receive and respond to an operation instruction for the highlight clip according to the playback interface.

48. The image processing device according to claim 47, wherein, The playback interface includes a highlight clip display control. When the processor receives and responds to an operation instruction for the highlight clip according to the playback interface, the processor is configured to: When a trigger operation for the highlight clip display control is detected, control the display to display a highlight clip playback interface and loop-play the highlight clip based on the highlight clip playback interface.

49. The image processing device according to claim 48, wherein, the highlight display control includes quantity indication information indicating the quantity of highlights in the target video.

50. The image processing device according to claim 48, wherein, the highlight playback interface further includes a summary information list of highlights, the summary information list includes at least one summary indication control for a highlight, the summary indication control indicates the summary information of the corresponding highlight, and when the processor plays back the highlights in a loop based on the highlight playback interface, the processor is configured to: during the process that the display plays back the highlights in a loop based on the highlight playback interface, control the display to display, based on a target display effect, the summary indication control corresponding to the currently played highlight, the target display effect being used to distinguish the summary indication control of the currently played highlight from the summary indication controls of other highlights.

51. The image processing device according to claim 50, wherein, the highlight playback interface further includes a highlight export control, and the processor is further configured to: when a trigger operation for the highlight export control is detected, perform an export process on the highlight corresponding to the selected summary indication control.

52. The image processing device according to claim 51, wherein, when the processor detects a trigger operation for the highlight export control and performs an export process on the highlight corresponding to the selected summary indication control, the processor is configured to: when a trigger operation for the highlight export control is detected, control the display to display an export interface, the export interface including at least one export type control; perform an export process on the highlight corresponding to the selected summary indication control according to the export type corresponding to the selected export type control.

53. The image processing device according to claim 52, wherein, the export types include a segmented export type and a combined export type; when the processor performs an export process on the highlight corresponding to the selected summary indication control according to the export type corresponding to the selected export type control, the processor is configured to: when the export type corresponding to the selected export type control is the segmented export type, perform separate export processes on the highlights corresponding to the selected summary indication controls; when the export type corresponding to the selected export type control is the combined export type, perform a combining process on the highlights corresponding to the selected summary indication controls and then export them.

54. The image processing device according to claim 47, wherein, the playback interface further includes a video playback control, and the processor is further configured to: In the case of detecting a trigger operation on the video playback control, control the display to play the target video, and during the playback of the target video, control the display to display the playback position interval corresponding to the exciting segment in the target video on the first progress bar of the target video.

55. The image processing device according to claim 54, wherein, the playback interface further includes an exciting segment editing control, and the processor is further configured to: During the playback of the target video, in the case of detecting a trigger operation on the exciting segment editing control, control the display to display the current playback progress of the target video in real time on the second progress bar of the target video, wherein the second progress bar is used to display the playback position interval corresponding to the exciting segment in the target video, and the size of the second progress bar is larger than the size of the first progress bar.

56. The image processing device according to claim 55, wherein, a playback progress indication control is provided at a preset position of the second progress bar, and the playback progress indication control indicates the current playback progress of the target video, and the processor is further configured to: When the playback progress indication control indicates that the current played video segment interval is the playback position interval corresponding to the exciting segment, and a deletion operation of the exciting segment is detected on the playback progress indication control, modify the currently played exciting segment to a non-exciting segment; When the playback progress indication control indicates that the current played video segment interval is not the playback position interval corresponding to the exciting segment, and a generation operation of the exciting segment is detected on the playback progress indication control, generate an exciting segment based on the current playback position interval of the second progress bar.

57. The image processing device according to claim 56, wherein, when the processor generates an exciting segment based on the current playback position interval of the second progress bar, the processor is configured to: In the case that there is no exciting segment within a preset interval threshold in the current playback position interval of the second progress bar, generate a separate exciting segment based on the current playback position interval.

58. The image processing device according to claim 56, wherein, when the processor generates an exciting segment based on the current playback position interval of the second progress bar, the processor is configured to: In the case that there is an exciting segment within a preset interval threshold in the current playback position interval of the second progress bar, generate a merged exciting segment based on the current playback position interval and the exciting segments within the preset interval threshold, and the merged exciting segment includes the exciting segments within the preset interval threshold.

Images