Display control method, device and electronic device

Abstract

The present application discloses a display control method, device, electronic device and storage medium, belonging to the field of electronic technology. The display control method comprises: displaying a playback interface of a target video; displaying a first object image when the playback interface displays a first video frame, wherein the first object image is an image associated with the first video frame, and the first object image comprises an image of a target object display area in the first video frame.

Description

Technical Field

[0001] The present application belongs to the field of camera technology, and specifically relates to a display control method, device, electronic device and storage medium. Background Art

[0002] In current work scenarios such as teaching or meetings, PPT screen projection demonstrations or multiple text demonstration areas are often performed. These important contents will also be included in video recording. However, when recording videos for a long time, it is very troublesome for users to obtain the PPT content or information in the text area in the recorded video. For example: If you want to obtain the PPT content in a three-hour meeting video or teaching video, you can only view the PPT content by viewing the picture frame by frame in the video. That is, viewing the PPT content or the information in the text area in the video obtained by the existing video recording function is cumbersome to operate, and it is difficult to quickly obtain the target content such as the PPT content or the information in the text area. Summary of the invention

[0003] The purpose of the embodiments of the present application is to provide a display control method, device, electronic device and storage medium to improve the efficiency of obtaining target content in a recorded video. In a first aspect, the embodiments of the present application provide a display control method, the method comprising:

[0004] Display the playback interface of the target video;

[0005] When the playback interface displays the first video frame, a first object image is displayed, wherein the first object image is an image associated with the first video frame, and the first object image includes an image of a target object display area in the first video frame.

[0006] In a second aspect, an embodiment of the present application provides a display control device, the display control device comprising:

[0007] A first display module, used to display the playback interface of the target video;

[0008] The second display module is used to display a first object image when the first video frame is displayed on the playback interface, wherein the first object image is an image associated with the first video frame, and the first object image includes an image of a target object display area in the first video frame.

[0009] In a third aspect, an embodiment of the present application provides an electronic device, which includes a processor, a memory, and a program or instruction stored in the memory and executable on the processor, wherein the program or instruction, when executed by the processor, implements the steps of the method described in the first aspect.

[0010] In a fourth aspect, an embodiment of the present application provides a readable storage medium, on which a program or instruction is stored, and when the program or instruction is executed by a processor, the steps of the method described in the first aspect are implemented.

[0011] In a fifth aspect, an embodiment of the present application provides a chip, comprising a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run a program or instruction to implement the method described in the first aspect.

[0012] In the embodiment of the present application, when the first video frame is displayed through the playback interface of the target video, the first object image is displayed. Since the first object image is an image associated with the first video frame, the first object image includes an image of the target object display area in the first video frame. Thus, when the user is retracing the target video, he can quickly know the first object image corresponding to the target object display area in the first video frame played by the target video, and obtain the corresponding position of the first object image in the target video. Thus, the user can quickly know the distribution of video content in the target video, can quickly select the time point of the content of interest in the target video for learning, and improve the efficiency of obtaining the target content in the recorded video. BRIEF DESCRIPTION OF THE DRAWINGS

[0013] Figure 1 It is one of the flow charts of the display control method provided by this application;

[0014] Figure 2 This is the second flow chart of the display control method provided by this application;

[0015] Figure 3 is a schematic diagram of an electronic device of the present application recording an image of an object;

[0016] Figure 4 This is the third flow chart of the display control method provided by this application;

[0017] Figure 5 is a schematic diagram of the electronic device of the present application recording multiple object images;

[0018] Figure 6 This is the fourth flow chart of the display control method provided by this application;

[0019] Figure 7 This is the fifth flow chart of the display control method provided by this application;

[0020] Figure 8 This is the sixth flow chart of the display control method provided by this application;

[0021] Fig. 9This is the seventh flow chart of the display control method provided by this application;

[0022] Fig.10 This is the eighth flow chart of the display control method provided by this application;

[0023] Fig.11 It is one of the schematic diagrams of the electronic device of the present application displaying a preview mark;

[0024] Fig.12 This is the second schematic diagram of the electronic device of the present application displaying a preview mark;

[0025] Fig.13 This is the ninth flowchart of the display control method provided by this application;

[0026] Fig.14 A schematic diagram of the electronic device of the present application receiving a second input of a user to a preview mark PPT1, and displaying a PPT1 object image indicated by the preview mark PPT1 in response to the second input;

[0027] Fig.15 This is the tenth flowchart of the display control method provided by the present application;

[0028] Fig.16 is a schematic diagram of a user performing a third input on a third object image, and the electronic device updating the display content to a second video frame associated with the third object image;

[0029] Fig.17 This is the eleventh flowchart of the display control method provided by the present application;

[0030] Fig.18 is a schematic diagram of starting the note-taking function of the electronic device of the present application;

[0031] Fig.19 It is a module schematic diagram of the display control device provided by the present application;

[0032] Fig. 20 It is one of the structural schematic diagrams of the electronic device provided by this application;

[0033] Fig.21 This is the second structural schematic diagram of the electronic device provided by this application. DETAILED DESCRIPTION

[0034] The following will be combined with the drawings in the embodiments of the present application to clearly describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all the embodiments. All other embodiments obtained by ordinary technicians in this field based on the embodiments in the present application belong to the scope of protection of this application.

[0035] The terms "first", "second", etc. in the specification and claims of the present application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable under appropriate circumstances, so that the embodiments of the present application can be implemented in an order other than those illustrated or described here, and the objects distinguished by "first", "second", etc. are generally of one type, and the number of objects is not limited. For example, the first object can be one or more. In addition, "and / or" in the specification and claims represents at least one of the connected objects, and the character " / " generally indicates that the objects associated with each other are in an "or" relationship.

[0036] The display control method provided in the embodiment of the present application is described in detail below through specific embodiments and application scenarios in conjunction with the accompanying drawings.

[0037] Please refer to Figure 1 , the display control method of the embodiment of the present application includes:

[0038] Step 200: display the playback interface of the target video;

[0039] The target video playback interface is displayed by an electronic device. The electronic device may be any common terminal device, such as a smart phone, a tablet computer, a wearable smart device, a personal computer, etc. The target video is a video generated after the electronic device completes video recording.

[0040] Step 300: When the first video frame is displayed on the playback interface, a first object image is displayed, wherein the first object image is an image associated with the first video frame, and the first object image includes an image of a target object display area in the first video frame.

[0041] The first video frame is any video frame in the target video that is associated with an object image. The first object image is an image associated with the first video frame. When the first video frame is displayed on the playback interface of the electronic device, the playback interface displays the image of the target object display area in the first video frame, that is, the first object image.

[0042] Specifically, the object image may be a target in the target object display area that users pay close attention to in various scenarios. For example, in the scenario of e-commerce live broadcast, the object image may be an image of a product recommended by an online shopping guide. In the scenario of e-commerce live broadcast, the target video is a video of the product promotion process obtained by recording the product promoted by the online shopping guide during the process of the online shopping guide promoting the product.

[0043] In the teaching scene, the object image can be a PPT image 10 used by the teacher during the lecture, or a blackboard image 20 where the teacher writes the teaching content. In the teaching scene, the target video is a video of the teaching process obtained by recording the PPT image 10 and / or the blackboard image 20 during the teacher's teaching.

[0044] In the urban shooting scene, the object image can be a building image or a static scene image (such as flowers, birds, insects, fish, etc.) taken by the user. In the urban shooting scene, the target video is a video of the urban shooting process obtained by recording the building image or the static scene image (such as flowers, birds, insects, fish, etc.) during the shooting process.

[0045] In addition, each video frame has its corresponding frame code, which is the ID number of each video frame. For example, the frame codes corresponding to the first, second and third frames of the video are 00001, 00002 and 00003, respectively. The frame code of the video frame is associated with the corresponding object image. Specifically, a mapping relationship between the frame code of the video frame and the corresponding object image is established. When the playback interface displays the first video frame, the first object image corresponding to the frame code of the first video frame is displayed. For example, the PPT image 10 is switched at the position where the frame code of the target video is 1080 frames. When the playback interface displays 1080 frames, the first object image corresponding to the 1080 frames is played, and the position of the change of the PPT image 10 in the recorded video can be accurately recorded through the frame code of the video frame.

[0046] When the first video frame is displayed through the playback interface of the target video, the first object image is displayed. Since the first object image is an image associated with the first video frame, the first object image includes the image of the target object display area in the first video frame. Therefore, when the user is retracing the target video, he can quickly know the first object image corresponding to the target object display area in the first video frame played by the target video, so as to associate the first video frame with the first object image corresponding to the PPT content in the first video frame; and obtain the corresponding position of the first object image in the target video. Therefore, the user can quickly know the distribution of the video content in the target video, and can quickly select the time point of the content of interest in the target video for viewing, thereby improving the efficiency of obtaining the target content in the recorded video.

[0047] For other aspects of this application, please refer to Figure 2 , step 200, before displaying the playback interface of the target video, further comprising:

[0048] Step 110: During the process of recording the target video, at least one target video frame is determined, where the target video frame includes an object display area of ​​a preset object type.

[0049] The object display area of ​​the preset object type may include an object display area in the target video frame. Taking the teaching scene as an example, the object display area of ​​the preset object type may be the PPT content demonstrated by the teacher during the teaching process. Figure 3 One of the target images is a PPT image 10. At this time, the PPT image 10 shows "1+1=2", which indicates an application scenario in which a teacher teaches "1+1=2" through PPT in a math class. Each target video frame includes a PPT image 10 of the teacher in the teaching process.

[0050] Step 120: extract the image of the object display area in each target video frame to obtain at least one object image.

[0051] The PPT image 10 in each target video frame is extracted by an electronic device to obtain at least one object image including the PPT image 10. In this embodiment, each target video frame corresponds to its object image one by one. The number of object images is the same as the number of target video frames.

[0052] Step 130: Store each object image in association with the corresponding target video frame.

[0053] Each object image is associated and stored with the corresponding target video frame by an electronic device. When the target video frame is played in the target video playback interface, the object image corresponding to the target video frame is displayed. For example, when the 1080th video frame is played, the PPT1 image corresponding to the 1080th video frame is displayed. This allows the user to quickly know the first object image corresponding to the target object display area in the first video frame played by the target video when retracing the target video, thereby associating the first video frame with the first object image corresponding to the PPT content in the first video frame. Improve the efficiency of obtaining the target content in the recorded video.

[0054] For other aspects of this application, please refer to Figure 4 , the at least one target video frame includes a first object display area of ​​a preset first object type and a second object display area of ​​a preset second object type. That is, the number of object display areas of the preset object type may also include two or more. For example, in a teaching scenario, the first object display area of ​​the preset first object type may be a display area corresponding to the PPT content in the target video frame; the second object display area of ​​the preset second object type may be a display area corresponding to the blackboard in the target video frame.

[0055] Step 120, extracting the image of the object display area in each target video frame to obtain at least one object image, includes:

[0056] Step 120a, extract the image of the first object display area in each target video frame to obtain at least one first object image, and extract the image of the second object display area in each target video frame to obtain at least one second object image.

[0057] For example, in a teaching scenario, the first object display area may be a PPT object display area, and the second object display area may be a blackboard object display area. Figure 5 , Figure 5 A schematic diagram showing the electronic device of the present application recording multiple object images. Figure 5 The multiple object images in the example include a PPT image 10 and a blackboard image 20. The PPT image 10 is a first object image, and the blackboard image 20 is a second object image. Figure 5 The PPT image 10 in the figure shows "1+1=2". Figure 5 The blackboard image 20 in the figure shows "1+2=3", which indicates an application scenario in which a teacher teaches through PPT and black and white. The specific scenario is that after the PPT image 10 shows "1+1=2", the teacher writes the question of what 1+2 equals on the blackboard in order to ask the students a question, and finally displays the answer "1+2=3" shown in the blackboard image 20.

[0058] Step 130, storing each object image in association with the corresponding target video frame, includes:

[0059] Step 130a: store each of the first object image, the second object image and the corresponding target video frame in association with each other.

[0060] Each of the first object image, the second object image and the corresponding target video frame are stored in association with each other through an electronic device. For example, each PPT image 10, blackboard image 20 and the corresponding target video frame are stored in association with each other electronically. So that when the user is retracing the target video, when the playback interface of the target video plays to each target video frame, he can quickly know the PPT image 10 (first object image) and blackboard image 20 (second object image) corresponding to the target video frame played by each target video. In this way, the user obtains the association between the target video frame and the PPT image 10 and the blackboard image 20, thereby improving the efficiency of obtaining the target content in the recorded video.

[0061] For other aspects of this application, please refer to Figure 6 , step 110, determining at least one target video frame, comprising:

[0062] Step 111a, acquiring a first video frame and a second video frame, wherein the acquisition time of the first video frame is earlier than that of the second video frame;

[0063] This embodiment is described based on the situation where there is animation in the PPT content. The electronic device obtains a first video frame and a second video frame. Among them, the first video frame and the second video frame respectively refer to two video frames that are gradually displayed in a complete PPT image 10 including animation effects. For example, the first video frame is collected at 1 minute and 00 seconds of the target video, and the content of image A is displayed in the PPT content in the first video frame at this time (at this time, image A is part of the complete PPT image 10, and the other part is fully displayed when the second video frame is played); the second video frame is collected at 2 minutes and 00 seconds of the target video, and the content of the complete PPT image 10 is displayed in the PPT content of the second video frame at this time.

[0064] Step 112a, obtaining a first image content difference value between the object display area of ​​the first video frame and the second video frame;

[0065] The first image content difference value between the object display area of ​​the first video frame and the second video frame is obtained by the electronic device. For example, the first PPT image 10 corresponding to the first video frame is obtained by the electronic device using an AI algorithm, and the second PPT image 10 corresponding to the second video frame is obtained by the electronic device using an AI algorithm. The first image content difference value between the object display area of ​​the first video frame and the second video frame is obtained based on the above-mentioned first PPT image 10 and second PPT image 10.

[0066] Step 113a: when the first image content difference value is less than a preset first threshold, determine the second video frame as a target video frame.

[0067] When the difference value of the first image content is less than the preset first threshold, the first video frame and the second video frame can be considered as two frames of images displayed step by step in the same PPT image 10. At this time, the electronic device should determine the second video frame as the target video frame. That is, the electronic device should use the video frame of the image that fully displays the entire PPT content as the target video frame.

[0068] For example, in the 3 minutes from 2 minutes to 5 minutes of the target video, four PPTs are updated, such as: PPT2, PPT3, PPT4, and PPT5, which sequentially add the content of 4 parts of a certain page of PPT image 10. For example, in PPT1 (i.e., the first page of PPT), a line of words "My favorite writers are:" is displayed. In PPT2, a line of words "Writer A" is updated on the basis of PPT1. At this time, PPT2 displays 20% of the content of the complete PPT image 10, and then this frame is recorded as the starting point, and the image of PPT2 can be segmented out by the AI ​​algorithm. In PPT3, a line of words "Writer B" is updated on the basis of PPT2. At this time, PPT3 displays 50% of the content of the complete PPT image 10, and then this frame is recorded as the starting point, and the image of PPT3 can be segmented out by the AI ​​algorithm. In PPT4, a line of words "Writer C" is updated on the basis of PPT3. At this time, PPT4 displays 80% of the content of the complete PPT image 10, and then this frame is recorded as the starting point, and the image of PPT4 can be segmented out by the AI ​​algorithm. In PPT5, a line of words "Writer D" is updated on the basis of PPT4. At this time, PPT5 displays 100% of the content of the complete PPT image 10. Then the content displayed in PPT5 includes five lines of words: "My favorite writers are:", "Writer A", "Writer B", "Writer C", "Writer D". Then this frame is recorded as the starting point, and the image of PPT 5 can be segmented by the AI ​​algorithm. At this time, since the content difference value between two adjacent PPT images 10 in PPT2, PPT3, PPT4, and PPT5 is less than the preset first threshold, it means that PPT2, PPT3, and PPT4 are intermediate PPT images gradually displayed in a complete PPT image 10. At this time, PPT5 is used as the target video frame so that the electronic device associates and stores the target video frame with the object image in the object display area of ​​the target video frame. Therefore, when the target video frame is played on the playback interface, the PPT image 10 representing the complete content of the PPT can be associated with the target video frame for display. The intermediate state of the PPT image 10 is not displayed. It is ensured that the user can obtain the PPT image 10 with the complete PPT content.

[0069] Among them, the above-mentioned AI algorithm can adopt LSTM (Long Short Term Memory) + CTC (Connectionist Temporal Classifier) ​​recognition algorithm, CRNN (Convolutional Recurrent Neural Network) recognition algorithm, etc. The preset first threshold can be set according to actual conditions. For example, the preset first threshold is set to 70%. It should be noted that the specific values ​​of the preset first threshold listed above are only for those skilled in the art to understand the technical solution of the present application, and should not be understood as a specific limitation on the preset first threshold of the present application.

[0070] For other aspects of this application, please refer to Figure 7 , step 110, determining at least one target video frame, comprising:

[0071] Step 111b, acquiring a third video frame and a fourth video frame, wherein the acquisition time of the third video frame is earlier than that of the fourth video frame;

[0072] This embodiment is described based on the situation that there is no animation in the PPT content. The third video frame and the fourth video frame are acquired by the electronic device, and at this time, the third video frame and the fourth video frame are two frames with different PPT contents in the object display area. The acquisition time of the third video frame is earlier than that of the fourth video frame. For example, the third video frame is acquired at 4 minutes and 00 seconds of the target video, and the fourth video frame is acquired at 5 minutes and 00 seconds of the target video.

[0073] Step 112b, obtaining a second image content difference value between the object display area of ​​the third video frame and the fourth video frame;

[0074] The second image content difference value between the object display area of ​​the third video frame and the fourth video frame is obtained by the electronic device. For example, the third PPT image corresponding to the third video frame is obtained by the electronic device using an AI algorithm, and the fourth PPT image corresponding to the fourth video frame is obtained by the electronic device using an AI algorithm. The first image content difference value between the object display area of ​​the third video frame and the fourth video frame is obtained based on the third PPT image and the fourth PPT image.

[0075] It can be understood that when the required object image is a blackboard, the third PPT image can also be replaced by the third blackboard image, and the fourth PPT image can also be replaced by the fourth blackboard image.

[0076] Step 113b: when the second image content difference value is greater than a preset second threshold, determine the fourth video frame as a target video frame.

[0077] When the difference value of the second image content is greater than the preset second threshold, it means that there is a large difference between the object display area of ​​the fourth video frame and the object display area of ​​the third video frame, that is, when the target video is recorded to the fourth video frame, the PPT content is switched. At this time, the fourth video frame where the PPT image 10 is switched is determined to be the target video frame.

[0078] The content of PPT1 is displayed in the object display area of ​​the third video frame, for example, the object display area of ​​the third video frame displays the biography and major works of writer A. The content of PPT2 is displayed in the object display area of ​​the fourth video frame, for example, the object display area of ​​the fourth video frame displays the biography and major works of writer B. Since the content difference value between PPT2 and PPT1 is greater than the preset second threshold value, the biography and major works of writer B and the biography and major works of writer A are obviously PPT contents of two different themes. At this time, it is explained that the PPT2 in the object display area of ​​the fourth video frame is different from the PPT1 in the object display area of ​​the third video frame, that is, the PPT content has been switched, and at this time, the fourth video frame where PPT2 is located is determined to be the target video frame. Therefore, in the target video playback interface, when the fourth video frame is played, the PPT image 10 of the object display area of ​​the fourth video frame can be displayed, so that the user obtains the association between the target video frame and the PPT image 10, thereby improving the efficiency of obtaining the target content in the recorded video.

[0079] The preset second threshold value can be set according to actual conditions. For example, the preset second threshold value is set to 70%. It should be noted that the specific values ​​of the preset second threshold values ​​listed above are only for those skilled in the art to understand the technical solution of the present application, and should not be understood as specific limitations on the preset second threshold values ​​of the present application.

[0080] For other aspects of this application, please refer to Figure 8 , step 110, determining at least one target video frame, comprising:

[0081] Step 111c: upon receiving a first input from a user regarding a fifth video frame displayed on a recording interface of a target video, in response to the first input, determining the fifth video frame as the target video frame.

[0082] By receiving a first input from the user, in response to the first input, the fifth video frame displayed on the recording interface during the video recording process is used as the target video frame. Wherein, the first input includes gesture input, voice input or click input. Specifically, the gesture input includes outputting a preset gesture operation to the screen of the electronic device (such as drawing a "C" shape on the screen). In response to the preset gesture operation, the electronic device uses the fifth video frame displayed on the recording interface as the target video frame. Voice input includes calling out a voice of "marking the target video frame" to the electronic device during the recording process, and the electronic device responds to the voice of "marking the target video frame" and uses the fifth video frame displayed on the recording interface during the video recording process as the target video frame. Click input includes the operation of the user clicking the screen on the electronic device (such as double-clicking the screen) or the user touching a physical button (such as a volume button) on a smart phone, for example, the user double-clicks the screen on the electronic device during the recording process, and the electronic device uses the fifth video frame displayed on the recording interface during the video recording process as the target video frame.

[0083] The target video frame can be freely selected through the user's first input. The user can mark the target video frame according to his or her needs, and associate the target video frame and the PPT image 10 of the object display area of ​​the target video frame for storage, so as to facilitate displaying the PPT image 10 corresponding to the target video frame when displaying the target video frame, thereby improving the freedom and flexibility of marking the target content in the recorded video, and improving the efficiency of obtaining the target content in the recorded video.

[0084] For other aspects of this application, please refer to Fig. 9 , step 110, determining at least one target video frame,

[0085] Step 111d, determining a first target video frame and a second target video frame, wherein the first target video frame and the second target video frame include N video frames, where N is a positive integer;

[0086] There is at least one video frame between the first target video frame and the second target video frame, that is, N is greater than or equal to 1.

[0087] Step 110, after determining at least one target video frame, further comprising:

[0088] Step 120b: generating a first video segment based on the first target video frame and the N video frames;

[0089] Step 130b: store the first video clip and the first target video frame in association with each other.

[0090] For example, the N video frames include two video frames, namely, the N1 video frame and the N2 video frame. For example, the object image corresponding to the object display area in the first target video frame is the PPT1 image, and the object image corresponding to the object display area in the N1 video frame is the PPT2 image. The electronic device generates a first video segment by the video segment between the first target video frame and the N1 video frame in the target video, and automatically associates and stores the first video segment with the first target video frame without user operation. Therefore, in the playback interface of the target video, it is convenient to associate the first video segment with the first target video frame. Let the user quickly know that the content explained in the first video segment is the content of the object image corresponding to the first target video frame. Thereby improving the efficiency of obtaining the target content in the recorded video.

[0091] In addition, the electronic device may also merge the small video clips corresponding to the multiple video frames to generate a first video clip. For example, N video frames include two video frames, namely, N1 video frame and N2 video frame. The small video clip corresponding to the first target video frame includes the video clip between the first target video frame and the N1 video frame; the small video clip corresponding to the N1 video frame includes the video clip between the N1 video frame and the N2 video frame. The electronic device may use the video clip between the first target video frame and the N2 video frame in the target video as the first video clip. And the first video clip and the first target video frame are stored in association. For example, the PPT content in the first target video frame is "addition operation", the PPT content of the N1 video frame is "1+1=2", and the PPT content of the N2 video frame is "1+2=3". The electronic device may use the video clip between the first target video frame and the N2 video frame in the target video as the first video clip. Thus, the first video clip explaining the teaching process of "1+1=2" is stored in association with the first target video frame showing "addition operation".

[0092] For other aspects of this application, please refer to Fig.10 , after step 110, at least one target video frame is determined, the method further includes:

[0093] Step 120c: generating a preview mark based on each target video frame;

[0094] The electronic device generates a preview mark 30 based on each target video frame. The preview mark includes a text mark or a vertical line text. The text mark can be a PPT sequence number or a summary of the PPT or blackboard content.

[0095] Step 130c, storing each preview identifier and the corresponding target video frame in association;

[0096] The playback interface of the target video includes a playback progress bar, and the playback progress bar includes at least one preview mark, and the preview mark is used to indicate an object image stored in association with a target video frame.

[0097] The electronic device stores each preview mark in association with the corresponding target video frame so as to display each preview mark on the playback progress bar of the playback interface of the target video. The electronic device can set the PPT serial number (such as PTT1 (11)) or the specific content of the PPT on the target video frame of the playback progress bar of the target video, or set a vertical line on the target video frame of the playback progress bar of the target video, and set the PPT serial number (such as PTT1) at the end of the vertical line away from the playback progress bar. For example, please refer to Fig.11 , Fig.11 It is a schematic diagram of the electronic device of the present application for identification based on an object image. Fig.11 In the example, the electronic device sets a vertical line on the target video frame of the progress bar of the target video, and sets the PPT sequence number (ie, PTT1 (11), PTT2, PTT3, PTT4) at the end of the vertical line away from the progress bar. Fig.11 The target video is a teaching video in which a teacher explains simple addition operations through PPT in a teaching scenario. The preview mark can be realized by setting a vertical line on the target video frame of the progress bar of the target video and setting the PPT serial number at the end of the vertical line away from the progress bar. For example, Fig.11 The content displayed in PPT1(11) is "1+1=2".

[0098] It can be understood that, in the case of multiple object images, the electronic device can display information of the multiple object images on the target video frame of the playback progress bar of the target video. Fig.12 ,For example, Fig.12 It is a schematic diagram of the electronic device of the present application for identification based on multiple object images; the electronic device can set a vertical line on the target video frame of the playback progress bar of the target video, and mark the PPT serial number and blackboard information at the end of the vertical line away from the progress bar (i.e. (PTT1, blackboard), (PTT2(12), blackboard), (PTT3, blackboard), (PTT4, blackboard)). Fig.12 In the example, the target video is a teaching video in which a teacher explains simple addition operations through PPT in a teaching scenario. The preview mark can be realized by setting a vertical line on the target video frame of the progress bar of the target video, and setting the PPT serial number and blackboard information at the end of the vertical line away from the progress bar. For example, Fig.12 The content displayed on PPT1 (12) is "2+2=4"; the content displayed on the blackboard 20 is "2+3=5".

[0099] For other application scenarios, such as in the scenario of e-commerce live broadcast, the electronic device sets a vertical line on the target video frame representing the target product in the playback progress bar of the target video, and marks the serial number and / or image information of the product at the end of the vertical line away from the progress bar. The user can learn about the product corresponding to a certain video clip by observing the preview mark, and thus select the video clip corresponding to the product he likes to watch.

[0100] By generating a preview mark based on each target video frame and displaying the preview mark in the playback progress bar of the target video playback interface, the user can know the main content corresponding to a certain video segment by observing the preview mark, so that the user can quickly know the distribution of video content in the target video, and quickly select the video frame of the target video with the content of interest for viewing, thereby improving the efficiency of obtaining the target content in the recorded video.

[0101] It should be noted that, under the reminder of the preview mark on the playback progress bar of the target video, the user can segment the target video according to the preview mark, for example, the preview mark on the playback progress bar includes preview mark 1, preview mark 2 and preview mark 3. The user can segment the target video into a first video segment from the video starting point to preview mark 1, a second video segment from preview mark 1 to preview mark 2, a second video segment from preview mark 2 to preview mark 3, and a fourth video segment from preview mark 3 to the end of the video.

[0102] In addition, in addition to segmenting the target video according to each mark on the progress bar, the user can also segment the target video at intervals of multiple marks on the progress bar of the target video, for example, segmenting the target video into a first video segment from the video start point to the preview mark 3, and a second video segment from the preview mark 3 to the video end point.

[0103] The preview mark on the play progress bar of the target video makes it convenient for the user to later edit the target video based on the preview mark.

[0104] For other aspects of this application, please refer to Fig.13 , after step 200, the target video playback interface is displayed, the method further includes:

[0105] Step 300a: receiving a second input from a user regarding a target preview identifier among the at least one preview identifier;

[0106] Among them, the second input is the user's selection operation on the target preview mark on the playback progress bar. Specifically, the user can select the target preview mark by clicking the target preview mark on the playback progress bar on the screen of the smart phone, or by clicking the target preview mark on the playback progress bar with a stylus.

[0107] Step 400a: In response to the second input, display the object image indicated by the target preview mark.

[0108] In response to the second input, the electronic device displays the object image indicated by the target preview mark while playing the target video. Thus, the user can watch the target video while watching the object image (PPT image 10 and / or blackboard image 20) corresponding to the current video frame. The current video frame is associated with the corresponding object image to achieve a better learning effect.

[0109] Among them, in the playback interface of the target video, the object image indicated by the target preview mark can be displayed in a split screen or window manner. Specifically, for example, the target video is played in the left half of the screen, and the PPT1 (11) indicated by the target preview mark corresponding to the user's second input is displayed in the right half of the screen. Or in the playback interface of the target video, the object image indicated by the target preview mark corresponding to the user's second input is displayed in a window manner. Please refer to Fig.14 ,When in the mathematics teaching scene, the left half of the screen plays the target video such as Fig.14 As shown in the “addition operation” in FIG. 1 , the PPT1 (11) indicated by the target preview mark corresponding to the user's second input is displayed in the right half of the screen, for example Fig.14 Displayed is “1+1=2”.

[0110] The target video of the present application includes at least two target video frames; the display control method also includes:

[0111] Step 400b: synthesize at least two object images according to the time sequence in which the object images appear in the target video, and output a synthesized image.

[0112] In some cases, the user does not want to review the recorded target video, but only wants to obtain the completed object image corresponding to the target video. Take PPT as an example of the object image. Therefore, the electronic device can also synthesize at least two object images based on the time sequence in which the object images appear in the target video, and output a synthesized image. For example, the object images in the target video are PPT1, PPT2, and PPT3. Based on the time sequence of PPT1, PPT2, and PPT3. Merge PPT1, PPT2, and PPT3 into a synthetic image. When viewing the synthetic image later, the user can slide the screen of the smartphone from left to right or from top to bottom to view the contents of PPT1, PPT2, and PPT3 in turn. It should be noted that there is no animation in the above-mentioned PPT content, that is, the PPT content is displayed completely at one time and will not be displayed step by step through animation effects.

[0113] At least two object images are synthesized according to the time sequence in which the object images appear in the target video, and a synthesized image is output. The user can obtain multiple object images corresponding to the target video without reviewing the content of the recorded target video, and learn the order in which the multiple object images are explained. The user can learn based on the object images, and improve the efficiency of obtaining the target content in the recorded video.

[0114] In other aspects of the present application, the playback interface of the target video includes at least one object image identifier, which is used to indicate an object image; the object image identifiers are displayed in the order of the time in which the indicated object images appear in the target video.

[0115] Specifically, the object image identifier can be displayed simultaneously with the target video playback interface in a split screen manner. For example, the target video is played in the upper half of the current screen, and the PPT image 10 identifier is displayed in the lower half of the current screen in the order of the time when the PPT image 10 appears in the target video.

[0116] By displaying the object image identifiers in the order in which the object images appear in the target video, the user can learn the order in which the multiple object images in the target video are explained. The user can learn based on the object images, thereby improving the efficiency of obtaining the target content in the recorded video.

[0117] It can be understood that when the object image includes multiple types, the PPT image 10 logo and the blackboard image 20 logo are displayed in sequence in the lower half of the screen according to the chronological order in which the PPT image 10 and the blackboard image 20 appear in the target video.

[0118] For other aspects of this application, please refer to Fig.15 After step 130, each object image is associated with the corresponding target video frame and stored, the method further includes:

[0119] Step 140a, receiving a third input of a third object image from a user;

[0120] The third object image is any object image obtained from the target video. The third input may be various preset operations on the third object image, such as long pressing the third object image on the screen, double-clicking the third object image, etc.

[0121] Step 150a: In response to the third input, update the display content of the playback interface of the target video to the second video frame associated with the third object image.

[0122] In response to the third input, the electronic device updates the display content of the playback interface of the target video to the second video frame associated with the third object image, thereby playing the content of the second video frame corresponding to the third object image.

[0123] Since the third object image corresponds to the main content of a video segment, the user can know the main content of the corresponding video segment through the third object image, so it is convenient to select and watch each third object image, and improve the efficiency of obtaining the target content in the recorded video.

[0124] For example, see Fig.16 , the target video includes three sub-videos, namely the first sub-video, the second sub-video and the third sub-video. The object image corresponding to the first sub-video is PPT1(11), the object image corresponding to the second sub-video is PPT2, and the object image corresponding to the third sub-video is PPT3. At this time, the object images PPT1, PPT2 and PPT3 of the target video can be displayed in the lower half of the current screen. The user can know that the target video is divided into three sub-videos by seeing PPT1, PPT2 and PPT3. And the three sub-videos correspond to three object images respectively. If the user is only interested in the video content corresponding to PPT1(11) during video replay, the user clicks on the object image of PPT1(11) in the lower half, and the electronic device immediately plays the video frame corresponding to PPT1(11). For example, when in a mathematics teaching scenario, the target video is as follows Fig.16 In the video with the PPT content of "addition operation" shown in , PPT1(11) corresponds to the PPT corresponding to the sub-video of the teaching content of "1+1=2" in the target video.

[0125] It should be noted that there is no animation in the above-mentioned PPT content, that is, the PPT content is displayed completely at one time and will not be displayed gradually through animation effects.

[0126] By associating and storing each object image with the corresponding target video frame, when displaying, as long as the third object image is input, the display content of the target video playback interface can jump to the second video frame corresponding to the third object image for playback. Thus, the user can quickly select the object image (PPT image 10 and / or blackboard image 20) of the content of interest in the target video for study, thereby improving the efficiency of obtaining the target content in the recorded video.

[0127] For other aspects of this application, please refer to Fig.17 , step 120, after extracting the image of the object display area in each target video frame to obtain at least one object image, it also includes:

[0128] Step 130b, displaying a fourth target video frame in the first area of ​​the display screen, and displaying a fourth object image in the second area of ​​the display screen;

[0129] The fourth target video frame is any target video frame in the target video. The first area and the second area can be screen areas obtained according to various division methods. For example, the fourth target video frame is displayed in the left half area of ​​the display screen, and the fourth object image corresponding to the fourth target video frame is displayed in the right half area of ​​the display screen.

[0130] Step 140b, receiving a fourth input from the user regarding the fourth object image;

[0131] Among them, the fourth input is the "trigger switch" for the user to start the note-taking function. When the electronic device detects the fourth input of the user, the note-taking function is activated. Similarly, the fourth input includes gesture input, voice input or click input. Gesture input includes outputting preset gesture operations to the screen of the electronic device (such as drawing a "C" shape on the screen), etc. The electronic device responds to the preset gesture operation, and the electronic device activates the note-taking function. Voice input includes calling out a voice of "take notes" to the electronic device during the recording process, and the electronic device responds to the voice of "take notes", and the electronic device activates the note-taking function. Click input includes the user clicking the screen on the electronic device (such as double-clicking the screen) or the user touching a physical button (such as a volume button) on a smartphone. For example, when the user double-clicks the screen on the electronic device during the recording process, the electronic device activates the note-taking function.

[0132] Step 150b: In response to the fourth input, display information input by the fourth input on the fourth object image.

[0133] The electronic device responds to the fourth input and displays the information input by the fourth input on the fourth object image. Specifically, the note-taking function can be implemented by splitting the screen. Fig.18 For example, a video is recorded on the left screen of the screen, PPT1 (11) is displayed on the right screen of the screen, and the user's fourth input is received and displayed. The electronic device synthesizes the user's fourth input with the image of PPT1 in the background for display. The fourth input can be text content input by the user by clicking the touch keyboard, sliding the screen, or using a stylus on the smartphone. Specifically, when in a mathematics teaching scenario, the left half of the screen displays the fourth target video frame, for example Fig.18 The fourth target video frame shows the teacher teaching "1+1=2". The note content corresponding to the user's fourth input is displayed in the right half of the screen, for example Fig.18The note content "What is 1+2?" is displayed. It should be noted that in some other embodiments, the note-taking function can also be implemented through a small window mode. That is, a video is recorded through a small window in the upper right corner of the current screen, and a fourth object image is displayed in other areas of the current screen except the small window and a fourth input from the user is received.

[0134] By receiving the fourth input of the user to the displayed fourth object image and displaying the information input by the fourth input on the fourth object image, the user can take notes on the current content during the target video recording process, which is convenient for recalling when watching the target video later, and improving the learning efficiency of the target video.

[0135] In other aspects of the present application, after step 120, extracting the image of the object display area in each target video frame to obtain at least one object image, the process further includes:

[0136] Step 120d: perform image quality enhancement processing on the object image.

[0137] The object image can be sharpened by an electronic device to achieve the effect of enhancing the image quality. In the teaching scene, the edge contour of the PPT image 10 or the blackboard image 20 can be highlighted by sharpening the object image to facilitate target recognition. The algorithms that can be used for sharpening include gradient method, operator, high-pass filtering, mask matching method, statistical difference method, etc. In addition, the object image can also be smoothed to achieve the effect of enhancing the image quality. The image noise of the object image can be eliminated by smoothing the object image. The algorithms that can be used for smoothing include mean filtering, median filtering, etc.

[0138] By performing image quality enhancement processing on the object image, the image quality of the object image (such as a PPT image) is improved, the trouble of post-editing and reshooting by the user is avoided, and the comfort and experience of viewing the object image are improved, while facilitating the operation of the electronic device to determine the target video frame based on the object image.

[0139] In the embodiment of the present application, when the first video frame is displayed through the playback interface of the target video, the first object image is displayed. Since the first object image is an image associated with the first video frame, the first object image includes an image of the target object display area in the first video frame. Thus, when the user is retracing the target video, he can quickly know the first object image corresponding to the target object display area in the first video frame played by the target video, and obtain the corresponding position of the first object image in the target video. Thus, the user can quickly know the distribution of the video content in the target video, can quickly select the time point of the content of interest in the target video for learning, and improve the efficiency of obtaining the target content in the recorded video.

[0140] It should be noted that the display control method provided in the embodiment of the present application can be executed by a display control device or a control module in the display control device for executing the video recording method. In the embodiment of the present application, the display control device provided in the embodiment of the present application is described by taking the method of executing video recording by the display control device as an example.

[0141] Please refer to Fig.19 , the display control device includes:

[0142] The first display module 201 is used to display the playback interface of the target video;

[0143] The second display module 202 is used to display a first object image when the first video frame is displayed on the playback interface, wherein the first object image is an image associated with the first video frame, and the first object image includes an image of a target object display area in the first video frame.

[0144] Wherein, the display control device also includes:

[0145] A first determining module is used to determine at least one target video frame during recording of a target video, wherein the target video frame includes an object display area of ​​a preset object type;

[0146] A first acquisition module, used for extracting the image of the object display area in each target video frame to obtain at least one object image;

[0147] The first association storage module is used to associate and store each object image with the corresponding target video frame.

[0148] Wherein, the at least one target video frame comprises a first object display area of ​​a preset first object type and a second object display area of ​​a preset second object type;

[0149] The first acquisition module includes:

[0150] A first sub-acquisition module, configured to extract an image of the first object display area in each target video frame to obtain at least one first object image, and to extract an image of the second object display area in each target video frame to obtain at least one second object image;

[0151] The first associated storage module includes:

[0152] The first sub-association storage module is used to associate and store each of the first object image, the second object image and the corresponding target video frame.

[0153] Wherein, the first determination module includes:

[0154] A second sub-acquisition module, used to acquire a first video frame and a second video frame, where the acquisition time of the first video frame is earlier than that of the second video frame;

[0155] A third sub-acquisition module, configured to acquire a first image content difference value between the object display area of ​​the first video frame and the second video frame;

[0156] The first sub-determination module is used to determine the second video frame as a target video frame when the first image content difference value is less than a preset first threshold.

[0157] Wherein, the first determination module includes:

[0158] A fourth sub-acquisition module, used to acquire a third video frame and a fourth video frame, wherein the acquisition time of the third video frame is earlier than that of the fourth video frame;

[0159] a fifth sub-acquisition module, configured to acquire a second image content difference value between the object display area of ​​the third video frame and the fourth video frame;

[0160] The second sub-determination module is configured to determine the fourth video frame as a target video frame when the second image content difference value is greater than a preset second threshold.

[0161] Wherein, the first determination module includes:

[0162] The third sub-determination module is used to determine the fifth video frame as the target video frame in response to receiving a first input from a user to the fifth video frame displayed on the recording interface of the target video.

[0163] Wherein, the first determination module includes:

[0164] A fourth sub-determination module is used to determine a first target video frame and a second target video frame, wherein the first target video frame and the second target video frame include N video frames, where N is a positive integer;

[0165] The display control device also includes:

[0166] A first generating module, configured to generate a first video segment based on the first target video frame and the N video frames;

[0167] The second sub-association storage module is used to associate and store the first video segment with the first target video frame.

[0168] The display control device also includes:

[0169] A second generating module, used for generating a preview mark based on each target video frame;

[0170] A third sub-association storage module is used to associate and store each preview identifier with a corresponding target video frame;

[0171] The playback interface of the target video includes a playback progress bar, and the playback progress bar includes at least one preview mark, and the preview mark is used to indicate an object image stored in association with a target video frame.

[0172] The display control device also includes:

[0173] A first receiving module, configured to receive a second input from a user regarding a target preview identifier among the at least one preview identifier;

[0174] A third display module is configured to display the object image indicated by the target preview mark in response to the second input.

[0175] The playback interface of the target video includes at least one object image identifier, and the object image identifier is used to indicate an object image; the object image identifier is displayed in the order of the time when the indicated object image appears in the target video.

[0176] The target video includes at least two target video frames; the display control device also includes:

[0177] The image synthesis module is used to synthesize at least two object images according to the time sequence in which the object images appear in the target video, and output a synthesized image.

[0178] The display control device also includes:

[0179] A second receiving module, configured to receive a third input of a third object image from a user;

[0180] The first updating module is used to update the display content of the playback interface of the target video to the second video frame associated with the third object image in response to the third input.

[0181] The display control device also includes:

[0182] a fourth display module, configured to display a fourth target video frame in the first area of ​​the display screen and a fourth object image in the second area of ​​the display screen;

[0183] A second receiving module, configured to receive a fourth input of the fourth object image from a user;

[0184] The fifth display module is used to display the information input by the fourth input on the fourth object image in response to the fourth input.

[0185] The display control device also includes:

[0186] The image enhancement module is used to perform image quality enhancement processing on the object image.

[0187] The display control device of the embodiment of the present application displays the first object image when the first video frame is displayed through the playback interface of the target video. Since the first object image is an image associated with the first video frame, the first object image includes the image of the target object display area in the first video frame. Therefore, when the user retraces the target video, he can quickly know the first object image corresponding to the target object display area in the first video frame played by the target video, obtain the association between the first video frame and the first object image; and obtain the corresponding position of the first object image in the target video. Therefore, the user can quickly know the distribution of video content in the target video, can quickly select the time point of the content of interest in the target video for viewing, and improve the efficiency of obtaining the target content in the recorded video.

[0188] The display control device in the embodiment of the present application can be a device, or a component, integrated circuit, or chip in a terminal. The device can be a mobile electronic device or a non-mobile electronic device. Exemplarily, the mobile electronic device can be a mobile phone, a tablet computer, a laptop computer, a PDA, an in-vehicle electronic device, a wearable device, an ultra-mobile personal computer (UMPC), a netbook, or a personal digital assistant (PDA), etc. The non-mobile electronic device can be a server, a network attached storage (NAS), a personal computer (PC), a television (TV), a teller machine or a self-service machine, etc., which is not specifically limited in the embodiment of the present application.

[0189] The display control device in the embodiment of the present application may be a device having an operating system. The operating system may be an Android operating system, an iOS operating system, or other possible operating systems, which are not specifically limited in the embodiment of the present application.

[0190] The display control device provided in the embodiment of the present application can realize Figures 1 to 13 To avoid repetition, the various processes implemented by the method embodiment are not described here.

[0191] Alternatively, if Fig. 20As shown, an embodiment of the present application also provides an electronic device 2000, including a processor 2001, a memory 2002, and a program or instruction stored in the memory 2002 and executable on the processor 2001. When the program or instruction is executed by the processor 2001, the various processes of the above-mentioned display control method embodiment are implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0192] It should be noted that the electronic devices in the embodiments of the present application include the mobile electronic devices and non-mobile electronic devices mentioned above.

[0193] Fig.21 A schematic diagram of the hardware structure of an electronic device to implement an embodiment of the present application.

[0194] The electronic device 2000 includes but is not limited to: a radio frequency unit 1001, a network module 1002, an audio output unit 1003, an input unit 1004, a sensor 1005, a display unit 1006, a user input unit 1007, an interface unit 1008, a memory 2002, and a processor 2001 and other components.

[0195] Those skilled in the art will appreciate that the electronic device 100 may also include a power source (such as a battery) for supplying power to each component, and the power source may be logically connected to the processor 2001 through a power management system, thereby implementing functions such as managing charging, discharging, and power consumption management through the power management system. Fig.21 The electronic device structure shown in the figure does not constitute a limitation on the electronic device. The electronic device may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently, which will not be described in detail here.

[0196] Among them, the display unit 1006 is used to display the playback interface of the target video; it is also used to display the first object image when the first video frame is displayed on the playback interface, wherein the first object image is an image associated with the first video frame, and the first object image includes an image of the target object display area in the first video frame.

[0197] When the electronic device of the embodiment of the present application displays the first video frame through the playback interface of the target video, the first object image is displayed. Since the first object image is an image associated with the first video frame, the first object image includes an image of the target object display area in the first video frame. Thus, when the user is retracing the target video, he can quickly know the first object image corresponding to the target object display area in the first video frame played by the target video, and obtain the corresponding position of the first object image in the target video. Thus, the user can quickly know the distribution of the video content in the target video, can quickly select the time point of the content of interest in the target video for learning, and improve the efficiency of obtaining the target content in the recorded video.

[0198] Optionally, processor 2001 is used to determine at least one target video frame during the process of recording a target video, wherein the target video frame includes an object display area of ​​a preset object type; extract an image of the object display area in each target video frame to obtain at least one object image; and store each object image in association with the corresponding target video frame.

[0199] Optionally, the at least one target video frame includes a first object display area of ​​a preset first object type and a second object display area of ​​a preset second object type;

[0200] Optionally, processor 2001 is used to extract the image of the first object display area in each target video frame to obtain at least one first object image, and to extract the image of the second object display area in each target video frame to obtain at least one second object image; and to associate and store each of the first object image, the second object image and the corresponding target video frame.

[0201] Optionally, processor 2001 is used to obtain a first video frame and a second video frame, the acquisition time of the first video frame is earlier than that of the second video frame; obtain a first image content difference value between the object display area of ​​the first video frame and the second video frame; when the first image content difference value is less than a preset first threshold, determine the second video frame as a target video frame.

[0202] Optionally, the processor 2001 is used to obtain a third video frame and a fourth video frame, the acquisition time of the third video frame being earlier than that of the fourth video frame; obtaining a second image content difference value between the object display areas of the third video frame and the fourth video frame; and when the second image content difference value is greater than a preset second threshold, determining the fourth video frame as a target video frame.

[0203] Optionally, the user input unit 1007 is used to, upon receiving a first input from a user of a fifth video frame displayed on a recording interface of a target video, determine the fifth video frame as the target video frame in response to the first input.

[0204] Optionally, processor 2001 is used to determine a first target video frame and a second target video frame, wherein the first target video frame and the second target video frame include N video frames, where N is a positive integer; generate a first video clip based on the first target video frame and the N video frames; and store the first video clip and the first target video frame in association with each other.

[0205] Optionally, processor 2001 is used to generate a preview identifier based on each target video frame; and store each preview identifier in association with the corresponding target video frame; wherein the playback interface of the target video includes a playback progress bar, and the playback progress bar includes at least one preview identifier, and the preview identifier is used to indicate an object image stored in association with a target video frame.

[0206] Optionally, the user input unit 1007 is used to receive a second input from a user regarding a target preview identifier in the at least one preview identifier; and the processor 2001 is used to display an object image indicated by the target preview identifier in response to the second input.

[0207] Optionally, the playback interface of the target video includes at least one object image identifier, and the object image identifier is used to indicate an object image; the object image identifier is displayed in the order of the time when the indicated object image appears in the target video.

[0208] Optionally, the target video includes at least two target video frames;

[0209] The processor 2001 is used to synthesize at least two object images according to the time sequence in which the object images appear in the target video, and output a synthesized image.

[0210] Optionally, the user input unit 1007 is used to receive a third input of a user on a third object image;

[0211] Processor 2001 is used to update the display content of the playback interface of the target video to the second video frame associated with the third object image in response to the third input.

[0212] Optionally, the display unit 1006 is configured to display a fourth target video frame in a first area of ​​the display screen, and display a fourth object image in a second area of ​​the display screen;

[0213] A user input unit 1007, configured to receive a fourth input from a user on the fourth object image;

[0214] The processor 2001 is configured to display information input by the fourth input on the fourth object image in response to the fourth input.

[0215] Optionally, the processor 2001 is used to perform image quality enhancement processing on the object image.

[0216] It should be understood that in the embodiment of the present application, the input unit 1004 may include a graphics processor (Graphics Processing Unit, GPU) 10041 and a microphone 10042, and the graphics processor 10041 processes the image data of the static picture or video obtained by the image capture device (such as a camera) in the video capture mode or the image capture mode. The display unit 1006 may include a display panel 10061, and the display panel 10061 may be configured in the form of a liquid crystal display, an organic light emitting diode, etc. The user input unit 1007 includes a touch panel 10071 and other input devices 10072. The touch panel 10071 is also called a touch screen. The touch panel 10071 may include two parts: a touch detection device and a touch controller. Other input devices 10072 may include, but are not limited to, a physical keyboard, a function key (such as a volume control button, a switch button, etc.), a trackball, a mouse, and a joystick, which will not be repeated here. The memory 2002 can be used to store software programs and various data, including but not limited to applications and operating systems. The processor 2001 may integrate an application processor and a modem processor, wherein the application processor mainly processes an operating system, a user interface, and application programs, and the modem processor mainly processes wireless communications. It is understandable that the modem processor may not be integrated into the processor 2001.

[0217] An embodiment of the present application also provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, the various processes of the above-mentioned display control method embodiment are implemented and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0218] The processor is a processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a computer read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.

[0219] An embodiment of the present application further provides a chip, which includes a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the various processes of the above-mentioned display control method embodiment, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0220] It should be understood that the chip mentioned in the embodiments of the present application can also be called a system-level chip, a system chip, a chip system or a system-on-chip chip, etc.

[0221] It should be noted that, in this article, the terms "comprise", "include" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the sentence "comprises one..." does not exclude the presence of other identical elements in the process, method, article or device including the element. In addition, it should be noted that the scope of the method and device in the embodiment of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in reverse order according to the functions involved, for example, the described method may be performed in an order different from that described, and various steps may also be added, omitted, or combined. In addition, the features described with reference to certain examples may be combined in other examples.

[0222] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM / RAM, a disk, or an optical disk), and includes a number of instructions for a terminal (which can be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods described in each embodiment of the present application.

[0223] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of the present application, ordinary technicians in this field can also make many forms without departing from the purpose of the present application and the scope of protection of the claims, all of which are within the protection of the present application.

Claims

1. A display control method, characterized in that: include: Display the playback interface of the target video; The target video includes at least two target video frames; In the case where the first video frame is displayed on the playback interface, a first object image is displayed, wherein the first object image is an image associated with the first video frame, and the first object image includes an image of a target object display area in the first video frame; At least two object images are synthesized according to the time sequence in which the object images appear in the target video, and a synthesized image is output; wherein the synthesized image is displayed completely at one time without animation display effect.

2. The display control method according to claim 1, characterized in that: Before displaying the playback interface of the target video, the method further includes: During recording of a target video, determining at least one target video frame, wherein the target video frame includes an object display area of ​​a preset object type; Extracting an image of the object display area in each target video frame to obtain at least one object image; Each object image is stored in association with the corresponding target video frame.

3. The display control method according to claim 2, characterized in that: The at least one target video frame includes a first object display area of ​​a preset first object type and a second object display area of ​​a preset second object type; The extracting the image of the object display area in each target video frame to obtain at least one object image includes: Extracting an image of the first object display area in each target video frame to obtain at least one first object image, and extracting an image of the second object display area in each target video frame to obtain at least one second object image; The storing each object image and the corresponding target video frame in association with each other includes: Each of the first object image, the second object image and the corresponding target video frame are stored in association.

4. The display control method according to claim 2, characterized in that: The determining of at least one target video frame comprises: Acquire a first video frame and a second video frame, where the acquisition time of the first video frame is earlier than that of the second video frame; Acquire a first image content difference value between the object display area of ​​the first video frame and the second video frame; When the first image content difference value is less than a preset first threshold, the second video frame is determined as a target video frame.

5. The display control method according to claim 2, characterized in that: The determining of at least one target video frame comprises: Acquire a third video frame and a fourth video frame, wherein the acquisition time of the third video frame is earlier than that of the fourth video frame; Acquire a second image content difference value between the object display area of ​​the third video frame and the fourth video frame; When the second image content difference value is greater than a preset second threshold, the fourth video frame is determined as a target video frame.

6. The display control method according to claim 2, characterized in that: The determining of at least one target video frame comprises: In the case of receiving a first input from a user to a fifth video frame displayed on a recording interface of a target video, in response to the first input, the fifth video frame is determined as the target video frame.

7. The display control method according to claim 2, characterized in that: The determining of at least one target video frame comprises: Determine a first target video frame and a second target video frame, wherein the first target video frame and the second target video frame include N video frames, where N is a positive integer; After determining at least one target video frame, the method further includes: Generate a first video clip based on the first target video frame and the N video frames; The first video segment and the first target video frame are stored in association with each other.

8. The display control method according to claim 2, characterized in that: After determining at least one target video frame, the method further includes: Based on each target video frame, generate a preview mark; Associating and storing each preview identifier with the corresponding target video frame; The playback interface of the target video includes a playback progress bar, and the playback progress bar includes at least one preview mark, and the preview mark is used to indicate an object image stored in association with a target video frame.

9. The display control method according to claim 8, characterized in that: After displaying the playback interface of the target video, the method further includes: receiving a second input from a user regarding a target preview identifier among the at least one preview identifier; In response to the second input, an object image indicated by the target preview mark is displayed.

10. The display control method according to claim 1, characterized in that: The playback interface of the target video includes at least one object image identifier, and the object image identifier is used to indicate an object image; the object image identifier is displayed in the order of the time when the indicated object image appears in the target video.

11. The display control method according to claim 2, characterized in that: After storing each object image in association with the corresponding target video frame, the method further includes: receiving a third input of a third object image from a user; the third object image is any object image obtained from the target video; In response to the third input, the display content of the playback interface of the target video is updated to the second video frame associated with the third object image.

12. The display control method according to claim 2, characterized in that: After extracting the image of the object display area in each target video frame to obtain at least one object image, the method further includes: displaying a fourth target video frame in a first area of ​​the display screen, and displaying a fourth object image in a second area of ​​the display screen; receiving a fourth input from a user regarding the fourth object image; In response to the fourth input, information input by the fourth input is displayed on the fourth object image.

13. The display control method according to claim 2, characterized in that: After extracting the image of the object display area in each target video frame to obtain at least one object image, the method further includes: Perform image quality enhancement processing on the object image.

14. A display control device, characterized in that: include: A first display module, used to display the playback interface of the target video; The target video includes at least two target video frames; A second display module, configured to display a first object image when the first video frame is displayed on the playback interface, wherein the first object image is an image associated with the first video frame, and the first object image includes an image of a target object display area in the first video frame; The image synthesis module is used to synthesize at least two object images according to the time sequence of the object images appearing in the target video, and output a synthesized image; wherein the synthesized image is displayed completely at one time without animation display effect.

15. The display control device according to claim 14, characterized in that: The display control device further comprises: A first determining module is used to determine at least one target video frame during recording of a target video, wherein the target video frame includes an object display area of ​​a preset object type; A first acquisition module, used for extracting the image of the object display area in each target video frame to obtain at least one object image; The first associative storage module is used to associate and store each object image with the corresponding target video frame.

16. The display control device according to claim 15, characterized in that: The at least one target video frame includes a first object display area of ​​a preset first object type and a second object display area of ​​a preset second object type; The first acquisition module includes: A first sub-acquisition module, configured to extract an image of the first object display area in each target video frame to obtain at least one first object image, and to extract an image of the second object display area in each target video frame to obtain at least one second object image; The first associated storage module includes: The first sub-association storage module is used to associate and store each of the first object image, the second object image and the corresponding target video frame.

17. The display control device according to claim 15, characterized in that: The first determination module includes: A second sub-acquisition module, used to acquire a first video frame and a second video frame, where the acquisition time of the first video frame is earlier than that of the second video frame; A third sub-acquisition module, configured to acquire a first image content difference value between the object display area of ​​the first video frame and the second video frame; The first sub-determination module is used to determine the second video frame as a target video frame when the first image content difference value is less than a preset first threshold.

18. The display control device according to claim 15, characterized in that: The first determination module includes: A fourth sub-acquisition module, used to acquire a third video frame and a fourth video frame, wherein the acquisition time of the third video frame is earlier than that of the fourth video frame; a fifth sub-acquisition module, configured to acquire a second image content difference value between the object display area of ​​the third video frame and the fourth video frame; The second sub-determination module is configured to determine the fourth video frame as a target video frame when the second image content difference value is greater than a preset second threshold.

19. The display control device according to claim 15, characterized in that: The first determining module comprises: A fourth sub-determination module is used to determine a first target video frame and a second target video frame, wherein the first target video frame and the second target video frame include N video frames, where N is a positive integer; The display control device also includes: A first generating module, configured to generate a first video segment based on the first target video frame and the N video frames; The second sub-association storage module is used to associate and store the first video segment with the first target video frame.

20. The display control device according to claim 15, characterized in that: The display control device further comprises: A second generating module, used for generating a preview mark based on each target video frame; A third sub-association storage module is used to associate and store each preview identifier with a corresponding target video frame; The playback interface of the target video includes a playback progress bar, and the playback progress bar includes at least one preview mark, and the preview mark is used to indicate an object image stored in association with a target video frame.

21. The display control device according to claim 20, characterized in that: The display control device further comprises: A first receiving module, configured to receive a second input from a user regarding a target preview identifier among the at least one preview identifier; A third display module is configured to display the object image indicated by the target preview mark in response to the second input.

22. The display control device according to claim 14, characterized in that: The playback interface of the target video includes at least one object image identifier, and the object image identifier is used to indicate an object image; the object image identifier is displayed in the order of the time when the indicated object image appears in the target video.

23. An electronic device, characterized in that: It includes a processor, a memory, and a program or instruction stored in the memory and executable on the processor, wherein the program or instruction, when executed by the processor, implements the steps of the display control method according to any one of claims 1 to 13.

Images