Screen recording method and device

Abstract

The invention discloses a screen recording method and device, and belongs to the technical field of communication. The method comprises the following steps: receiving a first input in a process of recording a screen of a display picture; in response to the first input, identifying a first target video frame containing at least one type of interference element in a recorded video; and removing interference elements of a target type in the first target video frame to obtain a first video, the interference elements of the target type being at least one of the interference elements of the at least one type.

Description

Technical Field

[0001] This application belongs to the field of communication technologies, and particularly relates to a screen recording method and apparatus. Background Art

[0002] With the rapid development of social media and webcasting, screen recording and video sharing have become an indispensable part of people's lives. During the screen recording process, there may be some interfering elements in the video frames, such as bullet screens, SMS verification codes, application notifications, etc., which affect the quality of the video being recorded.

[0003] Currently, during the screen recording process, users usually manually make some shielding settings before recording to avoid the appearance of some interfering information. However, the existing manual setting method has poor flexibility. Summary of the Invention

[0004] The purpose of the embodiments of this application is to provide a screen recording method and apparatus, which can solve the problem that users need to manually perform shielding settings before video recording currently, resulting in poor flexibility of video recording.

[0005] In a first aspect, the embodiments of this application provide a screen recording method, which includes:

[0006] Receiving a first input during the process of screen recording a display screen;

[0007] In response to the first input, identifying a first target video frame in the recorded video that contains at least one type of interfering element;

[0008] Removing the interfering elements of the target type in the first target video frame to obtain a first video, where the interfering elements of the target type are at least one of the at least one type of interfering element.

[0009] In a second aspect, the embodiments of this application provide a screen recording apparatus, including:

[0010] An input module, configured to receive a first input during the process of screen recording a display screen;

[0011] An identification module, configured to identify a first target video frame in the recorded video that contains at least one type of interfering element in response to the first input;

[0012] A removal module, configured to remove the interfering elements of the target type in the first target video frame to obtain a first video, where the interfering elements of the target type are at least one of the at least one type of interfering element.

[0013] In a third aspect, an embodiment of the present application provides an electronic device, which includes a processor and a memory. The memory stores a program or instruction that can run on the processor, and when the program or instruction is executed by the processor, the steps of the method described in the first aspect are implemented.

[0014] In a fourth aspect, an embodiment of the present application provides a readable storage medium, on which a program or instruction is stored, and when the program or instruction is executed by a processor, the steps of the method described in the first aspect are implemented.

[0015] In a fifth aspect, an embodiment of the present application provides a chip, which includes a processor and a communication interface. The communication interface is coupled to the processor, and the processor is used to run a program or instruction to implement the method described in the first aspect.

[0016] In a sixth aspect, an embodiment of the present application provides a computer program product, which is stored in a storage medium, and the program product is executed by at least one processor to implement the method described in the first aspect.

[0017] In the embodiment of the present application, even if interference elements appear in the recorded video frames during recording, affecting the quality of the recorded video, the already recorded video can be processed while recording to erase the interference elements therein. In this way, users do not need to perform special shielding settings before recording, so that during the video recording process, users can receive interference information and ensure the quality of the finally recorded video, improving the recording flexibility. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] Figure 1 A schematic diagram of an application scenario of the screen recording method provided by the embodiment of the present application;

[0019] Figure 2 A flowchart of the screen recording method provided by the embodiment of the present application;

[0020] Figure 3 A diagram for identifying and prompting interference elements provided by the embodiment of the present application;

[0021] Figure 4 An operation schematic diagram for erasing interference elements provided by the embodiment of the present application;

[0022] Figure 5 A schematic diagram of the two-way recording process provided by the embodiment of the present application;

[0023] Figure 6 A schematic diagram for filtering bullet screens during the post-real-time recording process provided by the embodiment of the present application;

[0024] Figure 7 A preview display effect diagram provided by the embodiment of the present application;

[0025] Figure 8 Schematic diagram of progress bar provided by an embodiment of the present application;

[0026] Figure 9 Schematic diagram of progress identifier display provided by an embodiment of the present application;

[0027] Figure 10 Schematic diagram of progress identifier display provided by another embodiment of the present application;

[0028] Figure 11 Schematic diagram of interference element identification process provided by an embodiment of the present application;

[0029] Figure 12 Schematic diagram of interference element troubleshooting provided by an embodiment of the present application;

[0030] Figure 13 Schematic diagram of screen recording method process provided by another embodiment of the present application;

[0031] Figure 14 Schematic diagram of the structure of a screen recording device provided by an embodiment of the present application;

[0032] Figure 15 Schematic diagram of the structure of an electronic device provided by an embodiment of the present application;

[0033] Figure 16 Schematic diagram of the hardware structure of an electronic device provided by another embodiment of the present application. Detailed implementation manners

[0034] Next, the technical solutions in the embodiments of the present application will be clearly described in conjunction with the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art belong to the scope of protection of the present application.

[0035] The terms "first", "second", etc. in the specification and claims of the present application are used to distinguish similar objects, rather than to describe a specific order or sequence. It should be understood that such data can be interchanged under appropriate circumstances so that the embodiments of the present application can be implemented in an order other than those illustrated or described herein, and the objects distinguished by "first", "second", etc. are usually of the same type, and the number of objects is not limited. For example, the first object can be one or multiple. In addition, "and / or" in the specification and claims represents at least one of the connected objects, and the character " / ", generally represents an "or" relationship between the associated objects before and after.

[0036] The following describes in detail the screen recording method and device provided by the embodiments of the present application in combination with specific embodiments and their application scenarios.

[0037] The screen recording method provided by the embodiments of the present application can be applied to various video recording scenarios such as game recording, teaching and education, and video live streaming.

[0038] Exemplarily, taking the teaching and education video recording scenario as an example, when a teacher uses an electronic device (such as a mobile phone) to record a teaching video, in order to ensure the recording quality and avoid the notification event pop-up triggered by the mobile phone being recorded into the picture, the teacher may need to turn off the mobile phone notification in advance, which may cause the teacher to miss some important notification events. The video recording quality and the access to notification events cannot be balanced. However, through the screen recording method provided by the embodiments of the present application, the teacher does not need to turn off the mobile phone notification in advance. Even if a notification event pop-up is recorded into the picture, the teacher can remove these notification event pop-ups in the recorded picture through relevant operations during the recording process. In this way, both the video recording quality can be ensured and the teacher will not miss important notification events. Among them, the electronic device may also include a tablet computer, a notebook computer, a desktop computer, a wearable device, a vehicle-mounted terminal, etc.

[0039] Currently, some interference contents are likely to appear in the screen during screen recording, such as incoming calls, SMS verification codes, system notifications, and application notifications. These interference messages will be recorded into the video. Users can only perform post-processing on the recorded video (that is, replay the recorded video after the screen recording ends, check for interference messages in the video, and then process these interference messages through video editing). This is likely to lead to a decline in the quality of the recorded content, especially in occasions that require high-quality recording, such as application usage tutorials, meeting screen recordings, teaching videos, etc. The existence of interference messages may even cause users to need to re-record, wasting the users' time.

[0040] Figure 1 FIG. is a schematic diagram of the application scenario of the screen recording method provided by the embodiments of the present application. The application scenario may be an electronic device, and the electronic device may be a mobile phone, a tablet computer, a notebook computer, a desktop computer, a wearable device, a vehicle-mounted terminal, etc. As Figure 1 shown, taking the electronic device as a tablet computer as an example, during the recording process, the video frame 101 being recorded is displayed in the display interface 100, and interference elements (such as Figure 1Among the bullet screens 1 to 4), when the user sees the video frame 101, the user can also see these bullet screens appearing in the video frame 101. As the recording progresses, the display interface continues to display the second video frame 102, while the video frame 101 is being recorded, and after recording, the video frame 101 contains the bullet screens 1 to 4. During the recording process, the user can, through a first input, trigger the display of the screen recording control control in a specific area of the display interface and implement removing the bullet screens 1 to 4 in the already recorded video frame 101.

[0041] Exemplarily, the first input includes but is not limited to: a touch input by the user on the display interface through a touch device such as a finger or a stylus, or a voice command input by the user, or a specific gesture input by the user, or other feasible inputs, which can be specifically determined according to actual usage requirements, and the embodiments of the present application do not make limitations. The specific gesture in the embodiments of the present application can be any one of a click gesture, a swipe gesture, a drag gesture, a pressure recognition gesture, a long press gesture, an area change gesture, a double press gesture, and a double click gesture; the click input in the embodiments of the present application can be a single click input, a double click input, or a click input of any number of times, and can also be a long press input or a short press input. For example, the above first input can be: a click input by the user on the display interface.

[0042] Figure 2 is a flowchart of the screen recording method provided by the embodiments of the present application. This screen recording method can be applied to an electronic device. Exemplarily, the electronic device can include Figure 1 the display interface 100 as shown. As Figure 2 shown, this screen recording method can include the following steps:

[0043] S210. During the process of screen recording the display screen, receive a first input.

[0044] S220. In response to the first input, identify a first target video frame in the already recorded video that contains at least one type of interference element.

[0045] S230. Remove the interference elements of the target type in the first target video frame to obtain a first video.

[0046] Wherein, the interference elements of the target type are at least one of the at least one type of interference elements.

[0047] In the embodiments of the present application, during recording, even if interference elements appear in the recorded video frames, affecting the quality of the recorded video, the already recorded video can be processed simultaneously during recording to remove the interference elements therein. In this way, users do not need to perform special shielding settings before recording, enabling users to receive interference information during video recording and also process the already recorded video simultaneously, ensuring the quality of the final recorded video and improving the recording efficiency and flexibility.

[0048] The above steps are described in detail as follows:

[0049] In S210, the display screen refers to the visual content presented by the display interface of the electronic device. Exemplarily, the display screen may include text, images, videos, etc. It is the visual output that users directly see when interacting with the electronic device.

[0050] Among them, the display interface refers to an interface method for information interaction between the user and the electronic device through the display screen. It not only includes the presentation of the visual elements of the display screen but also involves how the user interacts with the electronic device through this display interface, such as inputting instructions and obtaining feedback.

[0051] In this embodiment, screen recording is a technology that records and saves the content displayed on the display interface of the electronic device in real time as a video file. Screen recording can be divided into full-screen recording, area recording, window recording, etc. Full-screen recording means recording all the content displayed in the entire display interface, which is suitable for scenarios such as recording the operation process of the entire desktop and game screens. Area recording allows users to select a specific area on the display screen for recording, which is very useful for situations where only a certain part of the screen content needs to be focused on. Window recording mainly records the window of a specific application, which can exclude the interference of other irrelevant windows.

[0052] In this embodiment, screen recording can directly access the graphics interface at the system bottom layer to obtain the image data of the display screen presented by the current display interface. These image data include detailed information such as the color and position of each pixel point on the display screen, thereby realizing the complete replication of the display screen content.

[0053] In some other embodiments, in addition to the image data, the sound emitted by the electronic device or the sound input by the microphone of the electronic device can also be recorded simultaneously. The audio data will be separately collected and encoded synchronously with the image data to ensure that the sound in the recorded video matches and synchronizes with the image screen.

[0054] In this embodiment, the first input may be triggered by the user. Exemplarily, the first input includes, but is not limited to: a touch input on the display interface by the user using a touch device such as a finger or a stylus, or a voice command input by the user, or a specific gesture input by the user, or other feasible inputs, which can be specifically determined according to actual usage requirements and are not limited in the embodiments of the present application. The specific gesture in the embodiments of the present application may be any one of a click gesture, a swipe gesture, a drag gesture, a pressure recognition gesture, a long press gesture, an area change gesture, a double press gesture, and a double click gesture; the click input in the embodiments of the present application may be a single click input, a double click input, or a click input of any number of times, etc., and may also be a long press input or a short press input.

[0055] In this embodiment, after the user triggers the first input, the screen recording can continue, and the display interface can still present the next display screen. For example, taking the case where the user needs to record a video, even if the user triggers the first input, the video can continue to play.

[0056] In some other embodiments, the user can also stop the recording, end the recording, or stop the display interface from presenting the next screen (i.e., pause the display) through other inputs.

[0057] Exemplarily, the other inputs include, but are not limited to: a touch input on the display interface by the user using a touch device such as a finger or a stylus, or a voice command input by the user, or a specific gesture input by the user, or other feasible inputs, which can be specifically determined according to actual usage requirements and are not limited in the embodiments of the present application. The specific gesture in the embodiments of the present application may be any one of a click gesture, a swipe gesture, a drag gesture, a pressure recognition gesture, a long press gesture, an area change gesture, a double press gesture, and a double click gesture; the click input in the embodiments of the present application may be a single click input, a double click input, or a click input of any number of times, etc., and may also be a long press input or a short press input.

[0058] In this embodiment, taking the case where the user needs to record a video, the user can start screen recording during the process of watching the video and use the screen recording technology to capture the content in the display screen of the display interface (including the video playback area and the barrage area). During the recording process, some interference elements may appear in the display screen, such as incoming calls, SMS verification codes, and system notifications appearing in the screen recording content. If re-recording is done, it will affect the screen recording efficiency.

[0059] In S220, the recorded image data and / or audio data can be collectively referred to as the recorded video. A specific video coding algorithm can be used to compress and encode the recorded image data for storage.

[0060] Exemplarily, assume that the display interface presents one picture per unit time. After recording this picture, a video frame is formed. The information included in the video frame may include the above-mentioned image data and / or audio data.

[0061] In this embodiment, as mentioned above, the display screen may include text, images, videos, etc. According to the different content displayed on the display screen, interference elements are divided into multiple different types. For example, taking video as an example, interference elements may include bullet screens that appear during video playback, floating windows of notification events triggered by the electronic device itself, interference audio generated during recording, etc. All of these can be used as interference elements.

[0062] Exemplarily, the floating window of the notification event triggered by the electronic device itself may include: ① Call reminder. When a call comes in, the screen recording floating window will display a "call" reminder, including the incoming call number and contact information. ② SMS verification code. When performing identity verification or receiving important information, the SMS verification code will appear in the screen recording floating window. ③ System notification. System notifications include but are not limited to system update reminders, low battery warnings, network connection changes, etc. When the electronic device triggers a system notification, it will appear in the screen recording floating window. ④ Application notification. The application programs installed in the electronic device may send various notifications, such as new message reminders, event updates, order status. These notifications will appear in the screen recording floating window. ⑤ Other reminder events. For example, reminder events such as alarm reminders, calendar events, and health data updates will appear in the screen recording floating window.

[0063] Exemplarily, interference audio may include: ① Notification sound, such as SMS and application reminder sounds. ② Sounds collected by the microphone. For example, ambient noise after the microphone is turned on. ③ Media sound, such as other game sounds and video playback sounds in the electronic device.

[0064] Among them, the appearance of interference audio may include the following four scenarios: Scenario 1: When a notification is triggered during screen recording, the sound is still collected. Scenario 2: When using the camera during screen recording, the sound is collected. Scenario 3: When a third-party microphone is called during screen recording, such as when using an application software to send voice, the sound is collected. Scenario 4: When using the camera during screen recording and the ringtone is triggered, the sound is collected.

[0065] In this embodiment, the first target video frame may include at least one type of interference element among the above-mentioned bullet screens, notification event floating windows, and interference audio.

[0066] Exemplarily, when retrospectively searching for interference elements in the recorded video, this retrospective process can be displayed in a specific area (such as the left side or the upper side) of the display interface, and the detected interference elements are filtered out.

[0067] In S230, the obtained first video is equivalent to the recorded video after recording is completed. The interference elements of the target type can be at least one of the above-mentioned interference elements, such as at least one of bullet screens, notification event floating windows, and interference audio.

[0068] In this embodiment, when removing these interference elements, there may be certain differences in the removal methods for different types of interference elements.

[0069] Exemplarily, taking the bullet screen as an example, the bullet screen appears in a specific area of the video in a scrolling form. After the bullet screen is recognized, image processing technology or video editing technology can be used to remove the bullet screen content from the first target video frame.

[0070] Exemplarily, taking the interference audio as an example, the audio data in the first target video frame can be processed through steps such as audio separation, noise cancellation, and audio repair to remove the interference audio. Specifically, the video editing function of the electronic device can be called to separate the image data and audio data in the first target video frame into different tracks. After finding the audio track, select the part containing the interference audio and then delete or mute it. In addition, if the interference audio is relatively slight and persists, the noise reduction function can be used to remove the interference audio.

[0071] Exemplarily, after the removal operation on the first target video frame, in order to improve the screen recording efficiency, the first target video frame after the removal process can be directly updated to the originally recorded video, thereby obtaining the final recorded video.

[0072] In some embodiments, during the process of screen recording the display screen, if it is found that there is an interference element in a certain video frame that has been previously recorded, a prompt box can be displayed on the display screen at this time. Among them, the prompt box can include the position of the interference element in the recorded video (which can be represented by a timestamp) and the type of the interference element (which can be represented by different color identifiers). Exemplarily, Figure 3 This is a prompt diagram for interference element recognition provided by the embodiment of the present application. As Figure 3 shown, a prompt box 301 can be displayed on the display screen 300.

[0073] Among them, the display box 301 includes a black dot and a timestamp 3:58. The black dot can be used to represent the type of the interference element (for example, black represents audio interference and white represents a bullet screen). The timestamp 3:58 can ensure that the first target video frame is located at 3 minutes and 58 seconds in the recorded video.

[0074] Figure 4This is a schematic diagram of the operation for removing interference elements provided by an embodiment of the present application. During the process of recording the display screen, the first input triggered by the user specifically includes a first sub-input and a second sub-input. As Figure 4 shown, during the process of the electronic device recording the display screen, after receiving the first sub-input triggered by the user, in response to the first sub-input, the electronic device will display at least one candidate control on the display screen (such as Figure 4 there is a first candidate control and a second candidate control in it); further, the user can determine the target control from at least one candidate control through the second sub-input. The electronic device continues to receive the second sub-input triggered by the user, and the target control performs the corresponding removal operation.

[0075] Exemplarily, the first candidate control can trigger a first quick command, and in response to the first quick command, the electronic device removes all audio interference, bullet screens, and notification event floating windows in the first target video frame. Exemplarily, the second candidate control can trigger a second quick command, and in response to the second quick command, the electronic device removes the audio interference or bullet screen or notification event floating window in the first target video frame.

[0076] In this embodiment, the first sub-input and the second sub-input both include but are not limited to: the user's touch input on the display interface through a touch device such as a finger or a stylus, or a voice command input by the user, or a specific gesture input by the user, or other feasible inputs, which can be specifically determined according to actual usage requirements, and the embodiments of the present application do not make limitations. The specific gesture in the embodiments of the present application can be any one of a click gesture, a swipe gesture, a drag gesture, a pressure recognition gesture, a long press gesture, an area change gesture, a double press gesture, and a double click gesture; the click input in the embodiments of the present application can be a single click input, a double click input, or a click input of any number of times, and can also be a long press input or a short press input. Exemplarily, the first sub-input can be that the user's finger slides from the edge of the display interface into the display interface to call out Figure 4 the screen recording control control shown.

[0077] Among them, during the screen recording process, the screen recording control control and the video frame being recorded are in different layers, so that although the screen recording control control is also displayed on the display screen, it will not be recorded into the video frame (the recording process is to record the layer where the video frame is located).

[0078] Among them, the screen recording control control can be an intelligent body inside and outside the terminal selected by the user embedded in the display interface, and the intelligent body is displayed in the form of a floating window or a sidebar to realize the interaction between the intelligent body and the recorded screen content, so as to facilitate the user to remove interference elements during the screen recording process, and at the same time avoid the problem that the user needs to switch to other applications or interfaces to remove interference elements.

[0079] Further, in some embodiments, during the screen recording process, in addition to being able to retrospectively detect various interference elements such as notification times, bullet screens, and audio that appeared in the previously recorded video and removing these interference elements, since the screen recording is still in progress in real time, it is also possible to identify and remove interference elements during the real-time screen recording process. Specifically, when the video frame currently displayed on the display screen is the second target video frame, the interference elements included in the second target video frame can be identified, and then the interference elements of the target type in the second target video frame are removed to obtain the processed second target video frame, and then the processed second target video frame is updated to the first video.

[0080] In this embodiment, the electronic device can perform the following two tasks during the screen recording process: Task 1, process the interference elements included in the previously recorded video forward and remove these interference elements. Task 2, continue to record new video frames without interference elements backward in real time and precisely control the screen recording process.

[0081] Exemplarily, Figure 5 is a schematic diagram of the two-way recording process provided by the embodiment of the present application. As Figure 5 shown, after the user calls out the intelligent agent through the first input, at this time the electronic device still continues to maintain the recording process, and the display interface of the electronic device includes a display screen 500. At this time, the first icon 501 and the second icon 502 can be displayed on the display screen. Among them, the first icon 501 corresponds to Task 2, indicating that new video frames without interference elements can be continuously recorded backward in real time currently. In addition, the user can click the pause button or play button in the first icon 501 to control whether to continue recording backward in real time. At the same time, the recording duration (for example, 3 minutes and 59 seconds have been recorded) can also be displayed in the first icon 501 for the user to master the recording progress. The second icon 502 corresponds to Task 1, indicating that the interference elements included in the previously recorded video can be processed forward currently. Among them, the user can select "shortcut instruction" or "input instruction" in a specific area to implement the forward processing of the interference elements included in the previously recorded video.

[0082] Among them, after the user calls out the intelligent agent, the intelligent agent displayed on the display screen can receive various inputs from the user and execute corresponding functions in response to these inputs.

[0083] Exemplarily, taking the user clicking the "shortcut instruction" in the display screen 500 as an example, at this time, the interference element removal operation can be triggered to remove all the interference elements included in the previously recorded video.

[0084] In this embodiment, during the process of real-time recording of new video frames without interference elements backward, the barrage can still be displayed in the display screen 500. That is, when the display screen 500 is being recorded in real time, the user can see these barrages. However, the intelligent agent can ensure that these interference elements do not appear in the display screen 500 finally saved in the recorded video. That is, the intelligent agent will remove these barrages in the background without the user noticing. In this way, it can not only meet the timely reminder of user message notifications and the viewing of barrages, but also these message notifications and barrages will not be recorded into the video.

[0085] Exemplarily, Figure 6 is a schematic diagram of barrage filtering processing during the backward real-time recording provided by the embodiment of the present application. As Figure 6 shown, after the user calls out the intelligent agent, the intelligent agent can load the first control in the display screen 500. The intelligent agent responds to the fourth input to the first control to remove the barrage and reduce interference.

[0086] Among them, the fourth input includes but is not limited to: the touch input of the user on the display interface through a touch device such as a finger or a stylus, or the voice command input by the user, or the specific gesture input by the user, or other feasible inputs. Specifically, it can be determined according to the actual usage requirements, and the embodiments of the present application do not make limitations. The specific gesture in the embodiments of the present application can be any one of a click gesture, a swipe gesture, a drag gesture, a pressure recognition gesture, a long press gesture, an area change gesture, a double press gesture, and a double click gesture; the click input in the embodiments of the present application can be a single click input, a double click input, or a click input of any number of times, and can also be a long press input or a short press input. Exemplarily, the fourth input can be that the user drags the first control to Figure 6 the position where the barrage shown is located to remove the barrage.

[0087] In the embodiments of the present application, by removing the interference elements in the currently displayed video frame in the display screen during the backward real-time recording process, on the one hand, it can meet the timely reminder of user message notifications and the viewing of barrages, and on the other hand, it also avoids the reappearance of interference elements in the subsequent recorded video frames, improving the video recording quality.

[0088] Further, in some embodiments, after processing the interference elements included in the recorded video forward, the first target video frame after removing the interference elements can also be previewed and displayed in the display screen.

[0089] Among them, it has been mentioned above that the interference elements can include barrages that appear during video playback, notification event floating windows triggered by the electronic device itself, interference audio generated during the recording process, etc. In this embodiment, the barrages and / or notification event floating windows in the first target video frame previewed and displayed in the display screen are removed.

[0090] In addition, for the first target video frame displayed in preview form on the display screen, the electronic device may not play the audio corresponding to the first target video frame to avoid affecting the backward real-time recording task mentioned above and deteriorating the quality of the backward real-time recorded video.

[0091] Exemplarily, a specific first display area may be pre-configured on the display screen, and the first target video frame after interference element removal will be displayed in the first display area. In addition, in some embodiments, the size of the first display area is smaller than the entire display screen to avoid blocking the user from viewing the currently recorded video.

[0092] Furthermore, the first display area and the video frame currently displayed on the display screen are in different layers to avoid, when performing the backward real-time recording task, the first target video frame after interference element removal displayed in the first display area being recorded and overlapping with the currently displayed video frame, resulting in a decrease in the quality of the real-time recorded video.

[0093] Exemplarily, Figure 7 is the preview display effect diagram provided by the embodiments of the present application. As Figure 7 shown, a first display area may be configured below the intelligent agent, and the first display area may display the first target video frame after interference element removal in the recorded video.

[0094] In addition, in some embodiments, to ensure the continuity of the recorded video and facilitate the user's viewing, the entire recorded video after interference element removal may also be displayed in the first display area.

[0095] In the embodiments of the present application, by previewing and displaying the first target video frame after interference element removal in the display screen during backward real-time screen recording, it is possible to perform backward real-time screen recording while prompting the user to verify the effect of the removal process on the recorded video, thereby improving the screen recording efficiency.

[0096] As mentioned above, text, images, videos, etc. may be displayed on the display screen. Among them, the text may refer to the document currently being viewed by the user. The image may refer to the photos included in the album of the electronic device. The video may refer to the video being played by the electronic device.

[0097] Among them, if the display screen is the playback screen of the second video, and a video progress control control, such as a progress bar, is also displayed on the display screen. Then, in some embodiments, a progress identifier corresponding to the first target video frame in the second video may be displayed on the video progress control control.

[0098] In this embodiment, the progress identifier is mainly used to indicate the position of the first target video frame in the second video. Exemplarily, the progress identifier can be an identifier of the line category, such as a dotted line, a solid line, or a wavy line. Exemplarily, the progress identifier can also be an identifier of the graphic category, such as a circle, a triangle, or a diamond. Exemplarily, the progress identifier can also be an identifier of the animation effect category, such as an identifier that blinks at a certain frequency, and the color of the identifier can also be configured.

[0099] Among them, the first target video frame may include various types of interference elements, or may only contain a single type of interference element. For the convenience of users to distinguish. Exemplarily, different forms of progress identifiers can be used to represent the interference elements included in the first target video frame.

[0100] For example, if the interference element is a barrage, the color of the progress identifier is the first color; if the interference element is a notification event floating window, the color of the progress identifier is the second color; if the interference element is interference audio, the color of the progress identifier is the third color. Among them, the first color, the second color, and the third color are different from each other.

[0101] Another example is that if the interference element included in the first target video frame is a barrage, it can be represented by a circular progress identifier. If the first target video frame contains both a barrage and a notification event floating window, it can be represented by a triangular progress identifier. If the first target video frame contains a barrage, a notification event floating window, and interference audio at the same time, it can be represented by a diamond-shaped progress identifier.

[0102] In addition, in some embodiments, there may be multiple frames of the first target video frame in the recorded video. At this time, multiple progress identifiers will appear correspondingly on the progress bar. That is, each first target video frame corresponds to a progress identifier. Exemplarily, the forms of the progress identifiers corresponding to each first target video frame can be the same or different. Figure 8 The schematic diagram of the progress bar provided by the embodiment of the present application is as Figure 8 shown. There are a total of four progress identifiers 801 in the progress bar. These four progress identifiers are all white circles. The position of each progress identifier represents that there is a first target video frame at this position in the second video.

[0103] In the embodiment of the present application, by displaying the corresponding progress identifier at the corresponding position of the second video, the first target video frame can be quickly located, so that the user can view the first target video frame by adjusting the progress bar, further improving the removal efficiency of the interference elements in the first target video frame.

[0104] Further, based on the above embodiments, in some embodiments, when a progress identifier is displayed in the progress bar, the progress identifier corresponding to the first target video frame in the second video can be displayed differently based on the type of interference element in the first target video frame.

[0105] Exemplarily, the type of interference element can be determined according to the attribute or the content contained or the recognition method of the interference element. For example, the interference elements can be classified into the following two types: (1) Interference elements that appear in the picture. For example, bullet screens and notification event floating windows, both of which carry text and are visual interference elements that can appear in the picture and need to be visually recognized; (2) Interference elements that appear in the sound. For example, during the screen recording process, there may be noise in the external environment, and these noises need to be aurally recognized. Based on the above two types of interference elements, Figure 9 is a progress identifier display diagram provided by an embodiment of the present application. As Figure 9 shown, there are a total of five first target video frames, and each first target video frame has a corresponding progress identifier in the progress bar. Among them, all five first target video frames contain interference audio, so their progress identifiers look the same. Further, comparing the above Figure 8 , Figure 8 there are a total of four first target video frames, and similarly each first target video frame has a corresponding progress identifier in the progress bar. Among them, all four first target video frames contain bullet screens or notification event floating windows, so their progress identifiers also look the same. However, comparing Figure 8 and Figure 9 , since Figure 9 's interference factor belongs to the second type, that is, (2) interference elements that appear in the sound, while Figure 8 's interference element belongs to the first interference type, that is, (1) interference elements that appear in the picture. Therefore Figure 8 and Figure 9 's progress identifiers are different and are displayed differently.

[0106] Exemplarily, in some other embodiments, the interference elements can also be classified into the following three types according to the triggering method of the interference elements: (1) Triggered by the electronic device itself, such as a notification event floating window triggered by the electronic device itself, etc.; (2) Triggered by the user, such as bullet screens input by the user during the video viewing process, etc.; (3) Triggered by the external environment during the screen recording process, such as interference audio such as noise emitted in the external environment.

[0107] In some embodiments, as mentioned above, the interference elements can be divided into two types: (1) the interference elements that appear in the picture; (2) the interference elements that appear in the sound. Further, for the interference elements that appear in the sound of type (2), they can be further refined into multiple subtypes. Between the first target video frames containing different subtypes of interference elements, the progress identifiers corresponding to each first target video frame also need to be displayed differently.

[0108] Exemplarily, for the interference elements that appear in the sound of the second type (2), they can be specifically divided into the following three subtypes: ① notification audio; ② ambient audio; ③ media audio. Figure 10 The progress identifier display diagram provided by another embodiment of the present application is as Figure 10 shown. If ① notification audio appears in some first target video frames, then the progress identifiers corresponding to these first target video frames are triangles. If ② ambient audio appears in some other first target video frames, then the progress identifiers corresponding to these first target video frames are rectangles. If ③ media audio appears in some other first target video frames, then the progress identifiers corresponding to these first target video frames are diamonds. Between the first target video frames containing different subtypes of interference elements, their respective corresponding progress identifiers are displayed differently.

[0109] In the embodiments of the present application, by displaying the progress identifiers differently, it is convenient to know what type of interference elements are included in each first target video frame in the recorded video, so as to more quickly determine the target type and improve the removal flexibility and the removal efficiency of the interference elements.

[0110] Further, in some embodiments, if the interference elements include interference audio, such as the noise emitted by the external environment during the screen recording process, the interference sound collected by the electronic device microphone, the notification sound emitted by the electronic device itself, etc. At this time, a second control can be displayed on the display screen. Among them, the electronic device can receive a second input to the second control; in response to the second input, the interference audio in the first target video frame is removed.

[0111] In this embodiment, the interference audio can refer to various sounds that are irrelevant to the video recording process.

[0112] In this embodiment, the second input includes but is not limited to: the touch input of the display interface by the user through a touch device such as a finger or a stylus, or the voice command input by the user, or the specific gesture input by the user, or other feasible inputs, which can be specifically determined according to actual usage requirements and are not limited in the embodiments of the present application. The specific gesture in the embodiments of the present application can be any one of a click gesture, a swipe gesture, a drag gesture, a pressure recognition gesture, a long press gesture, an area change gesture, a double press gesture, and a double click gesture; the click input in the embodiments of the present application can be a single click input, a double click input, or a click input of any number of times, etc., and can also be a long press input or a short press input.

[0113] Exemplarily, referring to the above Figure 10 , the second input can be that the user clicks the second control 1004. At this time, the operation of removing the interfering audio will be triggered, and the interfering audio in the first target video frame in the recorded video will be removed.

[0114] Exemplarily, continuing to refer to the above Figure 10 , the second input can also be that after the user clicks the second control 1004, the second control 1004 is dragged to the position where a certain progress indicator is located, so that the interfering audio in a certain first target video frame can be removed specifically.

[0115] In the embodiments of the present application, by displaying the second control on the display interface, the electronic device receives the second input for the second control, and the removal of the interfering audio in the first target video frame can be realized. In this way, the sound interference in the recorded video is removed, and the quality of the recorded video can be further improved.

[0116] Further, on the basis of the above embodiments, when the interfering element is interfering audio as mentioned above, it can be specifically divided into three subtypes: ① notification audio; ② environmental audio; ③ media audio. Therefore, in some embodiments, different subtypes of interfering audio can be removed specifically to improve the flexibility of audio removal and enable it to adapt to various different application scenarios.

[0117] Specifically, a third control can be displayed on the display interface, and the electronic device can receive the third input for the third control; in response to the third input, the interfering audio of the target type in at least one type of interfering audio is removed.

[0118] In this embodiment, the interfering audio of the target type refers to one or more of the three subtypes of interfering audio: ① notification audio; ② environmental audio; ③ media audio.

[0119] In this embodiment, the third input includes but is not limited to: touch input on the display interface by the user using a touch device such as a finger or a stylus, or a voice command input by the user, or a specific gesture input by the user, or other feasible inputs. Specifically, it can be determined according to actual usage requirements, and the embodiments of the present application do not make limitations. The specific gesture in the embodiments of the present application can be any one of a click gesture, a swipe gesture, a drag gesture, a pressure recognition gesture, a long press gesture, an area change gesture, a double press gesture, and a double click gesture; the click input in the embodiments of the present application can be a single click input, a double click input, or a click input of any number of times, etc., and can also be a long press input or a short press input.

[0120] Exemplarily, continuing to refer to the above Figure 10 , the third control 1005 is divided into a notification sound recognition control, an ambient sound recognition control, and a media sound recognition control. The third input can be a click operation by the user. Specifically, when the user clicks on the notification sound recognition control, the ① notification audio in the first video frame can be removed, such as including text messages and application reminders. When the user clicks on the ambient sound recognition, the ② ambient audio in the first video frame can be removed, such as the ambient sound noise collected after the electronic device turns on the microphone. When the user clicks on the media sound recognition, the ③ media audio in the first video frame can be removed, such as game sounds and video playback sounds, etc.

[0121] Among them, the removal of interfering audio can be divided into the following three steps: audio separation, noise cancellation, and audio repair.

[0122] In the embodiments of the present application, by displaying the third control on the display screen, the electronic device can specifically remove different subtypes of interfering audio according to the third input to the third control, improving the flexibility of audio removal and enabling it to adapt to various different application scenarios.

[0123] In some embodiments, the following method can be used to quickly identify the first target video frame containing interfering elements in the recorded video. Figure 11 It is a schematic diagram of the interfering element recognition process provided by the embodiments of the present application. As Figure 11 shown, it specifically includes the following steps:

[0124] S1100. Determine the third target video frame containing at least one type of interfering element in each video frame of the recorded video.

[0125] S1110. Obtain the candidate video frame that is N frames away from the third target video frame in the recorded video.

[0126] Among them, N is a positive integer.

[0127] S1120. When there is at least one type of interference element in the candidate video frame, determine the candidate video frame surface, the third target video frame, and each video frame between the candidate video frame and the third target video frame as the first target video frames.

[0128] In this embodiment, each video frame of the recorded video is the video frame sequence to be processed forward, which contains several video frames. There may be a video frame among these several video frames that contains interference elements, that is, the third target video frame.

[0129] Among them, since interference elements appear continuously during video recording, for example, the bullet screen is scrolled and displayed on the screen, which will cause the bullet screen to appear in several consecutive video frames. Therefore, the upper N frames and / or the lower N frames of the third target video frame can be checked. There is a high probability that there are also interference elements in the upper N frames and / or the lower N frames, so as to improve the checking efficiency.

[0130] Among them, N, as the number of skipped frames, can be set in advance, specifically according to the empirical value screen refresh frame rate / screen recording frame rate, or user-defined. For example, the number of skipped frames is set to 3 in advance.

[0131] Exemplarily, Figure 12 is a schematic diagram of interference element checking provided by an embodiment of the present application. As Figure 12 shown, after the user triggers the agent to perform forward processing, the agent can check whether there are interference elements in the current frame. If there are interference elements in the current frame, then it can jump to the previous 4 frames to check whether there are interference elements in the previous 4 frames. If there are also the same interference elements in the previous 4 frames, then the previous 4 frames, the previous 3 frames, the previous 2 frames, the previous 1 frame, and the current frame can be directly regarded as the first target video frames containing the interference elements.

[0132] In the embodiment of the present application, by setting the number of skipped frames N, after finding the third target video frame containing interference elements, other video frames containing the interference elements can be quickly identified, so as to improve the checking efficiency of interference elements.

[0133] Further, in some embodiments, taking the interference element as the bullet screen as an example, when determining the third target video frame, the first display information in the first target area of each video frame of the recorded video can be obtained. When the first display information contains the video bullet screen, the video frame is determined as the third target video frame.

[0134] In this embodiment, according to the characteristics of the bullet screen, it appears in specific rows at the top, middle, and bottom of the display screen. In addition, the area where the bullet screen appears in the display screen can also be determined according to the user's settings of the bullet screen. Exemplarily, the user can set the bullet screen to only appear in the first row at the top of the display screen.

[0135] Among them, the first target area may refer to the area where the above-mentioned bullet screen may appear in the display screen. For example, if the bullet screen appears in the first line at the top, the first target area is the first line at the top. In addition, there may be multiple first target areas in the display screen.

[0136] In this embodiment, the bullet screen is usually in text format, such as Chinese characters or special symbols, etc. It has a large difference from other contents in the real picture. Exemplarily, edge detection can be performed on the image of the first target area, and whether there is a bullet screen can be judged by analyzing the edge features. In addition, in some embodiments, due to the rolling feature of the bullet screen, the color difference of pixel points between two adjacent video frames can also be compared to detect whether there is a bullet screen.

[0137] In this embodiment, the first display information is the picture content displayed in the first target area. For example, it can be video picture content (such as including the characters in the video, etc.). Among them, there is a difference between the first display information containing the bullet screen and the first display information not containing the bullet screen.

[0138] In the embodiment of the present application, by utilizing the characteristics of the bullet screen, the first display information of a specific first target area can be checked, the recognition efficiency of the bullet screen can be improved, and the first target video frame in the recorded video can be quickly determined.

[0139] The following describes this screen recording solution in detail through a complete embodiment. In this screen recording solution, during the screen recording process, the quick command ability of the intelligent agent can be combined to forward process the recorded content without interrupting the current screen recording process, and at the same time, video recording is performed in real time backward. In addition, the bullet screen frames can be traversed by setting the number of skipped frames, and then the bullet screen area in the first target video frame can be matched through the bullet screen filter. At the same time, during the forward processing process, the processed screen recording content can be presented in the intelligent agent area for preview for the user to operate, improving the screen recording efficiency.

[0140] This screen recording solution realizes the removal of interference elements without interrupting the screen recording process by forward processing the content being screen recorded and real-time backward recording. Taking the display screen playing a video as an example, exemplarily, Figure 13 It is a schematic flowchart of the screen recording method provided by another embodiment of the present application, as Figure 13As shown in the figure, it includes the following steps: S1310. Start screen recording and capture the screen. S1320. Backtrack and detect the content of the screen recording floating window. S1330. Select the intelligent agent to be embedded in the application. S1340. Link the intelligent agent for forward processing. S1350. Skip frames to traverse and check the first target video frame for bullet screen recognition. S1360. Two-way recording control. S1370. Remove interference elements. S1380. Remove interference elements during the real-time backward video recording process. S1390. Preview the forward processing effect of the intelligent agent. S13100. Output the screen recording.

[0141] The screen recording method provided in this embodiment can achieve the following functions: (1) Forward processing during screen recording: Without interrupting the current screen recording, evoke the intelligent agent and reverse process the recorded screen content; (2) It is possible to backtrack the content of the screen recording floating window: incoming calls, SMS verification codes, system notifications, application notifications. (3) It is possible to select the intelligent agent to be embedded in the application and remove interference factors in the screen recording: bullet screens, notifications, pop-up windows. (4) The identified interference frames are distributed as scatter points on the progress bar, and the interference sound collected during the screen recording process is removed. (5) Dual-process two-way recording: One is to forward process the recorded content, and the other is to backward record new content in real time; (6) Skip frame traversal: Since the adjacent frames of the recorded screen have relatively small changes in content, the electronic device identifies the bullet screen content in the third target video frame. During the forward processing process, it is not processed frame by frame, but the third target video frame is used as a feature bullet screen filter to match the area near the bullet screen of the adjacent frames; (7) Backward real-time recording: During the screen recording process, the bullet screen content is identified and the bullet screen area is not recorded.

[0142] The screen recording method provided in this embodiment can remove video bullet screens, improve the video viewing experience, and also protect the visual purity of the video content. At the same time, forward processing is adopted, which can filter and process bullet screens during the real-time video recording process, with higher efficiency and practicality. Specifically, this screen recording method can remove bullet screens in the video in real time, ensure the purity and clarity of the video content, and enhance the viewing experience. In addition, using forward processing to perform real-time processing on the recorded video can improve the quality of the recorded video, the processing process is more efficient, and the recorded video is smoother and clearer. Finally, users can record videos more conveniently, remove bullet screens, improve the video quality, and enhance the user's screen recording experience.

[0143] Regarding S1310, during the process of the user watching a video, start screen recording and capture the content displayed on the screen of the electronic device, including the video playback area and the bullet screen area, as described above Figure 3 As shown. Among them, during the process of recording teaching videos within the screen, some interference elements may appear, such as the appearance of incoming calls, SMS verification codes, and system notifications in the screen recording content, which affects the neatness of the screen recording content. If the forward processing provided by this solution is not used, it may be necessary to start recording again, affecting the screen recording efficiency.

[0144] For S1320, during the screen recording process, various notifications and events that occur during the screen recording are detected by backward processing. Exemplarily, the backward process is displayed on the left side of the screen, and the detected content and elements are filtered out. Additionally, the various notifications and events that occur during the screen recording may specifically include: (1) Detecting incoming call prompts: When a call comes in, the screen recording floating window will display an "incoming call" prompt, including the incoming call number and contact information. (2) Detecting SMS verification codes: When performing identity verification or receiving important information, the SMS verification code will appear in the screen recording floating window. (3) Detecting system notifications: System notifications include, but are not limited to, system update reminders, low battery warnings, network connection changes, etc. (4) Detecting application notifications: Installed applications may send various notifications, such as new message reminders, event updates, order status. (5) Detecting other events: Other types of events are also included, such as alarm reminders, calendar events, health data updates, etc.

[0145] For S1330, the user can select in - app and out - of - app intelligent agents (such as Blue Heart Xiaov, Doubao, Wenxin Yiyan, etc.) to be embedded in the screen recording interface, and use a floating window or sidebar form to display the intelligent agents. In the form of a combined intelligent agent, without switching to other applications or interfaces, by identifying the floating content of incoming calls, SMS verification codes, system notifications, and application notifications, these contents are dragged into the recorded video interval, recognized by the intelligent agent, and these contents in the screen recording picture are removed, realizing the interaction between the intelligent agent and the recorded video.

[0146] For S1340, during the screen recording process, the intelligent agent is invoked, and the capabilities of the intelligent agent are imported into the screen recording application. The recorded video is processed forward, that is, without interrupting the current screen recording process, a new process can be quickly started to process the recorded content. Swipe from the screen edge into the screen to invoke the intelligent agent, as shown above Figure 4 shown.

[0147] For S1350, computer vision and natural language processing technologies can be used to real - time identify the bullet screen content in the video. During the processing, it is not processed frame by frame. Instead, based on the fact that the adjacent frame changes in the screen recording are relatively small, the bullet screen content in the third target video frame is identified as the feature bullet screen, and the area near the bullet screen in the adjacent frames is matched. As shown above Figure 12 shown, in the sequence of video frames to be processed, the current frame is located, the bullet screen area in the current frame is identified, and the next frame to be processed is located by the number of skipped frames. Assuming the number of skipped frames is 3, the next frame to be processed is the previous 3 frames. The number of frames between skipped frames can be based on the empirical value screen refresh rate / screen recording frame rate, or user - defined, and is at least 1. When the number of skipped frames is 1, that is, no frames are skipped, and the adjacent frames are directly processed.

[0148] For S1360, during the two-way recording control process, ensure that the recording process is not interrupted, cache and process the recorded video, and traverse the recorded content backwards. In the two-way recording process, the screen recording application has two processes. One process processes the recorded content forward to identify bullet screen elements, and the other process continues to record new content without bullet screen elements in real time backwards, accurately controlling the screen recording process. For details, please refer to the above Figure 5 。

[0149] For S1370, after identifying the bullet screen content, use image processing technology or video editing technology to remove the bullet screen content from the video frames captured by the screen. For details, please refer to the above Figure 6 。

[0150] In addition, for removing the interfering audio recorded during the screen recording process. The interfering audio includes but is not limited to the following 4 scenarios: (1) When there is a notification during the screen recording, the sound is still recorded; (2) When recording with the camera, the sound will be recorded when there is a notification; (3) When calling a third-party microphone, such as in the scenario of sending voice messages on WeChat, etc., the sound will be recorded when there is a notification; (4) When a third-party application calls the camera to record, the bell rings when there is a notification, and the sound will be recorded.

[0151] Among them, users can easily remove the notification sound, background sound or any noise recorded in the screen recording like editing an image. Further, refer to the above Figure 8 , the progress identifier 801 (i.e., the white dot in Figure 8 ) represents the first target video frame that identifies the presence of a bullet screen or a floating window of a notification event. Users can click "Image Interference" to remove the bullet screen or the floating window of the notification event. Further, refer to the above Figure 9 , the progress identifier 901 represents the first target video frame that identifies the presence of interfering audio. Users can click "Sound Interference" to remove it.

[0152] Among them, the interfering audio can be understood as conflicting sounds. The processing measures of the conflicting sound removal tool chain include preventive settings (turn off the system sound recording before the screen recording), post-processing (process after the screen recording is completed), and real-time processing (post-process the recorded content during the screen recording process and clear the recorded conflicting sounds in real time). Among them, the identification of conflicting sounds mainly includes: (1) Notification sound identification: such as text messages, application reminders; (2) Ambient sound noise identification after turning on the microphone; (3) Media sound identification: such as game sounds, video playback sounds, etc. During the removal process, the audio can be separated first, then noise cancellation can be performed, and finally audio repair can be performed to achieve the removal of conflicting sounds.

[0153] In addition, a shortcut command brush can be configured and reused. Through the command brush, all conflicting sounds can be identified and all conflicting sounds can be cleared with one brush. Refer to the above Figure 10, the progress identifier 1001 can represent that the first target video frame includes a notification sound, the progress identifier 1002 can represent that the first target video frame includes conflicting ambient sounds, and the progress identifier 1003 can represent that the first target video frame includes conflicting media sounds. Exemplarily, the user can select "notification sound recognition", call the instruction brush, and swipe from right to left to clear the notification conflicting sound in the first target video frame represented by the progress identifier 1001.

[0154] For S1380, integrate barrage recognition and barrage removal, and with the help of a barrage filter, ensure that barrage content can be recognized and removed in real time during the video recording process to ensure the quality of the recorded video and the viewing experience.

[0155] For S1390, the intelligent agent floating display presents the effects of forward processing and backward real-time screen recording, and presents the forward-processed and backward-processed screen recording content in the preview window of the intelligent agent. Refer to the above Figure 7 , during the preview process, if an abnormal scene is found, forward processing can be repeated to customize the processing of the screen recording content in real time until a satisfactory screen recording effect is achieved.

[0156] For S13100, the video processed by barrage removal can be output to a target specified by the user, which can be an intelligent agent, a local file, or a remote server, for the user to share and publish.

[0157] It should be noted that for the screen recording method provided in the embodiments of the present application, the execution subject can be a screen recording device, or a processing module in the screen recording device for executing the screen recording method. In the embodiments of the present application, the screen recording method is executed by the screen recording device as an example to illustrate the screen recording device provided in the embodiments of the present application.

[0158] Figure 14 It is a schematic structural diagram of the screen recording device provided in the embodiments of the present application. This screen recording device can be integrated on an electronic device, or can be independent of the electronic device and cooperate with the electronic device to implement this solution. As Figure 14 shown, the screen recording device 1400 may include: an input module 1410 for receiving a first input during the process of screen recording a display screen. The recognition module 1420 is used to recognize a first target video frame containing at least one type of interference element in the recorded video in response to the first input. The removal module 1430 is used to remove the interference elements of the target type in the first target video frame to obtain a first video, and the interference elements of the target type are at least one of the at least one type of interference elements.

[0159] In the embodiments of the present application, even if interference elements appear in the recorded video frames during recording, affecting the quality of the recorded video, the recorded video can be processed while recording to remove the interference elements therein. In this way, users do not need to perform special shielding settings before recording, enabling users to receive interference information during video recording and ensuring the quality of the final recorded video, thereby improving the recording flexibility.

[0160] Optionally, the first input includes a first sub-input and a second sub-input; the input module can specifically be configured to: receive the first sub-input during the process of recording the display screen; in response to the first sub-input, display at least one candidate control on the display screen; and receive the second sub-input for the target control among the candidate controls.

[0161] Optionally, it further includes a real-time recording module, configured to identify the interference elements included in the second target video frame, where the second target video frame is the video frame displayed on the display screen; remove the interference elements of the target type in the second target video frame to obtain a processed second target video frame; and update the processed second target video frame to the first video.

[0162] Optionally, it further includes a preview module, configured to preview and display the first target video frame after removing the interference elements on the display screen.

[0163] Optionally, the display screen is the playback screen of the second video, and the display screen further includes a video progress control control for the second video. The screen recording device further includes a progress identification module, configured to display the progress identification corresponding to the first target video frame in the second video on the video progress control control.

[0164] Optionally, the interference elements include at least two types, and the screen recording device further includes a display module, configured to distinguish and display the progress identification corresponding to the first target video frame in the second video according to the types of the interference elements in the first target video frame.

[0165] Optionally, the interference elements include the interference audio in the first target video frame, and the display screen further includes a second control. The removal module can specifically be configured to: receive the second input for the second control; and in response to the second input, remove the interference audio in the first target video frame.

[0166] Optionally, the display screen further includes a third control, and the removal module can specifically be configured to: receive the third input for the third control; and in response to the third input, remove the interference audio of the target type in at least one type of interference audio.

[0167] Optionally, the recognition module can be specifically configured to: determine third target video frames including at least one type of interference element in each video frame of the recorded video; obtain candidate video frames that are N frames apart from the third target video frames in the recorded video, where N is a positive integer; in the case that the candidate video frames include at least one type of interference element, determine the candidate video frames, the third target video frames, and each video frame between the candidate video frames and the third target video frames as first target video frames.

[0168] Optionally, the interference element includes video bullet screens, and the recognition module can be specifically configured to: obtain first display information in a first target area of each video frame; in the case that the first display information includes video bullet screens, determine the video frame as a third target video frame.

[0169] The screen recording device provided in the embodiments of the present application may be a component in an electronic device, such as an integrated circuit or a chip. Exemplarily, the electronic device may be a mobile phone, a tablet computer, a laptop computer, a palmtop computer, a vehicle-mounted electronic device, a Mobile Internet Device (MID), an augmented reality (AR) / virtual reality (VR) device, a robot, a wearable device, an ultra-mobile personal computer (UMPC), a netbook, or a personal digital assistant (PDA), etc., and may also be a server, a Network Attached Storage (NAS), a personal computer (PC), a television (TV), a teller machine, or a self-service machine, etc. The embodiments of the present application do not make specific limitations.

[0170] The electronic device in the embodiments of the present application may be a terminal with an operating system. The operating system may be an Android operating system, an iOS operating system, or other possible operating systems. The embodiments of the present application do not make specific limitations.

[0171] The screen recording device provided in the embodiments of the present application can implement each process in the above-mentioned screen recording method embodiments and can achieve the same technical effects. To avoid repetition, it will not be elaborated here.

[0172] Figure 15 It is a schematic structural diagram of the electronic device provided in the embodiments of the present application, as Figure 15As shown in the figure, the electronic device 1500 includes a processor 1501 and a memory 1502. The memory 1502 stores programs or instructions that can run on the processor 1501. When the programs or instructions are executed by the processor 1501, each step of the above screen recording method embodiment is implemented, and the same technical effects can be achieved. To avoid repetition, details are not described here again. It should be noted that in the embodiments of the present application, the electronic device includes the above-mentioned mobile terminal and non-mobile terminal.

[0173] Figure 16 This is a schematic diagram of the hardware structure of an electronic device provided in another embodiment of the present application. The electronic device 1600 includes, but is not limited to: a radio frequency unit 1601, a network module 1602, an audio output unit 1603, an input unit 1604, a sensor 1605, a display unit 1606, a user input unit 1607, an interface unit 1608, a memory 1609, and a processor 1610, etc.

[0174] Those skilled in the art can understand that the electronic device 1600 may further include a power source (such as a battery) for supplying power to each component. The power source can be logically connected to the processor 1610 through a power management system, so as to implement functions such as management of charging, discharging, and power consumption management through the power management system. Figure 16 The structure of the electronic device 1600 shown in the figure does not constitute a limitation on the electronic device 1600. The electronic device 1600 may include more or fewer components than shown in the figure, or combine certain components, or have different component arrangements, which will not be elaborated here.

[0175] Among them, the display unit 1606 is used to display the screen to be recorded or preview and display the recorded screen.

[0176] The user input unit 1607 is used to receive a first input.

[0177] The processor 1610 is configured to, in response to the first input, identify a first target video frame in the recorded video that contains at least one type of interference element, and erase the interference element of the target type in the first target video frame to obtain a recorded video, where the target type is at least one of the at least one type.

[0178] In the embodiments of the present application, even if interference elements appear in the recorded video frames during recording, affecting the quality of the recorded video, the recorded video can be processed while recording to erase the interference elements therein. In this way, users do not need to perform special shielding settings before recording, so that users can receive interference information during the video recording process and ensure the quality of the final recorded video, improving the recording flexibility.

[0179] It should be understood that in the embodiments of the present application, the input unit 1604 may include a Graphics Processing Unit (GPU) 16041 and a microphone 16042. The graphics processor 16041 processes the image data of still pictures or videos obtained by an image capture device (such as a camera) in a video capture mode or an image capture mode. The display unit 1606 may include a display panel 16061, and the display panel 16061 may be configured in the form of a liquid crystal display, an organic light emitting diode, etc. The user input unit 1607 includes at least one of a touch panel 16071 and other input devices 16072. The touch panel 16071 is also referred to as a touch screen. The touch panel 16071 may include two parts, a touch detection device and a touch controller. The other input devices 16072 may include, but are not limited to, a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which will not be elaborated here.

[0180] The memory 1609 can be used to store software programs and various data. The memory 1609 may mainly include a first storage area for storing programs or instructions and a second storage area for storing data. Among them, the first storage area may store an operating system, application programs or instructions required for at least one function (such as a sound playback function, an image playback function, etc.). In addition, the memory 1609 may include volatile memory or non-volatile memory, or the memory 1609 may include both volatile and non-volatile memory. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), a static random access memory (SRAM), a dynamic random access memory (DRAM), a synchronous dynamic random access memory (SDRAM), a double data rate synchronous dynamic random access memory (DDR SDRAM), an enhanced synchronous dynamic random access memory (ESDRAM), a synch link dynamic random access memory (SLDRAM), and a direct rambus random access memory (DRRAM). The memory 1609 in the embodiments of the present application includes, but is not limited to, these and any other suitable types of memory.

[0181] The processor 1610 may include one or more processing units; optionally, the processor 1610 integrates an application processor and a modem processor. Among them, the application processor mainly processes operations related to the operating system, user interface, and application programs, etc., and the modem processor mainly processes wireless communication signals, such as a baseband processor. It can be understood that the above-mentioned modem processor may not be integrated into the processor 1610 either.

[0182] The embodiments of the present application also provide a readable storage medium. A program or instructions are stored on the readable storage medium. When the program or instructions are executed by a processor, each process of the above-mentioned screen recording method embodiment is implemented, and the same technical effects can be achieved. To avoid repetition, it will not be elaborated here.

[0183] Among them, the processor is the processor in the electronic device in the above-mentioned embodiment. The readable storage medium includes computer-readable storage media, such as computer read-only memory ROM, random access memory RAM, magnetic disks, or optical discs, etc.

[0184] Another embodiment of the present application provides a chip, which includes a processor and a communication interface. The communication interface is coupled to the processor. The processor is used to run programs or instructions to implement each process of the above-mentioned screen recording method embodiment, and can achieve the same technical effects. To avoid repetition, it will not be elaborated here.

[0185] It should be understood that the chip mentioned in the embodiment of the present application can also be referred to as a system-on-chip, system chip, chip system, or system-on-chip, etc.

[0186] The embodiment of the present application provides a computer program product, which is stored in a storage medium. The program product is executed by at least one processor to implement each process of the above-mentioned screen recording method embodiment, and can achieve the same technical effects. To avoid repetition, it will not be elaborated here.

[0187] It should be noted that in this article, the term "including", "comprising", or any other variant thereof is intended to cover non-exclusive inclusion, so that a process, method, article, or device including a series of elements not only includes those elements, but also includes other elements not expressly listed, or further includes elements inherent to such process, method, article, or device. Without more limitations, the element defined by the statement "including a..." does not exclude the existence of additional identical elements in the process, method, article, or device including that element. In addition, it should be pointed out that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in the reverse order according to the functions involved. For example, the described method may be performed in a different order than described, and various steps may be added, omitted, or combined. Additionally, the features described with reference to certain examples may be combined in other examples.

[0188] Through the description of the above embodiments, those skilled in the art can clearly understand that the above embodiment methods can be implemented by means of software plus a necessary general hardware platform. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, in essence, or the part that contributes to the related technology, can be embodied in the form of a computer software product. The computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disc), and includes several instructions to enable a terminal (which can be a mobile phone, computer, server, or network device, etc.) to execute the methods of the various embodiments of the present application.

[0189] The embodiments of the present application have been described above in conjunction with the accompanying drawings. However, the present application is not limited to the above specific embodiments. The above specific embodiments are merely illustrative rather than restrictive. Under the inspiration of the present application, those of ordinary skill in the art can also make many forms without departing from the purpose of the present application and the scope protected by the claims, and all of them fall within the protection scope of the present application.

Claims

1. A screen recording method, characterized in that, including: Receiving a first input during the process of screen recording a display screen; In response to the first input, identifying a first target video frame in the recorded video that contains at least one type of interference element; Removing the interference elements of the target type from the first target video frame to obtain a first video, where the interference elements of the target type are at least one of the at least one type of interference elements.

2. The method according to claim 1, wherein The first input includes a first sub-input and a second sub-input; The receiving the first input during the process of screen recording the display screen includes: Receiving the first sub-input during the process of screen recording the display screen; In response to the first sub-input, displaying at least one candidate control on the display screen; Receiving the second sub-input for a target control among the candidate controls.

3. The method according to claim 1 or 2, characterized in that, The method further includes: Identifying the interference elements included in a second target video frame, where the second target video frame is a video frame displayed on the display screen; Removing the interference elements of the target type from the second target video frame to obtain a processed second target video frame; Updating the processed second target video frame to the first video.

4. The method according to claim 1 or 2, wherein After removing the interference elements of the target type from the first target video frame to obtain the first video, the method further includes: Previewing and displaying the first target video frame after removing the interference elements on the display screen.

5. The method according to claim 1 or 2, characterized in that, The display screen is a playback screen of a second video, and the display screen further includes a video progress control control for the second video; the method further includes: Displaying a progress identifier corresponding to the first target video frame in the second video on the video progress control control.

6. The method according to claim 5, wherein The interference elements include at least two types, and the method further includes: Differentially displaying the progress identifier corresponding to the first target video frame in the second video according to the type of the interference elements in the first target video frame.

7. A screen recording device, characterized in that, including: An input module, configured to receive a first input during the process of screen recording a display screen; An identification module, configured to, in response to the first input, identify a first target video frame in the recorded video that contains at least one type of interference element; A removal module, configured to remove the interference elements of the target type from the first target video frame to obtain a first video, where the interference elements of the target type are at least one of the at least one type of interference elements.

8. The device according to claim 7, characterized in that, The first input includes a first sub-input and a second sub-input; The input module is specifically configured to: Receive the first sub-input during the process of screen recording the display screen; In response to the first sub-input, display at least one candidate control on the display screen; Receive the second sub-input for a target control among the candidate controls.

9. The device according to claim 7 or 8, characterized in that, The apparatus further includes a real-time recording module, configured to: Identify the interference elements included in a second target video frame, where the second target video frame is a video frame displayed on the display screen; Remove the interference elements of the target type from the second target video frame to obtain a processed second target video frame; Update the processed second target video frame to the first video.

10. The device according to claim 7 or 8, characterized in that, The device further includes a preview module for previewing and displaying a first target video frame after removing the interference elements in the display screen.

11. The device according to claim 7 or 8, characterized in that The display screen is a playback screen of a second video, and the display screen further includes a video progress control control for the second video; the device further includes a progress identification module for displaying a progress identifier corresponding to the first target video frame in the second video on the video progress control control.

12. The device according to claim 11, characterized in that, The interference elements include at least two types, and the device further includes a display module for differentially displaying a progress identifier corresponding to the first target video frame in the first video according to the type of the interference elements in the first target video frame.

Images