Screen recording method, device and computer readable storage medium

Abstract

A screen recording method, device and computer-readable storage medium, the screen recording method comprising: in response to a screen recording start instruction, triggering screen recording of foreground display content (101); when receiving a real-time effect editing instruction, using effect elements corresponding to the real-time effect editing instruction to perform effect editing on the video frame obtained by the current screen recording in real time (102); when receiving a screen recording end instruction, generating a screen recording file including the effect elements (103). Through this method, during the screen recording process, according to the instruction, the corresponding effect elements are used to perform effect editing on the current video frame in real time, so that at the end of the screen recording, the screen recording file after effect editing can be directly output, which greatly reduces the operational complexity of effect editing and effectively improves the efficiency of effect editing.

Description

Technical Field

[0001] The present application relates to the field of electronic technology, and in particular to a screen recording method, device and computer-readable storage medium. Background Art

[0002] With the continuous development of terminal technology, in order to better meet the user's terminal usage experience, the terminal provides users with a screen recording function, and users can use the screen recording function to record videos during the terminal operation process.

[0003] In actual applications, in order to improve the user experience and fun of the screen recording file, it is usually necessary to edit relevant effect elements in the screen recording file, such as adding labels, letters, sound effects, etc. At present, in order to obtain a screen recording file with effect elements, a special effect editing application is usually used to perform post-effect editing on the screen recording file after the screen recording is completed, and the user is required to review the screen recording file afterwards and find the effect editing position to perform the effect editing, resulting in low convenience and efficiency of the effect editing operation. SUMMARY OF THE INVENTION

[0005] Technical issues

[0006] The embodiments of the present application provide a screen recording method, device and computer-readable storage medium, which can at least solve the problem in the related art of performing post-effect editing on the screen recording file after the screen recording is completed, resulting in low convenience and efficiency of the effect editing operation.

[0007] Solution to the problem

[0008] Technical Solutions

[0009] A first aspect of an embodiment of the present application provides a screen recording method, including:

[0010] In response to a screen recording start instruction, triggering screen recording of the foreground display content;

[0011] When a real-time effect editing instruction is received, the effect element corresponding to the real-time effect editing instruction is used to perform effect editing on the video frame obtained by the current screen recording in real time;

[0012] When a screen recording end instruction is received, a screen recording file including the effect element is generated.

[0013] A second aspect of an embodiment of the present application provides a screen recording device, including:

[0014] A trigger module, used to trigger the screen recording of the foreground display content in response to a screen recording start instruction;

[0015] An editing module, for, upon receiving a real-time effect editing instruction, using an effect element corresponding to the real-time effect editing instruction to perform effect editing on a video frame obtained from the current screen recording in real time;

[0016] A generation module is used to generate a screen recording file including the effect element when receiving a screen recording end instruction.

[0017] A third aspect of an embodiment of the present application provides an electronic device, including: a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, it implements each step of the screen recording method provided in the first aspect of the embodiment of the present application.

[0018] The fourth aspect of the embodiments of the present application provides a computer-readable storage medium on which a computer program is stored. When the computer program is executed by a processor, the steps in the screen recording method provided in the first aspect of the embodiments of the present application are implemented.

[0019] Advantageous Effects of the Invention

[0020] Beneficial Effects

[0021] As can be seen from the above, according to the screen recording method, device and computer-readable storage medium provided by the present application, in response to the screen recording start instruction, the screen recording of the foreground display content is triggered; when the real-time effect editing instruction is received, the effect element corresponding to the real-time effect editing instruction is used to perform effect editing on the video frame obtained by the current screen recording in real time; when the screen recording end instruction is received, a screen recording file including the effect element is generated. Through the implementation of the present application, during the screen recording process, the corresponding effect element is used according to the instruction to perform effect editing on the current video frame in real time, so that the screen recording file after effect editing can be directly output at the end of the screen recording, which greatly reduces the operational complexity of effect editing and effectively improves the efficiency of effect editing.

[0022] Brief description of the accompanying drawings BRIEF DESCRIPTION OF THE DRAWINGS

[0023] Figure 1 A schematic diagram of the basic flow of the screen recording method provided in the first embodiment of the present application;

[0024] Figure 2 A flowchart of a speech recognition method provided in the first embodiment of the present application;

[0025] Figure 3 A flowchart of the instruction triggering method provided in the first embodiment of the present application;

[0026] Figure 4 A schematic diagram of a flow chart of an effect editing method provided in the first embodiment of the present application;

[0027] Figure 5 A detailed flowchart of the screen recording method provided in the second embodiment of the present application;

[0028] Figure 6 A schematic diagram of a program module of a screen recording device provided in the third embodiment of the present application;

[0029] Figure 7 A schematic diagram of program modules of another screen recording device provided in the third embodiment of the present application;

[0030] Figure 8 A schematic diagram of the structure of an electronic device provided in the fourth embodiment of the present application.

[0031] Embodiments of the invention

[0032] Embodiments of the present invention

[0033] In order to make the purpose, features, and advantages of the invention of this application more obvious and easy to understand, the technical solutions in the embodiments of this application will be clearly and completely described below in conjunction with the drawings in the embodiments of this application. Obviously, the described embodiments are only part of the embodiments of this application, not all of them. Based on the embodiments in this application, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of this application.

[0034] In order to solve the problem in the related art that the post-effect editing of the screen recording file is performed after the screen recording is completed, resulting in low convenience and efficiency of the effect editing operation, the first embodiment of the present application provides a screen recording method, such as Figure 1 This is a basic flow chart of the screen recording method provided in this embodiment, and the screen recording method includes the following steps:

[0035] Step 101: In response to a screen recording start instruction, trigger the screen recording of the foreground display content.

[0036] Specifically, in this embodiment, the foreground display content is the content of the application running in the foreground. The application running in the foreground includes but is not limited to game applications, camera applications, audio and video applications, etc., and in actual applications, the screen recording start instruction can be triggered manually by an external person or automatically by the terminal. If the screen recording start instruction is triggered manually, it may be that the user receives the screen recording start instruction through a special screen recording start option, and if the terminal automatically triggers the screen recording start instruction, it may be triggered according to the application attributes of the application currently running in the foreground, such as whether the application type of the application is a preset type, etc.

[0037] In some implementations of this embodiment, before triggering the screen recording of the foreground display content in response to the screen recording start instruction, it also includes: displaying a global effect editing option on the foreground display interface; when receiving the global effect editing instruction through the global effect editing option, obtaining the effect element corresponding to the global effect editing instruction. Correspondingly, triggering the screen recording of the foreground display content includes: triggering the screen recording of the foreground display content that has the effect element corresponding to the global effect editing instruction in the global editing.

[0038] Specifically, in this embodiment, before starting to record the foreground display content of the terminal, the global effect editing selection function will be opened to the outside world. The user enters the corresponding global effect editing instruction through the displayed global effect editing option. The effect element corresponding to the global effect editing instruction is applicable to all video frames recorded in the subsequent entire screen recording process. It should be noted that the effect elements of this embodiment include: audio effect elements and video effect elements, among which the audio effect elements can be background music, customized sound effects, volume parameters, etc., and the video effect elements can be watermarks, personalized windows, resolution parameters, subtitles, mosaics, etc., which are not limited here. It should also be understood that the global effect editing of this embodiment is to perform effect editing on all video frames in the entire screen recording process.

[0039] Step 102: When a real-time effect editing instruction is received, the effect element corresponding to the real-time effect editing instruction is used to perform effect editing on the video frame obtained from the current screen recording in real time.

[0040] Specifically, in actual applications, users may have the need to track, mark, record, and perform other operations on the content recorded during the screen recording process, such as highlighting a key object in a video screen (circling a graphic, drawing a line, etc.). However, if the function only supports reviewing the recorded file after the screen recording is completed to find the corresponding position to perform effect editing operations, on the one hand, the user may forget some effect editing operation requirements, resulting in the expressiveness of the recorded file not achieving the expected effect. On the other hand, the user needs to find the effect editing operation position frame by frame, and the operation is less convenient.

[0041] Based on this, during the screen recording process, this embodiment opens the real-time effect editing function to the outside, supports external input instructions to perform real-time effect editing on the current video frame, and thus can provide users with the ability to quickly edit effects during the screen recording process. Different from the global effect editing in the aforementioned embodiment, the effect element corresponding to the real-time effect editing instruction in this embodiment only takes effect from the current video frame, and it should be understood that the effect element can only act on the current video frame, or it can continue to act on multiple video frames starting from the current video frame. It should also be noted that the effect element corresponding to the real-time effect editing instruction of this embodiment can refer to the aforementioned description of the effect element corresponding to the global effect editing instruction, which will not be repeated here.

[0042] Step 103: When receiving a screen recording end instruction, generate a screen recording file including effect elements.

[0043] Specifically, in this embodiment, when the screen recording ends, a screen recording file with effects can be directly generated, which saves the user from the complicated process of post-editing the screen recording file. It should be noted that the screen recording end instruction of this embodiment can be triggered automatically or manually. For the specific implementation of automatically triggering the screen recording end instruction, in one case, the screen recording start instruction may carry the screen recording duration information, then when the screen recording duration is reached, the screen recording end instruction is directly triggered; in another case, the cumulative screen recording duration starting from the start time of the screen recording reaches the preset duration threshold; in another case, the application running in the foreground exits.

[0044] In some implementations of this embodiment, before responding to a screen recording start instruction and triggering the screen recording of the foreground display content, it also includes: when the application is in the foreground running state, real-time collection of external voice information to identify the screen recording request; when the screen recording request is identified, triggering the screen recording start instruction.

[0045] Specifically, considering that users record the screen through manual operation, which will result in low operational convenience and high operational interference, this embodiment uses voice recognition to recognize external screen recording requirements to record video of the application running in the foreground, which can greatly improve the operational convenience of screen recording and effectively reduce the interference of screen recording on normal application operations.

[0046] It should be noted that when the foreground triggers the application to run, in one case, the in-application voice recognition process can be automatically awakened to perform in-application voice-assisted operations, without having to use a special wake-up word such as "Hey, Siri" to wake up the in-application voice recognition process, and then the in-application voice-assisted operations can be performed, which is more immediate. In another case, before real-time collection of external voice information for recognition of screen recording requests, it also includes: monitoring whether the preset in-application voice recognition process startup trigger conditions are met; if so, the in-application voice recognition process corresponding to the current foreground running application is started; correspondingly, real-time collection of external voice information includes: real-time collection of external voice information through the in-application voice recognition process. Further, monitoring whether the preset in-application voice recognition process startup trigger conditions are met includes: real-time collection of external voice information through the terminal's global voice recognition application, and when the preset wake-up word is recognized based on the collected voice information, it is determined that the preset in-application voice recognition process startup trigger conditions are met. It should also be understood that the above-mentioned in-application voice recognition process is a process that only supports voice-assisted operations in the current application, and the global voice recognition application is a traditional voice assistant such as Apple's mobile phone voice assistant Siri.

[0047] In addition, this embodiment can collect external voice information in real time through full-duplex mode. While the voice recognition process continues to monitor the uplink voice stream (the user's voice is transmitted to the terminal), it supports a synchronous downlink voice stream (the terminal responds and is output to the user), which can effectively improve the voice interaction experience.

[0048] It should also be noted that in actual applications, the voice uttered by the user when using the terminal application is not limited to conscious screen recording-related voice, but may also be voice uttered unconsciously by the user, or voice uttered when talking with external users. Based on this, in order to ensure the accurate execution of video recording, this embodiment needs to accurately identify the user's screen recording intention in the collected voice.

[0049] Furthermore, in some implementations of this embodiment, before collecting external voice information in real time to identify the screen recording request, it also includes: querying a preset application whitelist to determine whether the application in the foreground running state is an application in the application whitelist. Correspondingly, when the application in the foreground running state is an application in the application whitelist, the step of collecting external voice information in real time to identify the screen recording request is performed.

[0050] Specifically, the application whitelist of this embodiment includes all applications that support the screen recording function of this embodiment. This embodiment only opens the screen recording function to the applications in the application whitelist, which can effectively meet the differentiated needs of users and avoid blindly opening the screen recording function of this embodiment to all applications, which may cause application operation errors, user operation interference, and reduction and waste of terminal processing performance.

[0051] Furthermore, in some implementations of the present embodiment, identifying a screen recording request based on voice information includes: performing semantic analysis on text information corresponding to the voice information, and dividing the text information into multiple participles; performing relevance matching on the multiple participles with feature texts associated with the screen recording request; and identifying the screen recording request based on the matching results.

[0052] Specifically, this embodiment converts voice information into text information, then performs semantic analysis on the text information, and segments the text information according to the analysis results, and then performs semantic disambiguation, semantic understanding and translation on the multiple segments to obtain the user's screen recording intention, thereby having a generalized understanding capability of the user's screen recording intention.

[0053] like Figure 2 The figure is a flow chart of a voice recognition method provided by this embodiment. In some implementations of this embodiment, real-time collection of external voice information for recognition of screen recording request specifically includes the following steps:

[0054] Step 201: collect external voice information in real time and extract voiceprint feature data from the voice information;

[0055] Step 202: compare the voiceprint feature data with the legal voiceprint feature data;

[0056] Step 203: When the comparison is successful, the screen recording request is identified based on the voice information.

[0057] Specifically, in actual applications, the terminal usage environment may be more complex, so in addition to the voice information of the legitimate user of the terminal, there may be other environmental voice information (such as voice information of other users). In order to avoid erroneously triggering a screen recording request that is inconsistent with the actual usage requirements of the legitimate user of the terminal or affects normal use, this embodiment performs a feature comparison on the voiceprint feature data corresponding to the voice information after collecting the voice information, and only triggers the screen recording request recognition for the voice information when the comparison is legitimate, which can effectively improve the accuracy and rationality of the screen recording.

[0058] The above scheme is illustrated below using a specific example. For example, if the terminal is set to respond to the voice of the terminal owner only within the application, the voice information of the terminal owner can be recorded in advance, and the voiceprint feature extraction of the voice information can be performed to obtain legal voiceprint feature data for storage. Then, in actual use, when the terminal owner uses the terminal to operate the application in a noisy environment (such as a subway), the voices of other people around may also be collected by the terminal, which may cause voice recognition errors of the terminal. In order to avoid this situation, this embodiment will compare the voiceprint feature information of the voice information with the legal voiceprint feature information when the voice information is collected. If the comparison is successful, it means that the collected voice is sent by the terminal owner and the voice information is legal, and then a screen recording request recognition is performed on the voice information.

[0059] like Figure 3 As shown in the flowchart of a command triggering method provided in this embodiment, in some implementations of this embodiment, before using the effect element corresponding to the real-time effect editing instruction to perform effect editing on the video frame obtained by the current screen recording in real time, the following steps are specifically included:

[0060] Step 301: Obtain the display attributes of the current foreground display content in real time;

[0061] Step 302: when the display attribute satisfies the preset effect editing trigger condition, obtain a real-time effect editing instruction corresponding to the display attribute;

[0062] Step 303: trigger the real-time effect editing instruction.

[0063] Specifically, in actual applications, the real-time effect editing instruction can be triggered manually or automatically. This embodiment takes into account that when manually triggered, the user's reaction ability and operation speed are limited. Therefore, in order to improve the intelligence and friendliness of real-time effect editing, conditional judgment is performed based on the display attributes of the foreground display content, and when the display attributes meet the conditions, the corresponding real-time effect editing instruction is automatically triggered. It should be noted that the display attributes of this embodiment may include: the type of feature display elements, the number of feature display elements, the degree of change of the current foreground display content relative to the previous display content, etc. The feature display element is also a specific display object, such as a person, animal, vehicle, text, picture, etc. Correspondingly, the effect editing trigger condition may correspond to the type of the feature display element being a preset type, the number of feature display elements reaching a preset number, or the degree of change of the foreground display content exceeding a preset degree, etc.

[0064] like Figure 4As shown in the flowchart of an effect editing method provided in this embodiment, in some implementations of this embodiment, using effect elements corresponding to real-time effect editing instructions to perform effect editing on the video frame obtained by the current screen recording in real time specifically includes the following steps:

[0065] Step 401: extract all characteristic display elements in the video frame obtained from the current screen recording;

[0066] Step 402: determining a target feature display element from all feature display elements based on the element attributes of the feature display element;

[0067] Step 403: Use the effect element corresponding to the real-time effect editing instruction to perform effect editing on the target feature display element in real time.

[0068] Specifically, in actual applications, when real-time effect editing is triggered, it usually involves effect editing of specific objects in the video frame, such as underlining a certain text in the picture displayed in the current frame, circling a specific person, etc. This embodiment takes into account the high complexity of manual editing operations and the low efficiency of effect editing operations. In actual applications, the target feature display elements that need to be effect edited can be determined from all feature display elements according to the attributes of the feature display elements, and the effect elements can be automatically used to perform effect editing on them, which greatly improves the efficiency of effect editing operations. It should be understood that the extraction of all feature display elements in this embodiment can be implemented using existing image recognition algorithms, which will not be elaborated here.

[0069] In some implementations of this embodiment, after generating a screen recording file including effect elements, it also includes: when receiving a screen recording file preview instruction, displaying an effect modification option on the preview interface; when receiving an effect modification instruction through the effect modification option, modifying the effect element in the screen recording file according to the effect modification instruction to obtain a modified screen recording file.

[0070] Specifically, in actual applications, the effects edited in real time during the screen recording process or the global effects edited before the screen recording may not absolutely meet the user's expectations. Therefore, this embodiment also provides the user with an effect modification function after the screen recording is completed, that is, in the screen recording file preview interface, the corresponding effect modification is performed according to the external effect modification instructions. The effect modification here includes effect element replacement, deletion, etc., to improve the flexibility of effect editing.

[0071] Based on the technical solution of the embodiment of the present application described above, in response to the screen recording start instruction, the screen recording of the foreground display content is triggered; when the real-time effect editing instruction is received, the effect element corresponding to the real-time effect editing instruction is used to perform effect editing on the video frame obtained by the current screen recording in real time; when the screen recording end instruction is received, a screen recording file including the effect element is generated. Through the implementation of the solution of the present application, during the screen recording process, the corresponding effect element is used according to the instruction to perform effect editing on the current video frame in real time, so that the screen recording file after effect editing can be directly output at the end of the screen recording, which greatly reduces the operational complexity of effect editing and effectively improves the efficiency of effect editing.

[0072] Figure 5 The method in is a refined screen recording method provided in the second embodiment of the present application, and the screen recording method includes:

[0073] Step 501: When the application is in the foreground, external voice information is collected in real time to identify the screen recording request.

[0074] Specifically, the applications of this embodiment include but are not limited to game applications, camera applications, audio and video applications, etc. This embodiment uses the in-application voice recognition process to accurately recognize the user's screen recording intention on the collected voice.

[0075] Step 502: When a global effect editing instruction is received through the global effect editing option on the foreground display interface, an effect element corresponding to the global effect editing instruction is obtained.

[0076] Step 503: When an external screen recording request is identified, trigger the screen recording of the foreground display content of the global editing effect element corresponding to the global effect editing instruction.

[0077] In this embodiment, before starting to record the foreground display content of the terminal, the global effect editing selection function will be opened to the outside world. The user enters the corresponding global effect editing instruction through the displayed global effect editing option. The effect element corresponding to the global effect editing instruction is applicable to all video frames recorded in the entire subsequent recording process.

[0078] Step 504: When a real-time effect editing instruction is received during the screen recording process, the effect element corresponding to the real-time effect editing instruction is used to perform effect editing on the video frame obtained from the current screen recording in real time.

[0079] During the screen recording process, this embodiment also opens the real-time effect editing function to the outside, supports external input instructions to perform real-time effect editing on the current video frame, thereby providing users with the ability to quickly edit effects during the screen recording process.

[0080] Step 505: When receiving a screen recording end instruction, generate a screen recording file including effect elements.

[0081] In this embodiment, when the screen recording is finished, a screen recording file with effects can be directly generated, which saves the user from the complicated process of post-editing the screen recording file.

[0082] Step 506: When receiving a screen recording file preview instruction, display effect modification options on the preview interface.

[0083] Step 507: When an effect modification instruction is received through the effect modification option, the effect element in the screen recording file is modified according to the effect modification instruction to obtain a modified screen recording file.

[0084] In actual applications, the edited global effects or real-time effects may not absolutely meet the user's expectations. Therefore, this embodiment provides the user with an effect modification function after the screen recording is completed, that is, the corresponding effect modification is performed according to the external effect modification instructions in the screen recording file preview interface. The effect modification here includes effect element replacement, deletion, etc., to improve the flexibility of effect editing.

[0085] It should be understood that the size of the serial number of each step in this embodiment does not mean the order of execution of the steps. The execution order of each step should be determined by its function and internal logic, and should not constitute a sole limitation on the implementation process of the embodiment of this application.

[0086] The embodiment of the present application discloses a screen recording method, which triggers the screen recording of the foreground display content when a screen recording request is recognized from the real-time collected voice information; when a real-time effect editing instruction is received, the effect element corresponding to the real-time effect editing instruction is used to perform effect editing on the video frame obtained by the current screen recording in real time; when the screen recording end instruction is received, a screen recording file including the effect element is generated. Through the implementation of the scheme of the present application, in the screen recording process, the corresponding effect element is used according to the instruction to perform effect editing on the current video frame in real time, so that the screen recording file after effect editing can be directly output at the end of the screen recording, which greatly reduces the operational complexity of effect editing and effectively improves the efficiency of effect editing; and, the present application triggers the screen recording of the application running in the foreground through the screen recording request triggered by voice recognition, which greatly improves the convenience of screen recording operation and effectively reduces the interference of screen recording on normal application operation. In addition, the present application also supports global effect editing before screen recording, which further improves the convenience and efficiency of effect editing.

[0087] Figure 6 A screen recording device is provided in the third embodiment of the present application. The screen recording device can be used to implement the screen recording method in the above-mentioned embodiment. Figure 6 As shown, the screen recording device mainly includes:

[0088] A trigger module 601 is used to trigger the screen recording of the foreground display content in response to a screen recording start instruction;

[0089] The editing module 602 is used to perform effect editing on the video frame obtained by the current screen recording in real time using the effect element corresponding to the real-time effect editing instruction when receiving the real-time effect editing instruction;

[0090] The generation module 603 is used to generate a screen recording file including effect elements when receiving a screen recording end instruction.

[0091] like Figure 7 Another screen recording device provided by this embodiment is shown. In some implementations of this embodiment, the screen recording device further includes: an acquisition module 604, which is used to: display a global effect editing option on the foreground display interface before triggering the screen recording of the foreground display content in response to the screen recording start instruction; when receiving the global effect editing instruction through the global effect editing option, obtain the effect element corresponding to the global effect editing instruction. Correspondingly, the trigger module 601 is specifically used to: in response to the screen recording start instruction, trigger the screen recording of the foreground display content that has the effect element corresponding to the global effect editing instruction in the global editing.

[0092] In some implementations of this embodiment, the trigger module 601 is also used to: before using the effect element corresponding to the real-time effect editing instruction to perform effect editing in real time on the video frame obtained from the current screen recording, obtain the display attributes of the current foreground display content in real time; when the display attributes meet the preset effect editing trigger conditions, obtain the real-time effect editing instruction corresponding to the display attributes; and trigger the real-time effect editing instruction.

[0093] In some implementations of the present embodiment, the editing module 602 is specifically used to: extract all feature display elements in the video frame obtained from the current screen recording when receiving a real-time effect editing instruction; determine the target feature display element from all feature display elements based on the element attributes of the feature display element; and use the effect element corresponding to the real-time effect editing instruction to perform effect editing on the target feature display element in real time.

[0094] Please refer again Figure 7 In some implementations of the present embodiment, the screen recording device also includes: a modification module 605, which is used to display an effect modification option on the preview interface after generating a screen recording file including an effect element when receiving a screen recording file preview instruction; when an effect modification instruction is received through the effect modification option, the effect element in the screen recording file is modified according to the effect modification instruction to obtain a modified screen recording file.

[0095] Please refer again Figure 7In some implementations of this embodiment, the screen recording device further includes: an identification module 606, which is used to collect external voice information in real time to identify the screen recording request when the application is in the foreground running state before triggering the screen recording of the foreground display content in response to the screen recording start instruction. Correspondingly, the trigger module 601 is also used to: trigger the screen recording start instruction when the screen recording request is identified.

[0096] In some implementations of this embodiment, the recognition module 606 is specifically used to: when the application is in the foreground running state, collect external voice information in real time, and extract voiceprint feature data in the voice information; compare the voiceprint feature data with the legitimate voiceprint feature data; when the comparison passes, identify the screen recording request based on the voice information.

[0097] It should be noted that the screen recording methods in the first and second embodiments can be implemented based on the screen recording device provided in this embodiment. Ordinary technical personnel in the relevant field can clearly understand that for the convenience and conciseness of description, the specific working process of the screen recording device described in this embodiment can refer to the corresponding process in the aforementioned method embodiment, and will not be repeated here.

[0098] According to the screen recording device provided by this embodiment, in response to the screen recording start instruction, the screen recording of the foreground display content is triggered; when the real-time effect editing instruction is received, the effect element corresponding to the real-time effect editing instruction is used to perform effect editing on the video frame obtained by the current screen recording in real time; when the screen recording end instruction is received, a screen recording file including the effect element is generated. Through the implementation of the scheme of this application, during the screen recording process, the corresponding effect element is used according to the instruction to perform effect editing on the current video frame in real time, so that the screen recording file after effect editing can be directly output at the end of the screen recording, which greatly reduces the operational complexity of effect editing and effectively improves the efficiency of effect editing.

[0099] See also Figure 8 , Figure 8 An electronic device is provided in the fourth embodiment of the present application. The electronic device can be used to implement the screen recording method in the above-mentioned embodiment. Figure 8 As shown, the electronic device mainly includes:

[0100] Memory 801, processor 802, bus 803, and a computer program stored in memory 801 and executable on processor 802, memory 801 and processor 802 are connected via bus 803. When processor 802 executes the computer program, the screen recording method in the aforementioned embodiment is implemented. The number of processors may be one or more.

[0101] The memory 801 may be a high-speed random access memory (RAM) memory, or a non-volatile memory (non-volatile memory), such as a disk memory. The memory 801 is used to store executable program codes, and the processor 802 is coupled to the memory 801 .

[0102] Furthermore, the present application also provides a computer-readable storage medium, which may be disposed in the electronic device in the above embodiments. Figure 8 Memory in the illustrated embodiment.

[0103] The computer readable storage medium stores a computer program, and when the program is executed by the processor, the screen recording method in the aforementioned embodiment is implemented. Furthermore, the computer storable medium can also be a U disk, a mobile hard disk, a read-only memory (ROM), a RAM, a magnetic disk or an optical disk, and other media that can store program codes.

[0104] In the several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of modules is only a logical function division. There may be other division methods in actual implementation, such as multiple modules or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or modules, which can be electrical, mechanical or other forms.

[0105] The modules described as separate components may or may not be physically separated, and the components shown as modules may or may not be physical modules, that is, they may be located in one place or distributed on multiple network modules. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0106] In addition, each functional module in each embodiment of the present application can be integrated into a processing module, or each module can exist physically separately, or two or more modules can be integrated into one module. The above integrated modules can be implemented in the form of hardware or software functional modules.

[0107] If the integrated module is implemented in the form of a software function module and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application, or the part that contributes to the prior art, or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a readable storage medium, including a number of instructions for a computer device (which can be a personal computer, server, or network device, etc.) to perform all or part of the steps of the various embodiments of the present application. The aforementioned readable storage medium includes: U disk, mobile hard disk, ROM, RAM, disk or CD-ROM and other media that can store program codes.

[0108] It should be noted that, for the above-mentioned method embodiments, for the sake of simplicity of description, they are all expressed as a series of action combinations, but those skilled in the art should be aware that the present application is not limited by the described action sequence, because according to the present application, certain steps can be performed in other sequences or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily required by the present application.

[0109] In the above embodiments, the description of each embodiment has its own emphasis. For parts that are not described in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0110] The above is a description of the screen recording method, device and computer-readable storage medium provided in the present application. For technicians in this field, according to the ideas of the embodiments of the present application, there will be changes in the specific implementation methods and application scopes. In summary, the content of this specification should not be understood as a limitation on the present application.

Claims

1. A screen recording method, characterized in that: include: Display global effect editing options on the front-end display interface; When a global effect editing instruction is received through the global effect editing option, an effect element corresponding to the global effect editing instruction is obtained; the effect element includes background music, customized sound effects, volume parameters, watermarks, personalized windows, resolution parameters or subtitles; In response to a screen recording start instruction, automatically triggering screen recording of the foreground display content of the global edited effect element corresponding to the global effect editing instruction; Acquire the display attributes of the current foreground display content in real time; the display attributes include the number of characteristic display elements and the degree of change of the current foreground display content relative to the previous display content; When the display attribute satisfies a preset effect editing trigger condition, obtaining a real-time effect editing instruction corresponding to the display attribute; The effect editing triggering condition includes that the number of the characteristic display elements reaches a preset number, or the degree of change of the foreground display content exceeds a preset degree; Triggering the real-time effect editing instruction; When a real-time effect editing instruction is received, the effect element corresponding to the real-time effect editing instruction is used to perform effect editing on the video frame obtained by the current screen recording in real time; When a screen recording end instruction is received, a screen recording file including the effect element is generated.

2. The screen recording method according to claim 1, characterized in that: The using the effect element corresponding to the real-time effect editing instruction to perform effect editing on the video frame obtained by the current screen recording in real time includes: Extract all feature display elements in the video frame obtained from the current screen recording; Determining a target feature display element from all the feature display elements based on the element attributes of the feature display elements; The effect element corresponding to the real-time effect editing instruction is used to perform effect editing on the target feature display element in real time.

3. The screen recording method according to claim 1, characterized in that: After generating the screen recording file including the effect element, the method further includes: When receiving a screen recording file preview instruction, the effect modification options are displayed on the preview interface; When an effect modification instruction is received through the effect modification option, the effect element in the screen recording file is modified according to the effect modification instruction to obtain a modified screen recording file.

4. The screen recording method according to any one of claims 1 to 3, characterized in that: Before triggering the screen recording of the foreground display content in response to the screen recording start instruction, the method further includes: When the application is in the foreground, external voice information is collected in real time to identify screen recording requests; When a screen recording request is identified, the screen recording start instruction is triggered.

5. The screen recording method according to claim 4, characterized in that: The real-time collection of external voice information for identifying screen recording requests includes: Collect external voice information in real time and extract voiceprint feature data from the voice information; Comparing the voiceprint feature data with legitimate voiceprint feature data; When the comparison is successful, the screen recording request is identified based on the voice information.

6. A screen recording device, characterized in that: include: A trigger module, for displaying a global effect editing option on a foreground display interface; when a global effect editing instruction is received through the global effect editing option, obtaining an effect element corresponding to the global effect editing instruction; the effect element includes background music, customized sound effects, volume parameters, watermarks, personalized windows, resolution parameters or subtitles; in response to a screen recording start instruction, automatically triggering screen recording of the foreground display content of the global editing having the effect element corresponding to the global effect editing instruction; and obtaining display attributes of the current foreground display content in real time; the display attributes include the number of characteristic display elements and the degree of change of the current foreground display content relative to the previous display content; when the display attributes meet a preset effect editing trigger condition, obtaining the real-time effect editing instruction corresponding to the display attributes; The effect editing triggering condition includes that the number of the characteristic display elements reaches a preset number, or the degree of change of the foreground display content exceeds a preset degree; Triggering the real-time effect editing instruction; An editing module, for, upon receiving a real-time effect editing instruction, using an effect element corresponding to the real-time effect editing instruction to perform effect editing on a video frame obtained from the current screen recording in real time; A generation module is used to generate a screen recording file including the effect element when receiving a screen recording end instruction.

7. An electronic device comprising: A memory, a processor and a bus, wherein the bus is used to realize connection and communication between the memory and the processor; the processor is used to execute a computer program stored in the memory, and when the processor executes the computer program, the steps in the method described in any one of claims 1 to 5 are implemented.

8. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps in the method according to any one of claims 1 to 5 are implemented.

Images