Screen recording method, screen recording device and terminal

[0030] In order to make the objectives, technical solutions, and advantages of the present application clearer, the following will further describe the embodiments of the present application in detail with reference to the accompanying drawings.

[0031] The "module" mentioned in this article generally refers to a program or instruction stored in a memory that can realize certain functions; the "unit" mentioned in this article generally refers to a functional structure divided logically, the "unit" It can be realized by pure hardware, or a combination of software and hardware.

[0032] The "plurality" mentioned herein means two or more. "And/or" describes the association relationship of the associated objects, indicating that there can be three types of relationships, for example, A and/or B, which can mean: A alone exists, A and B exist at the same time, and B exists alone. The character "/" generally indicates that the associated objects are in an "or" relationship.

[0033] First, explain the following terms involved in the embodiments of this application:

[0034] Screen recording: Screen recording, also known as screen recording, means that the terminal collects image data on all or part of the screen, and encodes the collected image data to obtain a video file. Screen recording can also be referred to as screen recording for short.

[0035] Screen recording area: The screen recording area refers to the area on the screen where the image data is collected. Illustratively, when the image data of the entire area of ​​the screen is collected, the screen recording area is the entire area of ​​the screen, and when the image data of the first area of ​​the screen is collected, the screen recording area is the area of ​​the screen. The first area, the first area is a partial (or partial) area of ​​the entire area.

[0036] Process: It is the basic unit for scheduling and allocating computing resources in the operating system. When an application is running, it can have one or more processes.

[0037] Optionally, the process may be the active process of the application program or the user interface (UI) process of the application program. An application program usually includes at least one program component. The program components are divided into four types: activity (English: Activity) component, service (English: Service) component, content provider (English: Content Provider) component, and broadcast receiver (English: Broadcast Receiver) component. Among them, the activity component is a component responsible for interacting with the user in the Android application, which provides a visual user interface for the Android application. An Android application can include zero to multiple activity components, such as an activity for unlocking, an activity for mobile payment, an activity for viewing photos, and an activity for setting user profile information. The active process refers to the process corresponding to the current running activity in the application. The UI process in the application refers to the process corresponding to the UI element displayed in the user interface of the application.

[0038] Whitelist: The whitelist stores the identifiers corresponding to the user interfaces that are restricted from screen recording. Among them, the user interfaces that are restricted from screen recording are usually user interfaces that require privacy protection. It is worth noting that the whitelist is an exemplary list naming method. According to the specific role of the whitelist, it can also be called a restricted list, a privacy protection list, etc. The embodiment of the application does not limit the naming method of the whitelist .

[0039] Split-screen display mode: Split-screen display mode refers to dividing the screen of the terminal into two or more areas, and each area displays different applications. In an optional embodiment, two or more areas are not excluded Shown in is the possibility of the same application.

[0040] Secondly, the implementation environment of the embodiments of this application is introduced, and the embodiments of this application are used in such figure 1 The terminal 100 shown is taken as an example for description.

[0041] The terminal 100 is a terminal with a screen recording function. Optionally, the screen recording function may be provided by the operating system in the terminal 100, or may be provided by an application installed in the terminal 100. The application may be a screen recording application or another screen recording provider. Functional application. Optionally, the terminal 100 may be any one of a mobile phone, a tablet computer, a laptop computer, a desktop computer, and a wearable device. Optionally, the terminal 100 includes: a processor 120 and a memory 140.

[0042] The processor 120 may include one or more processing cores. The processor 120 uses various interfaces and lines to connect various parts of the entire terminal 100, and executes the terminal by running or executing instructions, programs, code sets, or instruction sets stored in the memory 140, and calling data stored in the memory 140. 100 various functions and processing data. Optionally, the processor 120 may use at least one of Digital Signal Processing (DSP), Field-Programmable Gate Array (FPGA), and Programmable Logic Array (PLA) Realized in the form of hardware. The processor 120 may be integrated with one or a combination of a central processing unit (Central Processing Unit, CPU), a graphics processing unit (GPU), and a modem. Among them, the CPU mainly processes the operating system, user interface, and application programs; the GPU is used for rendering and drawing the content that needs to be displayed on the display screen 160; and the modem is used for processing wireless communication. It can be understood that the above-mentioned modem may not be integrated into the processor 120, but may be implemented by a chip alone.

[0043] The memory 140 may include a random access memory (Random Access Memory, RAM), or may include a read-only memory (Read-Only Memory). Optionally, the storage 140 includes a non-transitory computer-readable storage medium. The memory 140 may be used to store instructions, programs, codes, code sets or instruction sets. The memory 140 may include a program storage area and a data storage area. The program storage area may store instructions for implementing the operating system and instructions for at least one function (such as touch function, sound playback function, image playback function, etc.), Instructions for implementing the following various method embodiments, etc.; the storage data area can store data (such as audio data, phone book) created according to the use of the terminal 100, and the like.

[0044] Optionally, the terminal 100 further includes a display screen 160, which is used to display the display content of the application, or the display content corresponding to the active process of the application, or the display content corresponding to the UI process of the application. The display screen 160 may also be simply referred to as a screen.

[0045] figure 2 It is a flowchart of the screen recording method provided by an exemplary embodiment of the present application, and the screen recording method is applied in such as figure 1 Take the terminal 100 shown as an example, such as figure 2 As shown, the screen recording method includes:

[0046] Step 201: When the first display content is displayed in the screen recording area, it is judged whether the first display content is the display content restricted from screen recording.

[0047] Optionally, the screen recording area is the area where the screen is being recorded when the terminal is in the screen recording state. When the display content of all areas on the screen is being recorded, all areas of the screen are the screen recording areas; When the display content of part of the area in is being recorded on the screen, this part of the area is the screen recording area.

[0048] The screen recording state refers to the state of screen recording the display content of all or part of the screen.

[0049] Optionally, the first display content may be display content corresponding to the application program, or may be the active process of the application program, or the display content corresponding to the UI process of the application program.

[0050] Optionally, the terminal stores a list of restricted screen recording display content, and by matching the first display content with the restricted screen recording display content stored in the list, it can be known whether the first display content is restricted The display content of the screen recording.

[0051] Step 202: Stop recording the first display content when the first display content is the display content restricted from screen recording.

[0052] When the first display content is a display content restricted from screen recording, that is, when the first display content includes private information, the recording of the first display content is stopped.

[0053] To sum up, the screen recording method provided in this embodiment determines whether the first display content is the display content restricted to screen recording. When the first display content is the display content restricted to screen recording, the terminal stops viewing For the screen recording of the first display content, since the display content that is restricted from recording may be the display content that requires privacy protection, the above embodiment of the present application can prevent the user's private information from being recorded in the video file, thereby preventing private information It is leaked to ensure the user's information security.

[0054] In an optional embodiment, the terminal stores an identifier corresponding to the display content of the restricted screen recording, and the terminal judges whether the first display content is the display content of the restricted screen recording through the identifier. image 3 Be explained.

[0055] image 3 It is a flowchart of the screen recording method provided by another exemplary embodiment of the present application, and the screen recording method is applied in such as figure 1 Take the terminal 100 shown as an example, such as image 3 As shown, the screen recording method includes:

[0056] Step 301: When the first display content is displayed in the screen recording area, obtain a first identifier corresponding to the first display content.

[0057] Optionally, the screen recording area is the area where the screen is being recorded when the terminal is in the screen recording state. When the display content of all areas on the screen is being recorded, all areas of the screen are the screen recording areas; When the display content of part of the area in is being recorded on the screen, this part of the area is the screen recording area.

[0058] The screen recording state refers to the state of screen recording the display content of all or part of the screen.

[0059] Optionally, the first display content may be display content corresponding to the application program, or may be the active process of the application program, or the display content corresponding to the UI process of the application program.

[0060] Optionally, the screen recording area includes the first display content. Illustratively, the screen recording area may include all of the first display content, or may only include part of the first display content.

[0061] Step 302: Match the first identifier with the identifier in the white list.

[0062] Optionally, the whitelist stores an identifier corresponding to the displayed content restricted to screen recording.

[0063] Optionally, the display content of the restricted screen recording may be the display content corresponding to the application program, or the active process in the application program or the display content corresponding to the UI process in the application program.

[0064] When the restricted screen recording is the display content corresponding to the application, the identifier in the whitelist can be the application name or the installation package name of the application; when the restricted screen recording is the display content corresponding to the process At the time, the identifier in the whitelist can be the process name or the process identifier.

[0065] Schematically, taking the identifiers stored in the whitelist as the application name and process name as an example, as shown in the following table 1:

[0066] Table I

[0067] Serial number

[0068] As shown in Table 1 above, the identifiers 1 to 3 are application program names, and the identifiers 4 to 8 are process names corresponding to the active processes of the application program.

[0069] Step 303: When the first identifier matches any identifier in the white list, stop recording the first display content.

[0070] Optionally, when the identifier corresponding to the display content of the restricted screen recording includes the first identifier, that is, the first display content is the display content of the restricted screen recording, the terminal stops recording the first display content.

[0071] It is worth noting that when the first identifier corresponding to the first display content does not match any identifier in the whitelist, the terminal keeps recording the first display content.

[0072] In summary, the screen recording method provided in this embodiment, when the terminal is in the screen recording state, matches the identifier corresponding to the displayed content in the screen recording area with the identifier stored in the whitelist. If the matching is successful, then The terminal stops the screen recording of the display content. Since the identifier stored in the whitelist is the identifier corresponding to the display content that needs privacy protection, the above embodiment of the application can prevent the user's private information from being recorded in the video file, thereby preventing Private information is leaked, ensuring user information security.

[0073] Figure 4 It is a flowchart of the screen recording method provided by another exemplary embodiment of the present application, and the screen recording method is applied in such as figure 1 Take the terminal 100 shown as an example, such as Figure 4 As shown, the screen recording method includes:

[0074] Step 401: When the first display content is displayed in the screen recording area, acquire a first identifier corresponding to the first display content.

[0075] Optionally, the screen recording area is the area where the screen is being recorded when the terminal is in the screen recording state. When the display content of all areas on the screen is being recorded, all areas of the screen are the screen recording areas; When the display content of part of the area in is being recorded on the screen, this part of the area is the screen recording area.

[0076] The screen recording state refers to the state of screen recording the display content of all or part of the screen.

[0077] Optionally, the first display content may be display content corresponding to the application program, or may be the active process of the application program, or the display content corresponding to the UI process of the application program.

[0078] When the first display content is the display content corresponding to the application program, the first identifier may be the application program name of the application program or the installation package name of the application program. Illustratively, the terminal monitors the screen recording area during the screen recording process. The application program corresponding to the first display content displayed in, and obtain the application program name or installation package name of the application program, and determine the application program name or installation package name as the first identifier of the first display content.

[0079] When the first display content is an active process in an application program or display content corresponding to a UI process, the first identification may be the process name of the process or the identification of the process.

[0080] Take the Android operating system as an example. After the terminal starts the screen recording function, it monitors the running activities by active polling, and determines whether a process running event is generated according to the running activity. When a process running event occurs, Determine the process corresponding to the process running event.

[0081] Among them, an activity is a component that includes one or more user interfaces, and is used to implement interaction with a user. Each application program may include multiple activities, and each activity corresponds to one or more associated user interfaces. The running activity is the component corresponding to the user interface at the top level of the screen. The uppermost user interface is the user interface that the user sees on the screen when using the terminal. In the embodiment of the present application, description is made by taking the event as the first display content as an example.

[0082] Activities can be cascaded. Whenever a new activity is started, the new activity will overwrite the original activity. In the Android operating system, the activity stack is used to store the activities that have been started. The activity stack is a stack used to store the execution order of processes. The process at the top of the activity stack corresponds to the display content being displayed on the screen. The activity stack is a kind of last-in-first By default, every time an activity is started, the activity will be pushed into the activity stack and be at the top of the stack. The activity at the top of the stack is the running activity. When the running activity changes, the activity at the top of the activity stack will also change.

[0083] It should be noted that, in addition to the new activity at the top of the activity stack, when an old activity is switched to run, the old activity will also be moved to the top of the activity stack again.

[0084] Optionally, each process includes an identifier, which is used to distinguish the processes. When the first identifier is the identifier corresponding to the active process in the application, the first identifier may be the active name or the active identifier of the activity; when the first identifier is the identifier corresponding to the UI process in the application, the first identifier A logo can be a UI name or logo. Among them, the above-mentioned marks are all preset marks.

[0085] When the first display content is being displayed in the screen recording area, the terminal reads the identification of the process corresponding to the first display content from the top of the activity stack, that is, the terminal reads the active process corresponding to the first display content from the top of the activity stack And the identification of the activity process is determined as the first identification of the first display content;

[0086] or,

[0087] When the first display content is being displayed in the screen recording area, the terminal reads the ID of the process corresponding to the first display content from the top of the activity stack, that is, the terminal reads the user interface corresponding to the first display content from the top of the activity stack The identification of the process, and the identification of the user interface process is determined as the first identification of the first display content.

[0088] Step 402: Determine whether the first identifier matches the identifier in the white list.

[0089] Match the first identifier with the identifier in the whitelist.

[0090] Optionally, the whitelist stores an identifier corresponding to the displayed content restricted to screen recording.

[0091] Optionally, the display content of the restricted screen recording may be the display content corresponding to the application program, or the active process in the application program or the display content corresponding to the UI process in the application program.

[0092] When the restricted screen recording is the display content corresponding to the application, the identifier in the whitelist can be the application name or the package name of the application; when the restricted screen recording is the display content corresponding to the process At the time, the identifier in the whitelist can be the process name or the process identifier.

[0093] Optionally, when the display content of the restricted screen recording is the display content corresponding to the application, the application includes an online banking application, a financial transaction application, a short message application, an address book application, a shopping application, At least one of a memo application, a mailbox application, an album application, and an instant messaging application; when the display content of the restricted screen recording is the active process in the application or the display content corresponding to the UI process in the application , The process includes: payment process, password input process, short message reading process, contact information browsing process, financial transaction process, mail reading process, photo album browsing process, instant messaging message reading process and short message receiving process at least One kind.

[0094] It is worth noting that the above-mentioned exemplary applications and processes are only examples used for illustration in the embodiments of this application. In actual operation, the application corresponding to the display content of the restricted screen recording may be an application that comes with the operating system. The program can also be a third-party application installed in the terminal; the active process and the UI process that are restricted from screen recording can also be other active processes in the application or the UI process, or the active process that comes with the terminal's operating system Or UI process, this application does not limit it. In an optional embodiment, the above-mentioned application, the activity process in the application, and the UI process can also be set by the user.

[0095] Step 403: When the first identifier matches any identifier in the whitelist, stop recording the first display content.

[0096] Optionally, when the identifier corresponding to the display content of the restricted screen recording includes the first identifier, that is, the first display content is the display content of the restricted screen recording, the terminal stops recording the first display content.

[0097] Illustratively, the above steps 401 to 403 will be explained in detail with a specific example, where the screen recording area is the entire area of ​​the screen, and the first display content is the display content of the application program as an example. Please refer to Figure 5;

[0098] Some applications installed on the terminal are displayed in the user interface 51, including: xx online banking, yy player, z instant messaging, a browser, and photo album, and a screen recording control 52 is superimposed and displayed on the user interface 51, The screen recording control 52 is used to prompt the user about the screen recording state of the terminal, and the screen recording state includes but is not limited to at least one of the following contents: the screen recording duration and whether or not it is recording. Optionally, such as Figure 5 As shown, the screen recording time displayed in the screen recording control 52 has reached 1 minute and 20 seconds, and the black circular element indicates that the screen recording is in progress;

[0099] When the user selects xx online banking when the screen recording time reaches 1 minute and 20 seconds, the user interface 51 jumps to the user interface 53 corresponding to xx online banking, that is, the terminal opens the application xx online banking and displays it on the display The display content of xx online banking is displayed, and the terminal obtains the identity of the xx online banking application that is being displayed. For example, the identity obtained by the terminal can be the application name of the online banking "xx online banking", and the obtained identity is combined with Match the identifiers stored in the whitelist, and match the identifiers of the xx online banking in the whitelist. For example, if "xx online banking" is stored in the whitelist, the terminal will stop recording the user interface 53, such as screen recording Control 54 shows that the screen recording time is maintained at 1 minute and 20 seconds, and the black triangle element indicates that the screen recording of the terminal has stopped.

[0100] It is worth noting that after the terminal stops recording the user interface 53, the user can also resume the recording of the user interface 53 through the resume operation. For example, the user can click the screen recording control 54 and the terminal resumes the recording according to the click operation. User interface 53 recording.

[0101] Step 404: When the first identifier does not match any identifier in the whitelist, keep recording the first display content.

[0102] Step 405: When the second display content is displayed in the screen recording area, it is determined whether the second display content is the display content restricted from screen recording.

[0103] Optionally, the second display content is the display content being displayed in the screen recording area. Optionally, the screen recording area includes the second display content, and the screen recording area may include all content of the second display content, or may only include part of the second display content.

[0104] Optionally, the method for the terminal to determine whether the second display content is the display content restricted to screen recording may be: the terminal obtains the second identifier corresponding to the second display content, and compares the second identifier with the identifier in the whitelist Matching, judging whether the second display content is the display content restricted from screen recording according to the matching result.

[0105] Similar to step 401, when the second display content is the display content of the application, the terminal obtains the identification of the application, such as the application name, when the second display content is the active process in the application or the display corresponding to the UI process When content, the terminal reads the process ID from the top of the active stack.

[0106] Optionally, the whitelist stores an identifier corresponding to the displayed content restricted to screen recording.

[0107] Optionally, the display content of the restricted screen recording may be the display content corresponding to the application program, or the active process in the application program or the display content corresponding to the UI process in the application program.

[0108] When the second identifier matches any identifier in the white list, go to step 406; when the second identifier does not match any identifier in the white list, go to step 407.

[0109] Step 406: When the second display content is the display content restricted from screen recording, stop recording the second display content.

[0110] Optionally, when the second identifier matches any identifier in the whitelist, the second display content is the display content restricted from screen recording, and the recording of the second display content is stopped.

[0111] Step 407: When the second display content is not the display content restricted to screen recording, record the second display content.

[0112] Optionally, when the second identifier does not match any of the identifiers in the whitelist, that is, the second display content corresponding to the second identifier is not the display content that is restricted from recording, then the second display content is recorded .

[0113] Illustratively, the above steps 405 to 407 are explained in conjunction with a specific example, where the screen recording area is the entire area of ​​the screen, and the second display content is the display content of the application as an example. Please refer to Image 6;

[0114] The terminal receives the message sent by the yy player application, and superimposes the display interface element 55 on the user interface 53, and displays the message sent by the yy player on the interface element 55. When receiving the message sent by the yy player, the terminal The screen recording has been paused. As shown in the screen recording control 54, the screen recording duration is maintained at 1 minute and 20 seconds, and the black triangle element indicates that the screen recording of the terminal has been paused;

[0115] The user selects the message sent by the yy player on the interface element 55, and the terminal displays the user interface 56 corresponding to the yy player according to the user's selection, that is, the terminal opens the application yy player, and the terminal obtains the information of the yy player application. ID, the yy player is an application that is being displayed in the screen recording area, the terminal obtains the ID such as: the application name of the player "yyplayer", and compares the obtained ID with the ID stored in the whitelist Match, the whitelist does not include the identity of the yy player, the terminal records the user interface 56, as shown by the screen recording control 57, as the screen recording continues, the screen recording time is from 1 minute to 20 The second jumps to 1 minute and 22 seconds, and the black circular element indicates that the terminal is recording screen.

[0116] To sum up, the screen recording method provided in this embodiment determines whether the first display content is the display content restricted to screen recording. When the first display content is the display content restricted to screen recording, the terminal stops viewing For the screen recording of the first display content, since the display content that is restricted from recording may be the display content that requires privacy protection, the above embodiment of the present application can prevent the user's private information from being recorded in the video file, thereby preventing private information It was leaked to ensure the user's information security.

[0117] The screen recording method provided in this embodiment determines whether the second display content is the display content restricted to screen recording, and when the second display content is not the display content restricted to screen recording, the second display content is recorded to achieve This allows the terminal to automatically determine whether the displayed display content is a display content that requires privacy protection, so that the terminal can automatically start or stop screen recording.

[0118] In an alternative embodiment, the terminal may also operate in the split-screen display mode. At this time, when the terminal is recording the screen, it can record all the split-screen areas in the split-screen display mode, or just record the For a certain one or several split-screen areas in the split-screen display mode, in the following embodiments, the terminal is operated in the split-screen display mode as an example for description.

[0119] Figure 7 It is a flowchart of the screen recording method provided by another exemplary embodiment of the present application, and the screen recording method is applied in such as figure 1 Take the terminal 100 shown as an example, such as Figure 7 As shown, the screen recording method includes:

[0120] Step 701: Acquire a first identifier corresponding to the first display content when displaying the first display content in the first split screen area.

[0121] Optionally, the screen recording area includes a first split screen area and a second split screen area in the split screen display mode, and the first display content is the display content being displayed in the first split screen area.

[0122] Optionally, the first display content may be display content corresponding to the application program, or may be the active process of the application program, or the display content corresponding to the UI process of the application program.

[0123] Optionally, the two split-screen areas can correspond to two applications being displayed in the operating system, and the two split-screen areas can generate two activity stacks in the operating system correspondingly, and obtain the process ID according to the activity stack. Way above Figure 4 The step 401 shown has already been discussed and will not be repeated here.

[0124] Optionally, the terminal reads the identifier of the process corresponding to the displayed content from the top of the activity stack corresponding to the first split screen area, or the terminal obtains the identifier of the application being displayed in the first split screen area, such as: application name.

[0125] Step 702: Determine whether the first identifier matches the identifier in the white list.

[0126] Optionally, the whitelist stores an identifier corresponding to the displayed content restricted to screen recording.

[0127] Optionally, the display content of the restricted screen recording may be the display content corresponding to the application program, or the active process in the application program or the display content corresponding to the UI process in the application program.

[0128] Optionally, when the display content of the restricted screen recording is the display content corresponding to the application, the application includes an online banking application, a financial transaction application, a short message application, an address book application, a shopping application, At least one of a memo application, a mailbox application, an album application, and an instant messaging application; when the display content of the restricted screen recording is the active process in the application or the display content corresponding to the UI process in the application , The process includes: payment process, password input process, short message reading process, contact information browsing process, financial transaction process, mail reading process, photo album browsing process, instant messaging message reading process and short message receiving process at least One kind.

[0129] It is worth noting that the above exemplary process is only an example for illustration in the embodiments of this application. In actual operation, the application program corresponding to the display content of the restricted screen recording may be the application program of the operating system, or It can be a third-party application installed in the terminal. The restricted screen recording activity process and the UI process may also be other activity processes or UI processes in the application program, and may also be the active process or UI process of the operating system of the terminal, which is not limited in this application. In an optional embodiment, the above-mentioned application, the activity process in the application, and the UI process can also be set by the user.

[0130] Step 703: When the first identifier matches any identifier in the whitelist, stop recording the first display content.

[0131] Optionally, when the identifier corresponding to the display content of the restricted screen recording includes the first identifier, that is, the first display content is the display content of the restricted screen recording, the terminal stops recording the first display content.

[0132] Step 704: When the first identifier does not match any identifier in the whitelist, keep recording the first display content.

[0133] In step 705, when the terminal displays the third display content in the first split screen area, it is judged whether the third display content is the display content restricted from screen recording.

[0134] Optionally, the third display content is the display content being displayed in the first split screen area. Optionally, the first split-screen area includes the third display content, and the screen recording area may include all content of the third display content, or may only include part of the third display content.

[0135] Optionally, when the third display content is the display content corresponding to the process, at the third moment, the terminal reads the third identifier from the top of the activity stack corresponding to the first split-screen area; when the third display When the content is the display content of the application, the terminal obtains the identifier of the application corresponding to the third display content being displayed, such as the application name.

[0136] Optionally, the method for the terminal to determine whether the third display content is the display content restricted to screen recording may be: the terminal obtains the third identifier corresponding to the third display content, and compares the third identifier with the identifier in the whitelist Matching, judging whether the third display content is the display content restricted from screen recording according to the matching result.

[0137] Similar to step 401, when the third display content is the display content of the application, the terminal obtains the identification of the application, such as the application name, when the third display content is the active process in the application or the display corresponding to the UI process When content, the terminal reads the process ID from the top of the active stack.

[0138] Optionally, the whitelist stores an identifier corresponding to the displayed content restricted to screen recording.

[0139] Optionally, the display content of the restricted screen recording may be the display content corresponding to the application program, or the active process in the application program or the display content corresponding to the UI process in the application program.

[0140] When the third identifier matches any identifier in the white list, step 706 is entered; when the third identifier does not match any identifier in the white list, step 707 is entered.

[0141] Step 706: Stop recording the third display content when the third display content is the display content restricted from screen recording.

[0142] Optionally, when the third identifier matches any identifier in the whitelist, the recording of the third display content is stopped.

[0143] Step 707: When the third display content is not the display content restricted to screen recording, record the third display content.

[0144] Optionally, when the third identifier does not match any identifier in the whitelist, the third display content is recorded.

[0145] Optionally, when the third identifier does not match any identifier in the white list, that is, the third display content is not the display content restricted to screen recording, the third display content is recorded.

[0146] Step 708: The terminal judges whether the display content of the second split screen area is the display content of the restricted screen recording.

[0147] Optionally, the terminal determines whether the identifier corresponding to the display content of the second split screen area matches any identifier in the whitelist.

[0148] Step 709: When the display content in the second split-screen area is the display content restricted from screen recording, stop recording the display content in the second split-screen area.

[0149] Optionally, when the identifier corresponding to the display content in the second split screen area matches any identifier in the white list, stop recording the display content in the second split screen area.

[0150] Step 710: When the display content in the second split screen area is not the display content that is restricted from screen recording, keep recording the display content in the second split screen area.

[0151] Optionally, when the identifier corresponding to the display content in the second split screen area does not match any identifier in the white list, the recording of the display content in the second split screen area is maintained.

[0152] It is worth noting that when the above-mentioned recording area is displayed in split-screen mode, it is divided into two split-screen areas as an example. In actual operation, the split-screen mode can also be divided into more than two split-screens. Region, this embodiment of the application does not limit this.

[0153] Illustratively, the above steps 701 to 704 and steps 708 to 710 are explained in conjunction with a specific example, where the screen recording area is the entire area of ​​the screen, and the first display content corresponds to the activity process of the application Display content as an example for description, please refer to Figure 8A;

[0154] The screen recording area of ​​the terminal includes a first split screen area and a second split screen area in the split screen display mode. The first split screen area displays the user interface 81 corresponding to xx online banking, and the second split screen area Shown in is the user interface 82 corresponding to the yy player. According to the screen recording control 83, it can be known that the screen recording of the terminal has been carried out for 1 minute and 25 seconds, and the terminal is recording the screen;

[0155] After the terminal selects the input box corresponding to the login password in the user interface corresponding to xx online banking, the user interface 81 corresponding to xx online banking jumps to the user interface 84, in which the user needs to input the password, The terminal obtains the identifier corresponding to the password input process and matches it with the identifier in the whitelist. The whitelist stores the identifier corresponding to the password input process, so the terminal stops screen recording of the user interface 84, but the terminal keeps playing yy According to the screen recording control 85, the screen recording time has jumped from 1 minute 25 seconds to 1 minute 28 seconds, and the screen recording is continuing. It is worth noting that the screen recording corresponding to xx online banking When the user interface 84 stops recording, the finally generated screen recording file can be displayed in the form of a black screen, or in the form of a preset image frame, and the user interface 84 can also be paused for the last image before recording Perform freeze-frame display.

[0156] Illustratively, the above steps 705 to 707 will be explained in detail with a specific example, where the screen recording area is the entire area of ​​the screen, and the first display content is the display content of the application as an example. Please refer to Figure 8B;

[0157] The screen recording area of ​​the terminal includes a first split screen area and a second split screen area in the split screen display mode. The first split screen area displays the user interface 84 corresponding to xx online banking, and the second The user interface 82 corresponding to the yy player is displayed in the split screen area. According to the screen recording control 85, the screen recording of the terminal has been performed for 1 minute and 28 seconds, and the terminal is recording the screen, the user interface corresponding to xx online banking 84 is not within the scope of recording;

[0158] After the terminal clicks the return button in the user interface corresponding to xx online banking, the terminal jumps to the user interface 86 corresponding to the album, and the terminal obtains the corresponding identification of the album, such as the name of the application "album", and the whitelist The name "album" of the application program is not stored in the whitelist. Therefore, the terminal performs screen recording on the user interface 86. It is worth noting that the terminal is always in the screen recording state. Before the screen recording of the yy player, the terminal only records the user interface 82 corresponding to the yy player. After recording the user interface 86, the terminal resumes recording the recording area of ​​the entire screen. Illustratively, according to the screen recording control 88, The screen recording of the terminal has been performed for 1 minute and 30 seconds, and the screen recording is continuing.

[0159] It is worth noting that the first split-screen area and the second split-screen area in the above-mentioned embodiment are two separate split-screen areas, that is, whether the terminal performs screen recording in the first split-screen area does not affect the terminal’s ability to view the second split-screen area. Whether to record the screen in the screen area.

[0160] To sum up, the screen recording method provided in this embodiment determines whether the first display content is the display content restricted to screen recording. When the first display content is the display content restricted to screen recording, the terminal stops viewing For the screen recording of the first display content, since the display content that is restricted from recording may be the display content that requires privacy protection, the above embodiment of the present application can prevent the user's private information from being recorded in the video file, thereby preventing private information It is leaked to ensure the user's information security.

[0161] In the screen recording method provided in this embodiment, when the terminal is displayed in the split-screen display mode, and part of the displayed content in the split-screen mode is the display content that needs to be protected for privacy, it is realized that only the first split screen is displayed. The area performs the function of stopping recording and continuing to record the displayed content except for this part of the content.

[0162] In an optional embodiment, the screen recording area of ​​the terminal can be changed according to the received operation signal, such as switching from the first area to the second area, where the first area and the second area may not overlap each other The two areas of can also be two areas with partial overlap, the following combination Picture 9 Explain the change of the screen recording area.

[0163] Picture 9 It is a flowchart of the screen recording method provided by another exemplary embodiment of the present application, and the screen recording method is applied in such as figure 1 Take the terminal 100 shown as an example, such as Picture 9 As shown, the screen recording method includes:

[0164] Step 901: When the first display content is displayed in the screen recording area, a first identifier corresponding to the first display content is acquired.

[0165] Optionally, the screen recording area is the area where the screen is being recorded when the terminal is in the screen recording state. When the display content of all areas on the screen is being recorded, all areas of the screen are the screen recording areas; When the display content of part of the area in is being recorded on the screen, this part of the area is the screen recording area.

[0166] The screen recording state refers to the state of screen recording the display content of all or part of the screen.

[0167] Optionally, the first display content may be display content corresponding to the application program, or may be the active process of the application program, or the display content corresponding to the UI process of the application program.

[0168] Optionally, each application program corresponds to an identifier, and the identifier is used to distinguish different applications. Optionally, the identifier may be the name of the application program or the installation package name of the application program. Optionally, each process includes an identifier, which is used to distinguish the processes. When the first identifier is the identifier corresponding to the active process in the application, the first identifier may be the active name or the active identifier of the activity; when the first identifier is the identifier corresponding to the UI process in the application, the first identifier A logo can be a UI name or logo. Among them, the above-mentioned marks are all preset marks.

[0169] Step 902: Determine whether the first identifier matches the identifier in the white list.

[0170] Optionally, the whitelist stores an identifier corresponding to the displayed content restricted to screen recording.

[0171] Optionally, the display content of the restricted screen recording may be the display content corresponding to the application program, or the active process in the application program or the display content corresponding to the UI process in the application program.

[0172] Optionally, when the display content of the restricted screen recording is the display content corresponding to the application, the application includes an online banking application, a financial transaction application, a short message application, an address book application, a shopping application, At least one of a memo application, a mailbox application, an album application, and an instant messaging application; when the display content of the restricted screen recording is the active process in the application or the display content corresponding to the UI process in the application , The process includes: payment process, password input process, short message reading process, contact information browsing process, financial transaction process, mail reading process, photo album browsing process, instant messaging message reading process and short message receiving process at least One kind.

[0173] It is worth noting that the above exemplary process is only an example for illustration in the embodiments of this application. In actual operation, the application program corresponding to the display content of the restricted screen recording may be the application program of the operating system, or It can be a third-party application installed in the terminal. The restricted screen recording activity process and the UI process may also be other activity processes or UI processes in the application program, and may also be the active process or UI process of the operating system of the terminal, which is not limited in this application. In an optional embodiment, the above-mentioned application, the activity process in the application, and the UI process can also be set by the user.

[0174] Step 903: When the first identifier matches any identifier in the white list, stop recording the first display content.

[0175] Optionally, when the identifier corresponding to the display content of the restricted screen recording includes the first identifier, that is, the first display content is the display content of the restricted screen recording, the terminal stops recording the first display content.

[0176] Step 904: When the first identifier does not match any identifier in the whitelist, keep recording the first display content.

[0177] Step 905: Change the position of the screen recording area according to the received operation signal.

[0178] Optionally, the operation signal may be at least one of a drag signal, a touch signal, and a sliding signal, which is not limited in the embodiment of the present application.

[0179] Illustratively, taking the terminal receiving a drag signal as an example for description, the user performs a drag operation on the terminal, and the drag operation is used to modify the screen recording area from the first area of ​​the display screen to the second area. Optionally, the aforementioned first area and second area may be two areas that do not overlap each other, or may be two areas that partially overlap.

[0180] It is worth noting that Picture 9 In the flowchart of the screen recording method shown, step 905 can be performed after step 903, and in actual operation, step 905 can also be performed after step 904, that is, after continuing to record the first display content, you can also receive Drag the screen recording area and perform the following steps.

[0181] Step 906: When the fourth display content is displayed in the screen recording area after the position is changed, it is determined whether the fourth display content is the display content of the restricted screen recording.

[0182] Optionally, the fourth display content is the display content being displayed in the screen recording area after the position is changed. Optionally, the screen recording area after the position change includes the fourth display content, and the screen recording area may include all of the fourth display content, or may only include part of the fourth display content.

[0183] Optionally, the method for the terminal to determine whether the fourth display content is the display content restricted from screen recording may be: the terminal obtains the fourth identifier corresponding to the fourth display content, and performs the comparison between the fourth identifier and the identifier in the whitelist. Matching, judging whether the fourth display content is the display content restricted from screen recording according to the matching result.

[0184] Similar to step 401, when the fourth display content is the display content of the application, the terminal obtains the identification of the application, such as the application name, when the fourth display content is the active process in the application or the display corresponding to the UI process When content, the terminal reads the process ID from the top of the active stack.

[0185] Optionally, the whitelist stores an identifier corresponding to the displayed content restricted to screen recording.

[0186] Optionally, the display content of the restricted screen recording may be the display content corresponding to the application program, or the active process in the application program or the display content corresponding to the UI process in the application program. When the fourth identifier matches any identifier in the white list, step 907 is entered; when the fourth identifier does not match any identifier in the white list, step 908 is entered.

[0187] Step 907: Stop recording the fourth display content when the fourth display content is the display content restricted from screen recording.

[0188] Optionally, when the fourth identifier matches any identifier in the whitelist, the recording of the fourth display content is stopped.

[0189] Step 908: When the fourth display content is not the display content restricted to screen recording, record the fourth display content.

[0190] Optionally, when the fourth identifier does not match any identifier in the white list, that is, the fourth display content is not the display content restricted to screen recording, the fourth display content is recorded.

[0191] It is worth noting that the foregoing steps 905 to 908 are described in this embodiment by taking the execution after step 904 as an example. In actual operation, the foregoing steps 905 to 908 may also be performed before step 904.

[0192] Illustratively, the case where the display screen is not recording in the split-screen display mode and the case where the display screen is recording in the split-screen mode will be described separately in conjunction with the above steps 901 to 908.

[0193] First of all, explain the situation that the display screen is not recording in the split-screen display mode. Picture 10.

[0194] Such as Picture 10 As shown, the screen recording area of ​​the terminal is the screen recording area 1010, and the screen recording area 1010 includes a drag point 1020. The user can drag the drag point 1020 to drag the entire screen recording area 1010; The control 1030 knows that the terminal is recording the screen in the screen recording area, and the screen recording time is 1 minute 22 seconds; when the screen recording time reaches 1 minute 22 seconds, the terminal receives the short message sent by the short message application, and the short message The display element 1040 corresponding to the message is displayed in the screen recording area 1010, and the terminal obtains the identifier of the process corresponding to the short message, such as the identifier of the short message reading process corresponding to the short message, and stores the obtained identifier in the whitelist Because the short message reading process matches the short message reading process stored in the whitelist, the terminal stops screen recording in the screen recording area 1010. Illustratively, according to the screen recording control 1050, the screen recording The duration is maintained at 1 minute and 22 seconds, that is, after the terminal receives the short message, the screen recording of the screen area 1010 is stopped.

[0195] After the terminal stops recording the screen area 1010, the user drags the drag point 1020 and drags the screen area 1010 to the screen area 1060. The screen area 1060 is playing the content of the yy player "Promotional Video" The terminal obtains the running process in the screen area 1060. For example, the terminal obtains that the currently displayed application is a yy player, and the identification of the application is the name of the application "yy player", The terminal matches the identifier with the identifier stored in the whitelist, and any identifier stored in the whitelist does not match the application identifier "yyplayer", the terminal will check the display content in the screen area 1060, that is, " "Promotional video" part of the display content to be recorded.

[0196] In another optional embodiment, the situation where the display screen is recorded in the split-screen mode is explained, please combine Picture 11.

[0197] In the split-screen mode, the display screen is divided into a first split-screen area and a second split-screen area. The user interface 1110 corresponding to xx online banking is displayed in the first split-screen area, and the yy player is displayed in the second split-screen area. Corresponding to the user interface 1120, the terminal performs screen recording on the first split screen area (ie the user interface 1110 corresponding to xx online banking). According to the screen recording control 1130, it can be known that the screen recording time of the terminal has reached 1 minute and 25 seconds and is in progress Screen recording; the first split screen area includes the drag point 1140 (solid dot), the second split screen area includes the drag point 1150 (hollow point), the user can drag the drag point 1140 or the drag point 1150 Automatic operation to switch the screen recording area from the first split screen area to the second split screen area, where the solid dot user indicates the split screen area where the screen recording area is located.

[0198] After the user selects the password input box in the user interface 1110 corresponding to xx online banking, the user interface 1110 is switched to the user interface 1160. The user inputs the password in the user interface 1160, and the terminal obtains the password input process After the identification, the identification is matched with the identification stored in the white list, and the identification corresponding to the password input process is stored in the white list. Therefore, the terminal stops the screen recording of the first split screen area. The screen recording control 1170 shows that the terminal The screen recording duration of the screen remains at 1 minute 25 seconds, and the terminal has stopped recording the screen in the first split screen area.

[0199] After the user drags the drag point 1140 to the drag point 1150, the screen recording area of ​​the terminal is switched from the first split screen area to the second split screen area, that is, the screen recording area is switched from the area corresponding to xx online banking to yy In the area corresponding to the player, the terminal obtains the identifier of the process being displayed in the recording area (second split-screen area), such as the process identifier "yy player" corresponding to the yy player. According to the screen recording control 1180, the terminal Screen recording area (second split screen area) for screen recording. by Picture 11 It can be seen that when the screen recording area is switched from the first split screen area to the second split screen area, the drag point 1140 is converted from a solid point to a drag point 1190 (hollow point), and the drag point 1150 is converted from a hollow point to a drag Point 1191 (solid point).

[0200] It is worth noting that the above-mentioned drag operation is not limited to drag from a solid point to a hollow point, and can also be dragged from a hollow point to a solid point;

[0201] In the above drag operation, the user can also drag the solid point to any point in the split screen area where the hollow point is located, or drag the hollow point to any point in the split screen area where the solid point is located, to complete the recording. Switching of the screen area.

[0202] In summary, the screen recording method provided in this embodiment, when the terminal is in the screen recording state, matches the identifier corresponding to the displayed content in the screen recording area with the identifier stored in the whitelist. If the matching is successful, then The terminal stops the screen recording of the display content. Since the identifier stored in the whitelist is the identifier corresponding to the display content that needs privacy protection, the above embodiment of the application can prevent the user's private information from being recorded in the video file, thereby preventing Private information is leaked, ensuring user information security.

[0203] In the screen recording method provided in this embodiment, by dragging the screen recording area from the first area to the second area, when the user wants to record the display content in the second area, the user can start to check the second area only by dragging. Recording of the display content in the second area without ending the current screen recording and starting a new screen recording.

[0204] Picture 12 Is a structural block diagram of a screen recording device provided by an exemplary embodiment of the present application, such as Picture 12 As shown, the screen recording device includes: a judgment module 1201 and a recording module 1202;

[0205] The judging module 1201 is used for judging whether the first display content is the display content restricted from screen recording when the first display content is displayed in the screen recording area;

[0206] The recording module 1202 is configured to stop the recording of the first display content when the first display content is the display content restricted from screen recording.

[0207] In an optional embodiment, the judgment module 1201 includes:

[0208] An obtaining unit for obtaining a first identifier corresponding to the first display content;

[0209] The matching unit is configured to match the first identifier with the identifiers in the white list, and the white list stores the identifiers corresponding to the displayed content that is restricted from screen recording;

[0210] The recording module 1202 is further configured to stop recording the first display content when the first identifier matches any identifier in the whitelist.

[0211] In an optional embodiment, the acquiring unit includes:

[0212] The monitoring subunit is used to monitor the application corresponding to the first display content being displayed in the screen recording area;

[0213] The acquiring unit is also used to acquire the application program name or installation package name of the application program, and determine the application program name or installation package name as the first identifier of the first display content.

[0214] In an optional embodiment, the acquiring unit is further configured to read the identification of the active process corresponding to the first display content from the top of the active stack when the first display content is being displayed in the screen recording area; The identifier of is determined as the first identifier of the first display content;

[0215] The acquiring unit is further configured to read the identifier of the user interface process corresponding to the first display content from the top of the activity stack when the first display content is being displayed in the screen recording area; determine the identifier of the user interface process as the first display The first identifier of the content;

[0216] Among them, the active stack is a stack used to store the execution order of processes, and the process at the top of the active stack corresponds to the display content being displayed on the screen.

[0217] In an optional embodiment, the determining module 1201 is further configured to determine whether the second display content is the display content restricted from screen recording when the second display content is displayed in the screen recording area;

[0218] The recording module 1202 is also used to record the second display content when the second display content is not the display content restricted to screen recording.

[0219] In an optional embodiment, the screen recording area includes a first split screen area and a second split screen area in the split screen display mode, and the first display content is displayed in the first split screen area;

[0220] The recording module 1202 is also used to stop the recording of the first display content in the first split screen area.

[0221] In an optional embodiment, the determining module 1201 is further configured to determine whether the third display content is the display content restricted from screen recording when the third display content is displayed in the first split screen area;

[0222] The recording module 1202 is used to record the third display content when the third display content is not the display content restricted to screen recording.

[0223] In an optional embodiment, the device further includes:

[0224] The receiving module is used to change the position of the screen recording area according to the received operation signal;

[0225] The judging module 1201 is also used for judging whether the fourth display content is the display content of the restricted screen recording when the fourth display content is displayed in the screen recording area after the position is changed;

[0226] The recording module 1202 is also used to record the fourth display content when the fourth display content is not the display content restricted to screen recording.

[0227] In summary, the screen recording device provided by the embodiment of the present application determines whether the first display content is the display content restricted to screen recording, and when the first display content is the display content restricted to screen recording, the terminal stops For the screen recording of the first display content, since the display content of the restricted screen recording may be the display content that requires privacy protection, the above embodiment of the present application can prevent the user's private information from being recorded in the video file, thereby preventing privacy Information is leaked, ensuring the user's information security.

[0228] The embodiments of the present application also provide a computer-readable storage medium that stores at least one instruction, and the at least one instruction is loaded and executed by the processor to implement the recording as described in each of the above embodiments. Screen method.

[0229] The embodiments of the present application also provide a computer program product, and the computer program product stores at least one instruction, and the at least one instruction is loaded and executed by the processor to implement the screen recording method described in each of the above embodiments.

[0230] It should be noted that when the screen recording device provided in the above embodiment records the screen of the terminal, only the division of the above functional modules is used as an example for illustration. In actual applications, the above functions can be allocated to different functional modules according to needs. Complete, that is, divide the internal structure of the device into different functional modules to complete all or part of the functions described above. In addition, the screen recording method and device embodiments provided in the foregoing embodiments belong to the same concept, and the specific implementation process is detailed in the method embodiments, which will not be repeated here.

[0231] The serial numbers of the foregoing embodiments of the present application are only for description, and do not represent the advantages and disadvantages of the embodiments.

[0232] Those of ordinary skill in the art can understand that all or part of the steps in the foregoing embodiments can be implemented by hardware, or by a program instructing relevant hardware to be completed. The program can be stored in a computer-readable storage medium. The storage medium mentioned can be a read-only memory, a magnetic disk or an optical disk, etc.

[0233] The above descriptions are only preferred embodiments of this application and are not intended to limit this application. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of this application shall be included in the protection of this application. Within range.