Screen recording method, device, medium and apparatus

Abstract

Embodiments of the present application provide a screen recording method, device, medium and equipment, the method comprising: receiving a screen recording instruction for a target display interface, starting a screen recording function to obtain an initial image of the target display interface; traversing interface elements in the initial image, obtaining attribute information corresponding to each interface element; and adjusting the display effect of each interface element in the recording image corresponding to the target display interface according to the attribute information. Using the screen recording method provided by the embodiments of the present application, by obtaining the attribute information corresponding to the interface control currently displayed in the target display interface, and according to the image processing mode pre-configured for each attribute information, the corresponding display effect is added to different control elements, so that the recording image based on the target display interface can display the display effect of different control elements as required, and the sensitive content is prevented from being leaked in the screen recording image.

Description

Technical Field

[0001] This application relates to the field of electronic communication technology, and more particularly to the field of screen recording technology, and especially to a screen recording method, apparatus, medium and device. Background Technology

[0002] Screen recording can capture image data of the entire screen or a specified area, encoding the data into a transmittable file. During recording, users may perform actions involving sensitive information (such as bank card numbers, social media accounts, and personal identification information). Since this sensitive information is also recorded in the screen recording, other users can see it when playing back the recording, potentially leading to adverse consequences for the user.

[0003] To solve the above technical problems, most current methods involve post-processing the screen recording files, such as decryption. However, this approach is not only time-consuming but also prone to omissions, and thus has its shortcomings. Summary of the Invention

[0004] This application provides a screen recording method, apparatus, medium, and device. The screen recording method provided in this application aims to solve the problem of sensitive content being leaked when users perform screen recording operations on the display interface.

[0005] This application provides a screen recording method, which includes:

[0006] Receive a screen recording command for the target display interface, start the screen recording function to obtain the initial image of the target display interface;

[0007] Traverse the interface elements in the initial image and obtain the attribute information corresponding to each interface element;

[0008] Based on the attribute information, the display effect of each interface element in the recorded image of the corresponding target display interface is adjusted.

[0009] In the screen recording method described in this application embodiment, the attribute information includes:

[0010] The position information of the interface element in the initial image; and / or

[0011] A preset identifier used to indicate the category of the interface element.

[0012] In the screen recording method described in this application embodiment, adjusting the display effect of each interface element in the recorded image corresponding to the target display interface according to each attribute information includes:

[0013] Retrieve a preset blank data layer, which contains data filling areas corresponding to each interface element;

[0014] Based on the attribute information of each interface element, corresponding adjustment parameter values ​​are added to each data filling area to obtain the target data layer. The adjustment parameter values ​​are used to adjust the display effect of the interface elements and establish a mapping relationship between each data filling area and each attribute information.

[0015] Based on the adjustment parameter values ​​in the target data layer, the display effect of each interface element in the recorded image of the corresponding target display interface is adjusted.

[0016] In the screen recording method described in this application embodiment, adjusting the display effect of each interface element in the recorded image corresponding to the target display interface based on each of the adjustment parameter values ​​includes:

[0017] The data filling areas corresponding to each interface element are obtained from the target data layer respectively;

[0018] The image processing rules for each interface element are determined based on the adjustment parameter values ​​contained in each of the data filling areas.

[0019] Based on the image processing rules and adjustment parameter values ​​corresponding to each interface element, image processing is performed on each interface element to adjust the display effect of each interface element.

[0020] In the screen recording method described in the embodiments of this application, the display effect includes any one of normal display, blurred display, and display disabled.

[0021] In the screen recording method described in this application embodiment, the step of performing image processing on each of the interface elements in the initial image based on the image processing rules and adjustment parameter values ​​corresponding to each interface element to adjust the display effect of each interface element includes:

[0022] When the display effect of the interface element is normal, the initial display effect of the interface element is not modified;

[0023] When the display effect of the interface element is blurred, Gaussian processing is performed on all pixels of the interface element within a preset range in the initial image according to the adjustment parameter value, so that the interface element is blurred in the target recorded image.

[0024] When the display effect of the interface element is disabled, a replacement image is generated according to the adjustment parameter value and used as the output image of the interface element.

[0025] In the screen recording method described in this application embodiment, the replacement image is a preset image whose content is not related to the interface element, or an element image corresponding to the initial state of the interface element.

[0026] Accordingly, another aspect of this application embodiment also provides a screen recording device, the screen recording device comprising:

[0027] The receiving module is used to receive a screen recording command for the target display interface and start the screen recording function to obtain the initial image of the target display interface;

[0028] The acquisition module is used to traverse the interface elements in the initial image and acquire the attribute information corresponding to each interface element.

[0029] The adjustment module is used to adjust the display effect of each interface element in the recorded image of the corresponding target display interface according to the attribute information.

[0030] Accordingly, in another aspect, this application also provides a storage medium storing a plurality of instructions adapted for loading by a processor to execute the screen recording method described above.

[0031] Accordingly, another aspect of this application embodiment also provides a terminal device, including a processor and a memory, wherein the memory stores a plurality of instructions, and the processor loads the instructions to execute the screen recording method described above.

[0032] This application provides a screen recording method, apparatus, medium, and device. The method involves receiving a screen recording command for a target display interface, activating the screen recording function to obtain an initial image of the target display interface, traversing the interface elements in the initial image to obtain attribute information corresponding to each interface element, and adjusting the display effect of each interface element in the recorded image corresponding to the target display interface based on the attribute information. By using the screen recording method provided in this application, and by obtaining the attribute information corresponding to the currently displayed interface controls in the target display interface, and adding corresponding display effects to different control elements according to a pre-configured image processing method for each attribute information, the recorded image obtained based on the target display interface can display the display effects of different control elements as required, avoiding the leakage of sensitive content in the screen recording image. Attached Figure Description

[0033] To more clearly illustrate the technical solutions in the embodiments of this application, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0034] Figure 1 This is a flowchart illustrating the screen recording method provided in an embodiment of this application.

[0035] Figure 2 This is a schematic diagram of the target display interface in an embodiment of this application.

[0036] Figure 3 This is a schematic diagram of the screen recording device provided in an embodiment of this application.

[0037] Figure 4 This is another structural schematic diagram of the screen recording device provided in an embodiment of this application.

[0038] Figure 5 This is a schematic diagram of the structure of a terminal device provided in an embodiment of this application. Detailed Implementation

[0039] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only a part of the embodiments of this application, and not all of them. All other embodiments obtained by those skilled in the art based on the embodiments of this application without creative effort are within the protection scope of this application.

[0040] It should be noted that the following is a brief introduction to the background of this solution:

[0041] This solution primarily addresses the technical issue of potential leakage of sensitive content when users record their screens. Screen recording captures image data from the entire screen or a specified area, encoding this data into a transmittable file. During recording, users may perform actions involving sensitive information (such as bank card numbers, social media accounts, and personal identification information). Since this sensitive information is also recorded in the screen recording, other users may see this information when replaying the recording, potentially leading to adverse consequences for the user.

[0042] To address the aforementioned technical problems, most current methods involve post-processing the screen recording files, such as decryption. However, this approach is time-consuming and prone to omissions, exhibiting its own shortcomings. Therefore, based on the above background, this application provides a screen recording method. Using the screen recording method provided in this application, by obtaining the attribute information corresponding to the currently displayed interface controls in the target display interface, and according to the image processing method pre-configured for each attribute information, corresponding display effects are added to different control elements. This ensures that the recorded image obtained based on the target display interface can display the display effects of different control elements as required, preventing sensitive content from being leaked in the screen recording image.

[0043] Please see Figure 1 , Figure 1 This is a flowchart illustrating the screen recording method provided in an embodiment of this application. The screen recording method is applied to a terminal device. Optionally, the terminal device can be a terminal or a server. Optionally, the server can be an independent physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server providing basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, CDN (Content Delivery Network), and big data and artificial intelligence platforms. Optionally, the terminal can be a smartphone, tablet computer, laptop computer, desktop computer, smart speaker, smartwatch, smart voice interaction device, smart home appliance, or in-vehicle terminal, but is not limited to these.

[0044] In one embodiment, the method may include the following steps:

[0045] Step 101: Receive a screen recording command for the target display interface and start the screen recording function to obtain the initial image of the target display interface.

[0046] It should be noted that screen recording, also known as screen recording or screen recording, refers to the technology of capturing image data of the entire display interface or a specified part of the display interface of a device screen and encoding the image data to obtain a screen recording file. The target display interface mentioned in this solution refers to the display interface that needs to be screen recorded. For example, the target display interface can be the currently playing video interface of the device screen (such as a mobile phone screen), a static image interface, or even the mobile phone's desktop interface, without limitation.

[0047] When a screen recording command is received for the target display interface, the screen recording function is started to obtain the initial image of the target display interface. The initial image here refers to the image obtained directly without performing any image processing on the target display interface.

[0048] Step 102: Traverse the interface elements in the initial image and obtain the attribute information corresponding to each interface element.

[0049] In this embodiment, the interface elements can be elements that can be displayed on the target display interface, such as operation controls, text, and images. For example, assuming the target display interface is an app login screen, such as... Figure 2 As shown, an app login screen typically includes elements such as a user avatar, input method input box, account input box, and password input box. In the example above, the user avatar, password information, and input method input box are relatively sensitive information. Exposing this information to others during screen recording could easily have adverse consequences for the user. It should be noted that the touch feedback generated by the input method input box while the user is entering their password can also easily reveal the information the user is typing, thus indirectly exposing the user's password information. Therefore, in certain scenarios, the input method input box is also considered sensitive information and needs to be protected from leakage during screen recording.

[0050] In this embodiment, by traversing all interface elements in the initial image and obtaining the attribute information corresponding to each interface element, the display effect that different interface elements need to display in the screen recording image of the target display interface can be determined based on the attribute information. It should be explained that the attribute information may include the position information of the interface element in the initial image, or it may include a preset identifier for indicating the category of the interface element, or it may include both position information and preset identifier.

[0051] For example, since the positions of interface elements in the display interface are generally fixed and can be obtained by the system, unique display effects can be pre-added to different position information and then mapped to the corresponding interface elements. This allows the system to determine the corresponding display effect when it identifies the position information of any interface element. For example, display effects include any one of normal display, blurred display, and disabled display. Depending on the scenario, corresponding display effects can be set for different interface elements to achieve the effect of automatically identifying sensitive information and automatically shielding and preventing leakage of sensitive information.

[0052] Step 103: Adjust the display effect of each interface element in the recorded image of the corresponding target display interface according to the attribute information.

[0053] In order to set corresponding display effects for different types of interface elements, in this embodiment, a preset blank data layer is retrieved, which contains data filling areas corresponding to each interface element; according to the attribute information of each interface element, corresponding adjustment parameter values ​​are added to each data filling area to obtain a target data layer. The adjustment parameter values ​​are used to adjust the display effect of the interface elements, and a mapping relationship is established between each data filling area and each attribute information; based on each adjustment parameter value in the target data layer, the display effect of each interface element in the recorded image of the target display interface is adjusted respectively.

[0054] Furthermore, when it is necessary to adjust the display effect of different element controls, the data filling area corresponding to each attribute information is obtained from the target data layer; the image processing rules of each interface element are determined according to the adjustment parameter values ​​contained in each data filling area; based on the image processing rules and adjustment parameter values ​​corresponding to each interface element, image processing is performed on each interface element to adjust the display effect of each interface element.

[0055] Specifically, using normal display, blurred display, and disabled display as specific examples, this paper explains how to perform image processing on each interface element based on the image processing rules and parameter values ​​corresponding to each interface element to adjust the display effect of each interface element:

[0056] When the display effect of the interface element is normal, the initial display effect of the interface element is not modified. That is, the current interface element does not contain sensitive information and does not need to be protected against leakage. The image data of the interface element can be directly output to the target recorded image.

[0057] When the display effect of the interface element is blurred, Gaussian processing is performed on all pixels within the preset range of the interface element in the initial image according to the adjustment parameter value, so that the interface element is blurred in the target recorded image.

[0058] When the display effect of an interface element is disabled, a replacement image is generated based on the adjusted parameter value and used as the output image of the interface element. In other words, if the current interface element contains sensitive information, it needs to be protected against leakage before it can be output to the target recorded image.

[0059] Regarding leakage prevention measures that prohibit the display of this effect, this solution lists two specific methods, as follows:

[0060] The first method is to directly select a preset image (such as a mosaic image) whose content is not related to the interface elements as the replacement image for the interface elements, and then directly output the replacement image as the output image of the interface elements to the target recorded image.

[0061] The second method is to select the element image corresponding to the initial state of the interface element as the output image of the interface element and output it to the target recording image.

[0062] The first method is primarily suitable for application scenarios where user viewing experience is not a primary concern. For example, password information only needs to be kept hidden from others; the specific format used for preventing leakage is less important. Therefore, a pre-defined image unrelated to the content of the interface element can be used to overlay it. The second method differs slightly from the first. While still aiming to prevent leakage, it's suitable when the viewing experience shouldn't be excessively negatively impacted. For instance, input method boxes typically occupy a large portion of the screen. Directly blurring this area would create a large, pixelated image, resulting in a poor visual experience. Therefore, the initial image of the interface element, where visual appeal is crucial, can be used as a replacement image and overlaid on top of it.

[0063] In summary, when a user enables screen recording, the initial image of the target display interface is acquired, and then the interface elements in the initial image are identified. Taking interface element 'a' as an example, a data filling area corresponding to interface element 'a' is automatically generated in the blank data layer. At the same time, this data filling area is automatically filled with the corresponding adjustment parameter values ​​(such as transparency, pixel color, and blur level) according to the type of interface element 'a', thus obtaining the target data layer. Then, the initial image and the target data layer are sent to the processor for image processing. The image processing process is as follows: first, the data filling area corresponding to interface element 'a' is determined in the target data layer; then, the image processing rules corresponding to interface element 'a' are determined according to the adjustment parameter values ​​in the data filling area. If the adjustment parameter value in the data filling area is a transparency value of 0 (indicating opacity), then the corresponding image processing rule is to directly generate the corresponding replacement image using the adjustment parameter value recorded in the data filling area (transparency value of 0, pixel color determined by the replacement image) and output it as the image data of interface element 'a' to the target recorded image. If the adjustment parameter value in the data filling area is a transparency value of 255 (meaning completely transparent) and the blur level is greater than 0, then all pixels within a radius of R of the current point's coordinate position are taken from the target data layer, and after Gaussian processing, they are output as the image data of interface element a to the target recorded image.

[0064] All of the above-mentioned optional technical solutions can be combined in any way to form the optional embodiments of this application, and will not be described in detail here.

[0065] In practice, this application is not limited by the execution order of the described steps. Without causing conflicts, some steps may be performed in other orders or simultaneously.

[0066] As can be seen from the above, the screen recording method provided in this application receives a screen recording command for a target display interface, activates the screen recording function to obtain an initial image of the target display interface; it traverses the interface elements in the initial image to obtain attribute information corresponding to each interface element; and adjusts the display effect of each interface element in the recorded image corresponding to the target display interface according to the attribute information. Using the screen recording method provided in this application, by obtaining the attribute information corresponding to the currently displayed interface controls in the target display interface, and adding corresponding display effects to different control elements according to the image processing method pre-configured for each attribute information, the recorded image obtained based on the target display interface can display the display effects of different control elements as required, avoiding the leakage of sensitive content in the screen recording image.

[0067] This application also provides a screen recording device, which can be integrated into a terminal device.

[0068] Please see Figure 3 , Figure 3 This is a schematic diagram of the screen recording device provided in an embodiment of this application. The screen recording device 30 may include:

[0069] The receiving module 31 is used to receive a screen recording command for the target display interface and start the screen recording function to obtain the initial image of the target display interface;

[0070] The acquisition module 32 is used to traverse the interface elements in the initial image and acquire the attribute information corresponding to each interface element;

[0071] The adjustment module 33 is used to adjust the display effect of each interface element in the recorded image of the corresponding target display interface according to the attribute information.

[0072] In some embodiments, the attribute information includes: the position information of the interface element in the initial image; and / or a preset identifier for indicating the category of the interface element.

[0073] In some embodiments, the adjustment module 33 is used to retrieve a preset blank data layer, the blank data layer containing data filling areas corresponding to each interface element; according to the attribute information of each interface element, corresponding adjustment parameter values ​​are added to each data filling area to obtain a target data layer, the adjustment parameter values ​​are used to participate in adjusting the display effect of the interface element, and a mapping relationship is established between each data filling area and each attribute information; based on each adjustment parameter value, the display effect of each interface element in the recorded image corresponding to the target display interface is adjusted respectively.

[0074] In some embodiments, the adjustment module 33 is configured to obtain the data filling area corresponding to each interface element from the target data layer; determine the image processing rules for each interface element according to the adjustment parameter values ​​contained in each data filling area; and perform image processing on each interface element based on the image processing rules and adjustment parameter values ​​corresponding to each interface element to adjust the display effect of each interface element.

[0075] In some embodiments, the display effect includes any one of normal display, blurred display, and display disabled.

[0076] In some embodiments, the adjustment module 33 is configured to: when the display effect of the interface element is normal display, not modify the initial display effect of the interface element; when the display effect of the interface element is blurred display, perform Gaussian processing on all pixels of the interface element within a preset range in the initial image according to the adjustment parameter value, so that the interface element is blurred display in the target recorded image; when the display effect of the interface element is disabled display, generate a replacement image according to the adjustment parameter value and use it as the output image of the interface element.

[0077] In some embodiments, the replacement image is a preset image whose content is not associated with the interface element, or an element image corresponding to the initial state of the interface element.

[0078] In practice, the above modules can be implemented as independent entities or combined in any way to be implemented as the same or several entities.

[0079] As can be seen from the above, the screen recording device 30 provided in this application embodiment includes a receiving module 31, which is used to receive a screen recording instruction for a target display interface and start the screen recording function to obtain an initial image of the target display interface; an acquisition module 32, which is used to traverse the interface elements in the initial image and obtain attribute information corresponding to each interface element; and an adjustment module 33, which is used to adjust the display effect of each interface element in the recorded image corresponding to the target display interface according to each attribute information.

[0080] Please see Figure 4 , Figure 4 This is another schematic diagram of the screen recording device provided in an embodiment of this application. The screen recording device 30 includes a memory 120, one or more processors 180, and one or more application programs, wherein the one or more application programs are stored in the memory 120 and configured to be executed by the processors 180; the processors 180 may include a receiving module 31, an acquiring module 32, and an adjusting module 33. For example, the structure and connection relationship of the above components can be as follows:

[0081] Memory 120 can be used to store applications and data. The applications stored in memory 120 contain executable code. Applications can be composed of various functional modules. Processor 180 executes various functional applications and data processing by running the applications stored in memory 120. Furthermore, memory 120 may include high-speed random access memory and may also include non-volatile memory, such as at least one disk storage device, flash memory device, or other volatile solid-state storage device. Accordingly, memory 120 may also include a memory controller to provide processor 180 with access to memory 120.

[0082] The processor 180 is the control center of the device, connecting various parts of the terminal through various interfaces and lines. It performs various functions and processes data by running or executing applications stored in the memory 120 and calling data stored in the memory 120, thereby providing overall monitoring of the device. Optionally, the processor 180 may include one or more processing cores; preferably, the processor 180 may integrate an application processor and a modem processor, wherein the application processor mainly handles the operating system, user interface, and applications.

[0083] Specifically, in this embodiment, the processor 180 loads the executable code corresponding to the processes of one or more applications into the memory 120 according to the following instructions, and the processor 180 runs the applications stored in the memory 120 to achieve various functions:

[0084] The receiving instruction is used to receive a screen recording instruction for the target display interface and start the screen recording function to obtain the initial image of the target display interface;

[0085] The instruction is used to traverse the interface elements in the initial image and obtain the attribute information corresponding to each interface element.

[0086] The adjustment command is used to adjust the display effect of each interface element in the recorded image of the corresponding target display interface according to the attribute information.

[0087] In some embodiments, the attribute information includes: the position information of the interface element in the initial image; and / or a preset identifier for indicating the category of the interface element.

[0088] In some embodiments, the adjustment instruction is used to retrieve a preset blank data layer, which contains data filling areas corresponding to each interface element; according to the attribute information of each interface element, corresponding adjustment parameter values ​​are added to each data filling area to obtain a target data layer, wherein the adjustment parameter values ​​are used to participate in adjusting the display effect of the interface element and to establish a mapping relationship between each data filling area and each attribute information; based on each adjustment parameter value, the display effect of each interface element in the recorded image corresponding to the target display interface is adjusted respectively.

[0089] In some embodiments, the adjustment instructions are used to obtain the data filling area corresponding to each interface element from the target data layer; determine the image processing rules for each interface element according to the adjustment parameter values ​​contained in each data filling area; and perform image processing on each interface element based on the image processing rules and adjustment parameter values ​​corresponding to each interface element to adjust the display effect of each interface element.

[0090] In some embodiments, the display effect includes any one of normal display, blurred display, and display disabled.

[0091] In some embodiments, the adjustment instruction is used to: when the display effect of the interface element is normal display, not modify the initial display effect of the interface element; when the display effect of the interface element is blurred display, perform Gaussian processing on all pixels of the interface element within a preset range in the initial image according to the adjustment parameter value, so that the interface element is blurred display in the target recorded image; when the display effect of the interface element is disabled display, generate a replacement image according to the adjustment parameter value and use it as the output image of the interface element.

[0092] In some embodiments, the replacement image is a preset image whose content is not associated with the interface element, or an element image corresponding to the initial state of the interface element.

[0093] This application also provides a terminal device. The terminal device may be a server, smartphone, computer, tablet computer, or other similar device.

[0094] Please see Figure 5 , Figure 5 A schematic diagram of a terminal device provided in an embodiment of this application is shown. This terminal device can be used to implement the screen recording method provided in the above embodiments. The terminal device 1200 can be a television, a smartphone, or a tablet computer.

[0095] like Figure 5As shown, the terminal device 1200 may include an RF (Radio Frequency) circuit 110, a memory 120 including one or more (only one is shown in the figure) computer-readable storage media, an input unit 130, a display unit 140, a sensor 150, an audio circuit 160, a transmission module 170, a processor 180 including one or more (only one is shown in the figure) processing cores, and a power supply 190, etc. Those skilled in the art will understand that... Figure 5 The structure of the terminal device 1200 shown does not constitute a limitation on the terminal device 1200, and may include more or fewer components than shown, or combine certain components, or have different component arrangements. Wherein:

[0096] RF circuit 110 is used to receive and transmit electromagnetic waves, realizing the mutual conversion between electromagnetic waves and electrical signals, thereby enabling communication with communication networks or other devices. RF circuit 110 may include various existing circuit elements used to perform these functions, such as antennas, radio frequency transceivers, digital signal processors, encryption / decryption chips, Subscriber Identity Module (SIM) cards, memory, etc. RF circuit 110 can communicate with various networks such as the Internet, corporate intranets, and wireless networks, or communicate with other devices via wireless networks.

[0097] The memory 120 can be used to store software programs and modules, such as the program instructions / modules corresponding to the screen recording method in the above embodiment. The processor 180 executes various functional applications and data processing by running the software programs and modules stored in the memory 120. It can automatically select the vibration reminder mode for screen recording according to the current scenario of the terminal device, which can ensure that the recording is not disturbed in scenarios such as meetings, and also ensure that the user can sense incoming calls, thus improving the intelligence of the terminal device. The memory 120 may include high-speed random access memory, and may also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some instances, the memory 120 may further include memory remotely located relative to the processor 180. These remote memories can be connected to the terminal device 1200 via a network. Examples of such networks include, but are not limited to, the Internet, corporate intranets, local area networks, mobile communication networks, and combinations thereof.

[0098] Input unit 130 can be used to receive input numerical or character information, and to generate keyboard, mouse, joystick, optical, or trackball signal inputs related to user settings and function control. Specifically, input unit 130 may include touch-sensitive surface 131 and other input devices 132. Touch-sensitive surface 131, also known as a touch display screen or touchpad, can collect user touch operations on or near it (such as user operations using fingers, styluses, or any suitable object or accessory on or near touch-sensitive surface 131), and drive corresponding connection devices according to a pre-set program. Optionally, touch-sensitive surface 131 may include two parts: a touch detection device and a touch controller. The touch detection device detects the user's touch position and the signal generated by the touch operation, and transmits the signal to the touch controller; the touch controller receives touch information from the touch detection device, converts it into touch point coordinates, sends it to processor 180, and can receive and execute commands from processor 180. In addition, the touch-sensitive surface 131 can be implemented using various types such as resistive, capacitive, infrared, and surface acoustic wave. Besides the touch-sensitive surface 131, the input unit 130 may also include other input devices 132. Specifically, other input devices 132 may include, but are not limited to, one or more of the following: a physical keyboard, function keys (such as volume control buttons, power buttons, etc.), a trackball, a mouse, and a joystick.

[0099] Display unit 140 can be used to display information input by the user or information provided to the user, as well as various graphical user interfaces of terminal device 1200. These graphical user interfaces can be composed of graphics, text, icons, video, and any combination thereof. Display unit 140 may include display panel 141, optionally configured as LCD (Liquid Crystal Display), OLED (Organic Light-Emitting Diode), etc. Further, touch-sensitive surface 131 may cover display panel 141. When touch-sensitive surface 131 detects a touch operation on or near it, it transmits the information to processor 180 to determine the type of touch event. Subsequently, processor 180 provides corresponding visual output on display panel 141 according to the type of touch event. Although in Figure 5 In this embodiment, the touch-sensitive surface 131 and the display panel 141 are implemented as two separate components to realize input and output functions. However, in some embodiments, the touch-sensitive surface 131 and the display panel 141 can be integrated to realize input and output functions.

[0100] The terminal device 1200 may also include at least one sensor 150, such as a light sensor, a motion sensor, and other sensors. Specifically, the light sensor may include an ambient light sensor and a proximity sensor. The ambient light sensor can adjust the brightness of the display panel 141 according to the ambient light level, and the proximity sensor can turn off the display panel 141 and / or backlight when the terminal device 1200 is moved to the ear. As a type of motion sensor, a gravity acceleration sensor can detect the magnitude of acceleration in various directions (generally three axes). When stationary, it can detect the magnitude and direction of gravity and can be used for applications that recognize the phone's posture (such as landscape / portrait switching, related games, magnetometer posture calibration), vibration recognition-related functions (such as pedometer, tapping), etc. Other sensors that the terminal device 1200 may also be configured with, such as a gyroscope, barometer, hygrometer, thermometer, and infrared sensor, will not be described in detail here.

[0101] Audio circuitry 160, speaker 161, and microphone 162 provide an audio interface between the user and terminal device 1200. Audio circuitry 160 converts received audio data into electrical signals, which are then transmitted to speaker 161, where they are converted into sound signals for output. Conversely, microphone 162 converts collected sound signals into electrical signals, which are received by audio circuitry 160, converted back into audio data, and then processed by processor 180 before being transmitted via RF circuitry 110 to, for example, another terminal, or output to memory 120 for further processing. Audio circuitry 160 may also include an earphone jack to facilitate communication between peripheral headphones and terminal device 1200.

[0102] Terminal device 1200, through transmission module 170 (e.g., Wi-Fi module), can help users send and receive emails, browse web pages, and access streaming media, providing users with wireless broadband internet access. Although Figure 5 The transmission module 170 is shown, but it is understood that it is not a necessary component of the terminal device 1200 and can be omitted as needed without changing the nature of the invention.

[0103] The processor 180 is the control center of the terminal device 1200. It connects to various parts of the mobile phone via various interfaces and lines. By running or executing software programs and / or modules stored in the memory 120, and by calling data stored in the memory 120, it performs various functions of the terminal device 1200 and processes data, thereby providing overall monitoring of the mobile phone. Optionally, the processor 180 may include one or more processing cores; in some embodiments, the processor 180 may integrate an application processor and a modem processor, wherein the application processor mainly handles the operating system, user interface, and applications, and the modem processor mainly handles wireless communication. It is understood that the modem processor may also not be integrated into the processor 180.

[0104] The terminal device 1200 also includes a power supply 190 that supplies power to the various components. In some embodiments, the power supply can be logically connected to the processor 180 through a power management system, thereby enabling functions such as discharge management and power consumption management through the power management system. The power supply 190 may also include one or more DC or AC power supplies, recharging systems, power fault detection circuits, power converters or inverters, power status indicators, and other arbitrary components.

[0105] Although not shown, the terminal device 1200 may also include a camera (such as a front-facing camera and a rear-facing camera), a Bluetooth module, etc., which will not be described in detail here. Specifically, in this embodiment, the display unit 140 of the terminal device 1200 is a touch screen display, and the terminal device 1200 also includes a memory 120 and one or more programs, one or more of which are stored in the memory 120 and configured to be executed by one or more processors 180. One or more programs contain instructions for performing the following operations:

[0106] The receiving instruction is used to receive a screen recording instruction for the target display interface and start the screen recording function to obtain the initial image of the target display interface;

[0107] The instruction is used to traverse the interface elements in the initial image and obtain the attribute information corresponding to each interface element.

[0108] The adjustment command is used to adjust the display effect of each interface element in the recorded image of the corresponding target display interface according to the attribute information.

[0109] In some embodiments, the attribute information includes: the position information of the interface element in the initial image; and / or a preset identifier for indicating the category of the interface element.

[0110] In some embodiments, the adjustment instruction is used to retrieve a preset blank data layer, which contains data filling areas corresponding to each interface element; according to the attribute information of each interface element, corresponding adjustment parameter values ​​are added to each data filling area to obtain a target data layer, wherein the adjustment parameter values ​​are used to participate in adjusting the display effect of the interface element and to establish a mapping relationship between each data filling area and each attribute information; based on each adjustment parameter value, the display effect of each interface element in the recorded image corresponding to the target display interface is adjusted respectively.

[0111] In some embodiments, the adjustment instructions are used to obtain the data filling area corresponding to each interface element from the target data layer; determine the image processing rules for each interface element according to the adjustment parameter values ​​contained in each data filling area; and perform image processing on each interface element based on the image processing rules and adjustment parameter values ​​corresponding to each interface element to adjust the display effect of each interface element.

[0112] In some embodiments, the display effect includes any one of normal display, blurred display, and display disabled.

[0113] In some embodiments, the adjustment instruction is used to: when the display effect of the interface element is normal display, not modify the initial display effect of the interface element; when the display effect of the interface element is blurred display, perform Gaussian processing on all pixels of the interface element within a preset range in the initial image according to the adjustment parameter value, so that the interface element is blurred display in the target recorded image; when the display effect of the interface element is disabled display, generate a replacement image according to the adjustment parameter value and use it as the output image of the interface element.

[0114] In some embodiments, the replacement image is a preset image whose content is not associated with the interface element, or an element image corresponding to the initial state of the interface element.

[0115] This application also provides a terminal device. The terminal device may be a smartphone, computer, or other similar device.

[0116] As can be seen from the above, this application embodiment provides a terminal device 1200, which performs the following steps:

[0117] Receive a screen recording command for the target display interface, start the screen recording function to obtain the initial image of the target display interface;

[0118] Traverse the interface elements in the initial image and obtain the attribute information corresponding to each interface element;

[0119] Based on the attribute information, the display effect of each interface element in the recorded image of the corresponding target display interface is adjusted.

[0120] This application also provides a storage medium storing a computer program. When the computer program is run on a computer, the computer executes the screen recording method described in any of the above embodiments.

[0121] It should be noted that, for the screen recording method described in this application, those skilled in the art will understand that all or part of the process of the screen recording method described in the embodiments of this application can be implemented by a computer program controlling the relevant hardware. The computer program can be stored in a computer-readable storage medium, such as in the memory of a terminal device, and executed by at least one processor within the terminal device. During execution, it can include the process of the embodiments of the screen recording method described. The storage medium can be a magnetic disk, optical disk, read-only memory (ROM), random access memory (RAM), etc.

[0122] For the screen recording device described in this application embodiment, its functional modules can be integrated into a single processing chip, or each module can exist physically separately, or two or more modules can be integrated into one module. The integrated module can be implemented in hardware or as a software functional module. If the integrated module is implemented as a software functional module and sold or used as an independent product, it can also be stored in a computer-readable storage medium, such as a read-only memory, a disk, or an optical disk.

[0123] The screen recording method, apparatus, medium, and device provided in the embodiments of this application have been described in detail above. Specific examples have been used to illustrate the principles and implementation methods of this application. The descriptions of the embodiments above are only for the purpose of helping to understand the method and its core ideas. Furthermore, those skilled in the art will recognize that, based on the ideas of this application, there will be changes in the specific implementation methods and application scope. Therefore, the content of this specification should not be construed as a limitation of this application.

Claims

1. A screen recording method, characterized in that, include: Receive a screen recording command for the target display interface, start the screen recording function to obtain the initial image of the target display interface; Traverse the interface elements in the initial image and obtain the attribute information corresponding to each interface element; Based on the attribute information, adjust the display effect of each interface element in the recorded image of the corresponding target display interface; A preset blank data layer is retrieved, which contains data-filled areas corresponding to each interface element. Based on the attribute information of each interface element, corresponding adjustment parameter values ​​are added to each data-filled area to obtain a target data layer. These adjustment parameter values ​​are used to adjust the display effect of the interface elements and establish a mapping relationship between each data-filled area and each attribute information. The data-filled areas corresponding to each interface element are obtained from the target data layer. Image processing rules for each interface element are determined based on the adjustment parameter values ​​contained in each data-filled area. Based on the image processing rules and adjustment parameter values ​​corresponding to each interface element, image processing is performed on each interface element to adjust its display effect.

2. The screen recording method as described in claim 1, characterized in that, The attribute information includes: The position information of the interface element in the initial image; and / or A preset identifier used to indicate the category of the interface element.

3. The screen recording method as described in claim 1, characterized in that, The display effect includes any one of normal display, blurred display, and display disabled.

4. The screen recording method as described in claim 3, characterized in that, The step of performing image processing on each of the interface elements in the initial image based on the image processing rules and adjustment parameter values ​​corresponding to each of the interface elements, in order to adjust the display effect of each of the interface elements, includes: When the display effect of the interface element is normal, the initial display effect of the interface element is not modified; When the display effect of the interface element is blurred, Gaussian processing is performed on all pixels of the interface element within a preset range in the initial image according to the adjustment parameter value, so that the interface element is blurred in the target recorded image. When the display effect of the interface element is disabled, a replacement image is generated according to the adjustment parameter value and used as the output image of the interface element.

5. The screen recording method as described in claim 4, characterized in that, The replacement image is a preset image whose content is not related to the interface element, or an element image corresponding to the initial state of the interface element.

6. A screen recording device, characterized in that, include: The receiving module is used to receive a screen recording command for the target display interface and start the screen recording function to obtain the initial image of the target display interface; The acquisition module is used to traverse the interface elements in the initial image and acquire the attribute information corresponding to each interface element. An adjustment module is used to retrieve a preset blank data layer, which contains data-filled areas corresponding to each interface element; according to the attribute information of each interface element, corresponding adjustment parameter values ​​are added to each data-filled area to obtain a target data layer, where the adjustment parameter values ​​are used to adjust the display effect of the interface elements and establish a mapping relationship between each data-filled area and each attribute information; the data-filled areas corresponding to each interface element are obtained from the target data layer; the image processing rules for each interface element are determined according to the adjustment parameter values ​​contained in each data-filled area; and image processing is performed on each interface element based on the image processing rules and adjustment parameter values ​​to adjust the display effect of each interface element.

7. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a plurality of instructions adapted for loading by a processor to execute the screen recording method according to any one of claims 1-5.

8. A terminal device, characterized in that, The device includes a processor and a memory, the memory storing multiple instructions, and the processor loading the instructions to execute the screen recording method according to any one of claims 1-5.

Images