Scene image processing method and electronic device

Abstract

This application discloses a scene image processing method and electronic device, belonging to the field of electronic technology. The specific solution includes: when the electronic device is in a target scene, obtaining target frequency-boosting parameters that match the target scene; processing the scene image of the target scene using the target frequency-boosting parameters, and displaying the processed scene image; wherein the target frequency-boosting parameters include: frequency-boosting frequency and frequency-boosting duration.

Description

Technical Field

[0001] The present application belongs to the field of electronic technology, and specifically relates to a scene image processing method and electronic equipment. Background Art

[0002] Typically, after receiving user input, an electronic device can increase the frequency of the central processing unit (CPU) or graphics processing unit (GPU) to meet the system's performance requirements, so that frame drops and lags do not occur in various application scenarios.

[0003] In related technologies, multiple high-frequency applications are usually determined based on the application usage needs of most users, and then frequency optimization is performed on these high-frequency applications. However, for an individual user, the applications they frequently use may not be high-frequency applications, and users may encounter frame drops and freezes when using these applications. Summary of the Invention

[0004] The purpose of the embodiments of the present application is to provide a scene picture processing method and electronic device, which can perform frequency optimization for commonly used application scenarios of a single user in a targeted manner.

[0005] In a first aspect, an embodiment of the present application provides a scene picture processing method, the method comprising: when the electronic device is in a target scene, obtaining target frequency boosting parameters that match the target scene; using the target frequency boosting parameters to process the scene picture of the target scene, and displaying the processed scene picture; wherein the target frequency boosting parameters include: frequency boosting frequency and frequency boosting duration.

[0006] In a second aspect, an embodiment of the present application provides a scene picture processing device, comprising: an acquisition module, a processing module and a display module; the acquisition module is used to acquire target frequency boosting parameters that match the target scene when the electronic device is in the target scene; the processing module is used to use the target frequency boosting parameters to process the scene picture of the target scene; the display module is used to display the processed scene picture; wherein the target frequency boosting parameters include: frequency boosting frequency and frequency boosting duration.

[0007] In a third aspect, an embodiment of the present application provides an electronic device comprising a processor and a memory, wherein the memory stores programs or instructions that can be run on the processor, and when the programs or instructions are executed by the processor, the steps of the method described in the first aspect are implemented.

[0008] In a fourth aspect, an embodiment of the present application provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, the steps of the method described in the first aspect are implemented.

[0009] In a fifth aspect, an embodiment of the present application provides a chip, which includes a processor and a communication interface, the communication interface and the processor are coupled, and the processor is used to run programs or instructions to implement the method described in the first aspect.

[0010] In a sixth aspect, an embodiment of the present application provides a computer program product, which is stored in a storage medium and executed by at least one processor to implement the method described in the first aspect.

[0011] In an embodiment of the present application, when the electronic device is in the target scene, target frequency boosting parameters matching the target scene can be obtained; the scene picture of the target scene can be processed using the target frequency boosting parameters, and the processed scene picture can be displayed; wherein the target frequency boosting parameters include: frequency boosting frequency and frequency boosting duration. Through this solution, since when the electronic device is in the target scene, the scene picture of the target scene can be processed using target frequency boosting parameters matching the target scene, therefore, on the one hand, the problem of frame drops and freezes in the scene picture of the target scene during user use can be avoided; on the other hand, since the frequency boosting optimization is performed when the electronic device is in the target scene, that is, the optimization operation will only be performed when the electronic device is used in the target scene, it is possible to achieve targeted optimization of commonly used application scenarios for a single user. BRIEF DESCRIPTION OF THE DRAWINGS

[0012] Figure 1 Schematic diagram of the process of scene image processing provided by the embodiment of the present application;

[0013] Figure 2 is a structural diagram of a scene image processing device provided in an embodiment of the present application;

[0014] Figure 3 This is one of the hardware schematic diagrams of the electronic device provided in the embodiment of the present application;

[0015] Figure 4 This is the second hardware schematic diagram of the electronic device provided in the embodiment of the present application. DETAILED DESCRIPTION

[0016] The following will be combined with the accompanying drawings in the embodiments of the present application to clearly describe the technical solutions in the embodiments of the present application. Obviously, the embodiments described are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field are within the scope of protection of this application.

[0017] The terms "first," "second," and the like in the specification and claims of this application are used to distinguish similar objects, and are not used to describe a specific order or precedence. It should be understood that the terms used in this manner are interchangeable where appropriate, so that the embodiments of this application can be implemented in an order other than that illustrated or described herein, and that the objects distinguished by "first," "second," and the like are generally of the same type, and do not limit the number of objects; for example, the first object can be one or more. In addition, the term "and / or" in the specification and claims refers to at least one of the connected objects, and the character " / " generally indicates that the objects connected are in an "or" relationship.

[0018] The scene image processing method provided by the embodiment of the present application is described in detail below with reference to specific embodiments and their application scenarios in conjunction with the accompanying drawings.

[0019] The scene picture processing method provided in the embodiment of the present application may be executed by an electronic device or a functional module or functional entity in the electronic device that can implement the scene picture processing method. The electronic devices mentioned in the embodiment of the present application include but are not limited to mobile phones, tablet computers, computers, cameras, wearable devices, etc. The scene picture processing method provided in the embodiment of the present application is described below using an electronic device as an example of the execution subject.

[0020] like Figure 1 As shown, the embodiment of the present application provides a scene image processing method, which may include steps 101 and 102:

[0021] Step 101: When the electronic device is in a target scene, obtain target frequency boost parameters matching the target scene.

[0022] The target frequency increase parameters may include: frequency increase and frequency increase duration.

[0023] When an electronic device is running a foreground application, it can determine whether the current running scene is a target scene based on the scene's characteristic information. If the current running scene is the target scene, the electronic device can obtain target frequency-boosting parameters that match the target scene. In other words, each running scene can correspond to a set of frequency-boosting parameters. Once the running scene is determined, the frequency-boosting parameters that match it can be determined.

[0024] Optionally, the characteristic information of the above scenario may include at least one of the following: a foreground application identifier, an interface identifier, and a user operation type.

[0025] Specifically, the electronic device can determine the foreground application identifier (PackageName), interface identifier (Activity Name) and user operation type (TYPE) corresponding to the current running scene. When the foreground application identifier, interface identifier and user operation type are the same, the current running scene can be considered as the target scene.

[0026] Optionally, the above user operation types may include user operations such as clicking, sliding, and long pressing.

[0027] Optionally, since the target scene and the target frequency-increasing parameters are matched, before acquiring the target frequency-increasing parameters matching the target scene, the electronic device needs to first determine the frequency-increasing parameters matching each scene.

[0028] Specifically, when a foreground application has a frame drop problem during operation, the electronic device can record the frame drop information corresponding to the foreground application, and then determine the frequency increase parameters matching each scenario based on the frame drop information recorded within a preset time period.

[0029] The following describes in detail the process of the electronic device recording the frame drop information and the process of determining the frequency increase parameters matching each scenario according to the frame drop information recorded within a preset time period.

[0030] Process 1: The electronic device records the frame drop information.

[0031] Optionally, the above-mentioned frame drop information may include application information and freeze information, wherein the application information is used to describe the frame drop scenario, and the freeze information may include the frame drop frequency (CUR_FREQ), frame drop duration (HANG_TIME), number of frame drops (SKIPE_FRAME) and number of frame drops.

[0032] Specifically, when an electronic device is running a foreground application, the electronic device can determine whether there is a frame drop problem in the foreground application during the operation; if there is a frame drop problem, the frame drop information corresponding to the foreground application, that is, the frame drop scenario, frame drop frequency, frame drop duration, number of frame drops and number of frame drops is recorded, and the frame drop information is written into the corresponding configuration file.

[0033] For example, when the electronic device displays the main interface of the target application, if the user triggers a click event of the main interface, the electronic device can determine the frame drop information: Package Name is the target application, Activity Name is the main interface, TYPE is click, CUR_FREQ is 1.0GHz, HANG_TIME is 200ms, SKIPE_FRAME is 5 frames, and the number of frame drops in this frame drop scenario is increased by 1 on the original basis.

[0034] Optionally, the electronic device can determine whether the foreground application has a stuck frame drop problem by recording the frame refresh situation of the server (SurfaceFlinger). For example, if under normal circumstances, the electronic device can refresh the screen 60 times within 1 second, then when the number of SurfaceFlinger frame refreshes is less than 60, it can be determined that the foreground application has a stuck frame drop problem. After determining that there is a stuck frame drop problem, the electronic device can record the frame drop information corresponding to the foreground application.

[0035] It should be noted that the above-mentioned SurfaceFlinger is a system service, which is mainly used to receive data buffers from multiple sources, synthesize them, and then send them to the display device for display.

[0036] Based on the above solution, when a frame drop problem is found, the frame drop information corresponding to the foreground application can be recorded. Since the frame drop information collected by different user devices may be different, the scenarios requiring frequency increase and the corresponding frequency increase parameters determined based on the frame drop information are more targeted.

[0037] Process 2: The electronic device determines frequency boost parameters matching each scenario based on the frame drop information recorded within a preset time period.

[0038] Optionally, the electronic device can obtain frame drop information recorded within a preset time period, the frame drop information including the frame drop scenario and the frame drop severity; then, based on the frame drop severity, select N scenarios from the M frame drop scenarios included in the frame drop information; and finally determine a frequency boost parameter that matches each of the N scenarios; wherein, the N scenarios include the target scenario, and the N scenarios satisfy at least one of the following conditions: the frame drop severity corresponding to each of the N scenarios is greater than a first threshold; or, the frame drop severity corresponding to the N scenarios is greater than the frame drop severity corresponding to other (MN) scenarios, and the frame drop severity includes at least one of the following: frame drop frequency, frame drop duration, number of frame drops, and number of frame drops, where M and N are integers greater than or equal to 0, and M is greater than or equal to N.

[0039] Optionally, taking the example that the severity of frame drop includes the number of frame drops, the severity of frame drop in the scenario is determined by the number of frame drops. Specifically, the electronic device filters out N scenes from M frame drop scenes according to the severity of frame drop: one implementation method is that after the electronic device obtains the frame drop information recorded within a preset time period, it can sort the frame drop scenes according to the number of frame drops corresponding to different frame drop scenes within the preset time period. For example, the electronic device can arrange each frame drop scene in descending order according to the number of frame drops, or it can arrange each frame drop scene in descending order according to the number of frame drops, and then the electronic device can filter out N scenes from the arranged M frame drop scenes, and the number of frame drops corresponding to the N scenes is greater than the number of frame drops corresponding to other (MN) scenes, that is, it can be understood that the N scenes are the top N scenes in terms of the severity of frame drop (number of frame drops) among the M scenes with frame drops. In another implementation, after obtaining frame drop information recorded within a preset time period, the electronic device may compare the number of frame drops corresponding to each frame drop scenario with a first threshold. Based on the comparison result, N scenarios may be selected from the M frame drop scenarios, where the number of frame drops corresponding to each scenario is greater than the first threshold. Specifically, the N scenarios are those with a frame drop count greater than the first threshold among the M scenarios with frame drops. In another implementation, the electronic device may sort the M frame drop scenarios by the number of frame drops, and then select K scenarios from the M frame drop scenarios, where the number of frame drops corresponding to each K scenario is greater than the number of frame drops corresponding to the other (MK) scenarios. The electronic device may then compare each of the K scenarios with the first threshold to obtain N scenarios with a frame drop count greater than the first threshold, where K is an integer less than or equal to M and greater than or equal to N. Specifically, the N scenarios are those with the top N frame drop severity (number of frame drops) among the M scenarios with frame drops, and the number of frame drops in each of the N scenarios is greater than the first threshold. In this way, the frame drop scenarios that need to be optimized can be screened out, thereby avoiding the waste of power consumption by optimizing unnecessary frame drop scenarios.

[0040] Optionally, before filtering N scenarios based on the number of frame drops, the electronic device can read the frame drop information in the above configuration file and summarize the number of frame drops using Package Name+Activity Name+TYPE as the frame drop scenario. In the same frame drop scenario, if a frame drop occurs, the number of frame drops in the frame drop scenario will be increased by 1.

[0041] Based on the above scheme, on the one hand, since N scenarios can be screened out from M frame drop scenarios according to the severity of frame drop in the frame drop information, and the frequency increase parameters of the N scenarios can be determined, targeted optimization of the commonly used application scenarios of a single user can be achieved; on the other hand, since the frequency increase optimization of N scenarios can be performed based on the frame drop information recorded within a preset time period, the entire optimization process can be made more flexible.

[0042] Optionally, the frame drop severity includes the frame drop frequency, the frame drop duration and the number of dropped frames, and the target frequency increase parameter includes the frequency increase frequency; taking the target scene as an example, the electronic device determines the frequency increase parameter matching each of the N scenes, which may specifically include: the electronic device determines the average frame drop frequency, average frame drop duration and average number of dropped frames of the target scene within the preset time period based on the frame drop frequency, the frame drop duration and the number of dropped frames; then determines the number of full frames of the target scene based on the average frame drop duration; finally, determines the frequency increase frequency of the target scene based on the average frame drop frequency, the average number of dropped frames and the number of full frames.

[0043] Optionally, the electronic device determines the frequency increase frequency of the target scene according to the average frame drop frequency, the average number of frame drop numbers, and the number of full frames, which may specifically include: the electronic device determines the frequency increase frequency of the target scene according to the formula Determine the frequency increase F2 of the target scene; wherein F1 is the average frame drop frequency, N1 is the number of full frames, and N2 is the average number of dropped frames.

[0044] Optionally, the electronic device determines the number of full frames of the target scene based on the average frame drop duration, which may specifically include: taking the electronic device refreshing frames 60 times in 1s as an example, the number of full frames = average frame drop duration / 1000*60, that is, the electronic device can determine the number of full frames that should be refreshed within the average frame drop duration based on the average frame drop duration in milliseconds.

[0045] Based on the above scheme, since the frequency increase of the target scene can be determined according to the frame drop frequency, frame drop duration and number of frame drops, the frequency increase of the target scene can be optimized according to the frequency increase frequency, thereby avoiding the problem of stuttering and frame drop when the target scene is running.

[0046] Optionally, the frame drop severity includes the frame drop duration, and the frequency boost parameter includes the frequency boost duration; taking the target scene as an example, the electronic device determines the frequency boost parameter that matches each of the N scenes, specifically including: the electronic device can determine a normal distribution graph of the frame drop duration of the target scene within a preset time period; and then determine the peak value in the normal distribution graph as the frequency boost duration of the target scene.

[0047] Based on the above scheme, since the frame drop duration can present a normal distribution state, the peak value in the normal distribution graph is selected as the frequency boost duration of the target scene. This not only ensures that the frequency boost parameters cover most usage scenarios of the target scene, but also avoids the problem of wasting system power consumption and operating time due to excessive frequency boost duration.

[0048] After determining the frequency boosting duration and frequency boosting of the target scene, the electronic device can write the target scene, frequency boosting duration and frequency boosting into the frequency boosting file of the system accordingly. When the electronic device runs the target scene again, the frequency boosting duration and frequency boosting frequency will take effect, that is, the electronic device can process the scene image of the target scene according to the frequency boosting duration and frequency boosting frequency, and display the processed scene image.

[0049] Step 102: Process the scene image of the target scene using the target frequency-increasing parameter, and display the processed scene image.

[0050] In the embodiment of the present application, since the target frequency boosting parameters that match the target scene can be used to process the scene picture of the target scene when the electronic device is in the target scene, on the one hand, the problem of frame drops and freezes in the scene picture of the target scene during user use can be avoided. On the other hand, since the frequency boosting optimization is performed when the electronic device is in the target scene, that is, the optimization operation will only be performed when the electronic device is used in the target scene, it is possible to achieve targeted optimization of the application scenarios commonly used by a single user.

[0051] The scene picture processing method provided in the embodiment of the present application can be executed by a scene picture processing device. In the embodiment of the present application, the scene picture processing device provided in the embodiment of the present application is described by taking the scene picture processing device executing the scene picture processing method as an example.

[0052] like Figure 2 As shown, the embodiment of the present application further provides a scene image processing device 200, comprising: an acquisition module 201, a processing module 202, and a display module 203. The acquisition module 201 can be used to obtain target frequency-boosting parameters that match the target scene when the electronic device is in the target scene. The processing module 202 can be used to process the scene image of the target scene using the target frequency-boosting parameters; the display module 203 is used to display the processed scene image; wherein the target frequency-boosting parameters include: frequency-boosting frequency and frequency-boosting duration.

[0053] Optionally, the acquisition module 201 is further used to obtain frame drop information recorded within a preset time period, and the frame drop information includes frame drop scenarios and frame drop severity. The processing module 202 is further used to filter out N scenarios from M frame drop scenarios according to the frame drop severity; and determine the frequency boost parameter that matches each of the N scenarios; wherein the N scenarios include the target scenario, and the N scenarios meet at least one of the following conditions: the frame drop severity corresponding to each of the N scenarios is greater than a first threshold; or, the frame drop severity corresponding to the N scenarios is greater than the frame drop severity corresponding to the other (MN) scenarios, and the frame drop severity includes at least one of the following: frame drop frequency, frame drop duration, frame drop number, and frame drop count, where M and N are integers greater than or equal to 0, and M is greater than or equal to N.

[0054] Optionally, the frame drop severity includes the frame drop frequency, the frame drop duration and the number of dropped frames, and the target frequency increase parameter includes the frequency increase frequency; the processing module 202 is specifically used to determine the average frame drop frequency, the average frame drop duration and the average number of dropped frames of the target scene within the preset time period based on the frame drop frequency, the frame drop duration and the number of dropped frames; determine the number of full frames of the target scene based on the average frame drop duration; determine the frequency increase frequency of the target scene based on the average frame drop frequency, the average number of dropped frames and the number of full frames.

[0055] Optionally, the frame drop severity includes the frame drop duration, and the frequency boost parameter includes the frequency boost duration; the processing module 202 is specifically used to determine a normal distribution graph of the frame drop duration of the target scene within the preset time period; and determine the peak value in the normal distribution graph as the frequency boost duration of the target scene.

[0056] Optionally, the processing module 202 is further configured to record frame drop information corresponding to the foreground application when a frame drop problem occurs during the running of the foreground application.

[0057] In the embodiment of the present application, since the target frequency boosting parameters that match the target scene can be used to process the scene picture of the target scene when the electronic device is in the target scene, on the one hand, the problem of frame drops and freezes in the scene picture of the target scene during user use can be avoided. On the other hand, since the frequency boosting optimization is performed when the electronic device is in the target scene, that is, the optimization operation will only be performed when the electronic device is used in the target scene, it is possible to achieve targeted optimization of the application scenarios commonly used by a single user.

[0058] The scene image processing device in the embodiment of the present application can be an electronic device or a component in the electronic device, such as an integrated circuit or a chip. The electronic device can be a terminal or other devices other than a terminal. For example, the electronic device can be a mobile phone, a tablet computer, a laptop computer, a PDA, an in-vehicle electronic device, a mobile Internet device (MID), an augmented reality (AR) / virtual reality (VR) device, a robot, a wearable device, an ultra-mobile personal computer (UMPC), a netbook or a personal digital assistant (PDA), etc. It can also be a server, a network attached storage (NAS), a personal computer (PC), a television (TV), a teller machine or a self-service machine, etc., and the embodiment of the present application does not specifically limit it.

[0059] The scene image processing device in the embodiment of the present application can be a device having an operating system. The operating system can be an Android operating system, an iOS operating system, or other possible operating systems, which are not specifically limited in the embodiment of the present application.

[0060] The scene image processing device provided in the embodiment of the present application can achieve Figure 1 To avoid repetition, the various processes implemented in the method embodiment are not described here.

[0061] Alternatively, as Figure 3 As shown, an embodiment of the present application also provides an electronic device 300, including a processor 301 and a memory 302, wherein the memory 302 stores a program or instruction that can be run on the processor 301, and when the program or instruction is executed by the processor 301, the various steps of the above-mentioned scene image processing method embodiment are implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0062] It should be noted that the electronic devices in the embodiments of the present application include the mobile electronic devices and non-mobile electronic devices mentioned above.

[0063] Figure 4 A schematic diagram of the hardware structure of an electronic device implementing an embodiment of the present application.

[0064] The electronic device 1000 includes but is not limited to components such as a radio frequency unit 1001 , a network module 1002 , an audio output unit 1003 , an input unit 1004 , a sensor 1005 , a display unit 1006 , a user input unit 1007 , an interface unit 1008 , a memory 1009 , and a processor 1010 .

[0065] Those skilled in the art will understand that the electronic device 1000 may also include a power source (such as a battery) to power each component, and the power source may be logically connected to the processor 1010 through a power management system, thereby implementing functions such as charging, discharging, and power consumption management through the power management system. Figure 4 The electronic device structure shown in the figure does not constitute a limitation on the electronic device. The electronic device may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently, which will not be repeated here.

[0066] The processor 1010 may be configured to, when the electronic device is in a target scene, obtain target frequency-boosting parameters that match the target scene. The processor 1010 may be configured to process a scene image of the target scene using the target frequency-boosting parameters; the display unit 1006 may be configured to display the processed scene image. The target frequency-boosting parameters include a frequency-boosting frequency and a frequency-boosting duration.

[0067] In the embodiment of the present application, since the target frequency boosting parameters that match the target scene can be used to process the scene picture of the target scene when the electronic device is in the target scene, on the one hand, the problem of frame drops and freezes in the scene picture of the target scene during user use can be avoided. On the other hand, since the frequency boosting optimization is performed when the electronic device is in the target scene, that is, the optimization operation will only be performed when the electronic device is used in the target scene, it is possible to achieve targeted optimization of the application scenarios commonly used by a single user.

[0068] Optionally, the processor 1010 is further configured to obtain frame drop information recorded within a preset time period, wherein the frame drop information includes frame drop scenarios and frame drop severity. The processor 1010 is further configured to filter out N scenarios from M frame drop scenarios based on the frame drop severity; and determine a frequency boost parameter that matches each of the N scenarios; wherein the N scenarios include the target scenario, and the N scenarios satisfy at least one of the following conditions: the frame drop severity corresponding to each of the N scenarios is greater than a first threshold; or, the frame drop severity corresponding to the N scenarios is greater than the frame drop severity corresponding to the other (MN) scenarios, and the frame drop severity includes at least one of the following: frame drop frequency, frame drop duration, frame drop number, and frame drop count, where M and N are integers greater than or equal to 0, and M is greater than or equal to N.

[0069] In the embodiment of the present application, on the one hand, since N scenarios can be screened out from M frame drop scenarios based on the frame drop severity in the frame drop information, and the frequency increase parameters of the N scenarios can be determined, targeted optimization of the application scenarios commonly used by a single user can be achieved; on the other hand, since the frequency increase optimization can be performed on N scenarios based on the frame drop information recorded within a preset time period, the entire optimization process can be made more flexible.

[0070] Optionally, the frame drop severity includes the frame drop frequency, the frame drop duration and the number of dropped frames, and the target frequency increase parameter includes the frequency increase frequency; the processor 1010 is specifically used to determine the average frame drop frequency, the average frame drop duration and the average number of dropped frames of the target scene within the preset time period based on the frame drop frequency, the frame drop duration and the number of dropped frames; determine the number of full frames of the target scene based on the average frame drop duration; determine the frequency increase frequency of the target scene based on the average frame drop frequency, the average number of dropped frames and the number of full frames.

[0071] In an embodiment of the present application, since the frequency increase frequency of the target scene can be determined based on the frame drop frequency, frame drop duration and number of frame drops, the target scene can be optimized according to the frequency increase frequency, thereby avoiding the problem of stuttering and frame drop when the target scene is running.

[0072] Optionally, the frame drop severity includes the frame drop duration, and the frequency boost parameter includes the frequency boost duration; the processor 1010 is specifically used to determine a normal distribution graph of the frame drop duration of the target scene within the preset time period; and determine the peak value in the normal distribution graph as the frequency boost duration of the target scene.

[0073] In the embodiment of the present application, since the frame drop duration can present a normal distribution state, the peak value in the normal distribution graph is selected as the frequency boost duration of the target scene. This not only ensures that the frequency boost parameters cover most usage scenarios of the target scene, but also avoids the problem of wasting system power consumption and operating time due to excessive frequency boost duration.

[0074] Optionally, the processor 1010 is further configured to record frame drop information corresponding to the foreground application when a frame drop problem occurs during the operation of the foreground application.

[0075] In an embodiment of the present application, the frame drop information corresponding to the foreground application can be recorded when a frame drop problem is found. Since the frame drop information collected by different user devices may be different, the scenarios requiring frequency increase and the corresponding frequency increase parameters determined based on the frame drop information will be more targeted.

[0076] It should be understood that in an embodiment of the present application, the input unit 1004 may include a graphics processing unit (GPU) 10041 and a microphone 10042, and the graphics processor 10041 processes the image data of a static picture or video obtained by an image capture device (such as a camera) in a video capture mode or an image capture mode. The display unit 1006 may include a display panel 10061, and the display panel 10061 may be configured in the form of a liquid crystal display, an organic light emitting diode, etc. The user input unit 1007 includes a touch panel 10071 and at least one of other input devices 10072. The touch panel 10071 is also called a touch screen. The touch panel 10071 may include two parts: a touch detection device and a touch controller. Other input devices 10072 may include, but are not limited to, a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, and an operating stick, which will not be repeated here.

[0077] The memory 1009 can be used to store software programs and various data. The memory 1009 may mainly include a first storage area for storing programs or instructions and a second storage area for storing data, wherein the first storage area may store an operating system, applications or instructions required for at least one function (such as a sound playback function, an image playback function, etc.). In addition, the memory 1009 may include a volatile memory or a non-volatile memory, or the memory 1009 may include both volatile and non-volatile memories. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), a static random access memory (SRAM), a dynamic random access memory (DRAM), a synchronous dynamic random access memory (SDRAM), a double data rate synchronous dynamic random access memory (DDRSDRAM), an enhanced synchronous dynamic random access memory (ESDRAM), a synchronous link dynamic random access memory (SLDRAM), and a direct memory bus random access memory (DRRAM). The memory 1009 in the embodiment of the present application includes but is not limited to these and any other suitable types of memory.

[0078] Processor 1010 may include one or more processing units. Optionally, processor 1010 integrates an application processor and a modem processor. The application processor primarily handles operations related to the operating system, user interface, and application programs, while the modem processor primarily processes wireless communication signals, such as a baseband processor. It is understood that the modem processor may not be integrated into processor 1010.

[0079] An embodiment of the present application also provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, the various processes of the above-mentioned scene image processing method embodiment are implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0080] The processor is the processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a computer read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk.

[0081] An embodiment of the present application further provides a chip, which includes a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the various processes of the above-mentioned scene image processing method embodiment, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0082] It should be understood that the chip mentioned in the embodiments of the present application can also be called a system-level chip, a system chip, a chip system or a system-on-chip chip, etc.

[0083] An embodiment of the present application provides a computer program product, which is stored in a storage medium. The program product is executed by at least one processor to implement the various processes of the above-mentioned scene image processing method embodiment and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0084] It should be noted that, in this article, the terms "comprise", "include" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device comprising a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the statement "comprises a ..." does not exclude the presence of other identical elements in the process, method, article or device comprising the element. In addition, it should be noted that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in the opposite order according to the functions involved. For example, the described method may be performed in an order different from that described, and various steps may also be added, omitted, or combined. In addition, the features described with reference to certain examples may be combined in other examples.

[0085] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus the necessary general hardware platform, and of course can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of the present application, or the part that contributes to the relevant technology, can be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk), and includes a number of instructions for enabling a terminal (which can be a mobile phone, computer, server, or network device, etc.) to execute the methods described in each embodiment of the present application.

[0086] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of this application, ordinary technicians in this field can also make many forms without departing from the purpose of this application and the scope of protection of the claims, all of which are within the protection of this application.

Claims

1. A scene image processing method, characterized in that: include: Obtaining frame drop information recorded within a preset time period, wherein the frame drop information includes a frame drop scenario and a frame drop severity; Selecting N scenes from the M frame drop scenes according to the frame drop severity; Determining a frequency boost parameter that matches each of the N scenarios; The N scenes include a target scene, and the N scenes meet at least one of the following conditions: a frame drop severity corresponding to each of the N scenes is greater than a first threshold; or a frame drop severity corresponding to the N scenes is greater than a frame drop severity corresponding to other (MN) scenes, and the frame drop severity includes at least one of the following: frame drop frequency, frame drop duration, number of frame drops, and number of frame drops, where M and N are integers greater than or equal to 0, and M is greater than or equal to N; When the electronic device is in the target scene, acquiring a target frequency-increasing parameter that matches the target scene; Processing the scene image of the target scene using the target frequency-increasing parameters and displaying the processed scene image; wherein the target frequency-increasing parameters include: frequency-increasing frequency and frequency-increasing duration; In a case where the frame drop severity includes the frame drop frequency, the frame drop duration, and the number of dropped frames, determining the frequency increase parameter that matches each of the N scenes includes: determining, based on the frame drop frequency, the frame drop duration, and the number of dropped frames, an average frame drop frequency, an average frame drop duration, and an average number of dropped frames of the target scene within the preset time period; determining the number of full frames of the target scene based on the average frame drop duration; and determining the frequency increase frequency of the target scene based on the average frame drop frequency, the average number of dropped frames, and the number of full frames.

2. The scene image processing method according to claim 1, characterized in that: The frame drop severity includes the frame drop duration, and the frequency increase parameter includes the frequency increase duration; The determining of a frequency boost parameter matching each of the N scenarios includes: Determine a normal distribution graph of the frame drop duration of the target scene within the preset time period; The peak value in the normal distribution graph is determined as the frequency boost duration of the target scene.

3. The scene image processing method according to claim 1 or 2, characterized in that: Before obtaining the frame drop information recorded within a preset time period, the method further includes: In the case that a frame drop problem occurs during the operation of a foreground application, frame drop information corresponding to the foreground application is recorded.

4. A scene image processing device, characterized in that: include: Acquisition module, processing module and display module; The acquisition module is used to acquire frame drop information recorded within a preset time period, wherein the frame drop information includes the frame drop scenario and the frame drop severity; The processing module is configured to select N scenes from M frame drop scenes according to the frame drop severity; and determining a frequency boost parameter matching each of the N scenarios; The N scenes include a target scene, and the N scenes meet at least one of the following conditions: a frame drop severity corresponding to each of the N scenes is greater than a first threshold; or a frame drop severity corresponding to the N scenes is greater than a frame drop severity corresponding to other (MN) scenes, and the frame drop severity includes at least one of the following: frame drop frequency, frame drop duration, number of frame drops, and number of frame drops, where M and N are integers greater than or equal to 0, and M is greater than or equal to N; The acquisition module is further configured to, when the electronic device is in a target scene, acquire a target frequency-increasing parameter that matches the target scene; The processing module is further configured to process the scene image of the target scene using the target frequency-increasing parameter; The display module is used to display the processed scene image; wherein the target frequency increase parameters include: frequency increase frequency and frequency increase duration; In the case where the frame drop severity includes the frame drop frequency, the frame drop duration and the number of dropped frames, the processing module is specifically used to determine the average frame drop frequency, the average frame drop duration and the average number of dropped frames of the target scene within the preset time period based on the frame drop frequency, the frame drop duration and the number of dropped frames; determine the number of full frames of the target scene based on the average frame drop duration; and determine the frequency increase frequency of the target scene based on the average frame drop frequency, the average number of dropped frames and the number of full frames.

5. The scene image processing device according to claim 4, characterized in that: The frame drop severity includes the frame drop duration, and the frequency increase parameter includes the frequency increase duration; The processing module is specifically configured to determine a normal distribution graph of the frame drop duration of the target scene within the preset time period; and determine a peak value in the normal distribution graph as the frequency increase duration of the target scene.

6. The scene image processing device according to claim 4 or 5, characterized in that: The processing module is further configured to record frame drop information corresponding to the foreground application when a frame drop problem occurs during the operation of the foreground application.

Images