Display adjusting method, display adjusting device and storage medium

Abstract

The invention relates to a display adjusting method, a display adjusting device and a storage medium. The display adjustment method comprises the following steps: in response to the fact that a current use environment is an outdoor environment, obtaining current environment light intensity through a light intensity compensation function according to light intensity data collected by a light sensor and terminal angle data collected by an inertial measurement module. In response to the situation that the current environment light intensity is smaller than a light intensity threshold value, image data in the current use environment are obtained, and the current use environment is determined according to the image data. In response to the fact that the current use environment is the outdoor environment, the screen display brightness is set to be first brightness, and the first brightness is the lowest screen display brightness in the outdoor environment. According to the invention, when the terminal detects that the ambient light intensity is reduced, the terminal can distinguish whether the current use scene is the indoor scene or the outdoor shadow scene, and automatically adjust the screen display brightness according to the current use scene, so that a user can clearly see the display content of the terminal.

Description

Technical Field

[0001] The present disclosure relates to the field of terminal display, and in particular to a display adjustment method, a display adjustment device and a storage medium. Background Art

[0002] The terminal's automatic brightness function is an intelligent function that automatically adjusts the brightness level of the phone screen according to the intensity of the ambient light. The automatic brightness function is based on the terminal's built-in light sensor, which detects the light intensity of the surrounding environment and automatically adjusts the screen display brightness based on the detection results.

[0003] However, when the automatic brightness function of the terminal is turned on and the user uses the terminal in an outdoor environment, if the terminal is obscured by shadows, the light intensity detected by the light sensor will be reduced, and the automatic brightness function of the terminal will automatically reduce the display brightness of the screen, causing the user to be unable to see the screen display content clearly, affecting the user experience. Summary of the invention

[0004] In order to overcome the problems existing in the related art, the present disclosure provides a display adjustment method, a display adjustment device and a storage medium.

[0005] According to a first aspect of an embodiment of the present disclosure, a display adjustment method is provided, including: in response to a current use environment being an outdoor environment, obtaining the current ambient light intensity through a light intensity compensation function based on light intensity data collected by a light sensor and terminal angle data collected by an inertial measurement module, wherein the current use environment includes an outdoor environment and an indoor environment; in response to the current ambient light intensity being less than a light intensity threshold, obtaining image data under the current use environment, determining the current use environment based on the image data, wherein the light intensity threshold is a critical ambient light intensity for distinguishing between indoor and outdoor environments; in response to the current use environment being the outdoor environment, setting the screen display brightness to a first brightness, wherein the first brightness is the minimum screen display brightness under the outdoor environment.

[0006] In one embodiment, the usage environment of the terminal is determined in the following manner: light intensity data is obtained through the light sensor; in response to the light intensity data being greater than a data threshold, the inertial measurement module is turned on, and the terminal angle data is continuously collected through the inertial measurement module, and the current usage environment is determined based on the light intensity data and the terminal angle data, and the data threshold is the critical light intensity data for distinguishing indoor and outdoor environments; in response to the light intensity data being less than the data threshold, the current usage environment is determined to be an indoor environment.

[0007] In one embodiment, determining the current usage environment based on the light intensity data and the terminal angle data includes: continuously acquiring the current ambient light intensity based on the terminal angle data and the light intensity data; and determining the current usage environment based on the current ambient light intensity and a light intensity threshold.

[0008] In one embodiment, determining the current usage environment based on the current ambient light intensity and the light intensity threshold includes: in response to the ambient light intensity being less than the light intensity threshold, determining that the current usage environment is the indoor environment; in response to the ambient light intensity being greater than the light intensity threshold, determining that the current usage environment is the outdoor environment.

[0009] In one embodiment, determining the current usage environment based on the image data includes: inputting the image data into a scene discrimination model to obtain the current usage environment; the scene discrimination model is trained by a positive sample data set and a negative sample data set, the positive sample data set includes images taken by the terminal at different terminal angles in different outdoor environments, and the negative sample data set includes images taken by the terminal at different terminal angles in different indoor environments.

[0010] In one embodiment, the method further includes: in response to the ambient light intensity being less than a light intensity threshold, acquiring motion data through the inertial measurement module, and determining a current motion state based on the motion data; in response to being in a mobile state, acquiring image data based on a preset acquisition frequency, and updating the current usage environment based on the latest acquired image data, and resetting the screen display brightness when the current usage environment changes; in response to being in a non-mobile state, maintaining the most recently set screen display brightness.

[0011] In one embodiment, the method further includes: in response to the current use environment being an indoor environment, adjusting the screen display brightness according to the ambient light intensity.

[0012] According to a second aspect of an embodiment of the present disclosure, a display adjustment device is provided, including: a processing unit, in response to a current use environment being an outdoor environment, obtaining the current ambient light intensity through a light intensity compensation function based on light intensity data collected by a light sensor and terminal angle data collected by an inertial measurement module; in response to the current ambient light intensity being less than a light intensity threshold, obtaining image data under the current use environment, and determining the current use environment based on the image data, wherein the current use environment includes an outdoor environment and an indoor environment, and the light intensity threshold is a critical ambient light intensity for distinguishing between indoor and outdoor environments; and an adjustment unit, for setting the screen display brightness to a first brightness in response to the current use environment being the outdoor environment, the first brightness being the lowest screen display brightness under the outdoor environment.

[0013] In one embodiment, the usage environment of the terminal is determined by the processing unit in the following manner: light intensity data is obtained through the light sensor; in response to the light intensity data being greater than a data threshold, the inertial measurement module is turned on, and the terminal angle data is continuously collected through the inertial measurement module, and the current usage environment is determined based on the light intensity data and the terminal angle data, and the data threshold is the critical light intensity data for distinguishing indoor and outdoor environments; in response to the light intensity data being less than the data threshold, the current usage environment is determined to be an indoor environment.

[0014] In one embodiment, the processing unit determines the current usage environment according to the light intensity data and the terminal angle data in the following manner: continuously obtains the current ambient light intensity according to the terminal angle data and the light intensity data; determines the current usage environment according to the current ambient light intensity and the light intensity threshold.

[0015] In one embodiment, the processing unit determines the current usage environment according to the current ambient light intensity and the light intensity threshold in the following manner: in response to the ambient light intensity being less than the light intensity threshold, the current usage environment is determined to be the indoor environment; in response to the ambient light intensity being greater than the light intensity threshold, the current usage environment is determined to be the outdoor environment.

[0016] In one embodiment, the processing unit determines the current usage environment based on the image data in the following manner: the image data is input into a scene discrimination model to obtain the current usage environment; the scene discrimination model is trained by a positive sample data set and a negative sample data set, the positive sample data set includes images taken by the terminal at different terminal angles in different outdoor environments, and the negative sample data set includes images taken by the terminal at different terminal angles in different indoor environments.

[0017] In one embodiment, the adjustment unit is also used for: in response to the ambient light intensity being less than a light intensity threshold, acquiring motion data through the inertial measurement module, and determining a current motion state based on the motion data; in response to being in a mobile state, acquiring image data based on a preset acquisition frequency, and updating the current usage environment based on the latest acquired image data, and resetting the screen display brightness when the current usage environment changes; in response to being in a non-mobile state, maintaining the most recently set screen display brightness.

[0018] In one embodiment, the adjustment unit is further used for: in response to the current use environment being an indoor environment, adjusting the screen display brightness according to the ambient light intensity.

[0019] According to a third aspect of an embodiment of the present disclosure, a display adjustment device is provided, comprising: a processor; and a memory for storing processor executable instructions; wherein the processor is configured to: execute the display adjustment method described in the first aspect or any one of the implementations of the first aspect.

[0020] According to a fourth aspect of an embodiment of the present disclosure, a storage medium is provided, in which instructions are stored. When the instructions in the storage medium are executed by a processor, the processor is enabled to execute the display adjustment method described in the first aspect or any one of the embodiments of the first aspect.

[0021] The technical solution provided by the embodiments of the present disclosure may include the following beneficial effects: The present disclosure relates to a display adjustment method, a display adjustment device and a storage medium. The display adjustment method includes: when the current use environment of the terminal is an outdoor environment under sunny conditions, continuously collecting light intensity data and terminal angle data in the current use environment, and obtaining the current ambient light intensity through a light intensity compensation function. When the ambient light intensity is a preset light intensity threshold, further distinguish whether the current use scene is an outdoor scene or an indoor scene, obtain image data in the current use environment through a camera, and determine the current use environment based on the image data. In response to the current use environment being an outdoor environment, the screen display brightness is set to a display brightness corresponding to an outdoor sunny use scene. Through the present disclosure, when the terminal detects a decrease in ambient light intensity, it can distinguish whether the current use scene is an indoor scene or an outdoor shadow scene, and automatically adjust the screen display brightness according to the current use scene, so that the user can clearly see the display content of the terminal.

[0022] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0023] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the present disclosure.

[0024] Figure 1 The figure is a flow chart of a display adjustment method according to an exemplary embodiment.

[0025] Figure 2 The figure is a schematic diagram showing an inertial measurement module detecting angle information of a terminal according to an exemplary embodiment of the present disclosure.

[0026] Figure 3 The present invention is a flowchart showing a method for determining a current usage environment according to an exemplary embodiment.

[0027] Figure 4 is a flow chart of a display adjustment method according to yet another exemplary embodiment.

[0028] Figure 5 The present invention is a flowchart showing a method for determining a current use environment according to the current ambient light intensity and a light intensity threshold according to an exemplary embodiment.

[0029] Figure 6 The present invention is a flowchart showing a method for determining a current use environment according to image data according to an exemplary embodiment.

[0030] Figure 7 is a flow chart of a display adjustment method according to yet another exemplary embodiment.

[0031] Figure 8 is a flow chart of a display adjustment method according to yet another exemplary embodiment.

[0032] Fig. 9 The figure is a block diagram of a display adjustment device according to an exemplary embodiment.

[0033] Fig.10 It is a block diagram of a device for display adjustment according to an exemplary embodiment. DETAILED DESCRIPTION

[0034] Here, exemplary embodiments will be described in detail, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The implementations described in the following exemplary embodiments do not represent all implementations consistent with the present disclosure.

[0035] The display adjustment method provided by the embodiment of the present disclosure is applied to a scenario in which a terminal adjusts the screen display brightness according to the ambient light intensity.

[0036] The terminal's automatic brightness function is an intelligent function. When the terminal turns on the automatic brightness function, the terminal's front light sensor detects the light intensity of the current use environment in real time, and adjusts the terminal's display brightness according to the detected light intensity. When the light intensity of the current use environment changes, the screen display brightness is adaptively adjusted. For example, when the use environment changes from an indoor environment to an outdoor environment during the day, if the light intensity increases, the screen display brightness level is increased to ensure that the user can clearly see the terminal screen display content. When the use environment changes from an outdoor environment during the day to an indoor environment, if the light intensity decreases, the screen display brightness level is reduced. While ensuring that the user can clearly see the terminal screen display content, the terminal power consumption is reduced and the terminal's battery life is improved.

[0037] However, the light intensity data output by the terminal's light sensor based on the ambient light shining on the terminal cannot reflect the overall light intensity of the current usage environment. For example, if the user moves to a shadow area such as an eave or tree shade, or if the user does not move but is blocked by a bus or other people, the actual light intensity of the ambient light shining on the terminal will decrease, causing the light intensity data value output by the light sensor to decrease. However, the ambient light intensity of the current overall usage environment has not changed substantially, that is, the light intensity data output by the terminal's light sensor will be affected by shadows and will differ from the actual light intensity of the current usage environment. In the above case, if the terminal turns on the automatic brightness function, the terminal will adaptively reduce the terminal's screen display brightness based on the decrease in the light intensity data value output by the light sensor, causing the user to be unable to see what is displayed on the screen, affecting the user experience.

[0038] In view of this, the present disclosure proposes a display adjustment method, which, in an outdoor sunny environment, responds to a decrease in light intensity data detected by a sensor, calls an inertial measurement module to collect terminal data, and outputs ambient light intensity through a light intensity compensation function based on the light intensity data and terminal angle data, when the ambient light intensity is lower than a preset light intensity threshold. The image data of the current use environment is collected by an image acquisition device, the current use environment is further identified, and the screen display brightness is adjusted after the current use environment is determined. Through the present disclosure, when the terminal detects a decrease in ambient light intensity, it can distinguish whether the current use scene is an indoor scene or an outdoor shadow scene, and automatically adjust the screen display brightness according to the current use scene, so that the user can clearly see the display content of the terminal.

[0039] Figure 1 FIG. 1 is a flow chart showing a display adjustment method according to an exemplary embodiment. Figure 1 As shown, the method includes steps S101 to S103.

[0040] In step S101, in response to the current use environment being an outdoor environment, the current ambient light intensity is obtained through a light intensity compensation function according to the light intensity data collected by the light sensor and the terminal angle data collected by the inertial measurement module.

[0041] Among them, the current use environment includes outdoor environment and indoor environment.

[0042] In step S102, in response to the current ambient light intensity being less than the light intensity threshold, image data in the current use environment is acquired, and the current use environment is determined based on the image data.

[0043] The light intensity threshold is the critical ambient light intensity for distinguishing indoor environment and outdoor environment.

[0044] In step S103, in response to the current use environment being an outdoor environment, the screen display brightness is set to a first brightness.

[0045] Among them, the first brightness is the lowest screen display brightness in an outdoor environment.

[0046] In the embodiments of the present disclosure, the ambient light intensity is different in different usage environments, and the light intensity data collected by the optical sensor of the terminal is different. It is understandable that the light intensity data detected by the optical sensor of the terminal is affected by the incident angle of the ambient light, and often differs from the actual ambient light intensity. For example: the normal light intensity of the outdoor environment under sunny conditions is above 30,000 lux, and when the terminal is used under the corresponding usage conditions, the light intensity data collected by the light sensor should be above 8,000 lux; the normal light intensity of the outdoor environment under rainy conditions is 3,000-20,000 lux, and when the terminal is used under the corresponding usage conditions, the light intensity data collected by the light sensor is 1,200-16,000 lux; the normal light intensity in the indoor environment is 300-500 lux, and when the terminal is used under the corresponding usage conditions, the light intensity data collected by the light sensor is 50-300 lux. Taking into account the influence of the incident angle of ambient light on the light intensity data output by the optical sensor, combined with the correlation between the terminal angle information and the incident angle of light, the present disclosure collects light intensity data in real time through a light sensor in an outdoor environment under sunny conditions, and collects terminal angle data in real time through an inertial motion unit (IMU), and inputs the real-time collected light intensity data and terminal angle data into a light intensity compensation function, thereby obtaining ambient light intensity in real time. It can be understood that the ambient light intensity obtained by the light intensity compensation function of the present disclosure is closer to the actual ambient light intensity in the current use environment than the light intensity data directly output by the optical sensor.

[0047] In an exemplary embodiment of the present disclosure, Figure 2 As shown in the schematic diagram of the inertial measurement module detecting the terminal angle information, the X-axis in the figure corresponds to the perpendicular bisector of the long side of the terminal and is parallel to the short side of the terminal, the Y-axis corresponds to the perpendicular bisector of the short side of the terminal and is parallel to the long side of the terminal, the Z-axis is perpendicular to the terminal screen, and the X-axis, Y-axis and Z-axis intersect. The terminal angle information detected by the inertial measurement module built into the terminal includes the pitch angle (Pitch) of the terminal, that is, the rotation angle of the terminal around the X-axis; the roll angle (Roll) of the terminal: that is, the rotation angle of the terminal around the Z-axis; the azimuth angle (Azimuth) of the terminal, that is, the horizontal angle between the north direction line of a certain point of the terminal and the target direction line rotated in a clockwise direction. The terminal angle data output by the inertial measurement module in the present disclosure is determined according to the pitch angle, roll angle and azimuth of the above-mentioned terminal.

[0048] In an exemplary embodiment of the present disclosure, the following light intensity compensation function is used to obtain the ambient light intensity based on the light intensity data and the terminal angle data: the function expression of the light intensity compensation function is:

[0049] Linear model Poly51:

[0050] f(x,y)=p00+p10*x+p01*y+p20*x^2+p11*x*y+p30*x 3+p21*x^2*y+p40*x^4+p31*x^3*y+p50*x^5+p41*x^4*y

[0051] Among them, x is the terminal angle data, y is the light intensity data, f(x, y) is the ambient light intensity, and p00 to p41 are parameters (Coefficients) with 95% confidence bounds, such as:

[0052] Coefficients (with 95% confidence bounds):

[0053] p00=-0.6815(-1.163,-0.2004)

[0054] p10=0.0411(0.02733,0.05487)

[0055] p01=1.008(0.9909,1.024)

[0056] p20=-0.0001204(-0.0004744,0.0002337)

[0057] p11=0.0009078(0.000489,0.001327)

[0058] p30=-1.615e-05(-2.042e-05,-1.189e-05)

[0059] p21=-0.0002763(-0.0002886,-0.0002639)

[0060] p40=2.79e-08(-1.854e-08, 7.433e-08)

[0061] p31=-1.373e-07(-2.122e-07,-6.238e-08)

[0062] p50=1.47e-09(1.081e-09, 1.859e-09)

[0063] p41=1.876e-08 (1.714e-08, 2.037e-08).

[0064] In another exemplary embodiment of the present disclosure, the ambient light intensity is obtained based on the light intensity data and the terminal angle data through the light intensity compensation function in the following manner, and the function expression of the light intensity compensation function is represented by a Matlab custom curve fitting general Gaussian model:

[0065] Fit found when optimization terminated: General model Gauss3:

[0066] f(x1)=a1*exp(-((x1-b1) / c1)~2)+a2*exp(-((x1-b2) / c2)^2)+a3*exp(-((x1-b3) / c3)^2)

[0067] Wherein, exp is the abbreviation of natural exponential function, for example, N*exp(x0)=N^x0, x1 is the terminal angle data, f(x1) is the ratio of the ambient light intensity to the light intensity data collected by the light sensor, and a1 to c3 are parameters (Coefficients) with 95% confidence bounds, such as:

[0068] Coefficients(with 95%confidence bounds):

[0069] a1=24.41(-1.502e+04, 1.507e+04)

[0070] b1=14.69(-29.12,58.51)

[0071] c1=29.56(-131.1,190.2)

[0072] a2=0.3854(0.2727,0.4982)

[0073] b2 = -38.58 (-45.02, -32.13)

[0074] c2=24.06(19.7,28.43)

[0075] a3=9323.48(-1.507e+04, 1.502e+04)

[0076] b3=14.83(-29.69,59.36)

[0077] c3=29.05(-135.4,193.5)

[0078] In the disclosed embodiment, if the ambient light intensity obtained by the light intensity compensation function is less than the light intensity threshold (the light intensity threshold is the critical ambient light intensity for distinguishing indoor and outdoor environments), it is determined that the light intensity of the local environment where the terminal is located has decreased, and it is necessary to further determine whether the light intensity of the current overall use environment has also decreased, that is, to determine whether the current use environment of the terminal is an indoor environment (the light intensity of the current overall use environment has also decreased) or an outdoor environment (the light intensity of the current overall use environment has not decreased and remains at the original level). In this case, the light sensor cannot further determine the above-mentioned use environment, so the image acquisition device of the terminal (such as the front camera) is turned on to collect image data of the current use environment, and the current use environment is determined by the image data. When the current use environment is an outdoor environment, the screen display brightness of the terminal is maintained at the high display brightness in the outdoor environment to ensure that the user can clearly see the display content of the terminal.

[0079] In the disclosed embodiment, data is collected respectively by the inertial measurement module, light sensor and image acquisition device of the terminal, and the current use environment of the terminal is accurately determined based on the various types of data collected. When the ambient light intensity obtained by the light intensity compensation function is reduced to below the preset light intensity threshold, it is possible to accurately determine whether the current use scene is an indoor scene or an outdoor scene, and adjust the terminal screen display brightness so that the user can clearly see the display content of the terminal, thereby improving the user's use experience. In addition, the image acquisition device in the present disclosure is only triggered in a scenario where the ambient light intensity obtained by the light intensity compensation function is reduced to below the preset light intensity threshold, thereby realizing the above-mentioned display brightness adjustment function with low power consumption and ensuring the battery life of the terminal.

[0080] The following embodiments of the present disclosure illustrate a method for determining a current usage environment of a terminal.

[0081] Figure 3 FIG. 1 is a flow chart showing a method for determining a current usage environment according to an exemplary embodiment. Figure 3 As shown, the method includes step S201, step S202A and step S202B.

[0082] In step S201, light intensity data is acquired through a light sensor.

[0083] In step S202A, in response to the light intensity data being greater than the data threshold, the inertial measurement module is turned on, the terminal angle data is continuously collected through the inertial measurement module, and the current usage environment is determined based on the light intensity data and the terminal angle data.

[0084] The data threshold is the critical light intensity data for distinguishing indoor and outdoor environments.

[0085] In step S202B, in response to the light intensity data being less than the data threshold, it is determined that the current use environment is an indoor environment.

[0086] It is understandable that the continuous operation of the terminal inertial measurement module will increase the power consumption of the terminal and affect the battery life of the terminal, and there is a certain mapping relationship between the light intensity data obtained by the light sensor and the ambient light intensity further obtained through the light intensity compensation function. Therefore, when the automatic brightness function of the terminal is turned on and the terminal first enters the use state, if the light intensity data obtained by the light sensor is lower than the preset data threshold, it is determined that the current use environment is an indoor environment, and the screen display brightness can be set to the minimum brightness supported by automatic brightness adjustment (that is, to ensure that the screen display can be clearly seen in the indoor environment); if the light intensity data obtained by the light sensor is higher than the preset data threshold, further environmental judgment and brightness adjustment are required.

[0087] In the disclosed embodiment, when the current usage environment is preliminarily determined, only the light sensor is enabled to collect the light intensity data of the terminal usage environment. When the light intensity data exceeds the preset data threshold, other devices are considered to be enabled to perform further environmental judgment and display brightness adjustment, so as to avoid the increase in power consumption caused by the continuous activation of the inertial sensor and ensure the terminal's battery life.

[0088] In the disclosed embodiment, there is a difference between the light intensity data of the terminal usage environment collected by the light sensor and the actual light intensity of the usage scenario. Therefore, when the light intensity data is greater than the data threshold, it cannot be completely determined that the current environment is outdoor. It is necessary to continuously collect terminal angle data through the inertial measurement module to further determine the current usage environment based on the light intensity data and terminal angle data.

[0089] Figure 4 FIG. 1 is a flow chart of a display adjustment method according to another exemplary embodiment. Figure 4 As shown, the method includes step S301 to step S302.

[0090] In step S301, the current ambient light intensity is continuously acquired according to the terminal angle data and the light intensity data.

[0091] In step S302, the current use environment is determined according to the current ambient light intensity and the light intensity threshold.

[0092] In the embodiment of the present disclosure, when the light intensity data is greater than the data threshold, it is necessary to further determine whether the current use scene is an outdoor scene, that is, to enable the inertial measurement module to collect the angle data of the terminal, and input the angle data and the light intensity data into the light intensity compensation function to determine the current ambient light intensity, and then determine the current use environment according to the current ambient light intensity and the light intensity threshold. When the light intensity data exceeds the preset data threshold, the present disclosure enables the inertial measurement module, and determines the current ambient light intensity through the light intensity compensation function to ensure the accuracy of the light intensity determination result.

[0093] In the disclosed embodiment, when determining the light intensity threshold according to the ambient light intensity, the light intensity data is obtained by measuring the light intensity data at each angle in each environment by the light sensor of the terminal under various light intensity environments through the mobile phone. In view of the limited field of view FOV of the terminal light sensor, which is generally only 90-120 degrees, it cannot perfectly obtain the ambient light, so it is generally impossible to fully compensate for the ambient light intensity, but the values ​​are on the same horizontal line due to light scattering.

[0094] The following embodiments of the present disclosure illustrate a method for determining a current usage environment based on the current ambient light intensity and a light intensity threshold.

[0095] Figure 5 FIG. 1 is a flow chart showing a method for determining the current use environment according to the current ambient light intensity and the light intensity threshold according to an exemplary embodiment. Figure 5 As shown, the method includes step S401, step S402A and step S402B.

[0096] In step S401, the current ambient light intensity is continuously acquired according to the terminal angle data and the light intensity data.

[0097] In step S402A, in response to the ambient light intensity being less than the light intensity threshold, it is determined that the current use environment is an indoor environment.

[0098] In step S402B, in response to the ambient light intensity being greater than the light intensity threshold, it is determined that the current use environment is an outdoor environment.

[0099] In the embodiment of the present disclosure, the light intensity threshold is a preset critical ambient light intensity for distinguishing indoor environments from outdoor environments. It is understandable that the range of light intensity in indoor environments and the light intensity units in outdoor environments intersect, and the present disclosure sets the critical ambient light intensity based on the general range of indoor ambient light intensity and the general range of outdoor ambient light intensity. The outdoor environment defined in the present disclosure is mainly a scene during the day when the ambient light intensity is higher than the indoor ambient light intensity.

[0100] In the disclosed embodiment, the inertial measurement module is turned on to collect the angle data of the terminal, and the angle data and the light intensity data are input into the light intensity compensation function to determine the current ambient light intensity, and then determine whether the current use environment is an indoor environment or an outdoor environment according to the current ambient light intensity and the light intensity threshold. It is convenient to set the terminal display brightness according to the current use environment and the ambient light intensity determined in real time.

[0101] In the embodiment of the present disclosure, when the current ambient light intensity obtained by the light intensity compensation function decreases below the light intensity threshold, the current use environment is further determined to be an indoor environment or an outdoor environment according to the image data. The following embodiment of the present disclosure describes a method for determining the current use environment according to image data.

[0102] Figure 6 FIG. 1 is a flow chart showing a method for determining a current use environment based on image data according to an exemplary embodiment. Figure 6 As shown, the method includes step S501 to step S502.

[0103] In step S501, in response to the current ambient light intensity being less than a light intensity threshold, image data in the current use environment is acquired.

[0104] In step S502, the image data is input into a scene discrimination model to obtain the current usage environment.

[0105] Among them, the scene discrimination model is trained by positive sample data sets and negative sample data sets. The positive sample data sets include images taken by the terminal at different terminal angles in different outdoor environments, and the negative sample data sets include images taken by the terminal at different terminal angles in different indoor environments.

[0106] In the disclosed embodiment, a pre-trained scene discrimination model is used to determine the current usage environment. The positive sample data set used to train the scene discrimination model is a large number of images captured by the terminal at various terminal angles through an image acquisition device (such as a front camera) in outdoor shadow-covered scenes such as tree shades, building shadows, and object shadows in outdoor environments in various weather conditions. The negative sample data set used to train the scene discrimination model is a large number of images captured by the terminal at various terminal angles through an image acquisition device (such as a front camera) in indoor environments such as corridors, elevators, living rooms, and office areas in various weather conditions.

[0107] In an exemplary embodiment of the present disclosure, classification models such as MPN-COV can be used for model training. When training a scene discrimination model, classification training is first performed on a large dataset shared on the Internet (such as imageNet), and then the model is fine-tuned using the above-mentioned self-built positive sample dataset and negative sample dataset, and the model training is completed to obtain a classification model that can be actually applied.

[0108] In the disclosed embodiment, after the image data is input into the scene discrimination model, the scene discrimination model quickly determines and outputs the current usage scene based on the content of the image data, thereby achieving rapid determination of the usage scene and ensuring rapid adjustment of the terminal screen display brightness.

[0109] In the embodiments of the present disclosure, if the ambient light intensity is less than the light intensity threshold and the user is in a state of continuous movement, there will be different usage environment changes such as being in an outdoor shadow-shaded environment continuously, and an indoor environment converted from an outdoor shadow-shaded environment, based on the different usage environment changes when the user is in a state of continuous movement. The present disclosure needs to continuously determine the current usage environment when the ambient light intensity is less than the light intensity threshold and the user is in a mobile state, and adaptively adjust the display brightness of the terminal screen. The following embodiments of the present disclosure further illustrate the above display adjustment method.

[0110] Figure 7 FIG. 1 is a flow chart of a display adjustment method according to another exemplary embodiment. Figure 7 As shown, the method includes step S601, step S602A and step S602B.

[0111] In step S601, in response to the ambient light intensity being less than a light intensity threshold, motion data is acquired through an inertial measurement module, and a current motion state is determined according to the motion data.

[0112] In step S602A, in response to being in a moving state, image data is collected according to a preset collection frequency, and the current use environment is updated according to the latest collected image data, and the screen display brightness is reset when the current use environment changes.

[0113] In step S602B, in response to being in a non-moving state, the most recently set screen display brightness is maintained.

[0114] In the embodiment of the present disclosure, when the terminal is in a mobile state, the image data is collected according to a preset frequency (such as 10s) by an image acquisition device (such as a front camera), and the use scene of the current terminal is quickly judged according to the scene discrimination model, and then the screen display brightness is adjusted according to the use scene. It can be understood that the use scene of the current terminal in the present disclosure is mainly divided into indoor scenes and outdoor scenes. When the current use environment changes, the screen display brightness is reset. If the user continues to move in an outdoor shadow-shaded environment, image data of the outdoor shadow-shaded environment (such as images corresponding to the shade of trees, building shadows and object shadows in the outdoor environment) will be collected, and then the scene discrimination model is used to determine that the current use environment is an outdoor environment, and the display brightness is not adjusted according to the detected change in ambient light intensity, and the high display brightness corresponding to the normal outdoor environment is maintained. If the user moves from an outdoor shadow-shaded environment to an indoor environment, the image data of the indoor environment (corridors, elevators, living rooms and office areas) will be collected, and then the scene discrimination model is used to determine that the current use environment is an indoor environment, and the screen display brightness is adaptively adjusted according to the change in ambient light intensity. The present disclosure may use a pedometer algorithm or a neural network to determine the current motion state, wherein the pedometer algorithm is a traditional algorithm, that is, a waveform graph is drawn based on the motion data collected in real time, and a band of peaks and troughs is determined as one walk.

[0115] It is understandable that when the terminal is in a mobile state, there is a situation where the terminal moves from an outdoor shadowed environment to an unshadowed environment. In this case, the light intensity data output by the terminal light sensor will increase, and the ambient light intensity determined by the light intensity compensation function based on the light intensity data and the terminal angle data will also increase, thereby exceeding the light intensity threshold. In this case, there is no need to determine the current usage scenario through image data. The image acquisition device of the terminal can be turned off and image data can be stopped from being collected, thereby reducing terminal power consumption and ensuring terminal battery life.

[0116] In the embodiment of the present disclosure, if it has been determined that the terminal is in an outdoor shadowed environment and the terminal is in a non-moving state, it is judged that the current usage environment is always an outdoor environment, and the display brightness is not adjusted according to the detected changes in ambient light intensity, and the high display brightness corresponding to the normal outdoor environment is maintained.

[0117] In the disclosed embodiment, different screen display brightness adjustment strategies are used to adjust the screen display brightness according to whether the user moves when using the terminal and whether the usage scene changes when moving. Ensure that the screen display brightness is consistent with the current terminal usage environment. When the current usage environment is an outdoor environment, the terminal screen display brightness is maintained at a high display brightness in the outdoor environment to ensure that the user can clearly see the display content of the terminal. When the current usage environment is an indoor environment, the terminal screen display brightness is reduced to ensure that the user can clearly see the display content of the terminal while reducing the terminal power consumption and ensuring the terminal battery life.

[0118] The following embodiments of the present disclosure further illustrate the above display adjustment method.

[0119] Figure 8 FIG. 1 is a flow chart of a display adjustment method according to another exemplary embodiment. Figure 8 As shown, the method includes step S701 to step S702.

[0120] In step S701, the current ambient light intensity is obtained through a light intensity compensation function according to the light intensity data value collected by the light sensor and the terminal angle data collected by the inertial sensor.

[0121] In step S702, in response to the current use environment being an indoor environment, the screen display brightness is adjusted according to the ambient light intensity.

[0122] In an embodiment of the present disclosure, when a user uses the terminal and the terminal turns on the screen for the first time, light intensity data is first collected through the optical sensor to determine the current usage scenario. If the light intensity data is less than the data threshold, it is determined that the current usage environment is an indoor environment, and the screen display brightness can be set to the lowest brightness supported by automatic brightness adjustment (i.e., the display brightness that ensures that the screen display can be clearly seen in an indoor environment); if the light intensity data obtained through the light sensor is higher than the preset data threshold, the inertial measurement module is turned on, the terminal angle data is continuously obtained, and the current ambient light intensity is continuously obtained based on the terminal angle data and the light intensity data. In response to the current ambient light intensity being less than the light intensity threshold, it is determined that the current usage environment is an indoor environment, and the screen display brightness can be set to the lowest brightness supported by automatic brightness adjustment (i.e., the display brightness that ensures that the screen display can be clearly seen in an indoor environment).

[0123] In the disclosed embodiment, when the user uses the terminal and the terminal lights up the screen for the first time, the optical sensor first collects light intensity data to determine the current use scenario. If the light intensity data is less than the data threshold, the current use environment is determined to be an indoor environment and the screen display brightness is adjusted using the environment. If the light intensity data obtained by the light sensor is higher than the preset data threshold, the inertial measurement module is turned on to continuously obtain the terminal angle data, and the current ambient light intensity is continuously obtained according to the terminal angle data and the light intensity data. If the current ambient light intensity is less than the light intensity threshold, the current use environment is determined to be an indoor environment and the screen display brightness is adjusted using the environment. If the current ambient light intensity is greater than the light intensity threshold, the current use environment is determined to be an outdoor environment and the screen display brightness is adjusted according to the use environment. When the current use environment is an outdoor environment and the ambient light intensity obtained in real time is reduced to below the light intensity threshold, the image data under the current use environment is obtained, and the current use environment is determined to be an indoor environment or an outdoor shadow-shaded environment according to the image data. If the current use environment is an indoor environment, the screen display brightness is adjusted according to the change of the ambient light intensity. If the current use environment is an outdoor shadow-shaded environment, the screen display brightness of the terminal is kept at the high display brightness in the outdoor environment to ensure that the user can clearly see the display content of the terminal. Through the present disclosure, when the terminal detects a decrease in ambient light intensity, it can distinguish whether the current usage scenario is an indoor scene or an outdoor shadow scene, and automatically adjust the screen display brightness according to the current usage scenario, so that the user can clearly see the display content of the terminal, thereby improving the user's usage experience.

[0124] Based on the same concept, the embodiment of the present disclosure further provides a display adjustment device 100 .

[0125] It is understandable that the display adjustment device 100 provided in the embodiment of the present disclosure includes hardware structures and / or software modules corresponding to the execution of each function in order to realize the above functions. In combination with the units and algorithm steps of each example disclosed in the embodiment of the present disclosure, the embodiment of the present disclosure can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered to exceed the scope of the technical solution of the embodiment of the present disclosure.

[0126] Fig. 9 1 is a block diagram of a display adjustment device 100 according to an exemplary embodiment. Fig. 9 The device includes a processing unit 101 and an adjustment unit 102.

[0127] The processing unit 101, in response to the current use environment being an outdoor environment, obtains the current ambient light intensity through a light intensity compensation function based on the light intensity data collected by the light sensor and the terminal angle data collected by the inertial measurement module. In response to the current ambient light intensity being less than the light intensity threshold, obtains image data in the current use environment, and determines the current use environment based on the image data.

[0128] The current use environment includes an outdoor environment and an indoor environment, and the light intensity threshold is a critical ambient light intensity for distinguishing an indoor environment from an outdoor environment.

[0129] The adjustment unit 102 sets the screen display brightness to a first brightness in response to the current use environment being an outdoor environment.

[0130] Among them, the first brightness is the lowest screen display brightness in an outdoor environment.

[0131] In one implementation, the use environment of the terminal is determined by the processing unit 101 in the following manner: light intensity data is obtained through a light sensor. In response to the light intensity data being greater than a data threshold, the inertial measurement module is turned on, the terminal angle data is continuously collected through the inertial measurement module, and the current use environment is determined based on the light intensity data and the terminal angle data, where the data threshold is the critical light intensity data for distinguishing indoor environments and outdoor environments. In response to the light intensity data being less than the data threshold, the current use environment is determined to be an indoor environment.

[0132] In one implementation, the processing unit 101 determines the current use environment according to the light intensity data and the terminal angle data in the following manner: continuously obtain the current ambient light intensity according to the terminal angle data and the light intensity data. Determine the current use environment according to the current ambient light intensity and the light intensity threshold.

[0133] In one embodiment, the processing unit 101 determines the current use environment according to the current ambient light intensity and the light intensity threshold in the following manner: in response to the ambient light intensity being less than the light intensity threshold, the current use environment is determined to be an indoor environment. In response to the ambient light intensity being greater than the light intensity threshold, the current use environment is determined to be an outdoor environment.

[0134] In one implementation, the processing unit 101 determines the current usage environment according to the image data in the following manner: the image data is input into a scene discrimination model to obtain the current usage environment. The scene discrimination model is trained by a positive sample data set and a negative sample data set, the positive sample data set includes images taken by the terminal at different terminal angles in different outdoor environments, and the negative sample data set includes images taken by the terminal at different terminal angles in different indoor environments.

[0135] In one embodiment, the adjustment unit 102 is further configured to: in response to the ambient light intensity being less than the light intensity threshold, obtain motion data through the inertial measurement module, and determine the current motion state according to the motion data. In response to being in a mobile state, collect image data according to a preset collection frequency, update the current use environment according to the latest collected image data, and reset the screen display brightness when the current use environment changes. In response to being in a non-mobile state, maintain the most recently set screen display brightness.

[0136] In one implementation, the adjustment unit 102 is further configured to: in response to the current use environment being an indoor environment, adjust the screen display brightness according to the ambient light intensity.

[0137] Fig.10 2 is a block diagram of a device 200 for display adjustment according to an exemplary embodiment. The device 200 may be provided as a terminal. For example, the device 200 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, etc.

[0138] Reference Fig.10 , the device 200 may include one or more of the following components: a processing component 202 , a memory 204 , a power component 206 , a multimedia component 208 , an audio component 210 , an input / output (I / O) interface 212 , a sensor component 214 , and a communication component 216 .

[0139] The processing component 202 generally controls the overall operation of the device 200, such as operations associated with display, phone calls, data communications, camera operations, and recording operations. The processing component 202 may include one or more processors 220 to execute instructions to perform all or part of the steps of the above-described method. In addition, the processing component 202 may include one or more modules to facilitate interaction between the processing component 202 and other components. For example, the processing component 202 may include a multimedia module to facilitate interaction between the multimedia component 208 and the processing component 202.

[0140] The memory 204 is configured to store various types of data to support operations on the device 200. Examples of such data include instructions for any application or method operating on the device 200, contact data, phone book data, messages, pictures, videos, etc. The memory 204 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk.

[0141] The power component 206 provides power to the various components of the device 200. The power component 206 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the device 200.

[0142] The multimedia component 208 includes a screen that provides an output interface between the device 200 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundaries of the touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 208 includes a front camera and / or a rear camera. When the device 200 is in an operating mode, such as a shooting mode or a video mode, the front camera and / or the rear camera may receive external multimedia data. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.

[0143] The audio component 210 is configured to output and / or input audio signals. For example, the audio component 210 includes a microphone (MIC), and when the device 200 is in an operation mode, such as a call mode, a recording mode, and a speech recognition mode, the microphone is configured to receive an external audio signal. The received audio signal can be further stored in the memory 204 or sent via the communication component 216. In some embodiments, the audio component 210 also includes a speaker for outputting audio signals.

[0144] I / O interface 212 provides an interface between processing component 202 and peripheral interface modules, such as keyboards, click wheels, buttons, etc. These buttons may include but are not limited to: a home button, a volume button, a start button, and a lock button.

[0145] The sensor assembly 214 includes one or more sensors for providing various aspects of the status assessment of the device 200. For example, the sensor assembly 214 can detect the open / closed state of the device 200, the relative positioning of components, such as the display and keypad of the device 200, the sensor assembly 214 can also detect the position change of the device 200 or a component of the device 200, the presence or absence of user contact with the device 200, the orientation or acceleration / deceleration of the device 200 and the temperature change of the device 200. The sensor assembly 214 can include a proximity sensor configured to detect the presence of a nearby object without any physical contact. The sensor assembly 214 can also include an optical sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 214 can also include an accelerometer, a gyroscope sensor, a magnetic sensor, a pressure sensor or a temperature sensor.

[0146] The communication component 216 is configured to facilitate wired or wireless communication between the device 200 and other devices. The device 200 can access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component 216 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 216 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

[0147] In an exemplary embodiment, the apparatus 200 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors or other electronic components to perform the above method.

[0148] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 204 including instructions, and the instructions can be executed by the processor 220 of the device 200 to perform the above method. For example, the non-transitory computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.

[0149] It is to be understood that in the present disclosure, "plurality" refers to two or more than two, and other quantifiers are similar. "And / or" describes the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. The character " / " generally indicates that the associated objects before and after are in an "or" relationship. The singular forms "a", "the" and "the" are also intended to include plural forms, unless the context clearly indicates other meanings.

[0150] It is further understood that the terms "first", "second", etc. are used to describe various information, but such information should not be limited to these terms. These terms are only used to distinguish the same type of information from each other, and do not indicate a specific order or degree of importance. In fact, the expressions "first", "second", etc. can be used interchangeably. For example, without departing from the scope of the present disclosure, the first information can also be referred to as the second information, and similarly, the second information can also be referred to as the first information.

[0151] It will be further understood that the terms “center”, “longitudinal”, “lateral”, “front”, “back”, “up”, “down”, “left”, “right”, “vertical”, “horizontal”, “top”, “bottom”, “inside”, “outside”, etc., indicating orientations or positional relationships based on the orientations or positional relationships shown in the accompanying drawings, are only for the convenience of describing the present embodiment and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation.

[0152] It can be further understood that, unless otherwise specified, “connection” includes a direct connection without other components between the two, and also includes an indirect connection with other components between the two.

[0153] It is further understood that, although the operations are described in a specific order in the drawings in the embodiments of the present disclosure, it should not be understood as requiring the operations to be performed in the specific order shown or in a serial order, or requiring the execution of all the operations shown to obtain the desired results. In certain environments, multitasking and parallel processing may be advantageous.

[0154] Those skilled in the art will readily appreciate other embodiments of the present disclosure after considering the specification and practicing the invention disclosed herein. The present disclosure is intended to cover any variations, uses or adaptations of the present solution, which follow the general principles of the present disclosure and include common knowledge or customary technical means in the art that are not disclosed in the present disclosure.

[0155] It should be understood that the present disclosure is not limited to the precise structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the scope of the appended claims.

Claims

1. A display adjustment method, characterized in that: include: In response to the current use environment being an outdoor environment, obtaining the current ambient light intensity through a light intensity compensation function according to the light intensity data collected by the light sensor and the terminal angle data collected by the inertial measurement module, wherein the current use environment includes an outdoor environment and an indoor environment; In response to the current ambient light intensity being less than a light intensity threshold, acquiring image data under the current use environment, and determining the current use environment according to the image data, wherein the light intensity threshold is a critical ambient light intensity for distinguishing an indoor environment from an outdoor environment; In response to the current use environment being the outdoor environment, the screen display brightness is set to a first brightness, where the first brightness is the lowest screen display brightness in the outdoor environment.

2. The method according to claim 1, characterized in that: The use environment of the terminal is determined in the following manner: Acquiring light intensity data through the light sensor; In response to the light intensity data being greater than a data threshold, the inertial measurement module is turned on, the terminal angle data is continuously collected through the inertial measurement module, and the current use environment is determined according to the light intensity data and the terminal angle data, where the data threshold is the critical light intensity data for distinguishing indoor environments and outdoor environments; In response to the light intensity data being less than a data threshold, it is determined that the current use environment is an indoor environment.

3. The method according to claim 2, characterized in that The determining the current use environment according to the light intensity data and the terminal angle data includes: Continuously acquiring the current ambient light intensity according to the terminal angle data and the light intensity data; The current use environment is determined according to the current ambient light intensity and the light intensity threshold.

4. The method according to claim 3, characterized in that The determining the current use environment according to the current ambient light intensity and the light intensity threshold comprises: In response to the ambient light intensity being less than a light intensity threshold, determining that the current use environment is the indoor environment; In response to the ambient light intensity being greater than a light intensity threshold, the current usage environment is determined to be the outdoor environment.

5. The method according to claim 1, characterized in that The determining the current use environment according to the image data comprises: Inputting the image data into a scene discrimination model to obtain a current usage environment; The scene discrimination model is trained by a positive sample data set and a negative sample data set, wherein the positive sample data set includes images taken by a terminal at different terminal angles in different outdoor environments, and the negative sample data set includes images taken by a terminal at different terminal angles in different indoor environments.

6. The method according to claim 1, characterized in that The method further comprises: In response to the ambient light intensity being less than a light intensity threshold, acquiring motion data through the inertial measurement module, and determining a current motion state according to the motion data; In response to being in a mobile state, collecting image data according to a preset collection frequency, updating the current use environment according to the latest collected image data, and resetting the screen display brightness when the current use environment changes; In response to being in a non-moving state, the most recently set screen display brightness is maintained.

7. The method according to claim 1, characterized in that The method further comprises: In response to the current usage environment being an indoor environment, the screen display brightness is adjusted according to the ambient light intensity.

8. A display adjustment device, characterized in that: include: a processing unit, in response to the current use environment being an outdoor environment, obtaining the current ambient light intensity through a light intensity compensation function according to the light intensity data collected by the light sensor and the terminal angle data collected by the inertial measurement module, and in response to the current ambient light intensity being less than a light intensity threshold, obtaining image data under the current use environment, and determining the current use environment according to the image data, wherein the current use environment includes an outdoor environment and an indoor environment, and the light intensity threshold is a critical ambient light intensity for distinguishing an indoor environment from an outdoor environment; The adjustment unit is used to set the screen display brightness to a first brightness in response to the current use environment being the outdoor environment, where the first brightness is the minimum screen display brightness in the outdoor environment.

9. A display adjustment device, characterized in that: include: processor: a memory for storing processor-executable instructions; Wherein, the processor is configured to: execute the display adjustment method according to any one of claims 1 to 7.

10. A storage medium, characterized in that: The storage medium stores instructions, and when the instructions in the storage medium are executed by a processor, the processor is enabled to perform the display adjustment according to any one of claims 1 to 7.

Images