Display control method, device, electronic device and computer storage medium
By using the normally open AON function in electronic devices to detect the angle between the face and the screen, intelligent rotation is achieved, and the problem of screen rotation in the prior art is solved, which improves the user experience and reduces power consumption.
Patent Information
- Application Number
- CN202111566818.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-12-20
- Publication Date
- 2025-04-04
- Estimated Expiration
- 2041-12-20
AI Technical Summary
In the prior art, screen rotation is difficult to combine with the actual needs of the user, resulting in rotation still occur without rotation, or failure to rotate when rotation is required, affecting the user's user experience.
By using the normally open AON function, the angle between the face of the target object in the target image captured by the camera module and the display module is detected, and the display state of the display module is automatically adjusted when the specific angle threshold is met, thereby realizing intelligent rotation.
This method can rotate the screen when it is determined that the user needs to rotate the screen, improve the user's user experience, and reduce the power consumption of the electronic device by controlling the turn-on and off of the AON function.
Smart Images

Figure CN116320142B_ABST
Abstract
Description
Technical Field
[0001] The embodiments of the present application relate to but are not limited to electronic technology, and in particular to a display control method, device, electronic device and computer storage medium. Background Art
[0002] Screen rotation refers to when a mobile phone or other electronic device changes from vertical to horizontal, in order to make it more user-friendly, the screen can always be seen from the front without the user having to rotate with the phone, thereby facilitating user use.
[0003] However, screen rotation in the related art is difficult to combine with the actual needs of users. For example, the screen of the electronic device rotates when the user does not need it, or the screen of the electronic device does not rotate when the user needs it, which is not conducive to convenient use by the user. Summary of the invention
[0004] Embodiments of the present application provide a display control method, device, electronic device, and computer storage medium.
[0005] In a first aspect, an embodiment of the present application provides a display control method, including:
[0006] Obtaining first information determined by the camera module, and obtaining a rotation angle of the electronic device;
[0007] When the first information indicates that there is a target object within the shooting range of the camera module and the rotation angle is greater than a first angle threshold, second information is sent to the front processing module; the second information is used to instruct the front processing module to turn on the normally-on AON function. When the AON function is turned on, the front processing module determines the angle between the face of the target object and the display module based on the target image captured by the camera module;
[0008] When it is determined that the included angle is greater than a second angle threshold or is continuously increasing, and the rotation angle is greater than a third angle threshold, the display state of the display module is converted from a first display state to a second display state; and the third angle threshold is greater than the first angle threshold.
[0009] In a second aspect, an embodiment of the present application provides a display control device, including:
[0010] An obtaining unit, used to obtain the first information determined by the camera module and obtain the rotation angle of the electronic device;
[0011] a transmission unit, configured to send second information to a pre-processing module when the first information indicates that there is a target object within the shooting range of the camera module and the rotation angle is greater than a first angle threshold; the second information is used to instruct the pre-processing module to turn on a normally-on AON function, and when the AON function is turned on, the pre-processing module determines the angle between the face of the target object and the display module based on the target image captured by the camera module;
[0012] A conversion unit is used to convert the display state of the display module from a first display state to a second display state when it is determined that the angle is greater than a second angle threshold or is continuously increasing, and the rotation angle is greater than a third angle threshold; the third angle threshold is greater than the first angle threshold.
[0013] In a third aspect, an embodiment of the present application provides an electronic device, comprising: a processing module, a camera module, a pre-processing module and a display module; wherein:
[0014] The processing module is used to obtain the first information determined by the camera module and obtain the rotation angle of the electronic device;
[0015] The processing module is further configured to send second information to the pre-processing module when the first information indicates that there is a target object within the shooting range of the camera module and the rotation angle is greater than a first angle threshold; the second information is used to instruct the pre-processing module to turn on the normally-on AON function, and when the AON function is turned on, the pre-processing module determines the angle between the face of the target object and the display module based on the target image captured by the camera module;
[0016] The processing module is also used to convert the display state of the display module from the first display state to the second display state when it is determined that the angle is greater than the second angle threshold or is continuously increasing, and the rotation angle is greater than the third angle threshold; the third angle threshold is greater than the first angle threshold.
[0017] In a fourth aspect, an embodiment of the present application provides a computer storage medium, wherein the computer storage medium stores one or more programs, and the one or more programs can be executed by one or more processing modules to implement the steps in the above method.
[0018] In the embodiment of the present application, when the first information indicates that there is a target object within the shooting range of the camera module and the rotation angle is greater than the first angle threshold, the second information is sent to the front processing module; the second information is used to instruct the front processing module to turn on the normally open AON function. When the AON function is turned on, the front processing module determines the angle between the face of the target object and the display module based on the target image shot by the camera module; when it is determined that the angle is greater than the second angle threshold or is constantly increasing, and the rotation angle is greater than the third angle threshold, the display state of the display module is converted from the first display state to the second display state; the third angle threshold is greater than the first angle threshold. In this way, when it is determined that there is a target object in front of the electronic device and the rotation angle of the electronic device is greater than the first angle threshold, the AON function can be turned on, and then the angle between the face of the target object and the display module is determined, and the display state of the display module is converted, so that the front processing module will not continuously turn on the AON function, which is beneficial to reducing the power consumption of the electronic device. In addition, when it is determined that the user needs to rotate the screen, the screen can be rotated, which is beneficial to the user's convenient use. BRIEF DESCRIPTION OF THE DRAWINGS
[0019] The drawings described herein are used to provide further understanding of the present application and constitute a part of the present application. The illustrative embodiments of the present application and their descriptions are used to explain the present application and do not constitute improper limitations on the present application.
[0020] Figure 1 A flow chart of a display control method provided in an embodiment of the present application;
[0021] Figure 2 A flowchart of another display control method provided in an embodiment of the present application;
[0022] Figure 3 A flowchart of another display control method provided in an embodiment of the present application;
[0023] Figure 4 A flowchart of another display control method provided in an embodiment of the present application;
[0024] Figure 5 A flow chart of a display control method provided in another embodiment of the present application;
[0025] Figure 6 A flowchart of a display control method provided in yet another embodiment of the present application;
[0026] Figure 7 A flowchart of a display control method provided in yet another embodiment of the present application;
[0027] Figure 8A schematic diagram of a display control process provided by an embodiment of the present application;
[0028] Fig. 9 A schematic diagram of another display control process provided by an embodiment of the present application;
[0029] Fig.10 A flowchart of another display control method provided in another embodiment of the present application;
[0030] Fig.11 A schematic diagram of the structure of a display control device provided in an embodiment of the present application;
[0031] Fig.12 A hardware entity schematic diagram of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION
[0032] The technical solution of the present application will be described in detail below through embodiments and in conjunction with the accompanying drawings. The following specific embodiments can be combined with each other, and the same or similar concepts or processes may not be repeated in some embodiments.
[0033] It should be noted that in the examples of the present application, "first", "second", etc. are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence.
[0034] In addition, the technical solutions described in the embodiments of the present application can be combined arbitrarily without conflict. In the description of the present application, "multiple" means two or more, unless otherwise clearly and specifically defined.
[0035] Screen rotation allows the content displayed on the screen to be dynamically adjusted according to the state of the mobile phone or other electronic device. For example, when the mobile phone is in a vertical state, the content in the mobile phone is arranged vertically; when the mobile phone is in a horizontal state, the content in the mobile phone is changed to be arranged horizontally.
[0036] The screen rotation technology in the related technology is to determine whether the current state of the mobile phone has changed by analyzing a series of sensor parameters such as gravity sensors, gyroscopes, and light sensors. If the state of the mobile phone changes from landscape to portrait or from portrait to landscape, the screen of the mobile phone is controlled to rotate.
[0037] The screen rotation process in the related art is as follows: the processing module of the mobile phone continuously receives parameters from light sensors, gravity sensors, gyroscopes and other components. By calculating these parameters and comparing them with the data obtained from previous experiments in different scenarios, the current state of the mobile phone is determined. Once it is determined that the state of the mobile phone has changed, the mobile phone is triggered to rotate the screen.
[0038] In the related technical solutions, the processing module of the mobile phone obtains the current state of the mobile phone by analyzing various sensor parameters on the mobile phone. Once the mobile phone state changes (such as the conversion from landscape to portrait, or from portrait to landscape) is detected, the screen rotation will be triggered. This solution that triggers rotation only by analyzing the state of the mobile phone does not take into account the actual user needs, because in many cases, the change in the state of the mobile phone does not mean that the user wants to rotate the screen, it may just be a false trigger in the motion state. The original intention of the screen rotation technology is to bring convenience to users. The related technology does not take this demand of users into consideration. The solution that rotates the mobile phone only according to the state of the mobile phone will cause a series of rotations that do not meet the user's expectations. Obviously, this solution in the related technology can no longer meet the needs of users.
[0039] The embodiment of the present application proposes a method for intelligent screen rotation control based on Always On (AON). The main idea is to use the AON function to detect and recognize the ability of the face. By combining the analysis of the change in the angle between the face and the screen and the change in the sensor parameters of the mobile phone, the mobile phone screen can be rotated intelligently according to user needs.
[0040] The electronic device in the embodiment of the present application may include one of the following or a combination of at least two of them: a personal digital assistant (PDA), a handheld device with wireless communication function, a computing device or other processing device connected to a wireless modem, a server, a mobile phone, a tablet computer (Pad), a computer with wireless transceiver function, a handheld computer, a desktop computer, a personal digital assistant, a portable media player, a smart speaker, a navigation device, a smart watch, a smart glasses, a smart necklace and other wearable devices, a pedometer, a digital TV, a virtual reality (VR) terminal device, an augmented reality (AR) terminal device, a wireless terminal in industrial control, a wireless terminal in self driving, a wireless terminal in remote medical surgery, a wireless terminal in a smart grid, a wireless terminal in transportation safety, a wireless terminal in a smart city, a smart home, and a wireless terminal in a smart city. The wireless terminals in the Internet of Vehicles (IoV) and the vehicles, on-board equipment, on-board modules, wireless modems, handheld devices, customer premises equipment (CPE), smart home appliances, etc. in the IoV system.
[0041] Figure 1 A flow chart of a display control method provided in an embodiment of the present application is shown as follows: Figure 1 As shown, the method is applied to a processing module of a display control device or an electronic device, and the method includes:
[0042] S101: Obtain first information determined by a camera module, and obtain a rotation angle of the electronic device.
[0043] The first information may indicate whether there is a target object within the shooting range of the camera module.
[0044] The camera module in the electronic device may periodically or aperiodically send the first information to the processing module of the electronic device, so that the processing module may periodically or aperiodically acquire each piece of first information.
[0045] At least one of the light sensor, gravity sensor, and gyroscope in the electronic device can periodically or non-periodically send detected information to the processing module of the electronic device, so that the processing module can determine the rotation angle of the electronic device based on the information detected by at least one of the light sensor, gravity sensor, and gyroscope. Among them, the light sensor can be used to detect the brightness of the ambient light, the gravity sensor can be used to detect the tilt angle of the electronic device relative to the horizontal plane or the vertical direction, and the gyroscope is used to detect the angle change information of the electronic device.
[0046] In other embodiments, the processing module may periodically or non-periodically read the detected information from the camera module and from at least one of the light sensor, the gravity sensor, and the gyroscope.
[0047] The rotation angle of the electronic device may be the angle of change of the electronic device during or after the rotation process compared to the angle before the rotation. For example, when the length direction (or width direction) of the electronic device before rotation is parallel to the vertical direction, or when the angle with the vertical direction is less than or equal to the target angle, it can be determined that the electronic device is in portrait mode. For another example, when the length direction (or width direction) of the electronic device before rotation is perpendicular to the vertical direction, or when the angle with the vertical direction is greater than or equal to 90 degrees minus the target angle and less than or equal to 90 degrees plus the target angle, it can be determined that the electronic device is in landscape mode. The rotation angle of the electronic device can be determined based on the angle between the length direction (or width direction) of the electronic device and the vertical direction.
[0048] The camera module can obtain a specific image, and the specific image can be an image with a pixel size smaller than the target pixel size. The pixel size of the specific image can be smaller than the pixel size of the target image. The camera module can analyze the specific image to determine whether the target object exists within the shooting range of the camera module. In this way, the camera module can determine whether the target object exists within the shooting range of the camera module based on the specific image with a smaller pixel size captured, without the participation of other processing modules, thereby reducing the power consumption of the electronic device. In some embodiments, the pixel information of the pixel points in the specific image can be used to determine the facial contour or facial shape, and determine whether the target object exists within the shooting range of the camera module. The pixel points in the specific image can be very sparse, so that based on the specific image with sparse pixel points, it can be determined whether the target object exists within the shooting range of the camera module through a very small amount of calculation.
[0049] The camera module may send a first value to the processing module when it is determined that the first information indicates that there is a target object within the shooting range of the camera module, and send a second value to the processing module when it is determined that the first information indicates that there is no target object within the shooting range of the camera module.
[0050] The target object may be a person or any other object that can view the content displayed by the display module of the electronic device.
[0051] In some embodiments, the period for sending the first information configured by the camera module, and / or the period for sending the detected information configured by at least one of the light sensor, the gravity sensor, and the gyroscope, may be pre-configured in the camera module, and / or at least one of the light sensor, the gravity sensor, and the gyroscope, so that the camera module, and / or at least one of the light sensor, the gravity sensor, and the gyroscope, may send the detected information to the processing module based on the pre-configured period.
[0052] In other embodiments, the processing device may configure a cycle for sending the first information to the camera module, and / or the processing device may configure a cycle for sending the detected information to at least one of the light sensor, the gravity sensor, and the gyroscope. For example, when the processing device determines that the remaining power of the electronic device is less than a power threshold, or determines that the electronic device is in power saving mode, it may be determined that the configured cycle is larger.
[0053] In some embodiments, the processing module may obtain the first information determined by the camera module and the rotation angle of the electronic device when it is determined that the electronic device is in an open screen state. In other embodiments, the electronic device may obtain the first information determined by the camera module and the rotation angle of the electronic device when it is determined that the electronic device is using a preset type of application. The preset type of application may be an application that can be displayed in landscape mode during use. For example, the preset type of application may include: WeChat, video playback applications, video call applications, web browsing applications, etc.
[0054] In some embodiments, the processing module can send first designated information to the camera module and / or at least one of the light sensor, gravity sensor, and gyroscope when it is determined that the electronic device is in the screen-off state or is not using a preset type of application, and the designated information is used to instruct to stop detection. And, when the processing device determines that the electronic device is in the screen-on state or is using a preset type of application, it sends second designated information to the camera module and / or at least one of the light sensor, gravity sensor, and gyroscope, and the designated information is used to instruct to start detection.
[0055] S102. When the first information indicates that there is a target object within the shooting range of the camera module and the rotation angle is greater than a first angle threshold, send second information to the pre-processing module; the second information is used to instruct the pre-processing module to turn on the normally-on AON function. When the AON function is turned on, the pre-processing module determines the angle between the face of the target object and the display module based on the target image captured by the camera module.
[0056] The first angle threshold may be in the range of 30 to 60 degrees. For example, the first angle threshold may be 30, 45 or 60 degrees.
[0057] The pre-processing module can respond to the second information and turn on the always-on AON function. When the AON function is turned on, the pre-processing module can instruct the camera module to capture the target image once every preset time interval. The pre-processing module can determine the angle between the face of the target object and the display module based on the acquired target image.
[0058] The pixel size of the target image may be smaller than the specific pixel size. In some embodiments, the pre-processing module may detect a facial frame in the target image, and determine the angle between the face of the target object and the display module based on the position of the facial frame in the target image. In other embodiments, the pre-processing module may detect the positions of eyes, hair, nose, mouth, ears, etc. in the target image, and determine the angle between the face of the target object and the display module.
[0059] The pre-processing module may determine the angle once every preset time period, and then send the determined angle to the processing module.
[0060] S103. When it is determined that the included angle is greater than a second angle threshold or is continuously increasing, and the rotation angle is greater than a third angle threshold, converting the display state of the display module from a first display state to a second display state; the third angle threshold is greater than the first angle threshold.
[0061] The second angle threshold may be a value greater than or equal to 30 degrees and less than or equal to 90 degrees. For example, the second angle threshold may be 30 degrees, 45 degrees, 60 degrees, 75 degrees or 90 degrees. In some embodiments, the second angle threshold may be less than 90 degrees, so that during the rotation of the electronic device, the display state of the display module is converted from the first display state to the second display state, thereby making the switching of the display state of the display module smoother.
[0062] In some embodiments, the first display state may be a portrait display state, and the second display state may be a landscape display state. In other embodiments, the first display state may be a landscape display state, and the second display state may be a portrait display state.
[0063] The processing module may send the content to be displayed to the image conversion module, so that the image conversion module converts the display state from the first display state to the second display state, and outputs the content of the second display state to the display module, so that the display module switches from displaying the content of the first display state to displaying the content of the second display state. The image conversion module may include a graphics processing unit (GPU).
[0064] In the embodiment of the present application, when the first information indicates that there is a target object within the shooting range of the camera module and the rotation angle is greater than the first angle threshold, the second information is sent to the front processing module; the second information is used to instruct the front processing module to turn on the normally open AON function. When the AON function is turned on, the front processing module determines the angle between the face of the target object and the display module based on the target image shot by the camera module; when it is determined that the angle is greater than the second angle threshold or is constantly increasing, and the rotation angle is greater than the third angle threshold, the display state of the display module is converted from the first display state to the second display state; the third angle threshold is greater than the first angle threshold. In this way, when it is determined that there is a target object in front of the electronic device and the rotation angle of the electronic device is greater than the first angle threshold, the AON function can be turned on, and then the angle between the face of the target object and the display module is determined, and the display state of the display module is converted, so that the front processing module will not continuously turn on the AON function, which is beneficial to reducing the power consumption of the electronic device. In addition, when it is determined that the user needs to rotate the screen, the screen can be rotated, which is beneficial to the user's convenient use.
[0065] Figure 2 A flow chart of another display control method provided in an embodiment of the present application is shown as follows: Figure 2 As shown, the method is applied to a processing module of a display control device or an electronic device, and the method includes:
[0066] S201: Obtain first information determined by a camera module, and obtain a rotation angle of the electronic device.
[0067] S202. When the first information indicates that there is a target object within the shooting range of the camera module and the rotation angle is greater than a first angle threshold, send second information to the pre-processing module; the second information is used to instruct the pre-processing module to turn on the normally-on AON function. When the AON function is turned on, the pre-processing module determines the angle between the face of the target object and the display module based on the target image captured by the camera module.
[0068] S203: When it is determined that the included angle is greater than a second angle threshold or is continuously increasing, and the rotation angle is greater than a third angle threshold, converting the display state of the display module from a first display state to a second display state; the third angle threshold is greater than the first angle threshold.
[0069] S204: When it is determined that the included angle is less than or equal to the second angle threshold or the included angle gradually decreases, and the rotation angle is greater than the third angle threshold, maintain the display state of the display module in the first display state.
[0070] Figure 3 A flow chart of another display control method provided in an embodiment of the present application is as follows: Figure 3 As shown, the method is applied to a processing module of a display control device or an electronic device, and the method includes:
[0071] S301: Obtain first information determined by a camera module, and obtain a rotation angle of the electronic device.
[0072] S302. When the first information indicates that there is a target object within the shooting range of the camera module and the rotation angle is greater than a first angle threshold, send second information to the pre-processing module; the second information is used to instruct the pre-processing module to turn on the normally-on AON function. When the AON function is turned on, the pre-processing module determines the angle between the face of the target object and the display module based on the target image captured by the camera module.
[0073] S303: When it is determined that the included angle is greater than a second angle threshold or is continuously increasing, and the rotation angle is greater than a third angle threshold, converting the display state of the display module from a first display state to a second display state; the third angle threshold is greater than the first angle threshold.
[0074] In some embodiments, S305 may be executed after S303.
[0075] S304: When it is determined that the included angle is less than or equal to the second angle threshold or the included angle gradually decreases, and the rotation angle is greater than the third angle threshold, maintain the display state of the display module in the first display state.
[0076] In some embodiments, S305 may be executed after S304.
[0077] S305, sending third information to the pre-processing module; the third information is used to instruct the pre-processing module to turn off the AON function; when the AON function is turned off, the pre-processing module controls the camera module to stop capturing the target image.
[0078] It is understandable that when the AON function is turned off, the camera module will capture a specific image to determine the first information. When the AON function is turned on, the camera module will capture a target image so that the pre-processing module determines the angle based on the target image.
[0079] In the embodiment of the present application, when it is determined by turning on the normally-on AON function whether the angle is greater than the second angle threshold, the AON function can be turned off to avoid the situation where the AON function is turned on for a long time and the power consumption of the electronic device increases.
[0080] Figure 4 A flow chart of another display control method provided in an embodiment of the present application is shown as follows: Figure 4 As shown, the method is applied to a processing module of a display control device or an electronic device, and the method includes:
[0081] S401: Obtain first information determined by a camera module, and obtain a rotation angle of the electronic device.
[0082] S402. When the first information indicates that there is a target object within the shooting range of the camera module and the rotation angle is greater than a first angle threshold, send second information to the pre-processing module; the second information is used to instruct the pre-processing module to turn on the normally-on AON function. When the AON function is turned on, the pre-processing module determines the angle between the face of the target object and the display module based on the target image captured by the camera module.
[0083] S403: When it is determined that the included angle is greater than a second angle threshold or is continuously increasing, and the rotation angle is greater than a third angle threshold, converting the display state of the display module from a first display state to a second display state; the third angle threshold is greater than the first angle threshold.
[0084] In some embodiments, S403 may be followed by S404.
[0085] S404: Start a timer for the target duration.
[0086] The target duration may be a preconfigured duration, or the target duration may be flexibly determined based on the current operation of the electronic device. For example, in some embodiments, the processing module may determine the target duration based on whether the current time is evening or morning. When the current time is evening or morning, it indicates that the user may be lying in bed playing with the electronic device, and therefore, a longer target duration may be configured. In other embodiments, the processing module may determine whether the usage scenario of the electronic device is a room or a bedroom. When the usage scenario is a room or a bedroom, it indicates that the user may be lying in bed playing with the electronic device, and therefore, a longer target duration may be configured.
[0087] S405 and / or S406 may be executed after S404.
[0088] S405. During the operation of the timer, if it is determined that the included angle is less than or equal to the second angle threshold and the rotation angle is greater than the third angle threshold, the display state of the display module is converted from the second display state to the first display state, and third information is sent to the pre-processing module.
[0089] In some implementation scenarios, the user needs to use the electronic device while lying in bed, or needs to continue using the electronic device after getting up, and the user rotates the electronic device to an angle greater than a third angle threshold, but the face does not rotate with the electronic device. In this way, the electronic device can convert the display state of the display module from a first display state to a second display state. At this time, the electronic device will not immediately turn off the AON function, but predicts that the user will continue to use the electronic device, so that the electronic device can start a timer of a target duration. During the running of the timer, if the face rotates to the front of the electronic device, the display state of the display module is converted from the second display state to the first display state.
[0090] S406: During the operation of the timer, if it is determined that the included angle is greater than the second angle threshold and the rotation angle is greater than a third angle threshold, send the third information to the pre-processing module.
[0091] The third information is used to instruct the pre-processing module to turn off the AON function; when the AON function is turned off, the pre-processing module controls the camera module to stop capturing the target image.
[0092] Figure 5 A flow chart of a display control method provided in another embodiment of the present application is shown as follows: Figure 5As shown, the method is applied to a processing module of a display control device or an electronic device, and the method includes:
[0093] S501, obtaining first information determined by a camera module, and obtaining a rotation angle of the electronic device;
[0094] S502: When the first information indicates that a target object exists within the shooting range of the camera module and the rotation angle is greater than a first angle threshold, obtain the brightness of the ambient light detected by the light sensor.
[0095] S503: When the ambient light brightness is less than or equal to a brightness threshold, determine an image enhancement parameter based on the ambient light brightness information.
[0096] When the ambient light brightness is greater than the brightness threshold, the clarity of the target image meets the requirements, and there is no need to enhance the captured target image. When the ambient light brightness is less than or equal to the brightness threshold, the facial parts are not easy to identify, so the image enhancement parameters can be used to enhance the target image.
[0097] When the ambient light brightness is less than or equal to the brightness threshold, different ambient light brightnesses have different image enhancement parameters. For example, when one ambient light brightness is within a first brightness range, the determined image enhancement parameter is a first image enhancement parameter, and when another ambient light brightness is within a second brightness range, the determined image enhancement parameter is a second image enhancement parameter. The first image enhancement parameter and the second image enhancement parameter may be different. In some embodiments, the processing module may obtain a mapping relationship between multiple brightness ranges and multiple image enhancement parameters, thereby determining the image enhancement parameter corresponding to the obtained ambient light brightness based on the mapping relationship. Multiple brightness ranges may correspond one to one to multiple image enhancement parameters.
[0098] The image enhancement parameter may include at least one of the following: an image signal processing (ISP) brightening parameter and a night scene brightening parameter.
[0099] S504, sending the second information and the fourth information to the pre-processing module; the fourth information instructs the pre-processing module to use the image enhancement parameters to process the target image taken by the camera module, and determine the angle based on the processed image.
[0100] In this way, the target image captured by the camera module is processed using image enhancement parameters, so that a clearer facial image can be obtained, thereby improving the accuracy of the determined angle.
[0101] S505. When it is determined that the included angle is greater than a second angle threshold or is continuously increasing, and the rotation angle is greater than a third angle threshold, converting the display state of the display module from a first display state to a second display state; the third angle threshold is greater than the first angle threshold.
[0102] Figure 6 A flow chart of a display control method provided in another embodiment of the present application is as follows: Figure 6 As shown, the method is applied to a processing module of a display control device or an electronic device, and the method includes:
[0103] S601. When the first information determined based on the first configuration information indicates that there is a target object within the shooting range of the camera module, and the fifth information sent by the pre-processing module is received, second configuration information for identifying the target object is sent to the camera module; the fifth information indicates that the target object does not exist in the camera module.
[0104] S602: Obtain the first information determined by the camera module based on the second configuration information, and obtain a rotation angle of the electronic device.
[0105] The first configuration information and the second configuration information may include a target object recognition model. When the camera module obtains a specific image, the specific image may be input into the target object recognition model, so as to determine whether there is a target object in the specific image based on the target object recognition model.
[0106] In this way, when the recognition result of determining whether there is a target object through the first configuration information is inaccurate, the recognition result of the target object can be determined through the second configuration information.
[0107] The second configuration information may be obtained by modifying the first configuration information. The second configuration information may be obtained by user input.
[0108] In some embodiments, the first configuration information may indicate that the resolution of the specific image is a first resolution, and the second configuration information may indicate that the resolution of the specific image is a second resolution, and the second resolution is greater than the first resolution. In this way, since the second resolution is greater than the first resolution, the conclusion of whether there is a target object within the shooting range of the camera module determined by the second resolution is more accurate.
[0109] In some feasible embodiments, the processing module may configure the second configuration information to the camera module when the ambient light brightness is less than or equal to a certain threshold, and configure the first configuration information to the camera module when the ambient light brightness is greater than a certain threshold. In other feasible embodiments, the processing module may configure the second configuration information to the camera module when the current moment belongs to the night period, and configure the first configuration information to the camera module when the current moment belongs to the day period.
[0110] S603. When the first information indicates that there is a target object within the shooting range of the camera module and the rotation angle is greater than a first angle threshold, send second information to the pre-processing module; the second information is used to instruct the pre-processing module to turn on the normally-on AON function. When the AON function is turned on, the pre-processing module determines the angle between the face of the target object and the display module based on the target image captured by the camera module.
[0111] S604: When it is determined that the included angle is greater than a second angle threshold or is continuously increasing, and the rotation angle is greater than a third angle threshold, converting the display state of the display module from a first display state to a second display state; the third angle threshold is greater than the first angle threshold.
[0112] Figure 7 A flow chart of a display control method provided in yet another embodiment of the present application is as follows: Figure 7 As shown, the method is applied to a processing module of a display control device or an electronic device, and the method includes:
[0113] S701: Obtain facial feature information of a user using the electronic device.
[0114] In some embodiments, the user's facial feature information may be determined based on the historical target images obtained. In other embodiments, the user's facial feature information may be determined based on the photo album in the electronic device. In still other embodiments, the user's facial feature information may be determined based on the facial information uploaded by the user.
[0115] S702: Based on the facial feature information, determine third configuration information to be sent to the camera module for identifying the face of the target object.
[0116] The facial feature information may be facial feature information of one image, or may be facial feature information of at least two images. In some embodiments, the position of the face of the target object in the target image may be determined by a convolutional neural network. For example, the positions of the two eyes of the target object in the target image, the position of the mouth of the target object in the target image, and so on. The third configuration information may be parameter information of the convolutional neural network. The third configuration information may be obtained by training based on the facial feature information.
[0117] S703. Send the third configuration information to the pre-processing module; the third configuration information is used to instruct the pre-processing module to recognize the face of the target object based on the third configuration information.
[0118] S704: Obtain first information determined by the camera module, and obtain a rotation angle of the electronic device.
[0119] S705. When the first information indicates that there is a target object within the shooting range of the camera module and the rotation angle is greater than a first angle threshold, send second information to the pre-processing module; the second information is used to instruct the pre-processing module to turn on the normally-on AON function. When the AON function is turned on, the pre-processing module determines the angle between the face of the target object and the display module based on the target image captured by the camera module.
[0120] In S705, the pre-processing module may determine the angle between the face of the target object and the display module based on the third configuration information.
[0121] S706. When it is determined that the included angle is greater than a second angle threshold or is continuously increasing, and the rotation angle is greater than a third angle threshold, converting the display state of the display module from a first display state to a second display state; the third angle threshold is greater than the first angle threshold.
[0122] In the implementation of this application, the first level control can be performed first. In the first level control, the AON sensor (corresponding to the above-mentioned camera module) can be combined with the Human Exist (HE) function. If no human body is currently detected or the sensor parameters show that the state of the mobile phone has not changed (for example, there is no switching between the horizontal and vertical screen states), the AON function is not turned on for face detection and recognition, and smart rotation is not enabled at this time. Smart rotation is based on the user. If the user's presence is not detected, screen rotation is meaningless. This method can effectively reduce most of the invalid recognition and reduce power consumption.
[0123] If the primary control is passed, the secondary control is entered. In the secondary control, if a human body is detected and the sensor parameters show the status of the mobile phone and change, the pre-processing chip is configured to turn on the AON function to perform face detection and recognition. Face detection and recognition can be performed by the embedded neural-network processing units (NPU) in the pre-processing module mentioned above.
[0124] When performing face detection and recognition, the current light conditions can be judged based on the parameters of the light sensor. When the light condition is poor, ISP brightening and / or NPU night scene algorithm can be enabled to improve the recognition accuracy. ISP brightening can be performed by the pre-processing module before the image is input to the NPU. NPU night scene algorithm can be executed by the NPU.
[0125] In this way, the processing module continuously receives the angle between the face and the screen from the NPU, and then determines the movement state of the phone in combination with the parameters of each sensor of the phone. If the angle between the face and the screen continues to increase, and the phone sensor parameters indicate that the state of the phone is changing, the phone is triggered to rotate the screen. If it is detected that the state of the phone is changing, and the angle between the user's face and the screen has not changed significantly or the angle between the face and the screen is still getting smaller, it means that the user does not want the screen to rotate at this time (for example: when using the phone while lying on its side, the state of the phone changes, and the traditional screen rotation control strategy will trigger the screen rotation, but in fact the user does not want the screen to rotate at this time), then the control of the screen rotation is blocked.
[0126] The processing module can also analyze the changing pattern of the face angle, so as to notify the system in advance to perform intelligent rotation. Figure 1 At this time, we can trigger the screen rotation operation in advance based on the analysis of the angle change law. Compared with the traditional screen rotation, the screen needs to reach a certain angle before it starts to rotate. This strategy of predicting rotation in advance can give users a better experience.
[0127] After the control is completed, turn off the AON function, end the control of this screen rotation, and wait for the next wake-up trigger.
[0128] In the application embodiment, the use of the AON function brings the following advantages to screen rotation:
[0129] 1. Screen rotation is smarter: the screen is no longer rotated based on the phone's status, but is also combined with the user's usage status, making it more user-friendly.
[0130] 2. Faster screen rotation: By analyzing the changing trend of the angle between the face and the screen, the screen rotation control can be triggered in advance. Compared with the traditional solution that can only trigger the rotation after the phone status changes, it is faster and provides a better user experience.
[0131] 3. Save more power: Through the two-level control solution, compared with the traditional rotation solution, a large part of invalid screen rotation control can be filtered out. Since the screen rotation animation needs to be realized with the help of GPU, it consumes more power. By filtering out a large number of invalid controls, the power consumption of electronic devices can be saved.
[0132] The embodiment of the present application realizes secondary control of intelligent rotation by utilizing the characteristic of AON sensor that can detect human body without transmitting the captured target image, and realizes intelligent rotation of the screen according to user needs by utilizing the face detection and recognition capability of AON function in combination with the traditional method of reading and analyzing the sensor parameters of the mobile phone.
[0133] In the embodiment of the present application: 1. The facial information detected by the AON function (whether there is a human body, the angle between the face and the screen, the change trend of the angle, etc.) is used as the basis for controlling the intelligent rotation of the screen. 2. The entire intelligent rotation control process is divided into two levels, and the HE function of the AON sensor is used to determine whether to enter the second-level recognition, so as to filter out some invalid rotations, reduce the frequency of AON activation, and reduce power consumption.
[0134] In the embodiment of the present application, 1. In the screen rotation strategy, a face detection scheme based on the AON function is added. By continuously analyzing the changes in the face angle, when the changes in the face angle meet certain rules, the current state of the mobile phone is judged in combination with the mobile phone sensor to decide whether to rotate the screen. At the same time, according to the law of analyzing the angle change, the screen rotation can be triggered in advance to improve the response speed. 2. The control is divided into two levels. In the first level, the HE function of the AON sensor itself is used (the captured target image is not transmitted, and the power consumption is low). When a person is recognized and the sensor parameters show that the state of the mobile phone has changed, the AON function is enabled to perform intelligent rotation; in the second level, based on the detection of a person, the AON function is turned on for face recognition detection, and by continuously analyzing the changes in the face angle, the mobile phone sensor data is integrated to achieve the effect of intelligent rotation.
[0135] The intelligent screen rotation solution mentioned in the embodiment of the present application may be system-based, or the application itself may analyze the changes in the angle between the face and the screen to adjust the application itself, thereby bringing a better user experience.
[0136] Figure 8A schematic diagram of a display control process provided by an embodiment of the present application, such as Figure 8 As shown, when the rotation angle of the electronic device is 90 degrees, but the angle between the target object's face and the display module gradually increases, for example, the angle gradually changes from 0 degrees to 45 degrees and then to 90 degrees, the display state of the display module is converted from the first display state to the second display state, that is, the electronic device is converted from the portrait screen display to the landscape screen display, and the landscape screen display is switched before the angle changes to 90 degrees. For example, when the angle is 45, the portrait screen display is converted to the landscape screen display.
[0137] Fig. 9 Another schematic diagram of a display control process provided by an embodiment of the present application is as follows: Fig. 9 As shown, the rotation angle of the electronic device is 90 degrees, but the angle between the target object's face and the display module decreases successively, for example, the angle gradually changes from 90 degrees to 45 degrees and then to 0 degrees. In this case, the electronic device will maintain the first display state, that is, after the electronic device is rotated 90 degrees, since the angle between the target object's face and the display module is always decreasing, the electronic device will maintain the display of the first state.
[0138] Fig.10 A flow chart of another display control method provided in another embodiment of the present application is as follows: Fig.10 As shown, the method includes:
[0139] S1001: Whether the AON sensor detects a person.
[0140] If detected, execute S1002; if not detected, execute S1007.
[0141] S1002: A person is detected and the state of the electronic device changes.
[0142] S1003: The NPU in the pre-processing module recognizes and detects a face.
[0143] S1004, the pre-processing module calculates and analyzes the angle change between the face and the screen.
[0144] S1005. When the angle change satisfies a condition, control the display screen to rotate.
[0145] S1006: When the angle change does not satisfy the condition, control the display module not to rotate.
[0146] S1007: The state of the electronic device changes but no person is detected.
[0147] S1008. The process ends.
[0148] Based on the foregoing embodiments, an embodiment of the present application provides a display control device, which includes the units included and the modules included in the units, and can be implemented by a processing module in an electronic device; of course, it can also be implemented by a specific logic circuit.
[0149] Fig.11 A schematic diagram of the structure of a display control device provided in an embodiment of the present application is shown in FIG. Figure 6 As shown, the display control device 1100 includes:
[0150] An obtaining unit 1101 is used to obtain first information determined by a camera module and obtain a rotation angle of the electronic device;
[0151] The transmission unit 1102 is used to send second information to the pre-processing module when the first information indicates that there is a target object within the shooting range of the camera module and the rotation angle is greater than a first angle threshold; the second information is used to instruct the pre-processing module to turn on the normally-on AON function, and when the AON function is turned on, the pre-processing module determines the angle between the face of the target object and the display module based on the target image captured by the camera module;
[0152] The conversion unit 1103 is used to convert the display state of the display module from the first display state to the second display state when it is determined that the angle is greater than the second angle threshold or is continuously increasing, and the rotation angle is greater than the third angle threshold; the third angle threshold is greater than the first angle threshold.
[0153] In some embodiments, the conversion unit 1103 is also used to maintain the display state of the display module in the first display state when it is determined that the angle is less than or equal to the second angle threshold or the angle gradually decreases, and the rotation angle is greater than the third angle threshold.
[0154] In some embodiments, the transmission unit 1102 is further used to send third information to the pre-processing module; the third information is used to instruct the pre-processing module to turn off the AON function; when the AON function is turned off, the pre-processing module controls the camera module to stop capturing the target image.
[0155] In some embodiments, the display control device 1100 further includes: a timer unit, the timer unit being used to start a timer of a target duration; a conversion unit 1103 being used to, during the operation of the timer, determine that the angle is less than or equal to the second angle threshold, and the rotation angle is greater than the third angle threshold, convert the display state of the display module from the second display state to the first display state; a transmission unit 1102 being used to send third information to the pre-processing module;
[0156] The transmission unit 1102 is further configured to send the third information to the pre-processing module when it is determined during the operation of the timer that the included angle is greater than the second angle threshold and the rotation angle is greater than a third angle threshold;
[0157] The third information is used to instruct the pre-processing module to turn off the AON function; when the AON function is turned off, the pre-processing module controls the camera module to stop capturing the target image.
[0158] In some embodiments, the obtaining unit 1101 is further used to obtain the ambient light brightness detected by the light sensor;
[0159] The display control device 1100 further includes: a determination unit, configured to determine an image enhancement parameter based on the ambient light brightness information when the ambient light brightness is less than or equal to a brightness threshold;
[0160] The transmission unit 1102 is also used to send fourth information to the pre-processing module; the fourth information instructs the pre-processing module to use the image enhancement parameters to process the target image taken by the camera module, and determine the angle based on the processed image.
[0161] In some embodiments, the transmission unit 1102 is further configured to send second configuration information for identifying the target object to the camera module when the first information determined based on the first configuration information indicates that the target object exists within the shooting range of the camera module and the fifth information sent by the pre-processing module is received; the fifth information indicates that the target object does not exist in the camera module;
[0162] The obtaining unit 1101 is further configured to obtain the first information determined by the camera module based on the second configuration information.
[0163] In some embodiments, the obtaining unit 1101 is further configured to obtain facial feature information of a user using the electronic device;
[0164] The determining unit is further used to determine, based on the facial feature information, third configuration information to be sent to the camera module for identifying the face of the target object;
[0165] The transmission unit 1102 is further used to send the third configuration information to the pre-processing module; the third configuration information is used to instruct the pre-processing module to recognize the face of the target object based on the third configuration information.
[0166] The description of the above device embodiment is similar to the description of the above method embodiment, and has similar beneficial effects as the method embodiment. For technical details not disclosed in the device embodiment of the present application, please refer to the description of the method embodiment of the present application for understanding.
[0167] It should be noted that in the embodiments of the present application, if the above-mentioned display control method is implemented in the form of a software function module and sold or used as an independent product, it can also be stored in a computer storage medium. Based on this understanding, the technical solution of the embodiments of the present application is essentially or the part that contributes to the relevant technology can be embodied in the form of a software product, which is stored in a storage medium and includes a number of instructions for an electronic device to execute all or part of the methods described in each embodiment of the present application.
[0168] Fig.12 A hardware entity diagram of an electronic device provided in an embodiment of the present application, such as Fig.12 As shown, the hardware entity of the electronic device 1200 includes: a processing module 1201, a camera module 1202, a pre-processing module 1203 and a display module 1204; wherein,
[0169] The processing module 1201 is used to obtain the first information determined by the camera module 1202 and obtain the rotation angle of the electronic device;
[0170] The processing module 1201 is further configured to send second information to the pre-processing module 1203 when the first information indicates that there is a target object within the shooting range of the camera module 1202 and the rotation angle is greater than a first angle threshold; the second information is configured to instruct the pre-processing module 1203 to turn on the normally-on AON function, and when the AON function is turned on, the pre-processing module 1203 determines the angle between the face of the target object and the display module 1204 based on the target image captured by the camera module 1202;
[0171] The processing module 1201 is also used to convert the display state of the display module 1204 from the first display state to the second display state when it is determined that the angle is greater than the second angle threshold or is continuously increasing, and the rotation angle is greater than the third angle threshold; the third angle threshold is greater than the first angle threshold.
[0172] In some embodiments, the camera module 1202 may directly send the first information to the processing module 1201. In other embodiments, the camera module 1202 may send the first information to the processing module 1201 via the pre-processing module 1203.
[0173] An embodiment of the present application provides a computer storage medium, which stores one or more programs. The one or more programs can be executed by one or more processors to implement the steps of the display control method of any of the above embodiments.
[0174] It should be noted here that the description of the above computer storage medium and electronic device embodiments is similar to the description of the above method embodiments, and has similar beneficial effects as the method embodiments. For technical details not disclosed in the computer storage medium and electronic device embodiments of this application, please refer to the description of the method embodiments of this application for understanding.
[0175] The above-mentioned display control device, processing module or pre-processing module may include any one or more of the following integrations: Application Specific Integrated Circuit (ASIC), Digital Signal Processor (DSP), Digital Signal Processing Device (DSPD), Programmable Logic Device (PLD), Field Programmable Gate Array (FPGA), Central Processing Unit (CPU), Graphics Processing Unit, Embedded Neural Network Processor, Controller, Microcontroller, Microprocessor, Programmable Logic Device, Discrete Gate or Transistor Logic Device, Discrete Hardware Components. It is understandable that the electronic device that realizes the function of the above-mentioned processing module can also be other, and the embodiments of the present application are not specifically limited.
[0176] The above-mentioned computer storage medium / memory can be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), a magnetic random access memory (FRAM), a flash memory (Flash Memory), a magnetic surface memory, an optical disk, or a compact disc read-only memory (CD-ROM) and the like; it can also be various terminals including one or any combination of the above-mentioned memories, such as mobile phones, computers, tablet devices, personal digital assistants, etc.
[0177] It should be understood that the "one embodiment" or "an embodiment" or "an embodiment of the present application" or "the aforementioned embodiment" or "some implementations" or "some embodiments" mentioned throughout the specification means that the specific features, structures or characteristics related to the embodiment are included in at least one embodiment of the present application. Therefore, "in one embodiment" or "in an embodiment" or "an embodiment of the present application" or "the aforementioned embodiment" or "some implementations" or "some embodiments" appearing throughout the specification do not necessarily refer to the same embodiment. In addition, these specific features, structures or characteristics can be combined in one or more embodiments in any suitable manner. It should be understood that in various embodiments of the present application, the size of the sequence number of the above-mentioned processes does not mean the order of execution, and the execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiment of the present application. The above-mentioned sequence numbers of the embodiments of the present application are only for description and do not represent the advantages and disadvantages of the embodiments.
[0178] Unless otherwise specified, an electronic device performs any step in the embodiments of the present application, and the processor of the electronic device may perform the step. Unless otherwise specified, the embodiments of the present application do not limit the order in which the electronic device performs the following steps. In addition, the methods used to process data in different embodiments may be the same method or different methods. It should also be noted that any step in the embodiments of the present application can be independently executed by the electronic device, that is, when the electronic device executes any step in the above embodiments, it may not rely on the execution of other steps.
[0179] In the description of the present application, it should be understood that the terms "center", "longitudinal", "lateral", "length", "width", "thickness", "up", "down", "front", "back", "left", "right", "vertical", "horizontal", "top", "bottom", "inside", "outside", "clockwise", "counterclockwise" and the like indicate positions or positional relationships based on the positions or positional relationships shown in the accompanying drawings, and are only for the convenience of describing the present application and simplifying the description, rather than indicating or implying that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore cannot be understood as a limitation on the present application. In addition, the terms "first" and "second" are only used for descriptive purposes, and cannot be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Therefore, the features defined as "first" and "second" may explicitly or implicitly include one or more of the features. In the description of the present application, the meaning of "multiple" is two or more, unless otherwise clearly and specifically defined.
[0180] In the several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. The device embodiments described above are only schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation, such as: multiple units or components can be combined, or can be integrated into another system, or some features can be ignored or not executed. In addition, the coupling, direct coupling, or communication connection between the components shown or discussed can be through some interfaces, and the indirect coupling or communication connection of the devices or units can be electrical, mechanical or other forms.
[0181] The units described above as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units; they may be located in one place or distributed on multiple network units; some or all of the units may be selected according to actual needs to achieve the purpose of the present embodiment.
[0182] In addition, all functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may be a separate unit, or two or more units may be integrated into one unit; the above-mentioned integrated units may be implemented in the form of hardware or in the form of hardware plus software functional units.
[0183] The methods disclosed in several method embodiments provided in this application can be arbitrarily combined without conflict to obtain new method embodiments.
[0184] The features disclosed in several product embodiments provided in this application can be arbitrarily combined without conflict to obtain new product embodiments.
[0185] The features disclosed in several method or device embodiments provided in this application can be arbitrarily combined without conflict to obtain new method embodiments or device embodiments.
[0186] Those skilled in the art can understand that all or part of the steps of implementing the above method embodiments can be completed by hardware related to program instructions, and the aforementioned program can be stored in a computer storage medium. When the program is executed, it executes the steps of the above method embodiments; and the aforementioned storage medium includes: mobile storage devices, read-only memories (ROM), magnetic disks or optical disks, and other media that can store program codes.
[0187] Alternatively, if the above-mentioned integrated unit of the present application is implemented in the form of a software function module and sold or used as an independent product, it can also be stored in a computer storage medium. Based on such an understanding, the technical solution of the embodiment of the present application can be essentially or partly embodied in the form of a software product that contributes to the relevant technology. The computer software product is stored in a storage medium, including several instructions to enable a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the methods described in each embodiment of the present application. The aforementioned storage medium includes: various media that can store program codes, such as mobile storage devices, ROMs, magnetic disks, or optical disks.
[0188] In the embodiments of the present application, the descriptions of the same steps and the same contents in different embodiments can refer to each other. In the embodiments of the present application, the term "and" does not affect the order of the steps. For example, the electronic device executes A and executes B, which may be the electronic device executing A first and then executing B, or the electronic device executing B first and then executing A, or the electronic device executing A and executing B at the same time.
[0189] It is worth noting that the drawings in the embodiments of the present application are only for illustrating the schematic positions of various components on the electronic device and do not represent the actual positions in the electronic device. The actual positions of various components or areas may be changed or offset accordingly according to actual conditions (for example, the structure of the electronic device), and the proportions of different parts of the electronic device in the drawings do not represent the actual proportions.
[0190] As used in the embodiments of the present application and the appended claims, the singular forms "a," "an," "said," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise.
[0191] It should be understood that the term "and / or" used in this article is only a description of the association relationship of associated objects, indicating that there can be three relationships. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. In addition, the character " / " in this article generally indicates that the associated objects before and after are in an "or" relationship.
[0192] It should be noted that in each embodiment involved in the present application, all steps may be executed or part of the steps may be executed as long as a complete technical solution can be formed.
[0193] The above is only an implementation method of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art who is familiar with the present technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.
Claims
1. A display control method, characterized in that: include: Obtaining first information determined by the camera module, and obtaining a rotation angle of the electronic device; The rotation angle is determined based on the angle between the length direction or width direction of the electronic device and the vertical direction; the rotation angle represents the change angle of the electronic device during or after the rotation process compared to the angle before the rotation; When the first information indicates that there is a target object within the shooting range of the camera module and the rotation angle is greater than the first angle threshold, second information is sent to the front processing module; the second information is used to instruct the front processing module to turn on the normally-on AON function. When the AON function is turned on, the front processing module determines the angle between the face of the target object and the display module based on the target image captured by the camera module; When it is determined that the angle is greater than a second angle threshold or is continuously increasing, and the rotation angle is greater than a third angle threshold, converting the display state of the display module from the first display state to the second display state; the third angle threshold is greater than the first angle threshold; the first display state and the second display state are respectively one of a portrait display state and a landscape display state, and the first display state is different from the second display state; The method further includes: when it is determined that the included angle is less than or equal to the second angle threshold or the included angle gradually decreases, and the rotation angle is greater than the third angle threshold, maintaining the display state of the display module in the first display state.
2. The method according to claim 1, characterized in that After converting the display state of the display module from the first display state to the second display state, or after maintaining the display state of the display module in the first display state, the method further includes: Sending third information to the pre-processing module; the third information is used to instruct the pre-processing module to turn off the AON function; when the AON function is turned off, the pre-processing module controls the camera module to stop capturing the target image.
3. The method according to claim 1, characterized in that After converting the display state of the display module from the first display state to the second display state, the method further includes: Start the timer for the target duration; During the operation of the timer, if it is determined that the included angle is less than or equal to the second angle threshold and the rotation angle is greater than the third angle threshold, converting the display state of the display module from the second display state to the first display state, and sending third information to the pre-processing module; During the operation of the timer, if it is determined that the included angle is greater than the second angle threshold and the rotation angle is greater than a third angle threshold, sending the third information to the pre-processing module; The third information is used to instruct the pre-processing module to turn off the AON function; when the AON function is turned off, the pre-processing module controls the camera module to stop capturing the target image.
4. The method according to claim 1 or 2, characterized in that: The method further comprises: Get the ambient light brightness detected by the light sensor; When the ambient light brightness is less than or equal to a brightness threshold, determining an image enhancement parameter based on the ambient light brightness information; Sending fourth information to the pre-processing module; the fourth information instructs the pre-processing module to use the image enhancement parameters to process the target image taken by the camera module, and determine the angle based on the processed image.
5. The method according to claim 1 or 2, characterized in that: Before obtaining the first information determined by the camera module, the method further includes: when the first information determined based on the first configuration information indicates that there is a target object within the shooting range of the camera module, and when fifth information sent by the pre-processing module is received, sending second configuration information for identifying the target object to the camera module; the fifth information indicates that there is no target object in the camera module; The obtaining of the first information determined by the camera module includes: obtaining the first information determined by the camera module based on the second configuration information.
6. The method according to claim 1 or 2, characterized in that: Before obtaining the first information determined by the camera module, the method further includes: Obtaining facial feature information of a user using the electronic device; Based on the facial feature information, determining third configuration information for identifying the face of the target object to be sent to the camera module; The third configuration information is sent to the pre-processing module; the third configuration information is used to instruct the pre-processing module to recognize the face of the target object based on the third configuration information.
7. A display control device, characterized in that: include: An obtaining unit, used to obtain the first information determined by the camera module and obtain the rotation angle of the electronic device; The rotation angle is determined based on the angle between the length direction or width direction of the electronic device and the vertical direction; the rotation angle represents the change angle of the electronic device during or after the rotation process compared to the angle before the rotation; a transmission unit, configured to send second information to a pre-processing module when the first information indicates that there is a target object within the shooting range of the camera module and the rotation angle is greater than a first angle threshold; the second information is used to instruct the pre-processing module to turn on a normally-on AON function, and when the AON function is turned on, the pre-processing module determines an angle between the face of the target object and the display module based on the target image captured by the camera module; a conversion unit, configured to convert the display state of the display module from a first display state to a second display state when it is determined that the angle is greater than a second angle threshold or is continuously increasing, and the rotation angle is greater than a third angle threshold; the third angle threshold is greater than the first angle threshold; the first display state and the second display state are respectively one of a portrait display state and a landscape display state, and the first display state is different from the second display state; The conversion unit is further configured to maintain the display state of the display module in the first display state when it is determined that the angle is less than or equal to the second angle threshold or the angle is gradually decreasing and the rotation angle is greater than the third angle threshold.
8. An electronic device, characterized in that: include: processing module, camera module, pre-processing module and display module; wherein, The processing module is used to obtain the first information determined by the camera module, and to obtain a rotation angle of the electronic device; the rotation angle is determined based on an angle between a length direction or a width direction of the electronic device and a vertical direction; the rotation angle represents a change in angle of the electronic device during or after the rotation process compared to the angle before the rotation of the electronic device; The processing module is further configured to send second information to the pre-processing module when the first information indicates that there is a target object within the shooting range of the camera module and the rotation angle is greater than a first angle threshold; the second information is used to instruct the pre-processing module to turn on the normally-on AON function, and when the AON function is turned on, the pre-processing module determines the angle between the face of the target object and the display module based on the target image captured by the camera module; The processing module is further configured to convert the display state of the display module from the first display state to the second display state when it is determined that the included angle is greater than a second angle threshold or is continuously increasing, and the rotation angle is greater than a third angle threshold; the third angle threshold is greater than the first angle threshold; the first display state and the second display state are respectively one of a portrait display state and a landscape display state, and the first display state is different from the second display state; The processing module is further configured to maintain the display state of the display module in the first display state when it is determined that the included angle is less than or equal to the second angle threshold or the included angle is gradually decreasing and the rotation angle is greater than the third angle threshold.
9. A computer storage medium, characterized in that The computer storage medium stores one or more programs, and the one or more programs can be executed by one or more processing modules to implement the steps in any one of the methods of claims 1 to 6.
Citation Information
Patent Citations
Display picture presenting method and terminal
CN103376893A
Face recognition page display control method and mobile terminal
CN103412647A