Smart screen, method for automatically switching display frame rate of smart screen, and storage medium
By determining whether there are users in front of the smart screen and reducing the frame rate, the problem that the smart screen cannot automatically switch the display frame rate in specific scenarios is solved, achieving the reduction of power consumption and the guarantee of user experience.
Patent Information
- Application Number
- CN202011137262.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2020-10-22
- Publication Date
- 2024-12-03
- Estimated Expiration
- 2040-10-22
AI Technical Summary
The smart screen cannot automatically switch the display frame rate in a specific scenario, resulting in unnecessary power consumption increase.
By acquiring an image within the set area of the smart screen facing, the grayscale gain value of the image is determined to determine whether a user exists, and the display frame rate is reduced when the access device is in the user's attention state.
It realizes the power consumption of smart screens in specific scenarios, avoids waste of electricity, and ensures user experience.
Smart Images

Figure CN112351230B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of smart screens, and in particular to a method for automatically switching a display frame rate of a smart screen, a computer-readable storage medium, and a smart screen. Background Art
[0002] With the development of smart devices, smart screens have appeared in almost every smart home. In today's era of energy conservation and emission reduction, the most power-consuming smart screen is when working at a high frame rate. As the screen is getting bigger and bigger, the previous high-definition film source is 1080P, and now it has developed into a 4K screen, and the resolution of the screen itself has become higher. There are users in front of the smart screen, but the users are using other smart devices and are not watching the smart screen; or there are no users in front of the smart screen, such as when playing music and the user is not in front of the TV screen. In the face of these scenarios, the smart screen cannot automatically switch to the processing mode of low display frame rate, which increases the unnecessary power consumption of the smart screen.
[0003] Therefore, the existing technology still needs to be improved. Summary of the invention
[0004] In view of this, a method for automatically switching the display frame rate of a smart screen is provided to solve the problem that the smart screen cannot automatically switch the display frame rate in specific scenarios.
[0005] The present application embodiment provides a method for automatically switching the display frame rate of a smart screen, characterized in that the method includes:
[0006] Acquire an image within a set area that the smart screen is facing;
[0007] Judging whether there is a user in front of the smart screen according to a change in the grayscale gain value of the image acquired by the smart screen;
[0008] When it is determined that there is a user in front of the smart screen, obtaining an access device in the wireless local area network where the smart screen is located;
[0009] Determining whether the access device is in a user attention state;
[0010] When there is an access device in the user's attention state, the frame rate of the smart screen display is reduced.
[0011] In one embodiment, the step of judging whether there is a user in front of the smart screen according to the change of the gray gain value of the image acquired by the smart screen includes:
[0012] At first preset time intervals, an image within a set area that the smart screen is facing is acquired, and a grayscale gain value of the image is calculated;
[0013] Calculating a difference between two adjacent grayscale gain values;
[0014] When the difference is greater than a first preset threshold, it is determined that there is a user in front of the smart screen.
[0015] In one embodiment, the step of judging whether there is a user in front of the smart screen according to the change of the gray gain value of the image acquired by the smart screen includes:
[0016] At every second preset time period, an image within a set area that the smart screen is facing is acquired, and a grayscale gain value of the image is calculated;
[0017] Calculating a difference between two adjacent grayscale gain values;
[0018] When multiple consecutive difference values are greater than a second preset threshold, it is determined that there is a user in front of the smart screen.
[0019] In one embodiment, the step of calculating the grayscale gain value of the image includes:
[0020] Capturing images within the set area through the front camera of the smart screen;
[0021] Respectively obtain a red sub-pixel gain value, a green sub-pixel gain value, and a blue sub-pixel gain value of the image within the set area;
[0022] Calculating an average value of the acquired red sub-pixel gain value, the green sub-pixel gain value, and the blue sub-pixel gain value as a grayscale gain value of the corresponding pixel;
[0023] The average value of the grayscale gain values of all pixels within the set area is calculated as the grayscale gain value of the image.
[0024] In one embodiment, the step of determining whether the access device is in a user attention state includes:
[0025] Every third preset time period, obtaining an average acceleration of the access device within a preset unit time interval;
[0026] Calculating the difference between two adjacent average accelerations;
[0027] When the difference is greater than a third preset threshold, it is determined that the access device is in a user attention state.
[0028] In one embodiment, the average acceleration is an average value of accelerations within the preset unit time interval, wherein the acceleration is obtained by acquiring the acceleration of the acceleration sensor of the access device in the vertical direction.
[0029] In one embodiment, after the step of judging whether there is a user in front of the smart screen according to the change of the gray gain value of the image obtained in front of the smart screen, the step further includes:
[0030] When it is determined that there is no user in front of the smart screen, the frame rate displayed by the smart screen is reduced.
[0031] In one embodiment, reducing the frame rate displayed by the smart screen includes:
[0032] Obtain the maximum value of the current display frame rate of the smart screen;
[0033] The display frame rate of the smart screen is adjusted to one quarter of the maximum value.
[0034] In order to achieve the above-mentioned purpose, a computer-readable storage medium is also provided, on which a method program for automatically switching the display frame rate of an intelligent screen is stored. When the method program for automatically switching the display frame rate of an intelligent screen is executed by a processor, any of the above-mentioned methods is implemented.
[0035] In order to achieve the above-mentioned purpose, a smart screen is also provided, including a memory, a processor, and a method program for automatically switching the display frame rate of the smart screen stored in the memory and run on the processor. When the processor executes the method program for automatically switching the display frame rate of the smart screen, any of the above-mentioned methods is implemented.
[0036] One or more technical solutions provided in the embodiments of the present application have at least the following technical effects or advantages: obtaining an image within the set area to which the smart screen is facing; providing data support for determining whether there is a user in front of the smart screen. Determine whether there is a user in front of the smart screen based on the change in the grayscale gain value of the image obtained by the smart screen; obtain the grayscale gain value of the image in front of the smart screen in real time to determine whether there is a user in front of the smart screen, thereby ensuring the correctness and real-time nature of the judgment of whether there is a user in front of the smart screen. When it is determined that there is a user in front of the smart screen, obtain an access device in the wireless local area network where the smart screen is located; determine whether the access device is in a user-focused state; determining whether the access device is in a user-focused state or a user-using state is one of the judgment conditions for switching the display frame rate of the smart screen. When there is an access device in a user-focused state, the frame rate displayed by the smart screen is reduced. When the above conditions are met, the frame rate displayed by the smart screen is reduced, thereby reducing unnecessary power consumption of the smart screen and avoiding energy waste of the smart screen. BRIEF DESCRIPTION OF THE DRAWINGS
[0037] Figure 1A schematic diagram of the hardware architecture of the method for automatically switching the display frame rate of a smart screen involved in an embodiment of the present application;
[0038] Figure 2 This is a flow chart of the first embodiment of the method for automatically switching the display frame rate of the smart screen of the present application;
[0039] Figure 3 This is a schematic diagram of the specific flow of step S120 in the first embodiment of the method for automatically switching the display frame rate of the smart screen of this application;
[0040] Figure 4 This is another specific flow chart of step S120 in the first embodiment of the method for automatically switching the display frame rate of the smart screen of the present application;
[0041] Figure 5 This is a specific flow chart of step S121 of the method for automatically switching the display frame rate of the smart screen of this application;
[0042] Figure 6 This is a schematic diagram of the specific flow of step S140 in the first embodiment of the method for automatically switching the display frame rate of the smart screen of this application;
[0043] Figure 7 This is a flow chart of a second embodiment of the method for automatically switching the display frame rate of a smart screen of the present application;
[0044] Figure 8 This is a schematic diagram of the specific flow of step S150 in the first embodiment of the method for automatically switching the display frame rate of the smart screen of this application. DETAILED DESCRIPTION
[0045] It should be understood that the specific embodiments described herein are only used to explain the present invention, and are not used to limit the present invention.
[0046] The main solution of the embodiment of the present invention is: obtaining an image within the set area that the smart screen is facing; judging whether there is a user in front of the smart screen according to the change of the grayscale gain value of the image obtained by the smart screen; when it is determined that there is a user in front of the smart screen, obtaining an access device in the wireless local area network where the smart screen is located; judging whether the access device is in the user's attention state; when there is an access device in the user's attention state, reducing the frame rate displayed by the smart screen. The problem that the smart screen cannot automatically switch the display frame rate in specific scenarios is solved. The technical effect of reducing the power consumption of the smart screen in specific scenarios is achieved.
[0047] In order to better understand the above technical solution, the above technical solution will be described in detail below in conjunction with the accompanying drawings and specific implementation methods.
[0048] This application relates to a smart screen 01 including Figure 1 Shown: at least one camera 13, a processor 12, and a memory 11.
[0049] The camera 13 has an image gain function and is used to capture the image in front of the smart screen.
[0050] The processor 12 may be an integrated circuit chip with signal processing capabilities. In the implementation process, each step of the above method can be completed by the hardware integrated logic circuit in the processor 12 or the instruction in the form of software. The above processor 12 can be a general processor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components. The methods, steps and logic block diagrams disclosed in the embodiments of the present invention can be implemented or executed. The general processor can be a microprocessor or the processor can also be any conventional processor. The software module can be located in a mature storage medium in the field such as a random access memory, a flash memory, a read-only memory, a programmable read-only memory or an electrically erasable programmable memory, a register, etc. The storage medium is located in the memory 11, and the processor 12 reads the information in the memory 11 and completes the steps of the above method in combination with its hardware.
[0051] It can be understood that the memory 11 in the embodiment of the present invention can be a volatile memory or a non-volatile memory, or can include both volatile and non-volatile memories. Among them, the non-volatile memory can be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory can be a random access memory (RAM), which is used as an external cache. By way of example but not limitation, many forms of RAM are available, such as static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDRSDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link dynamic random access memory (SLDRAM) and direct RAM bus random access memory (DRRAM). The memory 11 of the system and method described in the embodiments of the present invention is intended to include, but is not limited to, these and any other suitable types of memory.
[0052] Reference Figure 2 , Figure 2 This is the first embodiment of the method for automatically switching the display frame rate of the smart screen of the present application, and the method comprises the following steps:
[0053] Step S110: Acquire an image within a set area that the smart screen is facing.
[0054] The smart screen can be the display screen of a smart TV, or it can be the mirrors and glass commonly found in smart homes, which are expected to become new carriers of smart screens in the future and are not limited to the display screens of smart TVs.
[0055] The set area range can be an image pre-set in front of the smart screen for determining whether the user is present. The set area range can be an image of the largest range in front of the smart screen obtained by wide-angle shooting; it can also be dynamically adjusted according to the user's daily habits of watching smart TVs, such as the user is used to watching movies on the sofa, or sitting on a chair next to the sofa, to more accurately determine whether the user is in front of the smart screen; the set area can also be adjusted according to the user's current behavior.
[0056] Step S120: Determine whether there is a user in front of the smart screen according to the change of the grayscale gain value of the image acquired by the smart screen.
[0057] Grayscale images are images with only one sampled color per pixel. Such images are usually displayed as grayscale from the darkest black to the brightest white. Grayscale images are different from black and white images. In the field of computer graphics, black and white images only have two colors, black and white, while grayscale images have many levels of color depth between black and white. Grayscale uses black tones to represent objects, that is, black is used as the base color, and different saturations of black are used to display images. Each grayscale object has a brightness value from 0% (white) to 100% (black).
[0058] Grayscale means no color, that is, in a color image, all RGB color components are equal. If the three RGB quantities are the same, for example: RGB (100, 100, 100) means the grayscale value is 100, and RGB (50, 50, 50) means the grayscale value is 50.
[0059] The function of gain is to amplify the image signal and enhance the brightness of the image.
[0060] Whether there is a user in front of the smart screen will affect the change of the grayscale gain value of the image in front of the smart screen. When there is a user in front of the smart screen, the grayscale gain of the image in front of the smart screen is relatively dark; when there is no user in front of the smart screen, the grayscale gain of the image in front of the smart screen is relatively bright. Therefore, it can be judged whether there is a user in front of the smart screen based on the change of the grayscale gain value of the image in front of the smart screen.
[0061] Step S130: When it is determined that there is a user in front of the smart screen, an access device in the wireless local area network where the smart screen is located is obtained.
[0062] The so-called wireless network refers to a network that can interconnect various communication devices without wiring. Wireless network technology covers a wide range, including global voice and data networks that allow users to establish long-distance wireless connections, as well as infrared and radio frequency technologies that are optimized for short-distance wireless connections. The wireless network in this embodiment can be WIFI, 4G / 5G, Bluetooth, etc.
[0063] The wireless network where the smart screen is located can be a short-range wireless connection. The smart screen and the access device are in the same wireless network. Whether the smart screen is viewed by the user is related to whether the user's access device is in use.
[0064] The access device may be a terminal that has a function of determining whether a user is paying attention, such as a smart phone, a tablet computer, a smart watch, etc.
[0065] Step S140: Determine whether the access device is in a user attention state.
[0066] Whether the access device is in the user attention state may be determined by movement of the access device or data transmission status of the access device.
[0067] Step S150: When there is an access device in the user's attention state, the frame rate of the smart screen display is reduced.
[0068] The frame rate of screen display is the frequency (rate) at which bitmap images in frames appear continuously on the display.
[0069] When the frame rate displayed on the smart screen is high, the corresponding power consumption of the smart screen is high; when the frame rate displayed on the smart screen is low, the corresponding power consumption of the smart screen is low. When there is a user watching the smart screen, but the access device is in the user's attention state, it means that the smart screen is not being watched by the user, and the frame rate displayed on the smart screen is reduced. Because the smart screen is not being watched by the user, it will not affect the user's viewing experience. At the same time, the frame rate displayed on the smart screen is reduced to reduce unnecessary power consumption.
[0070] The beneficial effects existing in the above embodiments are as follows: obtaining an image within the set area that the smart screen is facing; providing data support for determining whether there is a user within the set area that the smart screen is facing. Determine whether there is a user in front of the smart screen according to the change in the grayscale gain value of the image obtained by the smart screen; obtain the grayscale gain value of the image in front of the smart screen in real time to determine whether there is a user in front of the smart screen, thereby ensuring the correctness and real-time nature of the judgment of whether there is a user in front of the smart screen. When it is determined that there is a user in front of the smart screen, obtain an access device in the wireless local area network where the smart screen is located; determine whether the access device is in a user-focused state; determining whether the access device is in a user-focused state or a user-using state is one of the judgment conditions for switching the display frame rate of the smart screen. When there is an access device in a user-focused state, the frame rate of the smart screen display is reduced. When the above conditions are met, the frame rate of the smart screen display is reduced, thereby reducing unnecessary power consumption of the smart screen and avoiding energy waste of the smart screen.
[0071] Reference Figure 3 , Figure 3 This is a specific flow chart of step S120 of the first embodiment in the method for automatically switching the display frame rate of the smart screen of the present application. The step of judging whether there is a user in front of the smart screen according to the change of the gray gain value of the image obtained by the smart screen includes:
[0072] Step S121: acquiring an image within a set area that the smart screen is facing at intervals of a first preset time, and calculating a grayscale gain value of the image;
[0073] The first preset time length may be 100 ms, or may be other preset time lengths, and is not limited to 100 ms.
[0074] Step S122: Calculate the difference between two adjacent grayscale gain values;
[0075] Obtain the grayscale gain value of the image in front of the smart screen at the current moment and the grayscale gain value of the image in front of the smart screen after a preset time period; calculate the grayscale gain value of the image in front of the smart screen separated by a preset time period through a preset calculation rule, and calculate the difference between the two grayscale gain values.
[0076] Step S123: When the difference is greater than a first preset threshold, it is determined that there is a user in front of the smart screen.
[0077] When the calculated difference is greater than the first preset threshold, it is determined that there is a user in front of the smart screen.
[0078] The first preset threshold may be 10, or may be other preset thresholds, which are not limited here.
[0079] The beneficial effects of the above embodiments are as follows: the step of determining whether there is a user in front of the smart screen is a prerequisite for the smart screen to automatically switch the display frame rate. Determining whether there is a user in front of the smart screen ensures that the user's viewing experience is not affected during the process of automatically switching the display frame rate of the smart screen.
[0080] Reference Figure 4 , Figure 4 This is another specific flow chart of step S120 of the first embodiment in the method for automatically switching the display frame rate of the smart screen of the present application, wherein the step of judging whether there is a user in front of the smart screen according to the change of the gray gain value of the image acquired by the smart screen comprises:
[0081] Step S121': acquiring an image within a set area that the smart screen is facing at intervals of a second preset time, and calculating a grayscale gain value of the image;
[0082] The second preset time length may be 100 ms, or may be other preset time lengths, and is not limited to 100 ms.
[0083] Step S122': Calculate the difference between two adjacent grayscale gain values;
[0084] Obtain the grayscale gain value of the image in front of the smart screen at the current moment and the grayscale gain value of the image in front of the smart screen after a preset time period; calculate the grayscale gain value of the image in front of the smart screen separated by a preset time period through a preset calculation rule, and calculate the difference between the two grayscale gain values.
[0085] Step S123': When a plurality of consecutive difference values are greater than a second preset threshold, it is determined that there is a user in front of the smart screen.
[0086] The second preset threshold may be 10, or may be other preset thresholds, which are not limited here.
[0087] Whether there is a user in front of the smart screen can be determined by judging whether multiple difference values are greater than a second preset threshold.
[0088] The beneficial effect of the above embodiment is that the judgment of whether there is a user in front of the smart screen is more reliable by judging multiple difference values.
[0089] Reference Figure 5 , Figure 5 This is a specific flow chart of step S121 in the method for automatically switching the display frame rate of the smart screen of this application. The step of calculating the grayscale gain value of the image includes:
[0090] Step S1211: Capture images within the set area through the front camera of the smart screen.
[0091] The front camera of the smart screen is a video input device embedded in the smart screen. The smart screen camera in this application has an image gain function. It can also be obtained by other means.
[0092] Step S1212: respectively obtaining a red sub-pixel gain value, a green sub-pixel gain value, and a blue sub-pixel gain value of the image within the set area.
[0093] Each pixel in the image is represented by three components: R (red), G (green), and B (blue).
[0094] Frame_Rgain(x1)=140 means that the red sub-pixel gain at position x1 of the image in front of the smart screen is 140.
[0095] Frame_Ggain(x1)=140 means that the green sub-pixel gain at position x1 of the image in front of the smart screen is 140.
[0096] Frame_Bgain(x1)=140 means that the blue sub-pixel gain at position x1 of the image in front of the smart screen is 140.
[0097] Frame_Rgain(x2)=150 means that the red sub-pixel gain at position x2 of the image in front of the smart screen is 150.
[0098] Frame_Ggain(x2)=150 means that the green sub-pixel gain at position x2 of the image in front of the smart screen is 150.
[0099] Frame_Bgain(x2)=150 means that the blue sub-pixel gain at position x2 of the image in front of the smart screen is 150.
[0100] The red sub-pixel gain value, green sub-pixel gain value and blue sub-pixel gain value of pixel x1 and pixel x2 are illustrated here as examples. In this embodiment, the red sub-pixel gain value, green sub-pixel gain value and blue sub-pixel gain value of all pixels in a set area are obtained.
[0101] Step S1213: Calculate the average value of the acquired red sub-pixel gain value, the green sub-pixel gain value, and the blue sub-pixel gain value as the grayscale gain value of the corresponding pixel.
[0102] Frame_Graygain(x1)=(Frame_Rgain(x1)+Frame_Ggain(x1)+Frame_Bgain(x1)) / 3=140 means that the gray gain value of the x1 pixel is calculated to be 140;
[0103] Frame_Graygain(x1)=(Frame_Rgain(x1)+Frame_Ggain(x1)+Frame_Bgain(x1)) / 3=150 means that the gray gain value of the x2 pixel is calculated to be 150.
[0104] In this application, the average method is used to obtain the grayscale gain values of the x1 and x2 pixels, and the floating-point algorithm, integer method and shift method can also be used to calculate the grayscale gain values.
[0105] The floating point arithmetic calculation formula is as follows:
[0106] Frame_Graygain(x)=
[0107] Frame_Rgain(x)×0.299+Frame_Ggain(x)×0.587+Frame_Bgain(x)×0.114;
[0108] The integer method calculation formula is as follows:
[0109] Frame_Graygain(x)=
[0110] (Frame_Rgain(x)×299+Frame_Ggain(x)×587+Frame_Bgain(x)×114+500) / 1000;
[0111] The calculation formula of the shift method is as follows:
[0112] Frame_Graygain(x)=
[0113] (Frame_Rgain(x)×38+Frame_Ggain(x)×75+Frame_Bgain(x)×15)>>7 (the calculation result uses 7-bit precision).
[0114] Step S1214: Calculate the average value of the grayscale gain values of all pixels within the set area as the grayscale gain value of the image.
[0115] Ave_Frame_Graygain(x)=(Frame_Graygain(x1)+Frame_Graygain(x2)) / 2
[0116] =(140+150) / 2=145 means that by calculating the average of the grayscale gain values of the x1 and x2 pixels, the grayscale gain value of the image in front of the smart screen is obtained as 145.
[0117] Here, the grayscale gain values of two pixels are used as an example. In the present application, the average value of the grayscale gain values of all pixels within a set area is calculated as the grayscale gain value of the image.
[0118] The beneficial effects of the above embodiments are as follows: This embodiment provides a specific method for calculating the grayscale value of an image, which ensures the authenticity and correctness of the data and can more accurately determine whether there is a user in front of the smart screen.
[0119] Reference Figure 6 , Figure 6 This is a specific flow chart of step S140 of the first embodiment in the method for automatically switching the display frame rate of the smart screen of this application. The step of determining whether the access device is in the user's attention state includes:
[0120] Step S141: every third preset time period, obtaining an average acceleration of the access device within a preset unit time interval.
[0121] Obtain the acceleration value a of the access device at the start time Ta-begin and the end time Ta-end of the preset unit time interval; the preset unit time interval can be 50s or other time interval lengths, not limited to the above preset unit time interval.
[0122] Slave_Acc_Dev_Y(Ta-begin)=80 means that the acceleration value of the access device at the start time Ta-begin is 80.
[0123] Slave_Acc_Dev_Y(Ta-end)=80 means that the acceleration value of the access device at the end time Ta-end is 80.
[0124] Ave_Acc_Dev_Y(Ta)
[0125] =(Slave_Acc_Dev_Y(Ta-begin)+Slave_Acc_Dev_Y(Ta-end)) / 2=80 means that the average acceleration value a within the unit time interval is 80.
[0126] After a third preset time, another average acceleration value b is obtained. The preset time may be 50 seconds.
[0127] It may also be other preset time, and is not limited thereto.
[0128] Snd_Slave_Acc_Dev_Y(Tb-begin)=80 indicates that the acceleration value of the access device at the start time Tb-begin is 80.
[0129] Snd_Slave_Acc_Dev_Y(Tb-end)=200 indicates that the acceleration value of the access device at the end time Tb-end is 200.
[0130] Ave_Acc_Dev_Y(Tb)
[0131] =(Snd_Slave_Acc_Dev_Y(Tb-begin)+Snd_Slave_Acc_Dev_Y(Tb-end)) / 2=140 means that the average acceleration value b within the unit time interval is 140.
[0132] Step S142: Calculate the difference between two adjacent average accelerations.
[0133] Calculate the difference between the average accelerations of two adjacent preset time periods.
[0134] |Ave_Acc_Dev_Y(Ta)-Ave_Acc_Dev_Y(Tb)|=60 means that the difference between two adjacent accelerations is 60.
[0135] Step S143: When the difference is greater than a third preset threshold, it is determined that the access device is in a user attention state.
[0136] The third preset threshold is 10, and may also be other third preset thresholds, but is not limited thereto.
[0137] The step of determining whether the access device is in use may also be to determine whether the access device is in use by dynamically changing the network data of the access device. For example, the network data at the current moment and the network data after a preset time are obtained, and if the network data change meets a preset threshold, it is determined that the access device is in use.
[0138] The beneficial effects of the above embodiments are as follows: a specific calculation method for determining the use status of an access device is provided, reliable data support is provided, and whether the access device is in use can be determined more accurately.
[0139] In one of the embodiments, the average acceleration is an average value of each acceleration within the preset unit time interval, wherein the acceleration is obtained by acquiring the acceleration of the acceleration sensor of the access device in the vertical direction.
[0140] An accelerometer is a sensor that can measure acceleration. It is usually composed of a mass block, a damper, an elastic element, a sensitive element, and an adaptive circuit. During the acceleration process, the sensor measures the inertial force on the mass block and uses Newton's second law to obtain the acceleration value. Depending on the different sensitive elements of the sensor, common accelerometers include capacitive, inductive, strain gauge, piezoresistive, and piezoelectric.
[0141] The accelerometer can measure the acceleration values in three directions, X, Y, and Z. The value in the X direction represents the horizontal movement of the phone, the value in the Y direction represents the vertical movement of the phone, and the value in the Z direction represents the vertical direction of the phone in space. The direction of the sky is positive, and the direction of the earth is negative. The relevant acceleration values are then transmitted to the smart screen, and the changes in their size are judged to determine whether the access device is being used by the user.
[0142] In this embodiment, the current value of the vertical direction (Y direction) of the acceleration sensor of the access device is obtained. The acceleration change of the access device can also be further determined by obtaining the current value of the horizontal direction (X direction) and the vertical direction (Z direction) of the acceleration sensor or a combination thereof.
[0143] The beneficial effects of the above embodiments are as follows: judging whether the access device is used by the user by using the acceleration sensor of the access device, ensuring the correct judgment of whether the access device is used by the user, which is also a necessary judgment condition for specific scenarios.
[0144] Reference Figure 7 , Figure 7 This is the second embodiment of the method for automatically switching the display frame rate of the smart screen of the present application, and the method comprises the following steps:
[0145] Step S210: Acquire an image of a set area in front of the smart screen.
[0146] Step S220: judging whether there is a user in front of the smart screen according to the change of the gray gain value of the image in front of the smart screen.
[0147] Step S230: When it is determined that there is a user in front of the smart screen, an access device in the wireless local area network where the smart screen is located is obtained.
[0148] Step S240: Determine whether the access device is in a user attention state.
[0149] Step S250: When there is an access device in the user's attention state, the frame rate of the smart screen display is reduced.
[0150] Step S260: When it is determined that there is no user in front of the smart screen, the frame rate displayed by the smart screen is reduced.
[0151] The smart screen is in a normal power-on display state. Specific scenarios include: there is a user in front of the smart screen, but the user is using other smart devices and not watching the smart screen; or there is no user in front of the smart screen. In these specific scenarios, the smart screen automatically switches the display frame rate.
[0152] The method of judging whether there is no user in front of the smart screen can be:
[0153] First, through thermal infrared human body sensor;
[0154] Second, by acquiring an image of a set area that the smart screen is facing, an image recognition operation is performed on the image to determine whether there is a user in front of the smart screen;
[0155] Third, through voice recognition, if there is no voice recognition result within a preset time interval, it is determined that there is no user in front of the smart screen;
[0156] Fourth, through sound decibel monitoring, if the sound decibel is detected to be continuously stable within a preset time interval, it is determined that there is no user in front of the smart screen.
[0157] The second embodiment provides an operation of reducing the display frame rate of the smart screen in a specific scenario where there is no user in front of the smart screen.
[0158] At the same time, it is possible to determine whether there is a user in front of the smart screen within a preset time period. If there is no user in front of the smart screen within the preset time period, the smart screen will first reduce the display frame rate, and then if a user appears in front of the smart screen at a predetermined time within the preset time period, the smart screen will increase the display frame rate to improve the user's viewing experience. If there is no user in front of the smart screen within the preset time period, a shutdown reminder will be displayed on the smart screen or a smart screen shutdown reminder will be sent to the access device to avoid power consumption and energy waste of the smart screen.
[0159] Compared with the first embodiment, the second embodiment includes step S260. The other steps are the same as those of the first embodiment and will not be described in detail.
[0160] The beneficial effects of the above embodiments are: ensuring that the present application covers specific scenarios where there is no user in front of the smart screen, and further reducing unnecessary power consumption caused by the inability of the smart screen to automatically switch the display frame rate.
[0161] Reference Figure 8 , Figure 8 This is a specific flow chart of step S150 of the first embodiment of the method for automatically switching the display frame rate of the smart screen of this application. The frame rate of the display of the smart screen is reduced, including:
[0162] Step S151: Obtain the maximum value of the current display frame rate of the smart screen.
[0163] Different smart screens have different display frame rates, and they can be adjusted dynamically. This application obtains the maximum value of the frame rate currently displayed by the smart screen.
[0164] Step S152: Adjust the display frame rate of the smart screen to one quarter of the maximum value.
[0165] The display frame rate of the smart screen is reduced to one-fourth of the maximum value according to the calculation rule of geometric attenuation frame rate.
[0166] If in certain specific scenarios, the display frame rate of the smart screen needs to be increased to ensure the user's viewing experience, the current display frame rate of the smart screen can be obtained, and the frame rate can be increased to a frame rate suitable for user viewing according to the geometric increase method. The display frame rate of the smart screen can also be dynamically adjusted according to user needs.
[0167] The beneficial effects of the above embodiments are as follows: providing a specific method for reducing the display frame rate of the smart screen, indeed supporting the smart screen to automatically switch the display frame rate, and solving the problem that the smart screen cannot automatically switch the display frame rate.
[0168] The present invention also provides a computer-readable storage medium, on which is stored a method program for automatically switching the display frame rate of an intelligent screen. When the method program for automatically switching the display frame rate of an intelligent screen is executed by a processor, any of the above-mentioned methods is implemented.
[0169] The present invention also provides a smart screen, including a memory, a processor, and a method program for automatically switching the display frame rate of the smart screen stored in the memory and run on the processor. When the processor executes the method program for automatically switching the display frame rate of the smart screen, any of the above-described methods is implemented.
[0170] Those skilled in the art will appreciate that embodiments of the present invention may be provided as methods, systems, or computer program products. Therefore, the present invention may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the present invention may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.
[0171] The present invention is described with reference to flowcharts and / or block diagrams of methods, devices (systems), and computer program products according to embodiments of the present invention. It should be understood that each process and / or block in the flowchart and / or block diagram, as well as the combination of processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.
[0172] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.
[0173] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.
[0174] It should be noted that in the claims, any reference signs placed between brackets shall not be construed as limiting the claims. The word "comprising" does not exclude the presence of components or steps not listed in the claim. The word "a" or "an" preceding a component does not exclude the presence of a plurality of such components. The invention may be implemented by means of hardware comprising several different components and by means of a suitably programmed computer. In a unit claim enumerating several means, several of these means may be embodied by the same item of hardware. The use of the words first, second, and third etc. does not indicate any order. These words may be interpreted as names.
[0175] Although the preferred embodiments of the present invention have been described, those skilled in the art may make other changes and modifications to these embodiments once they have learned the basic creative concept. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications that fall within the scope of the present invention.
[0176] Obviously, those skilled in the art can make various changes and modifications to the present invention without departing from the spirit and scope of the present invention. Thus, if these modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include these modifications and variations.
Claims
1. A method for automatically switching the display frame rate of a smart screen, characterized in that: The method comprises: Acquire an image within a set area that the smart screen is facing; Judging whether there is a user in front of the smart screen according to a change in the grayscale gain value of the image acquired by the smart screen; When it is determined that there is a user in front of the smart screen, obtaining an access device in the wireless local area network where the smart screen is located; Determining whether the access device is in a user attention state; When there is an access device in a user attention state, the frame rate of the smart screen display is reduced; The step of determining whether the access device is in a user attention state comprises: At every first preset time length, an average acceleration of the access device within a preset unit time interval is obtained; the average acceleration is an average value of each acceleration within the preset unit time interval, wherein the acceleration is obtained by obtaining the acceleration of the acceleration sensor of the access device in the vertical direction; Calculating the difference between two adjacent average accelerations; When the difference is greater than a first preset threshold, it is determined that the access device is in a user attention state; The step of judging whether there is a user in front of the smart screen according to the change of the gray gain value of the image acquired by the smart screen comprises: At every second preset time period, an image within a set area that the smart screen is facing is acquired, and a grayscale gain value of the image is calculated; Calculating the difference between two adjacent grayscale gain values; When a plurality of consecutive difference values are greater than a second preset threshold, it is determined that there is a user in front of the smart screen; The step of calculating the grayscale gain value of the image comprises: Capturing images within the set area through the front camera of the smart screen; Respectively obtain a red sub-pixel gain value, a green sub-pixel gain value, and a blue sub-pixel gain value of the image within the set area; Calculating an average value of the acquired red sub-pixel gain value, the green sub-pixel gain value, and the blue sub-pixel gain value as a grayscale gain value of a corresponding pixel; The average value of the grayscale gain values of all pixels within the set area is calculated as the grayscale gain value of the image.
2. The method for automatically switching the display frame rate of a smart screen according to claim 1, characterized in that: The step of judging whether there is a user in front of the smart screen according to the change of the gray gain value of the image acquired by the smart screen comprises: At every third preset time period, an image within a set area that the smart screen is facing is acquired, and a grayscale gain value of the image is calculated; Calculating a difference between two adjacent grayscale gain values; When the difference is greater than a third preset threshold, it is determined that there is a user in front of the smart screen.
3. The method for automatically switching the display frame rate of a smart screen according to claim 1, wherein after the step of judging whether there is a user in front of the smart screen according to the change of the gray gain value of the image obtained in front of the smart screen, it is characterized in that: Also includes: When it is determined that there is no user in front of the smart screen, the frame rate displayed by the smart screen is reduced.
4. The method for automatically switching the display frame rate of a smart screen according to claim 1, characterized in that: The reducing the frame rate displayed on the smart screen includes: Obtain the maximum value of the current display frame rate of the smart screen; The display frame rate of the smart screen is adjusted to one quarter of the maximum value.
5. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a method program for automatically switching the display frame rate of the smart screen, and when the method program for automatically switching the display frame rate of the smart screen is executed by a processor, the method described in any one of claims 1-4 is implemented.
6. A smart screen, characterized in that: It includes a memory, a processor, and a method program for automatically switching the display frame rate of an intelligent screen stored in the memory and executable on the processor. When the processor executes the method program for automatically switching the display frame rate of the intelligent screen, any method described in claims 1-4 is implemented.
