A touch-control integrated machine display management method and system based on environmental perception

Abstract

The present invention relates to the field of display management, and discloses a touch-control integrated machine display management method and system based on environmental perception, including the following steps: obtaining environmental parameters of an agricultural greenhouse based on an environmental perception sensor, obtaining an environmental parameter view, and classifying the state of the touch-control integrated machine; based on the environmental parameter view and an adjustable brightness threshold, performing energy consumption optimization on the touch-control integrated machine by introducing a long short-term memory network algorithm. The present invention can collect environmental parameters in an agricultural greenhouse and act on the touch-control integrated machine, so that the touch-control integrated machine can realize adaptive adjustment of display brightness according to the environmental parameters, that is, reducing the energy consumption of the touch-control integrated machine, and protecting the human eye comfort of agricultural greenhouse workers when watching the touch-control integrated machine, avoiding causing amount fatigue, and improving the work efficiency of agricultural greenhouse workers.

Description

Technical Field

[0001] The present invention relates to the field of display management, and in particular to a touch-control integrated machine display management method and system based on environment perception. Background Art

[0002] With the continuous development of society and the advancement of science and technology, people's demand for the perception and management of environmental information is growing. Especially in the fields of agricultural greenhouses, farms, cold chain logistics, workshop warehousing, etc., environmental factors such as temperature, humidity, and light have an important impact on production activities. As a device that integrates multiple functions such as LCD display and touch screen, the touch-screen all-in-one machine has the characteristics of easy operation and strong interactivity, and is widely used in various information display and interactive scenarios. Combining the touch-screen all-in-one machine with environmental perception technology can not only display environmental parameters in real time, but also perform convenient operation and control through the touch screen, providing users with a more intuitive and efficient management experience.

[0003] The touch-screen all-in-one machine has touch feedback optimization, intelligent brightness adjustment, dynamic content adaptation, interactive media playback, and multi-user collaboration mode as its core functions. The environment-aware touch-screen all-in-one display management system can not only monitor and display environmental parameters in real time, but also perform convenient operations and controls through the touch screen to achieve intelligent adjustment and management of the environment. In the touch-screen all-in-one machine, the display management is mainly intelligent brightness adjustment and dynamic content adaptation, which can improve production efficiency, ensure product quality, and provide users with a more comfortable, healthy, and safe living and working environment. Summary of the invention

[0004] The present invention overcomes the deficiencies of the prior art and provides a touch-control integrated machine display management method and system based on environment perception.

[0005] In order to achieve the above object, the technical solution adopted by the present invention is:

[0006] A first aspect of the present invention provides a touch-control integrated machine display management method based on environment perception, comprising the following steps:

[0007] Control the environmental perception sensor in the touch-screen integrated machine to monitor environmental parameters in real time in the agricultural greenhouse, and perform data preprocessing on the monitored environmental parameters;

[0008] Acquire and analyze surveillance images in agricultural greenhouses, and classify the status of touch-screen integrated machines based on the surveillance image analysis results;

[0009] Based on the environmental parameter view and adjustable brightness threshold, the display brightness of the touch-screen integrated machine in different states is adaptively adjusted;

[0010] Based on the characteristic parameters of a type of monitored person image, a long short-term memory network algorithm is introduced into the touch-screen all-in-one computer for intelligent training to optimize the adjustment efficiency of the touch-screen all-in-one computer when adaptively adjusting the display brightness.

[0011] Furthermore, in a preferred embodiment of the present invention, the environment perception sensor in the touch-control integrated machine is controlled to monitor the environmental parameters in real time in the agricultural greenhouse, and perform data preprocessing on the monitored environmental parameters, specifically:

[0012] Obtain an agricultural greenhouse, and determine a location in the agricultural greenhouse where the touch-controlled all-in-one machine can be installed, and mark it as the installation location of the touch-controlled all-in-one machine;

[0013] Installing the touch-control integrated machine on the touch-control integrated machine installation position, and installing an environmental perception sensor in the agricultural greenhouse, wherein the environmental perception sensor includes a light intensity sensor, a temperature sensor, and a humidity sensor;

[0014] Control the environmental perception sensor to monitor the real-time environmental parameters of the agricultural greenhouse, and connect the environmental perception sensor to the touch-control integrated machine based on Bluetooth, so that the real-time environmental parameters of the agricultural greenhouse are stored in the touch-control integrated machine;

[0015] In the touch-screen all-in-one machine, the real-time environmental parameters of the agricultural greenhouse are tested for data integrity. If there are duplicate values ​​in the real-time environmental parameters of the agricultural greenhouse, the real-time environmental parameters of the agricultural greenhouse are deleted for duplicate values. If there are missing values ​​in the real-time environmental parameters of the agricultural greenhouse, the real-time environmental parameters of the agricultural greenhouse are supplemented for parameters based on the interpolation filling method to obtain complete real-time environmental parameters of the agricultural greenhouse, which are calibrated as real-time complete environmental parameters.

[0016] The time for performing environmental perception in the agricultural greenhouse is preset, and based on the time for performing environmental perception in the agricultural greenhouse, a timestamp is constructed and calibrated as a target timestamp;

[0017] The target timestamp is combined with the real-time complete environmental parameters to obtain the real-time complete environmental parameters in a time series format, and the real-time complete environmental parameters in the time series format are converted into a visual view in the touch-controlled all-in-one machine and calibrated as an environmental parameter view.

[0018] Furthermore, in a preferred embodiment of the present invention, the monitoring images are acquired and analyzed in the agricultural greenhouse, and the status of the touch-control machine is classified based on the monitoring image analysis results, specifically:

[0019] Install a surveillance camera in the touch-screen integrated machine, obtain the surveillance range of the surveillance camera, and based on the surveillance camera, obtain an image within the surveillance range of the surveillance camera in real time and mark it as a surveillance image;

[0020] The monitoring image is grayed to obtain a grayed monitoring image, and a two-dimensional Fourier transform algorithm is introduced to transform the grayed monitoring image into a grayed monitoring image in a frequency domain state based on the two-dimensional Fourier transform algorithm;

[0021] The wavelet transform method is introduced to filter the grayscale monitoring image in the frequency domain state, and the filtered grayscale monitoring image in the frequency domain state is inversely Fourier transformed to obtain a preprocessed monitoring image;

[0022] Performing character image feature extraction on the preprocessed monitoring image to obtain monitoring character image feature parameters, and obtaining a data repository of the agricultural greenhouse, wherein the data repository of the agricultural greenhouse stores character feature parameters of target staff members of the agricultural greenhouse;

[0023] Calculate the Euclidean distance between the monitored person image feature parameters and the person feature parameters of the target worker in the agricultural greenhouse, and preset a Euclidean distance threshold. If the Euclidean distance between the monitored person image feature parameters and the person feature parameters of the target worker in the agricultural greenhouse is greater than the Euclidean distance threshold, adjust the touch screen integrated machine to a first state;

[0024] If the Euclidean distance between the characteristic parameters of the monitored person image and the characteristic parameters of the target worker in the agricultural greenhouse is not greater than the Euclidean distance threshold, the touch-screen integrated machine is adjusted to the second category state.

[0025] Further, in a preferred embodiment of the present invention, the display brightness of the touch-controlled integrated machine in different states is adaptively adjusted based on the environmental parameter view and the adjustable brightness threshold, specifically:

[0026] In the touch-control machine, all screen information displayed to the outside is obtained and marked as target screen information, and an adjustable brightness threshold is obtained on the touch-control machine, wherein the brightness of the touch-control machine can only be adjusted within the adjustable brightness threshold;

[0027] Acquire a historical data network, retrieve a comparison map between the real-time brightness of the touch-control machine and the environmental parameters in the historical data network, and mark it as a brightness-environmental parameter comparison map;

[0028] Among them, in the brightness-environmental parameter comparison map, the real-time brightness of the touch-controlled integrated machine and the environmental parameters are in a single corresponding relationship;

[0029] Importing the environmental parameter view into the brightness-environmental parameter comparison map, and generating a target brightness value based on the real-time complete environmental parameters in the time series format in the environmental parameter view, wherein the target brightness value is a real-time brightness value generated by the touch-controlled all-in-one machine in the brightness-environmental parameter comparison map according to the real-time complete environmental parameters in the time series format;

[0030] When the state of the touch-control machine is a class one state, a first brightness value adjustment scheme is output in the touch-control machine, wherein the first brightness value adjustment scheme is to output a target brightness value in the touch-control machine, and adaptively adjust the target brightness value within an adjustable brightness threshold based on the real-time complete environmental parameters in a time series format;

[0031] When the state of the touch-control machine is the second state, the display brightness of the touch-control machine is adaptively adjusted in the touch-control machine in combination with the monitored person image feature parameters, the environmental parameter view and the adjustable brightness threshold.

[0032] Furthermore, in a preferred embodiment of the present invention, the touch-controlled integrated machine is combined with the monitored person image feature parameters, the environmental parameter view and the adjustable brightness threshold to adaptively adjust the display brightness of the touch-controlled integrated machine, specifically:

[0033] When the state of the touch-control machine is the second-class state, a first brightness value adjustment scheme is output in the touch-control machine, and when the first brightness value adjustment scheme is output, a comfort test timestamp is preset, and all monitoring person image feature parameters in the comfort test timestamp are obtained, and are calibrated as first-class monitoring person image feature parameters;

[0034] Among the one type of monitored person image characteristic parameters, obtain one type of monitored person image characteristic parameters of the eye position of the target worker in the agricultural greenhouse, and calculate the blinking frequency of the target worker in the agricultural greenhouse based on the one type of monitored person image characteristic parameters of the eye position, and mark it as the blinking frequency to be analyzed;

[0035] If the first type of monitored person image characteristic parameters does not contain the first type of monitored person image characteristic parameters at the human eye position, controlling the touch-controlled integrated machine to continuously output the first brightness value adjustment solution;

[0036] If a type of monitored person image characteristic parameter includes a type of monitored person image characteristic parameter of a human eye position, a blink frequency threshold is preset, and the blink frequency to be analyzed is analyzed. If the blink frequency to be analyzed is maintained less than the blink frequency threshold when the first brightness value adjustment scheme is output, the touch-controlled integrated machine is controlled to continuously output the first brightness value adjustment scheme;

[0037] If the blinking frequency to be analyzed does not remain less than the blinking frequency threshold when the first brightness value adjustment scheme is output, all target brightness values ​​whose blinking frequency to be analyzed is less than the blinking frequency threshold are obtained and calibrated as appropriate brightness values ​​for the person, and an appropriate brightness value adjustment threshold for the person is constructed based on all appropriate brightness values ​​for the person;

[0038] A second brightness adjustment scheme is generated, wherein the second brightness adjustment scheme is a real-time complete environment parameter based on a time series format, and adaptively adjusts the appropriate brightness value of the character at an appropriate brightness value adjustment threshold of the character.

[0039] Furthermore, in a preferred embodiment of the present invention, based on a type of monitoring person image feature parameters, a long short-term memory network algorithm is introduced into the touch-controlled integrated machine for intelligent training to optimize the adjustment efficiency of the touch-controlled integrated machine during display brightness adaptive adjustment, specifically:

[0040] When outputting the second brightness adjustment scheme, a long short-term memory network algorithm is introduced into the touch-controlled integrated machine, and based on the long short-term memory network algorithm, an initial model of the long short-term memory network is constructed;

[0041] Get the input layer, LSTM layer and fully connected layer of the initial model of the long short-term memory network, where the number of fully connected layers is 1;

[0042] Obtain the number of time steps and feature dimensions of different time steps in a class of monitoring person image feature parameters, and retrieve the standard number of layers of the input layer, the standard number of layers of the LSTM layer, and the standard number of neurons of a single LSTM layer in the historical data network based on the number of time steps and feature dimensions of different time steps in a class of monitoring person image feature parameters;

[0043] Based on a single-layer fully connected layer, a standard number of input layers, a standard number of LSTM layers, and a standard number of neurons in a single-layer LSTM layer, updating model parameters of the long short-term memory network initial model to obtain a long short-term memory network training model;

[0044] Based on the long short-term memory network training model, predict the appropriate brightness value adjustment thresholds of different agricultural greenhouse target workers;

[0045] In the agricultural greenhouse, the number of target agricultural greenhouse workers is analyzed. When the number of target agricultural greenhouse workers is 1, the appropriate brightness value adjustment threshold of the person is adjusted to the appropriate brightness value adjustment threshold of the person corresponding to the target agricultural greenhouse worker;

[0046] When the number of target agricultural greenhouse workers is greater than 1, the appropriate brightness value adjustment threshold for the person with the smallest threshold is selected from the appropriate brightness value adjustment thresholds for the different target agricultural greenhouse workers and outputted.

[0047] The second aspect of the present invention further provides a touch-control machine display management system based on environment perception, the touch-control machine display management system comprises a memory and a processor, the memory stores a touch-control machine display management method, and when the touch-control machine display management method is executed by the processor, the following steps are implemented:

[0048] Control the environmental perception sensor in the touch-screen integrated machine to monitor environmental parameters in real time in the agricultural greenhouse, and perform data preprocessing on the monitored environmental parameters;

[0049] Acquire and analyze surveillance images in agricultural greenhouses, and classify the status of touch-screen integrated machines based on the surveillance image analysis results;

[0050] Based on the environmental parameter view and adjustable brightness threshold, the display brightness of the touch-screen integrated machine in different states is adaptively adjusted;

[0051] Based on the characteristic parameters of a type of monitored person image, a long short-term memory network algorithm is introduced into the touch-screen all-in-one computer for intelligent training to optimize the adjustment efficiency of the touch-screen all-in-one computer when adaptively adjusting the display brightness.

[0052] The present invention solves the technical defects existing in the background technology, and the present invention has the following beneficial effects: based on the environmental perception sensor, the environmental parameters of the agricultural greenhouse are obtained, the environmental parameter view is obtained, and the state of the touch-control integrated machine is classified; based on the environmental parameter view and the adjustable brightness threshold, the touch-control integrated machine in different states is classified, and the long short-term memory network algorithm is introduced to optimize the energy consumption of the touch-control integrated machine. The present invention can collect environmental parameters in the agricultural greenhouse and act on the touch-control integrated machine, so that the touch-control integrated machine can realize adaptive adjustment of the display brightness according to the environmental parameters, that is, the energy consumption of the touch-control integrated machine is reduced, and the human eye comfort of the agricultural greenhouse staff when watching the touch-control integrated machine is protected, avoiding the amount of fatigue, and improving the work efficiency of the agricultural greenhouse staff. BRIEF DESCRIPTION OF THE DRAWINGS

[0053] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, drawings of other embodiments can be obtained based on these drawings without paying creative work.

[0054] Figure 1 A flow chart of a touch-control integrated machine display management method based on environment perception is shown;

[0055] Figure 2 A flow chart showing a method for adaptively adjusting the display brightness of a touch-controlled integrated machine in different states is shown;

[0056] Figure 3 A program view of a touch-control integrated machine display management system based on environment perception is shown. DETAILED DESCRIPTION

[0057] In order to more clearly understand the above-mentioned purpose, features and advantages of the present invention, the present invention is further described in detail below in conjunction with the accompanying drawings and specific embodiments. It should be noted that the embodiments of the present application and the features in the embodiments can be combined with each other without conflict.

[0058] In the following description, many specific details are set forth to facilitate a full understanding of the present invention. However, the present invention may also be implemented in other ways different from those described herein. Therefore, the protection scope of the present invention is not limited to the specific embodiments disclosed below.

[0059] Figure 1 A flow chart of a touch-control machine display management method based on environment perception is shown, comprising the following steps:

[0060] S102: Controlling the environment perception sensor in the touch-control integrated machine to monitor environmental parameters in real time in the agricultural greenhouse, and performing data preprocessing on the monitored environmental parameters;

[0061] S104: Acquire and analyze monitoring images in the agricultural greenhouse, and classify the status of the touch-screen integrated machine based on the monitoring image analysis results;

[0062] S106: Based on the environmental parameter view and the adjustable brightness threshold, adaptively adjust the display brightness of the touch-controlled integrated device in different states;

[0063] S108: Based on a type of monitored person image feature parameters, a long short-term memory network algorithm is introduced into the touch-controlled all-in-one computer for intelligent training to optimize the adjustment efficiency of the touch-controlled all-in-one computer when the display brightness is adaptively adjusted.

[0064] Furthermore, in a preferred embodiment of the present invention, the environment perception sensor in the touch-control integrated machine is controlled to monitor the environmental parameters in real time in the agricultural greenhouse, and perform data preprocessing on the monitored environmental parameters, specifically:

[0065] Obtain an agricultural greenhouse, and determine a location in the agricultural greenhouse where the touch-controlled all-in-one machine can be installed, and mark it as the installation location of the touch-controlled all-in-one machine;

[0066] Installing the touch-control integrated machine on the touch-control integrated machine installation position, and installing an environmental perception sensor in the agricultural greenhouse, wherein the environmental perception sensor includes a light intensity sensor, a temperature sensor, and a humidity sensor;

[0067] Control the environmental perception sensor to monitor the real-time environmental parameters of the agricultural greenhouse, and connect the environmental perception sensor to the touch-control integrated machine based on Bluetooth, so that the real-time environmental parameters of the agricultural greenhouse are stored in the touch-control integrated machine;

[0068] In the touch-screen all-in-one machine, the real-time environmental parameters of the agricultural greenhouse are tested for data integrity. If there are duplicate values ​​in the real-time environmental parameters of the agricultural greenhouse, the real-time environmental parameters of the agricultural greenhouse are deleted for duplicate values. If there are missing values ​​in the real-time environmental parameters of the agricultural greenhouse, the real-time environmental parameters of the agricultural greenhouse are supplemented for parameters based on the interpolation filling method to obtain complete real-time environmental parameters of the agricultural greenhouse, which are calibrated as real-time complete environmental parameters.

[0069] The time for performing environmental perception in the agricultural greenhouse is preset, and based on the time for performing environmental perception in the agricultural greenhouse, a timestamp is constructed and calibrated as a target timestamp;

[0070] The target timestamp is combined with the real-time complete environmental parameters to obtain the real-time complete environmental parameters in a time series format, and the real-time complete environmental parameters in the time series format are converted into a visual view in the touch-controlled all-in-one machine and calibrated as an environmental parameter view.

[0071] It should be noted that the touch-screen integrated machine is installed in the agricultural greenhouse to display various environmental parameters in the agricultural greenhouse. Various plants cultured in the agricultural greenhouse need to have appropriate environmental parameters. The role of the touch-screen integrated machine is to monitor the environmental parameters in the agricultural greenhouse in real time and display the environmental parameters in the agricultural greenhouse to the staff in the form of a visual view, so that the staff can adjust them according to the environmental parameters. After the environmental parameters are collected, they need to be preprocessed, because there may be data missing, data duplication, etc. after collection, resulting in inaccurate data, so preprocessing is required, including duplicate value deletion processing, parameter supplementation processing, etc. Finally, the preprocessed environmental parameters need to be converted into a time series format, the purpose is to determine the environmental parameters of the agricultural greenhouse at different times, so that the staff can work more efficiently, and finally convert the environmental parameters into a visual view output.

[0072] Furthermore, in a preferred embodiment of the present invention, the monitoring images are acquired and analyzed in the agricultural greenhouse, and the status of the touch-control machine is classified based on the monitoring image analysis results, specifically:

[0073] Install a surveillance camera in the touch-screen integrated machine, obtain the surveillance range of the surveillance camera, and based on the surveillance camera, obtain an image within the surveillance range of the surveillance camera in real time and mark it as a surveillance image;

[0074] The monitoring image is grayed to obtain a grayed monitoring image, and a two-dimensional Fourier transform algorithm is introduced to transform the grayed monitoring image into a grayed monitoring image in a frequency domain state based on the two-dimensional Fourier transform algorithm;

[0075] The wavelet transform method is introduced to filter the grayscale monitoring image in the frequency domain state, and the filtered grayscale monitoring image in the frequency domain state is inversely Fourier transformed to obtain a preprocessed monitoring image;

[0076] Performing character image feature extraction on the preprocessed monitoring image to obtain monitoring character image feature parameters, and obtaining a data repository of the agricultural greenhouse, wherein the data repository of the agricultural greenhouse stores character feature parameters of target staff members of the agricultural greenhouse;

[0077] Calculate the Euclidean distance between the monitored person image feature parameters and the person feature parameters of the target worker in the agricultural greenhouse, and preset a Euclidean distance threshold. If the Euclidean distance between the monitored person image feature parameters and the person feature parameters of the target worker in the agricultural greenhouse is greater than the Euclidean distance threshold, adjust the touch screen integrated machine to a first state;

[0078] If the Euclidean distance between the characteristic parameters of the monitored person image and the characteristic parameters of the target worker in the agricultural greenhouse is not greater than the Euclidean distance threshold, the touch-screen integrated machine is adjusted to the second category state.

[0079] It should be noted that when the touch-screen all-in-one displays environmental parameters, it is necessary to adjust the brightness of the display screen according to the light intensity in the environmental parameters to ensure that light pollution is not caused when viewing the display screen, and the health of the staff is not harmed. The state of the touch-screen all-in-one is different when there are staff and when there are no staff. When there are no staff, the touch-screen all-in-one can directly change the display brightness according to the light intensity, while when there are staff, it is necessary to analyze it in combination with the comfort of the staff. To determine whether there are staff, a camera can be integrated on the touch-screen all-in-one through image recognition, and an image can be taken, and feature data in the image can be extracted, and compared with the feature data preset by the staff, and the Euclidean distance between the two can be calculated to determine whether there are staff. The Euclidean distance is a reference for calculating the similarity of data. The smaller the Euclidean distance, the greater the data similarity. The two-dimensional Fourier transform algorithm can convert the image from the time domain to the frequency domain, and after filtering in the frequency domain state, an inverse transform is performed to obtain a filtered monitoring image. Feature extraction is then performed on the filtered monitoring image to achieve touch-screen all-in-one state classification.

[0080] Furthermore, in a preferred embodiment of the present invention, based on a type of monitoring person image feature parameters, a long short-term memory network algorithm is introduced into the touch-controlled integrated machine for intelligent training to optimize the adjustment efficiency of the touch-controlled integrated machine during display brightness adaptive adjustment, specifically:

[0081] When outputting the second brightness adjustment scheme, a long short-term memory network algorithm is introduced into the touch-controlled integrated machine, and based on the long short-term memory network algorithm, an initial model of the long short-term memory network is constructed;

[0082] Get the input layer, LSTM layer and fully connected layer of the initial model of the long short-term memory network, where the number of fully connected layers is 1;

[0083] Obtain the number of time steps and feature dimensions of different time steps in a class of monitoring person image feature parameters, and retrieve the standard number of layers of the input layer, the standard number of layers of the LSTM layer, and the standard number of neurons of a single LSTM layer in the historical data network based on the number of time steps and feature dimensions of different time steps in a class of monitoring person image feature parameters;

[0084] Based on a single-layer fully connected layer, a standard number of input layers, a standard number of LSTM layers, and a standard number of neurons in a single-layer LSTM layer, updating model parameters of the long short-term memory network initial model to obtain a long short-term memory network training model;

[0085] Based on the long short-term memory network training model, predict the appropriate brightness value adjustment thresholds of different agricultural greenhouse target workers;

[0086] In the agricultural greenhouse, the number of target agricultural greenhouse workers is analyzed. When the number of target agricultural greenhouse workers is 1, the appropriate brightness value adjustment threshold of the person is adjusted to the appropriate brightness value adjustment threshold of the person corresponding to the target agricultural greenhouse worker;

[0087] When the number of target agricultural greenhouse workers is greater than 1, the appropriate brightness value adjustment threshold for the person with the smallest threshold is selected from the appropriate brightness value adjustment thresholds for the different target agricultural greenhouse workers and outputted.

[0088] It should be noted that after obtaining the second brightness adjustment scheme, if the staff repeatedly enters and exits the agricultural greenhouse, the touch-control machine needs to identify the staff's blinking frequency each time, and then adjust the target brightness value, which will increase the energy consumption of the touch-control machine and is not conducive to resource conservation. In order to reduce the energy consumption of the touch-control machine, a method for automatically identifying staff is proposed. When the staff appears in the agricultural greenhouse, the display effect of the touch-control machine is directly adjusted to reduce energy waste. A long short-term memory network training model is constructed, and the long short-term memory network training model is a special recursive neural network specifically used for processing and predicting time series data. A class of monitoring character image feature parameters is introduced into the model to predict the brightness value adjustment threshold that the corresponding staff can bear. To construct the model, it is necessary to determine its input layer, fully connected layer and LSTM layer, that is, to determine the architecture of the model. Different data volumes and time dimensions have different architectures of the corresponding input layer and LSTM layer, so the standard number of layers of the input layer, the standard number of layers of the LSTM layer, and the standard number of neurons of the single-layer LSTM layer are obtained. After the model is built, the brightness adjustment thresholds that different staff members can bear are obtained through the model, that is, the appropriate brightness adjustment thresholds for people. After all the appropriate brightness adjustment thresholds for people are imported into the touch screen all-in-one, the touch screen all-in-one will adjust its own brightness value according to the identity of the staff member, and apply different appropriate brightness adjustment thresholds for people to perform adaptive adjustments to ensure that the staff member's blinking frequency is reduced and the eyes are protected. If there are multiple staff members, the smaller range will be used as the output appropriate brightness adjustment threshold for people to ensure that everyone can protect their eyes.

[0089] Figure 2 A flow chart of a method for adaptively adjusting the display brightness of a touch-controlled integrated machine in different states is shown, comprising the following steps:

[0090] S202: Obtaining an adjustable brightness threshold and a brightness-environmental parameter comparison map;

[0091] S204: Adaptively adjusting the display brightness of the touch-controlled integrated machine in a certain state;

[0092] S206: Adaptively adjust the display brightness of the touch-controlled all-in-one machine by combining the monitored person image feature parameters, the environmental parameter view, and the adjustable brightness threshold in the touch-controlled all-in-one machine.

[0093] Furthermore, in a preferred embodiment of the present invention, the display brightness of the touch-controlled integrated machine in a certain state is adaptively adjusted, specifically:

[0094] Importing the environmental parameter view into the brightness-environmental parameter comparison map, and generating a target brightness value based on the real-time complete environmental parameters in the time series format in the environmental parameter view, wherein the target brightness value is a real-time brightness value generated by the touch-controlled all-in-one machine in the brightness-environmental parameter comparison map according to the real-time complete environmental parameters in the time series format;

[0095] When the state of the touch-control machine is a type of state, a first brightness value adjustment scheme is output in the touch-control machine, wherein the first brightness value adjustment scheme is to output a target brightness value in the touch-control machine, and based on real-time complete environmental parameters in a time series format, adaptively adjust the target brightness value within an adjustable brightness threshold.

[0096] It should be noted that, since the brightness-environmental parameter comparison map records the different touch-control machine display brightness corresponding to different environmental parameters, by importing the environmental parameter view into the brightness-environmental parameter comparison map, the touch-control machine display brightness corresponding to different environmental parameters, that is, different target brightness values, can be obtained. When the touch-control machine is in a class I state, that is, there are no staff members within the monitoring range of the touch-control machine, the first brightness value adjustment scheme is output to control the touch-control machine to adaptively adjust the target brightness value within the adjustable brightness threshold according to the changes in environmental parameters.

[0097] Furthermore, in a preferred embodiment of the present invention, the touch-controlled integrated machine is combined with the monitored person image feature parameters, the environmental parameter view and the adjustable brightness threshold to adaptively adjust the display brightness of the touch-controlled integrated machine, specifically:

[0098] When the state of the touch-control machine is the second-class state, a first brightness value adjustment scheme is output in the touch-control machine, and when the first brightness value adjustment scheme is output, a comfort test timestamp is preset, and all monitoring person image feature parameters in the comfort test timestamp are obtained, and are calibrated as first-class monitoring person image feature parameters;

[0099] Among the one type of monitored person image characteristic parameters, obtain one type of monitored person image characteristic parameters of the eye position of the target worker in the agricultural greenhouse, and calculate the blinking frequency of the target worker in the agricultural greenhouse based on the one type of monitored person image characteristic parameters of the eye position, and mark it as the blinking frequency to be analyzed;

[0100] If the first type of monitored person image characteristic parameters does not contain the first type of monitored person image characteristic parameters at the human eye position, controlling the touch-controlled integrated machine to continuously output the first brightness value adjustment solution;

[0101] If a type of monitored person image characteristic parameter includes a type of monitored person image characteristic parameter of a human eye position, a blink frequency threshold is preset, and the blink frequency to be analyzed is analyzed. If the blink frequency to be analyzed is maintained less than the blink frequency threshold when the first brightness value adjustment scheme is output, the touch-controlled integrated machine is controlled to continuously output the first brightness value adjustment scheme;

[0102] If the blinking frequency to be analyzed does not remain less than the blinking frequency threshold when the first brightness value adjustment scheme is output, all target brightness values ​​whose blinking frequency to be analyzed is less than the blinking frequency threshold are obtained and calibrated as appropriate brightness values ​​for the person, and an appropriate brightness value adjustment threshold for the person is constructed based on all appropriate brightness values ​​for the person;

[0103] A second brightness adjustment scheme is generated, wherein the second brightness adjustment scheme is a real-time complete environment parameter based on a time series format, and adaptively adjusts the appropriate brightness value of the character at an appropriate brightness value adjustment threshold of the character.

[0104] It should be noted that when the touch-control machine is in the second-class state, it proves that there are staff members within the monitoring range of the touch-control machine. First, it is necessary to output the first brightness value adjustment scheme, and in the process of outputting the first brightness value adjustment scheme, perform a comfort analysis on the behavior state of the staff members, and realize adaptive adjustment of the display brightness based on the comfort analysis results. The purpose of obtaining the comfort test timestamp is to convert the format of the monitoring person image feature parameters into a time series format, so as to facilitate the understanding of the behavior state of the staff members at different times. Since the human eye is fragile, when the light is not suitable, the blinking frequency of the human eye will increase accordingly, so it is necessary to obtain the blinking frequency of the human eye to judge the comfort of the staff members. The higher the blinking frequency, the worse the comfort. The purpose of obtaining the first-class monitoring person image feature parameters of the human eye position is to obtain the blinking frequency of the staff members at the human eye position. If there are staff members within the monitoring range, but the feature parameters of the human eye position cannot be obtained, it proves that the staff members may not be looking at the touch-control machine. At this time, the touch-control machine can still perform adaptive adjustment of the display brightness according to the first brightness value adjustment scheme. When the characteristic parameters of the human eye position can be monitored, it is necessary to determine whether the blinking frequency of the staff is less than the blinking frequency threshold under the first brightness value adjustment scheme. If it is, it proves that the first brightness value adjustment scheme will not affect the eye comfort of the staff and will not cause fatigue, so the first brightness value adjustment scheme can be output. If not, it proves that the first brightness value adjustment scheme will affect the eye comfort of the staff and cause fatigue. It is necessary to analyze the blinking frequency, obtain the corresponding brightness value when the blinking frequency is less than the preset value, and collect all the brightness values ​​that make the blinking frequency less than the preset value, construct the appropriate brightness value adjustment threshold for the character, and finally generate the second brightness adjustment scheme based on the appropriate brightness value adjustment threshold for the character.

[0105] In addition, the touch-control integrated machine display management method based on environment perception also includes the following steps:

[0106] Based on a class of monitoring person image feature parameters, the viewing distance and viewing angle between the agricultural greenhouse staff and the touch-screen integrated machine are calculated in real time and calibrated as the real-time viewing distance and real-time viewing angle;

[0107] Different real-time viewing distances and real-time viewing angles are calibrated as real-time viewing combinations, and all real-time viewing combinations are imported into a long short-term memory network training model, and the long short-term memory network training model performs feature training on all real-time viewing combinations to obtain a long short-term memory network secondary training model;

[0108] Among them, in the long short-term memory network secondary training model, the appropriate brightness value adjustment threshold of different agricultural greenhouse target workers under different real-time viewing combinations can be predicted;

[0109] In the agricultural greenhouse, the threshold is adjusted based on the appropriate brightness value of the characters of different agricultural greenhouse target workers under different real-time viewing combinations, and the brightness of the touch-screen integrated machine display is adaptively adjusted based on the identity of the agricultural greenhouse target workers.

[0110] It should be noted that, since the viewing distance and angle of the staff may change, the brightness adjustment of the touch-screen integrated machine needs to be updated. The longer the viewing distance of the staff, the higher the upper limit of the corresponding brightness value threshold, and the smaller the viewing angle, the higher the display brightness of the touch-screen integrated machine in the opposite direction of the staff should be, so that the staff can clearly check it. Therefore, different real-time viewing combinations are obtained and imported into the long short-term memory network training model for secondary training, so as to achieve the purpose of generating the appropriate brightness value adjustment threshold for the character according to the viewing combination, and perform adaptive adjustment.

[0111] like Figure 3 As shown, the second aspect of the present invention further provides a touch-control machine display management system based on environment perception, the touch-control machine display management system includes a memory 31 and a processor 32, the memory 31 stores a touch-control machine display management method, and when the touch-control machine display management method is executed by the processor 32, the following steps are implemented:

[0112] Control the environmental perception sensor in the touch-screen integrated machine to monitor environmental parameters in real time in the agricultural greenhouse, and perform data preprocessing on the monitored environmental parameters;

[0113] Acquire and analyze surveillance images in agricultural greenhouses, and classify the status of touch-screen integrated machines based on the surveillance image analysis results;

[0114] Based on the environmental parameter view and adjustable brightness threshold, the display brightness of the touch-screen integrated machine in different states is adaptively adjusted;

[0115] Based on the characteristic parameters of a type of monitored person image, a long short-term memory network algorithm is introduced into the touch-screen all-in-one computer for intelligent training to optimize the adjustment efficiency of the touch-screen all-in-one computer when adaptively adjusting the display brightness.

[0116] The above are only specific embodiments of the present invention, but the protection scope of the present invention is not limited thereto. Any person skilled in the art who is familiar with the technical field can easily think of changes or substitutions within the technical scope disclosed by the present invention, which should be included in the protection scope of the present invention. Therefore, the protection scope of the present invention should be based on the protection scope of the claims.

Claims

1. A touch-control integrated machine display management method based on environment perception, characterized in that: The following steps are involved: Control the environmental perception sensor in the touch-screen integrated machine to monitor environmental parameters in real time in the agricultural greenhouse, and perform data preprocessing on the monitored environmental parameters; Acquire and analyze surveillance images in agricultural greenhouses, and classify the status of touch-screen integrated machines based on the surveillance image analysis results; Based on the environmental parameter view and adjustable brightness threshold, the display brightness of the touch-screen integrated machine in different states is adaptively adjusted; Based on the characteristic parameters of a type of monitored person image, a long short-term memory network algorithm is introduced into the touch-screen integrated machine for intelligent training to optimize the adjustment efficiency of the touch-screen integrated machine when the display brightness is adaptively adjusted; The acquisition and analysis of monitoring images in the agricultural greenhouse and the classification of the touch-screen integrated machine based on the monitoring image analysis results are as follows: Install a surveillance camera in the touch-screen integrated machine, obtain the surveillance range of the surveillance camera, and based on the surveillance camera, obtain an image within the surveillance range of the surveillance camera in real time and mark it as a surveillance image; The monitoring image is grayed to obtain a grayed monitoring image, and a two-dimensional Fourier transform algorithm is introduced to transform the grayed monitoring image into a grayed monitoring image in a frequency domain state based on the two-dimensional Fourier transform algorithm; The wavelet transform method is introduced to filter the grayscale monitoring image in the frequency domain state, and the filtered grayscale monitoring image in the frequency domain state is inversely Fourier transformed to obtain a preprocessed monitoring image; Performing character image feature extraction on the preprocessed monitoring image to obtain monitoring character image feature parameters, and obtaining a data repository of the agricultural greenhouse, wherein the data repository of the agricultural greenhouse stores character feature parameters of target staff members of the agricultural greenhouse; Calculate the Euclidean distance between the monitored person image feature parameters and the person feature parameters of the target worker in the agricultural greenhouse, and preset a Euclidean distance threshold. If the Euclidean distance between the monitored person image feature parameters and the person feature parameters of the target worker in the agricultural greenhouse is greater than the Euclidean distance threshold, adjust the touch screen integrated machine to a first state; If the Euclidean distance between the characteristic parameters of the monitored person image and the characteristic parameters of the target worker in the agricultural greenhouse is not greater than the Euclidean distance threshold, the touch screen integrated machine is adjusted to the second type state; The method of adaptively adjusting the display brightness of the touch-controlled integrated machine in different states based on the environmental parameter view and the adjustable brightness threshold is specifically as follows: In the touch-control machine, all screen information displayed to the outside is obtained and marked as target screen information, and an adjustable brightness threshold is obtained on the touch-control machine, wherein the brightness of the touch-control machine can only be adjusted within the adjustable brightness threshold; Acquire a historical data network, retrieve a comparison map between the real-time brightness of the touch-control machine and the environmental parameters in the historical data network, and mark it as a brightness-environmental parameter comparison map; Among them, in the brightness-environmental parameter comparison map, the real-time brightness of the touch-controlled integrated machine and the environmental parameters are in a single corresponding relationship; Importing the environmental parameter view into the brightness-environmental parameter comparison map, and generating a target brightness value based on the real-time complete environmental parameters in the time series format in the environmental parameter view, wherein the target brightness value is a real-time brightness value generated by the touch-controlled all-in-one machine in the brightness-environmental parameter comparison map according to the real-time complete environmental parameters in the time series format; When the state of the touch-control machine is a class one state, a first brightness value adjustment scheme is output in the touch-control machine, wherein the first brightness value adjustment scheme is to output a target brightness value in the touch-control machine, and adaptively adjust the target brightness value within an adjustable brightness threshold based on the real-time complete environmental parameters in a time series format; When the state of the touch-control machine is the second state, the display brightness of the touch-control machine is adaptively adjusted in the touch-control machine in combination with the monitored person image feature parameters, the environmental parameter view and the adjustable brightness threshold.

2. According to the method for display management of a touch-control integrated machine based on environment perception described in claim 1, it is characterized in that: The environmental perception sensor in the control touch integrated machine monitors the environmental parameters in real time in the agricultural greenhouse, and performs data preprocessing on the monitored environmental parameters, specifically: Obtain an agricultural greenhouse, and determine a location in the agricultural greenhouse where the touch-controlled all-in-one machine can be installed, and mark it as the installation location of the touch-controlled all-in-one machine; Installing the touch-control integrated machine on the touch-control integrated machine installation position, and installing an environmental perception sensor in the agricultural greenhouse, wherein the environmental perception sensor includes a light intensity sensor, a temperature sensor, and a humidity sensor; Control the environmental perception sensor to monitor the real-time environmental parameters of the agricultural greenhouse, and connect the environmental perception sensor to the touch-control integrated machine based on Bluetooth, so that the real-time environmental parameters of the agricultural greenhouse are stored in the touch-control integrated machine; In the touch-screen all-in-one machine, the real-time environmental parameters of the agricultural greenhouse are tested for data integrity. If there are duplicate values ​​in the real-time environmental parameters of the agricultural greenhouse, the real-time environmental parameters of the agricultural greenhouse are deleted for duplicate values. If there are missing values ​​in the real-time environmental parameters of the agricultural greenhouse, the real-time environmental parameters of the agricultural greenhouse are supplemented for parameters based on the interpolation filling method to obtain complete real-time environmental parameters of the agricultural greenhouse, which are calibrated as real-time complete environmental parameters. The time for performing environmental perception in the agricultural greenhouse is preset, and based on the time for performing environmental perception in the agricultural greenhouse, a timestamp is constructed and calibrated as a target timestamp; The target timestamp is combined with the real-time complete environmental parameters to obtain the real-time complete environmental parameters in a time series format, and the real-time complete environmental parameters in the time series format are converted into a visual view in the touch-controlled all-in-one machine and calibrated as an environmental parameter view.

3. According to the method for display management of a touch-control integrated machine based on environment perception as described in claim 1, it is characterized in that: The method of combining the monitored person image feature parameters, the environmental parameter view and the adjustable brightness threshold in the touch-controlled integrated machine to adaptively adjust the display brightness of the touch-controlled integrated machine is specifically as follows: When the state of the touch-control machine is the second-class state, a first brightness value adjustment scheme is output in the touch-control machine, and when the first brightness value adjustment scheme is output, a comfort test timestamp is preset, and all monitoring person image feature parameters in the comfort test timestamp are obtained, and are calibrated as first-class monitoring person image feature parameters; Among the one type of monitored person image characteristic parameters, obtain one type of monitored person image characteristic parameters of the eye position of the target worker in the agricultural greenhouse, and calculate the blinking frequency of the target worker in the agricultural greenhouse based on the one type of monitored person image characteristic parameters of the eye position, and mark it as the blinking frequency to be analyzed; If the first type of monitored person image characteristic parameters does not contain the first type of monitored person image characteristic parameters at the human eye position, controlling the touch-controlled integrated machine to continuously output the first brightness value adjustment solution; If a type of monitored person image characteristic parameter includes a type of monitored person image characteristic parameter of a human eye position, a blink frequency threshold is preset, and the blink frequency to be analyzed is analyzed. If the blink frequency to be analyzed is maintained less than the blink frequency threshold when the first brightness value adjustment scheme is output, the touch-controlled integrated machine is controlled to continuously output the first brightness value adjustment scheme; If the blinking frequency to be analyzed does not remain less than the blinking frequency threshold when the first brightness value adjustment scheme is output, all target brightness values ​​whose blinking frequency to be analyzed is less than the blinking frequency threshold are obtained and calibrated as appropriate brightness values ​​for the person, and an appropriate brightness value adjustment threshold for the person is constructed based on all appropriate brightness values ​​for the person; A second brightness adjustment scheme is generated, wherein the second brightness adjustment scheme is a real-time complete environment parameter based on a time series format, and adaptively adjusts the appropriate brightness value of the character at an appropriate brightness value adjustment threshold of the character.

4. According to the method for display management of a touch-control integrated machine based on environment perception as described in claim 1, it is characterized in that: Based on a type of monitoring person image feature parameters, a long short-term memory network algorithm is introduced into the touch-controlled integrated machine for intelligent training to optimize the adjustment efficiency of the touch-controlled integrated machine during display brightness adaptive adjustment. Specifically, When outputting the second brightness adjustment scheme, a long short-term memory network algorithm is introduced into the touch-controlled integrated machine, and based on the long short-term memory network algorithm, an initial model of the long short-term memory network is constructed; Get the input layer, LSTM layer and fully connected layer of the initial model of the long short-term memory network, where the number of fully connected layers is 1; Obtain the number of time steps and feature dimensions of different time steps in a class of monitoring person image feature parameters, and retrieve the standard number of layers of the input layer, the standard number of layers of the LSTM layer, and the standard number of neurons of a single LSTM layer in the historical data network based on the number of time steps and feature dimensions of different time steps in a class of monitoring person image feature parameters; Based on a single-layer fully connected layer, a standard number of input layers, a standard number of LSTM layers, and a standard number of neurons in a single-layer LSTM layer, updating model parameters of the long short-term memory network initial model to obtain a long short-term memory network training model; Based on the long short-term memory network training model, predict the appropriate brightness value adjustment thresholds of different agricultural greenhouse target workers; In the agricultural greenhouse, the number of target agricultural greenhouse workers is analyzed. When the number of target agricultural greenhouse workers is 1, the appropriate brightness value adjustment threshold of the person is adjusted to the appropriate brightness value adjustment threshold of the person corresponding to the target agricultural greenhouse worker; When the number of target agricultural greenhouse workers is greater than 1, the appropriate brightness value adjustment threshold for the person with the smallest threshold is selected from the appropriate brightness value adjustment thresholds for the different target agricultural greenhouse workers and outputted.

5. A touch-control integrated machine display management system based on environment perception, characterized in that: The touch-control machine display management system includes a memory and a processor, wherein the memory stores a touch-control machine display management method program. When the touch-control machine display management method program is executed by the processor, the touch-control machine display management method steps based on environmental perception as described in any one of claims 1 to 4 are implemented.

Images