Image content improving system for warehousing environment monitoring

Through the combination of convolutional neural network model and amplitude identification device, intelligently match and select the optimal smoothing algorithm to process video images, solving the problem of difficulty in matching video images in the prior art and improving image quality and signal-to-noise ratio.

CN118967500AInactive Publication Date: 2024-11-15NANJING LEJI & ELECTRONIC TECHNOLOGY CO LTD
View PDF 0 Cites 2 Cited by

Patent Information

Application Number
CN202411026121.3
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-07-30
Publication Date
2024-11-15
Estimated Expiration
Not applicable · inactive patent

AI Technical Summary

Technical Problem

The prior art is difficult to match the optimal smoothing algorithm for different video picture content, resulting in blurring of image edges and affecting image quality.

Method used

Using the convolutional neural network model after multiple learning, combining the amplitude identification device and parameter comparison device, the resolution of the gradient filtered image, the number of foreground pixels, the brightness value, the signal-to-noise ratio and the contrast, intelligently identify and select the best Suitable smoothing algorithms to perform smoothing processing to ensure optimal processing of images.

Benefits of technology

It realizes intelligent matching of contents for different video images, improves the signal-to-noise ratio of the image, ensures the best smoothing effect of the image, and avoids blurring of the edges of the image.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118967500A_ABST
    Figure CN118967500A_ABST
Patent Text Reader

Abstract

The invention relates to an image content improving system for warehousing environment monitoring, and the system comprises a warehousing triggering mechanism which is used for transmitting a visual collection request when detecting that new logistics goods enter a warehouse; the environment shooting mechanism is used for shooting the internal environment of the warehouse once when the visual acquisition request is received; and the parameter comparison device is used for taking the smoothing algorithm corresponding to the minimum maximum noise amplitude in the maximum noise amplitudes obtained by adopting the convolutional neural network model after multiple times of learning as a target smoothing algorithm. The image content improving system for warehousing environment monitoring is stable in operation and simple and convenient to control. The maximum noise amplitude of the smoothed image can be intelligently identified based on the image information of the warehouse picture and the algorithm mark data corresponding to the used smoothing algorithm, so that intelligent analysis of the optimal smoothing algorithm for the time-sharing image can be conveniently executed.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of image processing, and in particular to an image content enhancement system for warehouse environment monitoring. Background Art

[0002] Image smoothing refers to the fact that some areas with large brightness changes or some bright spots will appear on the remote sensing image due to the influence of factors such as sensors and atmosphere, also known as noise. This processing method to suppress noise and make the image brightness tend to be flat is image smoothing. Image smoothing is actually low-pass filtering, and the smoothing process will cause the image edges to become blurred. Image smoothing methods include: interpolation method, linear smoothing method, convolution method, etc. This processing method is smoothed according to the different image noises. For example, for salt and pepper noise, linear smoothing method is used.

[0003] Image smoothing can be applied to various sub-fields, such as performing image smoothing on warehouse images obtained by monitoring a warehouse to obtain better imaging quality. However, in actual operation, the video monitoring inside the warehouse at different times has different contents in each frame of video output in time-sharing, and the smoothing algorithms required to obtain the best image quality are also different. How to match the optimal smoothing algorithm for different video content is one of the technical problems that need to be solved at present. Summary of the invention

[0004] In order to solve the technical problems in the related fields, the present invention provides an image content enhancement system for warehousing environment monitoring, which can obtain the resolution of the gradient filtered image after targeted optimization of the warehouse screen, the number of foreground pixels and the brightness values ​​corresponding to each pixel, and at the same time obtain the signal-to-noise ratio and contrast of the gradient filtered image, and use a convolutional neural network model that has completed multiple learnings to intelligently identify the maximum noise amplitude of the processed image obtained after the gradient filtered image is smoothed using the smoothing algorithm based on the algorithm flag data corresponding to the smoothing algorithm used, the resolution of the gradient filtered image, the number of foreground pixels and the brightness values ​​corresponding to each pixel, the signal-to-noise ratio and contrast of the gradient filtered image, and use the smoothing algorithm corresponding to the maximum noise amplitude with the smallest value among the maximum noise amplitudes obtained by various smoothing algorithms using the convolutional neural network model that has completed multiple learnings as the target smoothing algorithm, thereby completing the intelligent analysis of the optimal smoothing algorithm for the gradient filtered image.

[0005] According to the present invention, there is provided an image content enhancement system for warehousing environment monitoring, the system comprising:

[0006] The inbound trigger mechanism is used to issue a visual collection request when it detects that new logistics goods have entered the warehouse, otherwise, it issues a signal to suspend collection;

[0007] An environment shooting mechanism, which is arranged at the top of the central position of the warehouse and connected to the warehouse entry trigger mechanism, is used to perform a shooting operation on the internal environment of the warehouse upon receiving the visual acquisition request, so as to obtain and output a corresponding warehouse environment image;

[0008] An on-site processing device, connected to the environment shooting mechanism, is used to perform histogram equalization processing on the received library environment image to obtain and output a corresponding equalized processed image;

[0009] A point image restoration device, connected to the field processing device, for performing single or multiple point image restoration processing on the received equalization processed image to obtain and output a corresponding signal restoration image;

[0010] A gradient filtering device, connected to the point image restoration device, for performing a gradient sharpening filtering process on the received signal restoration image to obtain and output a corresponding gradient filtered image;

[0011] an amplitude identification device connected to the gradient filtering device, for obtaining the resolution of the received gradient filtering image, the number of foreground pixels, and the brightness values ​​corresponding to the pixels, and obtaining the signal-to-noise ratio and contrast of the gradient filtering image, and using a convolutional neural network model that has completed multiple learnings to intelligently identify the maximum noise amplitude of the processed image obtained after the gradient filtering image is smoothed using the smoothing algorithm based on the algorithm flag data corresponding to the used smoothing algorithm, the resolution of the gradient filtering image, the number of foreground pixels, and the brightness values ​​corresponding to the pixels, and the signal-to-noise ratio and contrast of the gradient filtering image;

[0012] A parameter comparison device is connected to the amplitude identification device and is used to use the smoothing algorithm corresponding to the smallest maximum noise amplitude among the maximum noise amplitudes obtained by the convolutional neural network model after multiple learning by various smoothing algorithms as the target smoothing algorithm;

[0013] Among them, various smoothing algorithms include a non-scaling transformation fuzzy algorithm, a median fuzzy algorithm, a Gaussian fuzzy algorithm, and a bilateral smoothing fuzzy algorithm.

[0014] It can be seen that the present invention mainly has the following significant technical effects:

[0015] Firstly, the introduction of a customized amplitude identification device provides the necessary hardware resources for the analysis of the optimal smoothing algorithm, thereby obtaining the best matching smoothing algorithm for each warehouse frame to ensure the signal-to-noise ratio of the final image;

[0016] Secondly: obtain the resolution of the gradient filtered image after targeted optimization of the warehouse screen, the number of foreground pixels and the brightness values ​​corresponding to each pixel, and at the same time obtain the signal-to-noise ratio and contrast of the gradient filtered image, and use the convolutional neural network model after completing multiple learning to intelligently identify the maximum noise amplitude of the processed image obtained after the gradient filtered image is smoothed using the smoothing algorithm based on the algorithm mark data corresponding to the smoothing algorithm used, the resolution of the gradient filtered image, the number of foreground pixels and the brightness values ​​corresponding to each pixel, the signal-to-noise ratio and contrast of the gradient filtered image;

[0017] Again: various smoothing algorithms are used respectively, and the smoothing algorithm corresponding to the smallest maximum noise amplitude among the maximum noise amplitudes obtained by the convolutional neural network model after multiple learning is used as the target smoothing algorithm, thereby completing the intelligent analysis of the optimal smoothing algorithm for the gradient filtered image.

[0018] The image content enhancement system for warehouse environment monitoring of the present invention is stable in operation and easy to operate. Since the maximum noise amplitude of the smoothed image can be intelligently identified based on various image information of the warehouse screen and the algorithm mark data corresponding to the smoothing algorithm used, it is convenient to perform intelligent analysis of the optimal smoothing algorithm for the time-sharing image. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] The embodiments of the present invention will be described below with reference to the accompanying drawings, wherein:

[0020] Figure 1 Schematic diagram of the internal structure of an image content enhancement system for warehouse environment monitoring according to the first embodiment of the present invention.

[0021] Figure 2 Schematic diagram of the internal structure of an image content enhancement system for warehouse environment monitoring according to a second embodiment of the present invention.

[0022] Figure 3 Schematic diagram of the internal structure of an image content enhancement system for warehouse environment monitoring according to a third embodiment of the present invention. DETAILED DESCRIPTION

[0023] The following will describe in detail an embodiment of the image content enhancement system for warehouse environment monitoring of the present invention with reference to the accompanying drawings.

[0024] Figure 1 This is a schematic diagram of the internal structure of an image content enhancement system for warehouse environment monitoring according to a first embodiment of the present invention, wherein the system comprises:

[0025] The inbound trigger mechanism is used to issue a visual collection request when it detects that new logistics goods have entered the warehouse, otherwise, it issues a signal to suspend collection;

[0026] For example, the warehouse entry trigger mechanism is used to issue a visual acquisition request when detecting that new logistics goods enter the warehouse, otherwise, issue a suspended acquisition signal, including: a logic control device can be selected to implement the warehouse entry trigger mechanism, which is used to issue a visual acquisition request when detecting that new logistics goods enter the warehouse, otherwise, issue a suspended acquisition signal;

[0027] An environment shooting mechanism, which is arranged at the top of the central position of the warehouse and connected to the warehouse entry trigger mechanism, is used to perform a shooting operation on the internal environment of the warehouse upon receiving the visual acquisition request, so as to obtain and output a corresponding warehouse environment image;

[0028] An on-site processing device, connected to the environment shooting mechanism, is used to perform histogram equalization processing on the received library environment image to obtain and output a corresponding equalized processed image;

[0029] A point image restoration device, connected to the field processing device, for performing single or multiple point image restoration processing on the received equalization processed image to obtain and output a corresponding signal restoration image;

[0030] A gradient filtering device, connected to the point image restoration device, for performing a gradient sharpening filtering process on the received signal restoration image to obtain and output a corresponding gradient filtered image;

[0031] an amplitude identification device connected to the gradient filtering device, for obtaining the resolution of the received gradient filtering image, the number of foreground pixels, and the brightness values ​​corresponding to the pixels, and obtaining the signal-to-noise ratio and contrast of the gradient filtering image, and using a convolutional neural network model that has completed multiple learnings to intelligently identify the maximum noise amplitude of the processed image obtained after the gradient filtering image is smoothed using the smoothing algorithm based on the algorithm flag data corresponding to the used smoothing algorithm, the resolution of the gradient filtering image, the number of foreground pixels, and the brightness values ​​corresponding to the pixels, and the signal-to-noise ratio and contrast of the gradient filtering image;

[0032] A parameter comparison device is connected to the amplitude identification device and is used to use the smoothing algorithm corresponding to the smallest maximum noise amplitude among the maximum noise amplitudes obtained by the convolutional neural network model after multiple learning by various smoothing algorithms as the target smoothing algorithm;

[0033] Among them, various smoothing algorithms include non-scaling transformation fuzzy algorithm, median fuzzy algorithm, Gaussian fuzzy algorithm and bilateral smoothing fuzzy algorithm;

[0034] Wherein, the environment shooting mechanism is also used to suspend the shooting operation of the internal environment of the warehouse when receiving the suspend collection signal;

[0035] Among them, the convolutional neural network model that has completed multiple learnings intelligently identifies the maximum noise amplitude of the processed image obtained after the gradient filtered image is smoothed using the smoothing algorithm based on the algorithm flag data corresponding to the smoothing algorithm used, the resolution of the gradient filtered image, the number of foreground pixels and the brightness values ​​corresponding to each pixel, the signal-to-noise ratio and the contrast of the gradient filtered image. The method includes: numerically normalizing the algorithm flag data corresponding to the smoothing algorithm used, the resolution of the gradient filtered image, the number of foreground pixels and the brightness values ​​corresponding to each pixel, the signal-to-noise ratio and the contrast of the gradient filtered image, and then inputting them in parallel into the convolutional neural network model that has completed multiple learnings.

[0036] Figure 2 Schematic diagram of the internal structure of an image content enhancement system for warehouse environment monitoring according to a second embodiment of the present invention.

[0037] Compared to Figure 1 The image content enhancement system for warehousing environment monitoring according to the second embodiment of the present invention may further include:

[0038] a wireless transceiver device, connected to the field processing device, the point image restoration device, the gradient filtering device and the amplitude identification device, respectively, and used for receiving various configuration information of the field processing device, the point image restoration device, the gradient filtering device and the amplitude identification device in a time-sharing manner, so as to realize real-time configuration of the current working mode of the field processing device, the point image restoration device, the gradient filtering device and the amplitude identification device;

[0039] The wireless transceiver is connected to the field processing device, the point image restoration device, the gradient filter device and the amplitude identification device, respectively, and is used to receive the configuration information of the field processing device, the point image restoration device, the gradient filter device and the amplitude identification device in a time-sharing manner, so as to realize the real-time configuration of the current working mode of the field processing device, the point image restoration device, the gradient filter device and the amplitude identification device, respectively. The wireless transceiver is connected to the field processing device, the point image restoration device, the gradient filter device and the amplitude identification device, respectively, through a wireless communication link;

[0040] The wireless transceiver device is connected to the field processing device, the point image restoration device, the gradient filtering device and the amplitude identification device respectively through a time division duplex communication link, including: the field processing device, the point image restoration device, the gradient filtering device and the amplitude identification device have different IP address data;

[0041] The wireless transceiver device is connected to the field processing device, the point image restoration device, the gradient filtering device and the amplitude identification device through wireless communication links, including: the wireless transceiver device is connected to the field processing device, the point image restoration device, the gradient filtering device and the amplitude identification device through time division duplex communication links;

[0042] Among them, the wireless transceiver device is connected to the field processing equipment, the point image restoration equipment, the gradient filtering equipment and the amplitude identification device respectively through wireless communication links, including: the wireless transceiver device is connected to the field processing equipment, the point image restoration equipment, the gradient filtering equipment and the amplitude identification device respectively through frequency division duplex communication links.

[0043] Figure 3 Schematic diagram of the internal structure of an image content enhancement system for warehouse environment monitoring according to a third embodiment of the present invention.

[0044] Compared to Figure 1 The image content enhancement system for warehousing environment monitoring according to the third embodiment of the present invention may further include:

[0045] An HDMI transmission device, connected to the field processing device, the point image restoration device, the gradient filtering device and the amplitude identification device, respectively, for providing data input operation and data output operation for the field processing device, the point image restoration device, the gradient filtering device and the amplitude identification device in a time-sharing manner;

[0046] The HDMI transmission device is respectively connected to the field processing device, the point image restoration device, the gradient filtering device and the amplitude identification device, and is used to provide data input operation and data output operation for the field processing device, the point image restoration device, the gradient filtering device and the amplitude identification device in a time-sharing manner, including: the HDMI transmission device includes a plurality of HDMI transmission interfaces, which are respectively connected to the field processing device, the point image restoration device, the gradient filtering device and the amplitude identification device, and are used to provide data input operation and data output operation for the field processing device, the point image restoration device, the gradient filtering device and the amplitude identification device in a time-sharing manner;

[0047] The HDMI transmission device includes a plurality of HDMI transmission interfaces, which are respectively connected to the field processing device, the point image restoration device, the gradient filtering device and the amplitude identification device, and are used to provide data input operation and data output operation for the field processing device, the point image restoration device, the gradient filtering device and the amplitude identification device in a time-sharing manner, including: the internal structures of the plurality of HDMI transmission interfaces are the same;

[0048] And wherein, the HDMI transmission device includes multiple HDMI transmission interfaces, which are used to be connected to the field processing equipment, the point image restoration equipment, the gradient filtering equipment and the amplitude identification equipment respectively, and are used to provide data input operations and data output operations for the field processing equipment, the point image restoration equipment, the gradient filtering equipment and the amplitude identification equipment in a time-sharing manner, including: the multiple HDMI transmission interfaces use the same pulse generating circuit.

[0049] In addition, in the image content enhancement system for warehouse environment monitoring, the convolutional neural network model that has completed multiple learnings uses the algorithm flag data corresponding to the smoothing algorithm used, the resolution of the gradient filtered image, the number of foreground pixels and the brightness values ​​corresponding to each pixel, the signal-to-noise ratio and contrast of the gradient filtered image to intelligently identify the maximum noise amplitude of the processed image obtained after the gradient filtered image is smoothed using the smoothing algorithm, and also includes: running the convolutional neural network model that has completed multiple learnings to obtain the maximum noise amplitude of the processed image output by the convolutional neural network model that has completed multiple learnings and represented in numerical normalized form.

[0050] Although the present invention has been fully described in an example manner with reference to the accompanying drawings, it should be appreciated that various changes and modifications are apparent to those skilled in the art. Therefore, unless such changes and modifications depart from the protection scope of the present invention, they should be understood to be included in the present invention.

Claims

1. An image content enhancement system for warehousing environment monitoring, characterized in that: The system comprises: The inbound trigger mechanism is used to issue a visual collection request when it detects that new logistics goods have entered the warehouse, otherwise, it issues a signal to suspend collection; An environment shooting mechanism, which is arranged at the top of the central position of the warehouse and connected to the warehouse entry trigger mechanism, is used to perform a shooting operation on the internal environment of the warehouse upon receiving the visual acquisition request, so as to obtain and output a corresponding warehouse environment image; An on-site processing device, connected to the environment shooting mechanism, is used to perform histogram equalization processing on the received library environment image to obtain and output a corresponding equalized processed image; A point image restoration device, connected to the field processing device, for performing single or multiple point image restoration processing on the received equalization processed image to obtain and output a corresponding signal restoration image; A gradient filtering device, connected to the point image restoration device, for performing a gradient sharpening filtering process on the received signal restoration image to obtain and output a corresponding gradient filtered image; an amplitude identification device connected to the gradient filtering device, for obtaining the resolution of the received gradient filtering image, the number of foreground pixels, and the brightness values ​​corresponding to the pixels, and obtaining the signal-to-noise ratio and contrast of the gradient filtering image, and using a convolutional neural network model that has completed multiple learnings to intelligently identify the maximum noise amplitude of the processed image obtained after the gradient filtering image is smoothed using the smoothing algorithm based on the algorithm flag data corresponding to the used smoothing algorithm, the resolution of the gradient filtering image, the number of foreground pixels, and the brightness values ​​corresponding to the pixels, and the signal-to-noise ratio and contrast of the gradient filtering image; A parameter comparison device is connected to the amplitude identification device and is used to use the smoothing algorithm corresponding to the smallest maximum noise amplitude among the maximum noise amplitudes obtained by the convolutional neural network model after multiple learning by various smoothing algorithms as the target smoothing algorithm; Among them, various smoothing algorithms include a non-scaling transformation fuzzy algorithm, a median fuzzy algorithm, a Gaussian fuzzy algorithm, and a bilateral smoothing fuzzy algorithm.

2. The image content enhancement system for warehouse environment monitoring according to claim 1, characterized in that: The environment shooting mechanism is also used to suspend the shooting operation of the internal environment of the warehouse when receiving the suspend collection signal; Among them, the convolutional neural network model that has completed multiple learnings intelligently identifies the maximum noise amplitude of the processed image obtained after the gradient filtered image is smoothed using the smoothing algorithm based on the algorithm flag data corresponding to the smoothing algorithm used, the resolution of the gradient filtered image, the number of foreground pixels and the brightness values ​​corresponding to each pixel, the signal-to-noise ratio and the contrast of the gradient filtered image. The method includes: numerically normalizing the algorithm flag data corresponding to the smoothing algorithm used, the resolution of the gradient filtered image, the number of foreground pixels and the brightness values ​​corresponding to each pixel, the signal-to-noise ratio and the contrast of the gradient filtered image, and then inputting them in parallel into the convolutional neural network model that has completed multiple learnings.

3. The image content enhancement system for warehousing environment monitoring according to claim 2, characterized in that: The system further comprises: a wireless transceiver device, connected to the field processing device, the point image restoration device, the gradient filtering device and the amplitude identification device, respectively, and used for receiving various configuration information of the field processing device, the point image restoration device, the gradient filtering device and the amplitude identification device in a time-sharing manner, so as to realize real-time configuration of the current working mode of the field processing device, the point image restoration device, the gradient filtering device and the amplitude identification device; Among them, the wireless transceiver device is respectively connected to the field processing equipment, the point image restoration equipment, the gradient filtering equipment and the amplitude identification equipment, and is used for receiving the respective configuration information of the field processing equipment, the point image restoration equipment, the gradient filtering equipment and the amplitude identification equipment in a time-sharing manner, so as to realize the real-time configuration of the current working mode of the field processing equipment, the point image restoration equipment, the gradient filtering equipment and the amplitude identification equipment, including: the wireless transceiver device is respectively connected to the field processing equipment, the point image restoration equipment, the gradient filtering equipment and the amplitude identification equipment through a wireless communication link.

4. The image content enhancement system for storage environment monitoring according to claim 3, characterized in that: The wireless transceiver device is connected to the field processing device, the point image restoration device, the gradient filtering device and the amplitude identification device respectively through a time division duplex communication link, including: the field processing device, the point image restoration device, the gradient filtering device and the amplitude identification device have different IP address data.

5. The image content enhancement system for storage environment monitoring according to claim 4, characterized in that: The wireless transceiver device is connected to the field processing device, the point image restoration device, the gradient filtering device and the amplitude identification device respectively through wireless communication links, including: the wireless transceiver device is connected to the field processing device, the point image restoration device, the gradient filtering device and the amplitude identification device respectively through time division duplex communication links.

6. The image content enhancement system for storage environment monitoring according to claim 4, characterized in that: The wireless transceiver device is connected to the field processing equipment, the point image restoration equipment, the gradient filtering equipment and the amplitude identification equipment respectively through wireless communication links, including: the wireless transceiver device is connected to the field processing equipment, the point image restoration equipment, the gradient filtering equipment and the amplitude identification equipment respectively through frequency division duplex communication links.

7. The image content enhancement system for warehouse environment monitoring according to claim 2, characterized in that: The system further comprises: An HDMI transmission device, connected to the field processing device, the point image restoration device, the gradient filtering device and the amplitude identification device, respectively, for providing data input operation and data output operation for the field processing device, the point image restoration device, the gradient filtering device and the amplitude identification device in a time-sharing manner; Among them, the HDMI transmission device is respectively connected to the field processing device, the point image restoration device, the gradient filtering device and the amplitude identification device, and is used to provide data input operations and data output operations for the field processing device, the point image restoration device, the gradient filtering device and the amplitude identification device in a time-sharing manner, including: the HDMI transmission device includes multiple HDMI transmission interfaces, which are respectively connected to the field processing device, the point image restoration device, the gradient filtering device and the amplitude identification device, and are used to provide data input operations and data output operations for the field processing device, the point image restoration device, the gradient filtering device and the amplitude identification device in a time-sharing manner.

8. The image content enhancement system for storage environment monitoring according to claim 7, characterized in that: The HDMI transmission device includes multiple HDMI transmission interfaces, which are used to be connected to the field processing equipment, the point image restoration equipment, the gradient filtering equipment and the amplitude identification equipment respectively, and are used to provide data input operations and data output operations for the field processing equipment, the point image restoration equipment, the gradient filtering equipment and the amplitude identification equipment in a time-sharing manner, including: the internal structures of the multiple HDMI transmission interfaces are the same.

9. The image content enhancement system for warehouse environment monitoring according to claim 7, characterized in that: The HDMI transmission device includes multiple HDMI transmission interfaces, which are used to be connected to the field processing device, the point image restoration device, the gradient filtering device and the amplitude identification device respectively, and are used to provide data input operations and data output operations for the field processing device, the point image restoration device, the gradient filtering device and the amplitude identification device in a time-sharing manner, including: the multiple HDMI transmission interfaces use the same pulse generating circuit.

Citation Information

Cited By

  • Neural network application system for image data processing

    CN119006327A

  • Neural network application system for image data processing

    CN119006327B