A surveillance video sharpening method and device

Abstract

The present invention discloses a surveillance video sharpening method and device. The method comprises: collecting original image data of a surveillance video; splitting the original image data to obtain a key data area and a non-key data area; sharpening the key data area and the non-key data area respectively according to a sharpening level index to obtain a first sharpened image and a second sharpened image; fitting the first sharpened image and the second sharpened image to obtain an image sharpening result. The present invention solves the technical problem that the image sharpening process in the prior art is to simply directly input the entire image data to be sharpened into a sharpening calculation formula or a sharpening processing model, and output the sharpened image data, and cannot quickly and specifically sharpen the key image area when the image is complex and the amount of image sharpening is large, thereby reducing the overall efficiency of the sharpening work.

Description

Technical Field

[0001] The present invention relates to the field of surveillance image processing, and in particular to a surveillance video sharpening method and device. Background Art

[0002] With the continuous development of intelligent technology, people are increasingly using intelligent devices in their lives, work and study. The use of intelligent technology has improved the quality of people's lives and increased the efficiency of their study and work.

[0003] Currently, when it comes to image processing of surveillance videos, if local or global image sharpening is required, the dynamic image is usually decomposed into static image data in frames. The static image data is then used as the data source for the image sharpening process. The image parameters are then sharpened according to a fixed sharpening calculation formula to obtain the sharpened image data. However, the existing image sharpening process simply inputs the entire image data to be sharpened directly into the sharpening calculation formula or sharpening processing model and outputs the sharpened image data. This makes it impossible to quickly and specifically sharpen key image areas when the image is complex and the amount of image sharpening is large, thereby reducing the overall efficiency of the sharpening process.

[0004] To address the above-mentioned problems, no effective solutions have been proposed so far. Summary of the Invention

[0005] The embodiments of the present invention provide a surveillance video sharpening method and device to at least solve the technical problem that the existing technology for image sharpening processing only directly inputs the entire image data to be sharpened into a sharpening calculation formula or a sharpening processing model, and outputs the sharpened image data. When the image is complex and the image sharpening amount is large, it is impossible to quickly and specifically sharpen the key image areas, thereby reducing the overall efficiency of the sharpening work.

[0006] According to one aspect of an embodiment of the present invention, a surveillance video sharpening method is provided, comprising: acquiring original image data of a surveillance video; splitting the original image data to obtain a key data area and a non-key data area; sharpening the key data area and the non-key data area respectively according to a sharpening level index to obtain a first sharpened image and a second sharpened image; and fitting the first sharpened image and the second sharpened image to obtain an image sharpening result.

[0007] Optionally, the splitting of the original image data to obtain the key data area and the non-key data area includes: pixelating the original image data to obtain a global pixel set based on a pixelated coordinate set; splitting and dividing the global pixel set according to preset scene rules to obtain the key data area and the non-key data area.

[0008] Optionally, before sharpening the key data area and the non-key data area according to the sharpening level index to obtain the first sharpened image and the second sharpened image, the method also includes: generating a sharpening threshold parameter according to the preset scene rule; generating the sharpening level index according to the sharpening threshold parameter and the sharpening peak parameter, wherein the sharpening level index includes: a high sharpening index and a low sharpening index.

[0009] Optionally, the sharpening processing of the key data area and the non-key data area according to the sharpening level index to obtain the first sharpened image and the second sharpened image includes: combining the key data area and the high sharpening index for sharpening to obtain the first sharpened image; combining the non-key data area and the low sharpening index for sharpening to obtain the second sharpened image.

[0010] According to another aspect of an embodiment of the present invention, a surveillance video sharpening device is also provided, including: an acquisition module for acquiring original image data of a surveillance video; a splitting module for splitting the original image data to obtain a key data area and a non-key data area; a sharpening module for sharpening the key data area and the non-key data area respectively according to a sharpening level index to obtain a first sharpened image and a second sharpened image; and a fitting module for fitting the first sharpened image and the second sharpened image to obtain an image sharpening result.

[0011] Optionally, the segmentation module includes: a processing unit for pixelating the original image data to obtain a global pixel set based on a pixelated coordinate set; a segmentation unit for segmenting and dividing the global pixel set according to preset scene rules to obtain the key data area and the non-key data area.

[0012] Optionally, the device also includes: a generation module for generating a sharpening threshold parameter according to the preset scene rule; an indicator module for generating the sharpening level indicator according to the sharpening threshold parameter and the sharpening peak parameter, wherein the sharpening level indicator includes: a high sharpening index and a low sharpening index.

[0013] Optionally, the sharpening module includes: a first sharpening unit, used to sharpen the key data area and the high sharpening index in combination to obtain the first sharpened image; and a second sharpening unit, used to sharpen the non-key data area and the low sharpening index in combination to obtain the second sharpened image.

[0014] According to another aspect of an embodiment of the present invention, a non-volatile storage medium is provided. The non-volatile storage medium includes a stored program. When the program is executed, the device where the non-volatile storage medium is located is controlled to execute a surveillance video sharpening method.

[0015] According to another aspect of an embodiment of the present invention, an electronic device is provided, comprising a processor and a memory; the memory stores computer-readable instructions, and the processor is configured to execute the computer-readable instructions, wherein the computer-readable instructions execute a surveillance video sharpening method when executed.

[0016] In an embodiment of the present invention, original image data of a surveillance video is collected; the original image data is split to obtain a key data area and a non-key data area; the key data area and the non-key data area are sharpened according to a sharpening level index to obtain a first sharpened image and a second sharpened image; the first sharpened image and the second sharpened image are fitted to obtain an image sharpening result. This solves the technical problem that in the prior art, the sharpening processing of an image is merely to directly input the entire image data to be sharpened into a sharpening calculation formula or a sharpening processing model, and output the sharpened image data, and it is impossible to quickly and specifically sharpen the key image area when the image is complex and the amount of image sharpening is large, thereby reducing the overall efficiency of the sharpening work. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] The drawings described herein are used to provide a further understanding of the present invention and constitute a part of this application. The exemplary embodiments of the present invention and their descriptions are used to explain the present invention and do not constitute an improper limitation of the present invention. In the drawings:

[0018] Figure 1 is a flowchart of a surveillance video sharpening method according to an embodiment of the present invention;

[0019] Figure 2 This is a structural block diagram of a surveillance video sharpening device according to an embodiment of the present invention;

[0020] Figure 3 is a block diagram of a terminal device for executing a method according to an embodiment of the present invention;

[0021] Figure 4It is a storage unit for holding or carrying a program code for implementing a method according to an embodiment of the present invention. DETAILED DESCRIPTION

[0022] In order to enable those skilled in the art to better understand the solutions of the present invention, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the embodiments described are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making creative efforts should fall within the scope of protection of the present invention.

[0023] It should be noted that the terms "first", "second", etc. in the description and claims of the present invention and the above-mentioned drawings are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that the numbers used in this way can be interchanged where appropriate, so that the embodiments of the present invention described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0024] According to an embodiment of the present invention, a method embodiment of a surveillance video sharpening method is provided. It should be noted that the steps shown in the flowchart of the accompanying drawings can be executed in a computer system such as a set of computer-executable instructions, and although a logical order is shown in the flowchart, in some cases, the steps shown or described can be executed in an order different from that shown here.

[0025] Example 1

[0026] Figure 1 is a flow chart of a surveillance video sharpening method according to an embodiment of the present invention. Figure 1 As shown, the method includes the following steps:

[0027] Step S102: collecting original image data of the surveillance video.

[0028] Step S104 : splitting the original image data to obtain a key data area and a non-key data area.

[0029] Step S106 , performing sharpening processing on the key data area and the non-key data area according to the sharpening level index to obtain a first sharpened image and a second sharpened image.

[0030] Step S108: Fitting the first sharpened image and the second sharpened image to obtain an image sharpening result.

[0031] Optionally, the splitting of the original image data to obtain the key data area and the non-key data area includes: pixelating the original image data to obtain a global pixel set based on a pixelated coordinate set; splitting and dividing the global pixel set according to preset scene rules to obtain the key data area and the non-key data area.

[0032] Optionally, before sharpening the key data area and the non-key data area according to the sharpening level index to obtain the first sharpened image and the second sharpened image, the method also includes: generating a sharpening threshold parameter according to the preset scene rule; generating the sharpening level index according to the sharpening threshold parameter and the sharpening peak parameter, wherein the sharpening level index includes: a high sharpening index and a low sharpening index.

[0033] Optionally, the sharpening processing of the key data area and the non-key data area according to the sharpening level index to obtain the first sharpened image and the second sharpened image includes: combining the key data area and the high sharpening index for sharpening to obtain the first sharpened image; combining the non-key data area and the low sharpening index for sharpening to obtain the second sharpened image.

[0034] Through the above embodiments, the technical problem that the image sharpening processing in the prior art is only to directly input the entire image data to be sharpened into the sharpening calculation formula or the sharpening processing model, and output the sharpened image data, is solved, and it is impossible to quickly and specifically sharpen the key image areas when the image is complex and the image sharpening amount is large, thereby reducing the overall efficiency of the sharpening work.

[0035] Example 2

[0036] Figure 2 is a structural block diagram of a surveillance video sharpening device according to an embodiment of the present invention. Figure 2 As shown, the device includes:

[0037] The acquisition module 20 is used to acquire the original image data of the surveillance video.

[0038] The splitting module 22 is used to split the original image data to obtain a key data area and a non-key data area.

[0039] The sharpening module 24 is configured to perform sharpening processing on the key data region and the non-key data region according to a sharpening level index to obtain a first sharpened image and a second sharpened image.

[0040] The fitting module 26 is configured to fit the first sharpened image and the second sharpened image to obtain an image sharpening result.

[0041] Optionally, the segmentation module includes: a processing unit for pixelating the original image data to obtain a global pixel set based on a pixelated coordinate set; a segmentation unit for segmenting and dividing the global pixel set according to preset scene rules to obtain the key data area and the non-key data area.

[0042] Optionally, the device also includes: a generation module for generating a sharpening threshold parameter according to the preset scene rule; an indicator module for generating the sharpening level indicator according to the sharpening threshold parameter and the sharpening peak parameter, wherein the sharpening level indicator includes: a high sharpening index and a low sharpening index.

[0043] Optionally, the sharpening module includes: a first sharpening unit, used to sharpen the key data area and the high sharpening index in combination to obtain the first sharpened image; and a second sharpening unit, used to sharpen the non-key data area and the low sharpening index in combination to obtain the second sharpened image.

[0044] According to another aspect of an embodiment of the present invention, a non-volatile storage medium is provided. The non-volatile storage medium includes a stored program. When the program is executed, the device where the non-volatile storage medium is located is controlled to execute a surveillance video sharpening method.

[0045] Specifically, the above method includes: collecting raw image data of a surveillance video; splitting the raw image data to obtain a key data area and a non-key data area; sharpening the key data area and the non-key data area according to a sharpening level index to obtain a first sharpened image and a second sharpened image; fitting the first sharpened image and the second sharpened image to obtain an image sharpening result. Optionally, splitting the raw image data to obtain a key data area and a non-key data area includes: pixelating the raw image data to obtain a global pixel set based on a pixelated coordinate set; splitting and dividing the global pixel set according to preset scene rules to obtain the key data area and the non-key data area. Optionally, before sharpening the key data area and the non-key data area according to the sharpening level index to obtain the first sharpened image and the second sharpened image, the method further includes: generating a sharpening threshold parameter according to the preset scene rule; generating the sharpening level index according to the sharpening threshold parameter and the sharpening peak parameter, wherein the sharpening level index includes: a high sharpening index and a low sharpening index. Optionally, sharpening the key data area and the non-key data area according to the sharpening level index to obtain the first sharpened image and the second sharpened image includes: combining the key data area with the high sharpening index for sharpening to obtain the first sharpened image; combining the non-key data area with the low sharpening index for sharpening to obtain the second sharpened image.

[0046] According to another aspect of an embodiment of the present invention, an electronic device is provided, comprising a processor and a memory; the memory stores computer-readable instructions, and the processor is configured to execute the computer-readable instructions, wherein the computer-readable instructions execute a surveillance video sharpening method when executed.

[0047] Specifically, the above method includes: collecting raw image data of a surveillance video; splitting the raw image data to obtain a key data area and a non-key data area; sharpening the key data area and the non-key data area according to a sharpening level index to obtain a first sharpened image and a second sharpened image; fitting the first sharpened image and the second sharpened image to obtain an image sharpening result. Optionally, splitting the raw image data to obtain a key data area and a non-key data area includes: pixelating the raw image data to obtain a global pixel set based on a pixelated coordinate set; splitting and dividing the global pixel set according to preset scene rules to obtain the key data area and the non-key data area. Optionally, before sharpening the key data area and the non-key data area according to the sharpening level index to obtain the first sharpened image and the second sharpened image, the method further includes: generating a sharpening threshold parameter according to the preset scene rule; generating the sharpening level index according to the sharpening threshold parameter and the sharpening peak parameter, wherein the sharpening level index includes: a high sharpening index and a low sharpening index. Optionally, sharpening the key data area and the non-key data area according to the sharpening level index to obtain the first sharpened image and the second sharpened image includes: combining the key data area with the high sharpening index for sharpening to obtain the first sharpened image; combining the non-key data area with the low sharpening index for sharpening to obtain the second sharpened image.

[0048] The serial numbers of the above embodiments of the present invention are for description only and do not represent the advantages or disadvantages of the embodiments.

[0049] In the above embodiments of the present invention, the description of each embodiment has its own focus. For parts that are not described in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0050] In the several embodiments provided in this application, it should be understood that the disclosed technical content can be implemented in other ways. Among them, the device embodiments described above are only exemplary. For example, the division of the units can be a logical function division. In actual implementation, there may be other division methods, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of units or modules, which can be electrical or other forms.

[0051] The units described as separate components may or may not be physically separate, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed across multiple units. Some or all of the units may be selected according to actual needs to achieve the purpose of the present embodiment.

[0052] in addition, Figure 3 This is a schematic diagram of the hardware structure of a terminal device provided in one embodiment of the present application. Figure 3 As shown, the terminal device may include an input device 30, a processor 31, an output device 32, a memory 33, and at least one communication bus 34. Communication bus 34 is used to implement communication between components. Memory 33 may include high-speed RAM memory or non-volatile storage (NVM), such as at least one disk storage device. Memory 33 may store various programs for performing various processing functions and implementing the method steps of this embodiment.

[0053] Optionally, the processor 31 may be implemented as a central processing unit (CPU), an application-specific integrated circuit (ASIC), a digital signal processor (DSP), a digital signal processing device (DSPD), a programmable logic device (PLD), a field programmable gate array (FPGA), a controller, a microcontroller, a microprocessor or other electronic components, and the processor 31 may be coupled to the input device 30 and the output device 32 via a wired or wireless connection.

[0054] Optionally, the input device 30 may include multiple input devices, such as a user interface for the user, a device interface for the device, a software programmable interface, a camera, and a sensor. Optionally, the device interface for the device may be a wired interface for data transmission between devices, or a hardware plug-in interface for data transmission between devices (such as a USB interface, a serial port, etc.); optionally, the user interface for the user may be, for example, a user-oriented control button, a voice input device for receiving voice input, and a touch sensing device for receiving user touch input (such as a touch screen or touchpad with touch sensing function); optionally, the software programmable interface may be, for example, an entry for users to edit or modify programs, such as an input pin interface or input interface of a chip; optionally, the transceiver may be a radio frequency transceiver chip with communication function, a baseband processing chip, and a transceiver antenna, etc. Audio input devices such as microphones may receive voice data. The output device 32 may include output devices such as a display and speakers.

[0055] In this embodiment, the processor of the terminal device includes functions for executing each module of the data processing device in each device. The specific functions and technical effects can be referred to the above embodiments and will not be repeated here.

[0056] Figure 4 A schematic diagram of the hardware structure of a terminal device provided in another embodiment of the present application. Figure 4 Yes Figure 3 A specific embodiment in the implementation process. Figure 4 As shown, the terminal device of this embodiment includes a processor 41 and a memory 42.

[0057] The processor 41 executes the computer program code stored in the memory 42 to implement the method in the above embodiment.

[0058] The memory 42 is configured to store various types of data to support operations on the terminal device. Examples of such data include instructions for any application or method operating on the terminal device, such as messages, images, and videos. The memory 42 may include random access memory (RAM) and may also include non-volatile memory, such as at least one disk drive.

[0059] Optionally, the processor 41 is provided in the processing component 40. The terminal device may further include: a communication component 43, a power component 44, a multimedia component 45, an audio component 46, an input / output interface 47, and / or a sensor component 48. The specific components included in the terminal device are set according to actual needs and are not limited in this embodiment.

[0060] The processing component 40 generally controls the overall operation of the terminal device. The processing component 40 may include one or more processors 41 to execute instructions to complete all or part of the steps of the above-described method. Furthermore, the processing component 40 may include one or more modules to facilitate interaction between the processing component 40 and other components. For example, the processing component 40 may include a multimedia module to facilitate interaction between the multimedia component 45 and the processing component 40.

[0061] The power supply component 44 provides power to various components of the terminal device. The power supply component 44 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to the terminal device.

[0062] The multimedia component 45 includes a display screen that provides an output interface between the terminal device and the user. In some embodiments, the display screen may include a liquid crystal display (LCD) and a touch panel (TP). If the display screen includes a touch panel, the display screen may be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundaries of a touch or slide action, but also detect the duration and pressure associated with the touch or slide operation.

[0063] The audio component 46 is configured to output and / or input audio signals. For example, the audio component 46 includes a microphone (MIC), which is configured to receive external audio signals when the terminal device is in an operating mode, such as a voice recognition mode. The received audio signal can be further stored in the memory 42 or transmitted via the communication component 43. In some embodiments, the audio component 46 also includes a speaker for outputting audio signals.

[0064] The input / output interface 47 provides an interface between the processing component 40 and peripheral interface modules, such as click wheels, buttons, etc. These buttons may include, but are not limited to, volume buttons, start buttons, and lock buttons.

[0065] The sensor assembly 48 includes one or more sensors for providing various status assessments for the terminal device. For example, the sensor assembly 48 can detect the open / closed state of the terminal device, the relative positioning of components, and the presence or absence of user contact with the terminal device. The sensor assembly 48 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact, including detecting the distance between the user and the terminal device. In some embodiments, the sensor assembly 48 may also include a camera, etc.

[0066] The communication component 43 is configured to facilitate wired or wireless communication between the terminal device and other devices. The terminal device can access a wireless network based on a communication standard, such as WiFi, 2G, or 3G, or a combination thereof. In one embodiment, the terminal device may include a SIM card slot for inserting a SIM card, allowing the terminal device to log into a GPRS network and establish communication with a server via the Internet.

[0067] From the above, we can see that Figure 4 The communication component 43, audio component 46, input / output interface 47, and sensor component 48 involved in the embodiment can all be used as Figure 3 Implementation of the input device in the embodiment.

[0068] In the several embodiments provided in this application, it should be understood that the disclosed technical content can be implemented in other ways. Among them, the device embodiments described above are only exemplary. For example, the division of the units can be a logical function division. In actual implementation, there may be other division methods, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of units or modules, which can be electrical or other forms.

[0069] The units described as separate components may or may not be physically separate, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed across multiple units. Some or all of the units may be selected according to actual needs to achieve the purpose of the present embodiment.

[0070] In addition, the functional units in the various embodiments of the present invention may be integrated into a single processing unit, each unit may exist physically separately, or two or more units may be integrated into a single unit. The aforementioned integrated units may be implemented in the form of hardware or software functional units.

[0071] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, or the part that contributes to the prior art, or all or part of the technical solution can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes several instructions for enabling a computer device (which can be a personal computer, server or network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present invention. The aforementioned storage medium includes: U disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), mobile hard disk, magnetic disk or optical disk, etc. Various media that can store program codes.

[0072] The above is only a preferred embodiment of the present invention. It should be pointed out that for ordinary technicians in this technical field, several improvements and modifications can be made without departing from the principles of the present invention. These improvements and modifications should also be regarded as within the scope of protection of the present invention.

Claims

1. A surveillance video sharpening method, characterized in that: include: Collect raw image data of surveillance video; Splitting the original image data to obtain key data areas and non-key data areas; Sharpening the key data area and the non-key data area respectively according to a sharpening level index to obtain a first sharpened image and a second sharpened image; Fitting the first sharpened image and the second sharpened image to obtain an image sharpening result; The splitting of the original image data to obtain the key data area and the non-key data area includes: Pixelating the original image data to obtain a global pixel set based on a pixelated coordinate set; Splitting and dividing the global pixel set according to preset scene rules to obtain the key data area and the non-key data area; Before performing sharpening processing on the key data area and the non-key data area according to the sharpening level index to obtain the first sharpened image and the second sharpened image, the method further includes: Generate a sharpening threshold parameter according to the preset scene rule; Generate the sharpening level index according to the sharpening threshold parameter and the sharpening peak parameter, wherein the sharpening level index includes: a high sharpening index and a low sharpening index; The sharpening the key data area and the non-key data area according to the sharpening level index to obtain the first sharpened image and the second sharpened image includes: Sharpening the key data area and the high sharpness index to obtain the first sharpened image; The non-critical data area and the low sharpness index are combined for sharpening to obtain the second sharpened image.

2. A surveillance video sharpening device, characterized in that: include: An acquisition module, used to acquire raw image data of surveillance videos; A splitting module, configured to split the original image data to obtain a key data area and a non-key data area; a sharpening module, configured to perform sharpening processing on the key data area and the non-key data area respectively according to a sharpening level index to obtain a first sharpened image and a second sharpened image; a fitting module, configured to fit the first sharpened image and the second sharpened image to obtain an image sharpening result; The splitting module includes: a processing unit, configured to perform pixelation processing on the original image data to obtain a global pixel set based on a pixelated coordinate set; a splitting unit, configured to split and divide the global pixel set according to a preset scene rule to obtain the key data area and the non-key data area; The device further comprises: A generating module, configured to generate a sharpening threshold parameter according to the preset scene rule; An indicator module, configured to generate the sharpening level indicator according to the sharpening threshold parameter and the sharpening peak parameter, wherein the sharpening level indicator includes: a high sharpening indicator and a low sharpening indicator; The sharpening module includes: A first sharpening unit, configured to perform sharpening on the key data area and the high sharpening index to obtain the first sharpened image; The second sharpening unit is configured to perform sharpening on the non-critical data area in combination with the low sharpening index to obtain the second sharpened image.

3. A non-volatile storage medium, characterized in that: The non-volatile storage medium includes a stored program, wherein when the program is executed, the device where the non-volatile storage medium is located is controlled to execute the method according to claim 1.

4. An electronic device, characterized in that: The method comprises a processor and a memory; the memory stores computer-readable instructions, and the processor is configured to execute the computer-readable instructions, wherein the computer-readable instructions execute the method according to claim 1 when executed.

Images