Method for uploading camera monitoring video, electronic equipment and storage medium

By obtaining multi-frame images in the camera monitoring system and determining the target area, filtering irrelevant areas and uploading videos only when there are changes in non-target areas, the frequent video uploading problems caused by irrelevant objects are solved, which significantly reduces storage and network occupation and improves the use of the data. Video analysis efficiency.

CN119094697APending Publication Date: 2024-12-06GEER TECH CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202411028392.2
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-07-29
Publication Date
2024-12-06

AI Technical Summary

Technical Problem

When existing camera surveillance systems detect unrelated objects such as TVs or fish tanks, they frequently trigger video storage and upload, causing the cloud or storage device to occupy a large amount of invalid video, resulting in wasting storage space and bandwidth.

Method used

By acquiring multi-frame images, determining the target area and filtering the irrelevant areas, uploading videos only when there is a change in the non-target area, and using technologies such as grayscale image difference calculation and threshold filtering to accurately identify the irrelevant areas.

Benefits of technology

It effectively reduces the upload frequency of unrelated videos, reduces network and storage usage, and improves the efficiency of video analysis.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119094697A_ABST
    Figure CN119094697A_ABST
Patent Text Reader

Abstract

The invention relates to the field of camera monitoring, in particular to a camera monitoring video uploading method, electronic equipment and a storage medium. The method comprises the following steps: acquiring multiple frames of images in a target video shot by the camera; determining a target area according to the multiple frames of images; and controlling the camera to filter the target area in the monitoring process, and determining whether to upload based on the filtered monitoring video.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present disclosure relates to the field of camera monitoring, and more specifically, to a camera monitoring video uploading method, an electronic device and a storage medium. Background Art

[0002] In order to save power, storage and network bandwidth, current cameras will compare the captured images during monitoring, and will only trigger the action of storing and uploading videos when the images are found to have changed. However, there is a problem in this regard. If there is a fish tank or a TV in front of the camera, the camera's video storage and upload actions may be triggered frequently, resulting in a lot of invalid videos being stored in the cloud or storage device, occupying storage space and bandwidth, and interfering with video analysis. Summary of the invention

[0003] An object of the present disclosure is to provide a method for uploading camera surveillance videos to solve the problem of invalid videos being stored in the cloud or in storage devices.

[0004] According to a first aspect of the present disclosure, a method for uploading a camera monitoring video is provided, comprising:

[0005] Acquire multiple frames of images from the target video captured by the camera;

[0006] Determine a target area according to the multiple frames of images;

[0007] The camera is controlled to filter the target area during monitoring, and whether to upload the filtered monitoring video is determined based on the filtered monitoring video.

[0008] Optionally, acquiring multiple frames of images from the target video captured by the camera includes:

[0009] A plurality of frames of images are acquired in the target video based on a preset time interval.

[0010] Optionally, acquiring multiple frames of images from the target video captured by the camera includes:

[0011] Acquire multiple frames of images in the target video based on a preset frame interval.

[0012] Optionally, the multiple frames of images are 2N images, and determining the target area according to the multiple frames of images includes:

[0013] Convert the 2N images into grayscale images;

[0014] Subtract the 1st to Nth images from the N+1th to 2Nth images respectively to obtain N difference results;

[0015] Adding the absolute values ​​of the N difference results to obtain a gradient image;

[0016] A target region is determined in the gradient image.

[0017] Optionally, before determining the target area in the gradient image, the method further includes:

[0018] Normalizing the grayscale value of each pixel in the gradient image;

[0019] The normalized grayscale value of each pixel is multiplied by 255, and the gradient image is updated.

[0020] Optionally, determining the target area in the gradient image includes:

[0021] The area in the gradient image where the grayscale value is greater than a preset threshold is taken as the target area.

[0022] Optionally, determining the target area in the gradient image includes:

[0023] Determine a first region in the gradient image having a grayscale value greater than a preset threshold;

[0024] The first region is surrounded by a minimum preset shape, and an area corresponding to the minimum preset shape in the gradient image is determined as the target area.

[0025] Optionally, controlling the camera to filter the target area during monitoring, and determining whether to upload the monitored video based on the filtered monitored video, includes:

[0026] Capture any two frames of images from the video screen monitored by the camera;

[0027] Determine whether there is a change in the non-target area of ​​the two frames of images;

[0028] In case there is a change, the surveillance video is uploaded.

[0029] According to a second aspect of the present disclosure, an electronic device is provided, including a processor and a memory, wherein the memory stores computer instructions, and when the computer instructions are executed by the processor, the steps of any one of the methods described in the first aspect are implemented.

[0030] According to a third aspect of the present disclosure, there is provided a storage medium on which computer instructions are stored, and when the computer instructions are executed by a processor, the steps of any one of the methods described in the first aspect are implemented.

[0031] One technical effect of the present disclosure is that a method for uploading camera videos is provided, which can obtain multiple frames of images from a target video captured by a camera, and determine the area that needs to be filtered by the camera during monitoring based on the multiple frames of images, and then determine whether to upload the monitoring video based on the filtered video. In this way, video upload actions caused by irrelevant factors such as TVs and fish tanks can be effectively eliminated, greatly reducing network and storage usage.

[0032] Other features and advantages of the embodiments of the present disclosure will become apparent from the following detailed description of exemplary embodiments of the present disclosure with reference to the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0033] The accompanying drawings, which constitute a part of the specification, illustrate embodiments of the present disclosure and, together with the description, serve to explain the principles of the embodiments of the present disclosure.

[0034] Figure 1 is a flow chart of a method for uploading camera surveillance video according to one embodiment;

[0035] Figure 2 is a schematic structural diagram of an electronic device according to an embodiment; DETAILED DESCRIPTION

[0036] Various exemplary embodiments of the present disclosure will now be described in detail with reference to the accompanying drawings. It should be noted that the relative arrangement of components and steps, numerical expressions and numerical values ​​set forth in these embodiments do not limit the scope of the present invention unless otherwise specifically stated.

[0037] The following description of at least one exemplary embodiment is merely illustrative in nature and is in no way intended to limit the invention, its application, or uses.

[0038] Techniques and equipment known to ordinary technicians in the relevant art may not be discussed in detail, but where appropriate, the techniques and equipment should be considered part of the specification.

[0039] In all examples shown and discussed herein, any specific values ​​should be interpreted as merely exemplary and not limiting. Therefore, other examples of the exemplary embodiments may have different values.

[0040] It should be noted that like reference numerals and letters refer to similar items in the following figures, and therefore, once an item is defined in one figure, it need not be further discussed in subsequent figures.

[0041] The present application embodiment discloses a method for uploading a camera monitoring video, such as Figure 1 As shown, it includes steps S11 to S13.

[0042] Step S11, acquiring multiple frames of images from the target video captured by the camera.

[0043] In this embodiment, the target video captured by the camera may be a target video that has been uploaded to a remote end or a storage device.

[0044] In one example, before acquiring multiple frames of images in a target video captured by a camera, the method further includes: determining a target video in a target storage space in response to a first input from a user.

[0045] In an example of this embodiment, a target video can be determined in the storage space based on the user's operation. The first input of the user can be an input operation of marking the video stored in the storage space and adding a label such as "invalid video" to the video. For example, there are multiple videos uploaded by cameras in the storage space. When the user is viewing the videos, he finds that a certain video is a video of a TV playing or a fish swimming in a fish tank, and there is no other substantial content. At this time, the user can add a specific video tag to the video so that the video is determined as the target video.

[0046] In another example of this embodiment, the target video may not be selected by the user, but may be automatically selected by an algorithm or a preset program, and the target video may not be a video without substantial changes.

[0047] In an example of this embodiment, acquiring multiple frames of images in a target video captured by a camera includes: acquiring multiple frames of images in the target video based on a preset time interval.

[0048] In one example, after determining the target video, multiple frames of images may be acquired in the target video. In this example, images may be acquired at target intervals based on a preset time interval, for example, an image may be captured every 0.1 seconds in the target video.

[0049] In an example of this embodiment, acquiring multiple frames of images in a target video captured by a camera includes: acquiring multiple frames of images in the target video based on a preset frame number interval.

[0050] In one example, after determining the target video, multiple frames of images may be acquired in the target video. In this example, images may be acquired at a target interval based on a preset frame number interval, for example, an image may be captured every 5 frames in the target video.

[0051] Step S12, determining the target area based on the multiple frame images.

[0052] In this embodiment, the target area that has been changing in the target video, that is, the area that needs to be ignored by the camera monitoring, can be determined by taking screenshots of multiple frames of images. In this embodiment, the target area can be determined in multiple frames of images by using an image recognition algorithm or grayscale value calculation.

[0053] In an example of the present embodiment, the multiple-frame images are 2N images, and determining the target area based on the multiple-frame images includes: converting the 2N images into grayscale images; subtracting the 1st to Nth images from the N+1th to 2Nth images respectively to obtain N difference results; adding the absolute values ​​of the N difference results to obtain a gradient image; and determining the target area in the gradient image.

[0054] In this embodiment, if the number of acquired multiple frames of images is odd, the first image or the last image can be ignored, and the remaining 2N images can be used to determine the target area.

[0055] In one example, the 2N images can be converted into grayscale images first. Then, subtract the 1st to Nth images from the N+1st to 2Nth images respectively. Grayscale image subtraction is an image processing technique used to extract the difference information between two grayscale images, in which each pixel in one image is subtracted from the grayscale value of the corresponding pixel in the other image. After the subtraction is completed, a new grayscale image will be obtained, reflecting the difference between the original two images. In this example, the 1st image is subtracted from the N+1th image, the 2nd image is subtracted from the N+2th image, and so on, the Nth image is subtracted from the 2Nth image. Finally, N difference results are obtained, that is, new grayscale images. In this example, the grayscale value of each pixel in the unchanged area of ​​the two images being subtracted is the same, while the grayscale value of the changing part will inevitably change. Therefore, after the two images are subtracted, the grayscale values ​​of the changing area and the unchanged area will be significantly different. Afterwards, the grayscale images of the multiple difference results may be added together to obtain a gradient image, and the target area may be determined in the gradient image.

[0056] In this example, the target area such as the TV and fish tank can be determined by converting the acquired multiple frame images into grayscale images, subtracting the grayscale images two by two, and finally superimposing them to obtain a gradient map, so as to filter the images in the area later and prevent the camera from falsely reporting the uploaded images.

[0057] In an example of this embodiment, before determining the target area in the gradient image, the method further includes: normalizing each pixel in the gradient image; multiplying the grayscale value of each normalized pixel by 255, and updating the gradient image.

[0058] In this example, after N difference results are superimposed, the grayscale value of each superimposed pixel may exceed 255. Therefore, the grayscale value of each pixel can be normalized, all grayscale values ​​are set within the range of 0 to 1 and then multiplied by 255 to obtain an updated gradient image, and then the target area is determined based on the updated gradient image.

[0059] In an example of this embodiment, determining the target area in the gradient image includes: taking an area in the gradient image whose grayscale value is greater than a preset threshold as the target area.

[0060] In an example of this embodiment, a grayscale value threshold can be preset, and the area where the pixels with grayscale values ​​greater than the threshold are located is taken as the target area. In this example, since after subtracting 2N images, the grayscale value of the unchanged area in the two images after subtraction is 0, the preset threshold can be set to 0, and the area with changes in the target video is determined by the preset threshold. And the area is taken as the target area.

[0061] In an example of this embodiment, determining a target area in a gradient image includes: determining a first area in the gradient image whose grayscale value is greater than a preset threshold; using a minimum preset shape to surround the first area, and determining an area corresponding to the minimum preset shape in the gradient image as the target area.

[0062] In this embodiment, in some cases, only a part of the TV or fish tank may be changed in a video monitored by the camera. Therefore, to obtain a more accurate target area, the area with a gray value greater than a preset threshold can be surrounded by a minimum preset shape, and the minimum preset shape can be a rectangle, square, triangle or circle. In one example, after the area with a gray value greater than the preset threshold is surrounded by the smallest rectangle, the area where the rectangle is located can be used as the target area for subsequent filtering.

[0063] Step S13, controlling the camera to filter the target area during monitoring, and determining whether to upload the filtered monitoring video.

[0064] After determining the target area, you can control the target area that the camera filters during the monitoring process. That is, even if there are changes in the target area, the camera will ignore it. The operation of uploading the surveillance video can be triggered only when there are changes in the non-target area.

[0065] In an example of this embodiment, the camera is controlled to filter the target area during the monitoring process, and determines whether to upload the filtered surveillance video, including: capturing any two frames of images from the video screen monitored by the camera; determining whether there is a change in the non-target area of ​​the two frames of images; and uploading the surveillance video if there is a change.

[0066] During camera monitoring, two frames of images can be captured regularly and compared to see if there are any differences or changes in the non-target areas of the two frames of images to eliminate interference. When there are changes in the two frames of images, the video monitored by the camera is uploaded. When there are no changes, the monitored video is not uploaded.

[0067] In this example, a camera video upload method is provided, which can obtain multiple frames of images from the target video captured by the camera, and determine the area that needs to be filtered by the camera during the monitoring process based on the multiple frames of images, and then determine whether the monitoring video needs to be uploaded based on the filtered video. In this way, video upload actions caused by irrelevant factors such as TVs and fish tanks can be effectively eliminated, greatly reducing network and storage usage.

[0068] An embodiment of the present application also provides a device for uploading camera surveillance videos, including an acquisition module for acquiring multiple frames of images in a target video captured by a camera; a determination module for determining a target area based on the multiple frames of images; and a control module for controlling the camera to filter the target area during the monitoring process, and determining whether to upload based on the filtered surveillance video.

[0069] Optionally, the acquisition module is specifically used to acquire multiple frames of images in the target video based on a preset time interval.

[0070] Optionally, the acquisition module is specifically used to acquire multiple frames of images in the target video based on a preset frame number interval.

[0071] Optionally, the multiple-frame images are 2N images, and the determination module is specifically used to: convert the 2N images into grayscale images; subtract the 1st to Nth images from the N+1th to 2Nth images respectively to obtain N difference results; add the absolute values ​​of the N difference results to obtain a gradient image; and determine the target area in the gradient image.

[0072] Optionally, the determination module is further configured to normalize the grayscale value of each pixel in the gradient image before determining the target area in the gradient image; multiply the normalized grayscale value of each pixel by 255, and update the gradient image.

[0073] Optionally, determining the target area in the gradient image includes: taking an area in the gradient image whose grayscale value is greater than a preset threshold as the target area.

[0074] Optionally, determining the target area in the gradient image includes: determining a first area in the gradient image whose grayscale value is greater than a preset threshold; using a minimum preset shape to surround the first area, and determining an area corresponding to the minimum preset shape in the gradient image as the target area.

[0075] Optionally, the control module is specifically used to: capture any two frames of images from the video screen monitored by the camera; determine whether there is a change in the non-target area of ​​the two frames of images; and upload the monitoring video if there is a change.

[0076] like Figure 2 As shown, an embodiment of the present application further provides an electronic device 200, including a processor 201 and a memory 202, wherein the memory 202 stores computer instructions, and when the computer instructions are executed by the processor 201, the steps of any method in the embodiment of the method for uploading camera surveillance video are implemented.

[0077] The embodiment of the present application also provides a storage medium on which computer instructions are stored. When the computer instructions are executed by the processor, any one of the above-mentioned camera surveillance video uploading embodiments is implemented and the same technical effect can be achieved. To avoid repetition, they will not be repeated here.

[0078] Each embodiment in the present disclosure is described in a progressive manner, and the same or similar parts between the embodiments can be referred to each other, and each embodiment focuses on the differences from other embodiments. In particular, for the device and equipment embodiments, since they are basically similar to the method embodiments, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiments.

[0079] The above describes specific embodiments of the present disclosure. Other embodiments are within the scope of the appended claims. In some cases, the actions or steps recorded in the claims can be performed in an order different from that in the embodiments and still achieve the desired results. In addition, the processes depicted in the drawings do not necessarily require the specific order or continuous order shown to achieve the desired results. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.

[0080] The embodiments of the present disclosure may be systems, methods and / or computer program products. The computer program product may include a computer-readable storage medium carrying computer-readable program instructions for causing a processor to implement various aspects of the embodiments of the present disclosure.

[0081] A computer-readable storage medium may be a tangible device that can hold and store instructions used by an instruction execution device. A computer-readable storage medium may be, for example, but not limited to, an electrical storage device, a magnetic storage device, an optical storage device, an electromagnetic storage device, a semiconductor storage device, or any suitable combination of the foregoing. More specific examples of computer-readable storage media (a non-exhaustive list) include: a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), a static random access memory (SRAM), a portable compact disk read-only memory (CD-ROM), a digital versatile disk (DVD), a memory stick, a floppy disk, a mechanical encoding device, such as a punch card or a raised structure in a groove on which instructions are stored, and any suitable combination of the foregoing. As used herein, a computer-readable storage medium is not to be interpreted as a transient signal per se, such as a radio wave or other freely propagating electromagnetic wave, an electromagnetic wave propagating through a waveguide or other transmission medium (e.g., a light pulse through a fiber optic cable), or an electrical signal transmitted through a wire.

[0082] The computer-readable program instructions described herein can be downloaded from a computer-readable storage medium to each computing / processing device, or downloaded to an external computer or external storage device via a network, such as the Internet, a local area network, a wide area network, and / or a wireless network. The network can include copper transmission cables, optical fiber transmissions, wireless transmissions, routers, firewalls, switches, gateway computers, and / or edge servers. The network adapter card or network interface in each computing / processing device receives the computer-readable program instructions from the network and forwards the computer-readable program instructions for storage in the computer-readable storage medium in each computing / processing device.

[0083] The computer program instructions for performing the operation of the embodiments of the present disclosure may be assembly instructions, instruction set architecture (ISA) instructions, machine instructions, machine-related instructions, microcode, firmware instructions, state setting data, or source code or object code written in any combination of one or more programming languages, including object-oriented programming languages ​​such as Smalltalk, C++, etc., and conventional procedural programming languages ​​such as "C" language or similar programming languages. Computer-readable program instructions may be executed completely on a user's computer, partially on a user's computer, as an independent software package, partially on a user's computer, partially on a remote computer, or completely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer via any type of network including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., using an Internet service provider to connect via the Internet). In some embodiments, an electronic circuit, such as a programmable logic circuit, a field programmable gate array (FPGA), or a programmable logic array (PLA), may be personalized by utilizing the state information of a computer-readable program instruction, and the electronic circuit may execute a computer-readable program instruction, thereby realizing various aspects of the embodiments of the present disclosure.

[0084] Various aspects of the embodiments of the present disclosure are described herein with reference to the flowcharts and / or block diagrams of the methods, devices (systems) and computer program products according to the embodiments of the present disclosure. It should be understood that each box in the flowchart and / or block diagram and the combination of each box in the flowchart and / or block diagram can be implemented by computer-readable program instructions.

[0085] These computer-readable program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, thereby producing a machine, so that when these instructions are executed by the processor of the computer or other programmable data processing device, a device that implements the functions / actions specified in one or more boxes in the flowchart and / or block diagram is generated. These computer-readable program instructions can also be stored in a computer-readable storage medium, and these instructions cause the computer, programmable data processing device, and / or other equipment to work in a specific manner, so that the computer-readable medium storing the instructions includes a manufactured product, which includes instructions for implementing various aspects of the functions / actions specified in one or more boxes in the flowchart and / or block diagram.

[0086] Computer-readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other device so that a series of operating steps are performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions executed on the computer, other programmable data processing apparatus, or other device to implement the functions / actions specified in one or more boxes in the flowchart and / or block diagram.

[0087] The flowcharts and block diagrams in the accompanying drawings show the possible architecture, functions and operations of the systems, methods and computer program products according to multiple embodiments of the present disclosure. In this regard, each box in the flowchart or block diagram can represent a module, a program segment or a part of an instruction, and a part of a module, a program segment or an instruction contains one or more executable instructions for realizing the specified logical function. In some alternative implementations, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two consecutive boxes can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or the flowchart, and the combination of the boxes in the block diagram and / or the flowchart can be implemented by a dedicated hardware-based system that performs the specified function or action, or can be implemented by a combination of dedicated hardware and computer instructions. It is well known to those skilled in the art that it is equivalent to implement it by hardware, implement it by software, and implement it by combining software and hardware.

[0088] The embodiments of the present disclosure have been described above, and the above description is exemplary, not exhaustive, and is not limited to the disclosed embodiments. Many modifications and changes will be apparent to those of ordinary skill in the art without departing from the scope of the described embodiments. The selection of terms used herein is intended to best explain the principles of the embodiments, practical applications, or improvements to the technology in the market, or to enable other persons of ordinary skill in the art to understand the embodiments disclosed herein.

Claims

1. A method for uploading camera surveillance video, characterized in that: include: Acquire multiple frames of images from the target video captured by the camera; Determine a target area according to the multiple frames of images; The camera is controlled to filter the target area during monitoring, and whether to upload the filtered monitoring video is determined based on the filtered monitoring video.

2. The method according to claim 1, characterized in that The step of acquiring multiple frames of images from the target video captured by the camera includes: A plurality of frames of images are acquired in the target video based on a preset time interval.

3. The method according to claim 1, characterized in that The step of acquiring multiple frames of images from the target video captured by the camera includes: Acquire multiple frames of images in the target video based on a preset frame interval.

4. The method according to claim 1, characterized in that: The multiple frames of images are 2N images, and determining the target area according to the multiple frames of images includes: Convert the 2N images into grayscale images; Subtract the 1st to Nth images from the N+1th to 2Nth images respectively to obtain N difference results; Adding the absolute values ​​of the N difference results to obtain a gradient image; A target region is determined in the gradient image.

5. The method according to claim 4, characterized in that Before determining the target area in the gradient image, the method further includes: Normalizing the grayscale value of each pixel in the gradient image; The normalized grayscale value of each pixel is multiplied by 255, and the gradient image is updated.

6. The method according to claim 4, characterized in that Determining the target area in the gradient image includes: The area in the gradient image where the grayscale value is greater than a preset threshold is taken as the target area.

7. The method according to claim 5, characterized in that Determining the target area in the gradient image includes: Determine a first region in the gradient image having a grayscale value greater than a preset threshold; The first region is surrounded by a minimum preset shape, and an area corresponding to the minimum preset shape in the gradient image is determined as the target area.

8. The method according to claim 1, characterized in that The controlling the camera to filter the target area during monitoring, and determining whether to upload the filtered monitoring video, includes: Capture any two frames of images from the video screen monitored by the camera; Determine whether there is a change in the non-target area of ​​the two frames of images; In case there is a change, the surveillance video is uploaded.

9. An electronic device, characterized in that: The method comprises a processor and a memory, wherein the memory stores computer instructions, and when the computer instructions are executed by the processor, the steps of the method described in any one of claims 1 to 8 are implemented.

10. A storage medium, characterized in that: Computer instructions are stored thereon, and when the computer instructions are executed by a processor, the steps of the method according to any one of claims 1 to 8 are implemented.