A universal image acquisition method, system and device

Abstract

The present invention discloses a universal image acquisition method, system and device, wherein the universal image acquisition method is applied to an image application platform, including receiving image data transmitted to the image application platform by a camera and an image acquisition device through a transmission protocol; analyzing and resolving the image data, and extracting the file name and path information transmitted by the protocol; extracting the three elements of time, place and event from the file name and path information according to matching regular expressions; performing face recognition, face control, vehicle acquisition, vehicle control, visual analysis and quality diagnosis according to the extracted three elements. The technical solution of the present invention aims to connect the images of cameras and image acquisition devices of different brands and protocols to a unified image application platform through a universal FTP protocol, only through simple rule configuration without development, thereby reducing deployment and maintenance costs and simplifying the system architecture.

Description

Technical Field

[0001] The present invention relates to the field of general image acquisition technology, and in particular to a general image acquisition method, system and device. Background Art

[0002] With the development of the Internet and the advancement of technology, the application of video surveillance is becoming more and more common in order to protect personal life and property safety and social public safety. Whether it is a shopping mall or a home community, remote monitoring through cameras and the Internet, so as to achieve real-time information viewing and video information storage, is becoming more and more valued by people.

[0003] However, there are many different types of cameras in the same surveillance network. Different manufacturers and devices may use different transmission protocols to transmit image data. If each transmission protocol requires a separate platform or system to process, it will increase the cost and complexity of the system.

[0004] Therefore, there is an urgent need for a platform that is compatible with multiple transmission protocols, has strong scalability and high flexibility. Summary of the invention

[0005] The main purpose of the present invention is to provide a universal image acquisition method, system and device, which aims to recognize and compatibly access images transmitted by cameras with different transmission protocols to the same image application platform, reduce deployment and maintenance costs, and simplify the system architecture.

[0006] In a first aspect, the present invention provides a general image acquisition method, which is applied to an image application platform, comprising:

[0007] Receive image data transmitted by cameras and image acquisition devices to the image application platform through transmission protocols;

[0008] Analyze and parse the image data, and extract the file name and path information transmitted by the protocol;

[0009] Extract three elements from the file name and path information based on matching regular expressions;

[0010] Based on the extracted three elements, face recognition, face control, vehicle collection, vehicle control, visual analysis and quality diagnosis are performed.

[0011] In the above technical solution, the image application platform receives the image data transmitted by the camera and image acquisition device in real time, analyzes and parses the image data, extracts the file name and path information of the protocol transmission, matches the path information to a regular expression, extracts three elements from it, and performs face recognition, face control, vehicle acquisition, vehicle control and quality diagnosis based on the three elements. In this way, cameras with different transmission protocols can be compatible with the same image application platform without switching or replacing different systems or applications, providing a more unified and consistent user experience, reducing deployment and maintenance costs, and simplifying the system architecture.

[0012] In conjunction with the first aspect, in some possible implementations, the step of receiving image data transmitted by the camera to the image application platform through a transmission protocol includes:

[0013] Responding to a connection request sent by the camera to the image application platform;

[0014] Receiving image data transmitted by a camera and captured at a predetermined time interval or time trigger;

[0015] Feedback a confirmation message of receiving the image data and record the upload result.

[0016] In the above technical solution, the image application platform can effectively respond to the connection request of the camera, receive image data, and provide necessary feedback and recording functions, thereby realizing the monitoring and management of the camera.

[0017] In combination with the first aspect, in some possible implementations, the transmission protocol is the FTP protocol.

[0018] In combination with the first aspect, in some possible implementations, the three elements include time, place and event, where the time is the time point or time period when the event occurs; the place is the specific place or location where the event occurs; and the event is the triggered behavior.

[0019] In the above technical solutions, determining the exact time when the incident occurred can help record the sequence of events, duration of events and possible timelines; determining the location of the incident can help investigators accurately locate the location of the incident and conduct related investigations and handling work; the event content refers to the specific circumstances, activities or behaviors involved when the incident occurred, covering the substantive content of the incident, including the nature of the incident, the main participants, possible impacts, etc.

[0020] In combination with the first aspect, in some possible implementations, after the steps of performing face recognition, face control, vehicle collection, vehicle control, visual analysis, and quality diagnosis on the three elements extracted, the method further includes:

[0021] Provide real-time alarm and log records for the results of face recognition, face control, vehicle collection, vehicle control, visual analysis and quality diagnosis.

[0022] In a second aspect, the present invention further provides a general image acquisition system, comprising:

[0023] An image data transmission module is configured to receive image data transmitted by a camera to an image application platform via a transmission protocol;

[0024] The file name extraction module is configured to analyze and parse the image data and extract the file name and path information transmitted by the protocol therein;

[0025] An event extraction module, configured to extract three elements from the file name and path information according to matching regular expressions;

[0026] The image processing module is configured to perform face recognition, face control, vehicle collection, vehicle control and quality diagnosis based on the extracted three elements.

[0027] In conjunction with the second aspect, some possible implementations further include:

[0028] The early warning and recording module is configured to provide real-time alarm and log recording of the results of face recognition, face control, vehicle collection, vehicle control and quality diagnosis.

[0029] In a third aspect, the present invention provides a computer device, comprising one or more processors, and a memory;

[0030] The memory stores computer-readable instructions, and when the computer-readable instructions are executed by one or more processors, the general image acquisition method in the above-mentioned first aspect or any possible implementation of the first aspect is executed.

[0031] The technical solution of the present invention adopts an image application platform to receive image data transmitted by cameras and image acquisition devices, analyzes and parses the image data, extracts the file name and path information of the protocol transmission, matches the path information to a regular expression, extracts three elements therefrom, and performs face recognition, face control, vehicle acquisition, vehicle control and quality diagnosis based on the three elements. In this way, cameras with different transmission protocols can be compatible on the same image application platform without switching or replacing different systems or applications, thereby providing a more unified and consistent user experience, reducing deployment and maintenance costs, and simplifying the system architecture. BRIEF DESCRIPTION OF THE DRAWINGS

[0032] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on the structures shown in these drawings without paying creative work.

[0033] Figure 1 A flowchart of an embodiment of a method for transmitting data from a camera according to the present invention;

[0034] Figure 2 FIG. 4 is a flow chart of an embodiment of step S10 of the present invention.

[0035] The realization of the purpose, functional features and advantages of the present invention will be further explained in conjunction with embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION

[0036] In order to make the purpose, technical solution and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0037] See also Figure 1 , Figure 1 This is a flow chart of an embodiment of a universal image acquisition method of the present invention. In a first aspect, the present invention provides a universal image acquisition method, which is applied to an image application platform and includes the following steps:

[0038] S10, receiving image data transmitted by the camera to the image application platform through the transmission protocol.

[0039] In this step, the camera collects image data and transmits it to the image application platform in real time. Different types of cameras have different transmission protocols, such as RTSP (Real-Time Streaming Protocol), RTMP (Real-Time Messaging Protocol), HTTP (Hypertext Transfer Protocol), etc. The image data of cameras with different transmission protocols cannot be directly read by the monitoring system. Therefore, the monitoring system obtains the network data packets sent by the camera, which is equivalent to directly obtaining the complete data information of the camera.

[0040] S20, analyzing and parsing the image data, and extracting the file name and path information transmitted by the protocol.

[0041] In this step, the image data stored in the image application platform is analyzed to understand the protocol type, port number, data content and other information of each image data. Identify the file transfer protocol used, such as HTTP, FTP, SMB, etc. File transfer protocols usually use specific ports for communication, so the protocol type can be determined based on the port number. For the identified file transfer protocol, it is necessary to parse the data packet of the corresponding protocol. For example, for the HTTP protocol, the HTTP header information can be parsed; for the FTP protocol, the FTP commands and responses can be parsed, etc. Extract the file name and path information from the protocol data packet. The specific method depends on the protocol used and the data packet structure. For example, in the HTTP protocol, the file name is usually contained in the URL; in the FTP protocol, the file name and path information can be extracted from the FTP command.

[0042] S30. Extract three elements from the file name and path information according to the matching regular expression.

[0043] In this step, the regular expression function in the programming language is used to extract the required three time elements, such as time, location and event content, based on the file name and path information.

[0044] A regular expression is a text pattern that uses a single string to describe and match a series of strings that match a certain syntactic rule. It is usually used to retrieve and replace text that conforms to certain rules. In this embodiment, regular expressions are used to parse and process file paths related to captured image data. Exemplarily, a regular expression is used to match the file path, and a replacement character is used to replace the meaningless characters in the path. Then, the position of the device serial number in the path is determined, the position of the capture date in the path is determined, and a date format option is provided. The position of the capture channel in the path is determined, and then the type is indexed to determine the position of the capture type (such as face, human figure, motor vehicle, non-motor vehicle) in the path. Finally, the image type index is determined, and the position of the image type (such as panorama, thumbnail) in the path is determined. Finally, the image is saved according to the availability regulations.

[0045] S40, performing face recognition, face control, vehicle collection, vehicle control and quality diagnosis based on the extracted three elements.

[0046] In this step, a security monitoring system is built based on face recognition technology to identify and track faces in the control list in real time; set the list of controlled personnel, location, time and other information to ensure timely detection of controlled objects; use vehicle detection algorithms and models, such as deep learning-based vehicle detection algorithms such as YOLO and SSD; extract vehicle feature information such as license plate number, model, etc.; use image processing technology to evaluate the quality of extracted image data; based on deep learning or traditional image processing technology, realize the identification of defects or abnormalities in the extracted image data.

[0047] To summarize, the image application platform receives image data transmitted by the camera, analyzes and parses the image data, extracts the file name and path information of the protocol transmission, matches the path information to a regular expression, extracts three elements from it, and performs face recognition, face control, vehicle collection, vehicle control and quality diagnosis based on the three elements. In this way, cameras with different transmission protocols can be compatible with the same image application platform without switching or replacing different systems or applications, providing a more unified and consistent user experience, reducing deployment and maintenance costs, and simplifying the system architecture.

[0048] refer to Figure 2 As shown, in combination with the first aspect, in some possible implementations, the step of receiving image data transmitted by the camera to the image application platform through the transmission protocol includes:

[0049] S101. Responding to a connection request sent by a camera to an image application platform.

[0050] In this step, the image application platform needs to run a service to listen for connection requests from the camera, which is usually achieved by running a server software on a specific port. After receiving the connection request from the camera, the image application platform will accept the connection and establish a communication channel with the camera.

[0051] S102: Receive image data transmitted by a camera and captured according to a predetermined time interval or time trigger.

[0052] In this step, once the connection is established and verified, the image application platform will start receiving image data from the camera. These data are usually captured at a predetermined time interval or event trigger, and transmitted to the image application platform via FTP protocol or the like.

[0053] S103: Feedback a confirmation message of receiving the image data and record the upload result.

[0054] In this step, after successfully receiving the image data, the image application platform will send a confirmation message to the camera, indicating that the image data has been successfully received. This helps ensure the integrity and reliability of data transmission. The image application platform may record the upload results, including the number of images received, transmission time, transmission speed, and other information. These records are helpful for subsequent data management and analysis.

[0055] In the above technical solution, the image application platform can effectively respond to the connection request of the camera, receive image data, and provide necessary feedback and recording functions, thereby realizing the monitoring and management of the camera.

[0056] In combination with the first aspect, in some possible implementations, the transmission protocol is the FTP protocol.

[0057] In the above technical solution, FTP (File Transfer Protocol) is a standard protocol for transferring files on a computer network. It allows files to be transferred from one computer system to another, and is used for uploading, downloading and managing files between a client and a server.

[0058] In combination with the first aspect, in some possible implementations, the three elements include the time, place and participants of the event, where the time is the time point or time period when the event occurs; the place is the specific place or venue where the event occurs; and the participants are the persons or entities directly or indirectly involved in the event.

[0059] In the above technical solution, determining the exact time when the incident occurred can help record the sequence of events, duration of events and possible timeline; determining the location of the incident can help investigators accurately locate the location of the incident and conduct related investigation and handling work; the event content refers to the specific circumstances, activities or behaviors involved when the incident occurred, covering the substantive content of the incident, including the nature of the incident, the main participants, possible impacts, etc.

[0060] In combination with the first aspect, in some possible implementations, after the steps of performing face recognition, face control, vehicle collection, vehicle control, and quality diagnosis on the three elements extracted, the method further includes:

[0061] Provide real-time alarm and log records for the results of face recognition, face control, vehicle collection, vehicle control and quality diagnosis.

[0062] Specifically, face recognition includes face image storage, captured face image download, face-associated video playback, real-time scrolling display of faces, etc.; face control includes face image search, black and white list control, control retrieval, etc.; vehicle collection includes vehicle image storage, captured image download, license plate query, etc.; vehicle control includes black and white list control, control retrieval, control linkage, etc.; by connecting the image application platform to the alarm module, real-time alarm function can be realized.

[0063] In the second aspect, the present invention also provides a universal image acquisition system, including an image data transmission module, configured to receive image data transmitted by a camera to an image application platform through a transmission protocol; a file name extraction module, configured to analyze and parse the image data, and extract the file name and path information transmitted by the protocol; an event extraction module, configured to extract three elements from the file name and path information based on matching regular expressions; an image processing module, configured to perform face recognition, face control, vehicle acquisition, vehicle control and quality diagnosis based on the extracted three elements.

[0064] In conjunction with the second aspect, some possible implementations further include:

[0065] The early warning and recording module is configured to provide real-time alarm and log recording of the results of face recognition, face control, vehicle collection, vehicle control and quality diagnosis.

[0066] In a third aspect, the present invention provides a computer device comprising one or more processors and a memory; the memory stores computer-readable instructions, and when the computer-readable instructions are executed by one or more processors, the general image acquisition method in the above-mentioned first aspect or any possible implementation of the first aspect is executed.

[0067] Schematically, the computer device can be provided as a server. The computer device includes a processing component, which further includes one or more processors, and a memory resource represented by a memory for storing instructions that can be executed by the processing component, such as an application. The application stored in the memory can include one or more modules each corresponding to a set of instructions. In addition, the processing component is configured to execute instructions to perform the general image acquisition method of any of the above embodiments. The computer device may also include a power supply component configured to perform power management of the computer device, an online or wireless network interface configured to connect the computer device to a network, and an input and output (I / O interface). The computer device can run on an operating system in the memory, such as Windows Server TM Mac OS X TM, Unix TM, Linux TM, Free BSD TM or the like.

[0068] The above are only preferred embodiments of the present application and are not intended to limit the present application. Any modifications, equivalent substitutions and improvements made within the spirit and principles of the present application should be included in the protection scope of the present application.

Claims

1. A general image acquisition method, applied to an image application platform, characterized in that: include: Receive image data transmitted by cameras and image acquisition devices to the image application platform through transmission protocols; Analyze and parse the image data, obtain the port number of the image data, determine the protocol type of the image data according to the port number, parse the data packet of the corresponding protocol of the image data according to the protocol type, and extract the file name and path information of the image data protocol transmission from the data packet; According to the regular expression function in the programming language, three elements are extracted from the file name and path information, including: using regular expressions to match the file path and replace meaningless characters in the path; Determine the location of the device serial number in the path, the location of the capture date and provide date format options, the location of the capture channel, and then index the capture type to determine the location of the capture type in the path, and then determine the image type index, determine the location of the image type in the path, and save the image according to the availability regulations; Based on the extracted three elements, face recognition, face control, vehicle collection, vehicle control, visual analysis and quality diagnosis are performed.

2. The general image acquisition method according to claim 1, characterized in that: The step of receiving image data transmitted by a camera or an image acquisition device to an image application platform via a transmission protocol comprises: Responding to a connection request sent by a camera or image acquisition device to an image application platform; Receiving image data transmitted by a camera or image acquisition device and captured at a predetermined time interval or time trigger; Feedback a confirmation message of receiving the image data and record the upload result.

3. The general image acquisition method according to claim 2, characterized in that: The transmission protocol is FTP protocol.

4. The general image acquisition method according to claim 1, characterized in that: The three elements include time, place and event, where the time is the time point or time period when the event occurs; the place is the specific place or location where the event occurs; and the event is the triggered behavior.

5. The general image acquisition method according to claim 1, characterized in that: After the steps of performing face recognition, face control, vehicle collection, vehicle control, visual analysis and quality diagnosis on the three elements extracted, the method further includes: Provide real-time alarm and log records for the results of face recognition, face control, vehicle collection, vehicle control, visual analysis and quality diagnosis.

6. A general image acquisition system, characterized in that: include: An image data transmission module is configured to receive image data transmitted to the image application platform by a camera or an image acquisition device through a transmission protocol; a file name extraction module configured to analyze and parse the image data, obtain the port number of the image data, determine the protocol type of the image data according to the port number, parse the data packet of the corresponding protocol of the image data according to the protocol type, and extract the file name and path information of the image data protocol transmission from the data packet; The event extraction module is configured to extract three elements from the file name and path information according to the regular expression function in the programming language, including: using the regular expression to match the file path and replace the meaningless characters in the path; determining the position of the device serial number in the path, the position of the capture date and providing the date format option, the position of the capture channel, and then indexing the capture type to determine the position of the capture type in the path, and then determining the image type index, determining the position of the image type in the path, and saving the image according to the availability regulations; The image processing module is configured to perform face recognition, face control, vehicle collection, vehicle control, visual analysis and quality diagnosis based on the extracted three elements.

7. The universal image acquisition system according to claim 6, characterized in that: Also includes: The early warning and recording module is configured to provide real-time alarm and log recording of the results of face recognition, face control, vehicle collection, vehicle control and quality diagnosis.

8. A computer device, characterized in that: including one or more processors, and memory; The memory stores computer-readable instructions, and when the computer-readable instructions are executed by one or more processors, the general image acquisition method according to any one of claims 1 to 5 is executed.

Images