Data transmission method, monitoring system, storage medium, and device

Abstract

The embodiment of the present application discloses a data transmission method and a monitoring system, a storage medium, and a device. The monitoring system includes: a site and multiple image acquisition devices, the site and the multiple image acquisition devices constitute a local area network, and the multiple image acquisition devices are connected to the local area network through the site. The image acquisition device is used to collect multimedia data and send the multimedia data to the site. The site is used to send the multimedia data of each image acquisition device in parallel when the connection with the receiving device is normal, and cache the multimedia data locally when the connection with the receiving device is abnormal, thereby achieving: the site centrally collects the multimedia data sent by multiple image acquisition devices, and sends the multimedia data of multiple image acquisition devices in parallel when the connection with the receiving device is normal, thereby improving the utilization rate of the bandwidth. In addition, when the connection with the receiving device is abnormal, the multimedia data is cached to prevent the loss of monitoring data.

Description

Technical Field

[0001] The embodiments of the present application relate to the field of surveillance video technology, and specifically to a data transmission method and a surveillance system, a storage medium, and a device. Background Art

[0002] With the development of information technology, the application of monitoring systems is becoming more and more extensive. In existing monitoring systems, usually, a camera is connected to a receiving device (such as the cloud) through a network, and the camera uploads the collected images or videos to the receiving device.

[0003] However, the existing connection mode has the problem that the amount of transmitted data does not match the network resources. Summary of the invention

[0004] The embodiments of the present application provide a data transmission method and a monitoring system, a storage medium, and a device.

[0005] In a first aspect, an embodiment of the present application provides a monitoring system, the monitoring system comprising:

[0006] sites and multiple image acquisition devices;

[0007] The site and the plurality of image acquisition devices constitute a local area network;

[0008] The image acquisition device is used to acquire multimedia data and send the multimedia data to the site;

[0009] The site is used to send data of each image acquisition device in parallel to the receiving device when the connection with the receiving device is normal, and cache the data locally when the connection with the receiving device is abnormal, and the data includes the multimedia data.

[0010] In some embodiments, the image acquisition device is used to send the multimedia data to the site, including:

[0011] The image acquisition device is specifically used to take the multimedia data acquired within a preset time period as a data slice, and send the data slice to the site.

[0012] In some embodiments, the image acquisition device is further used to:

[0013] Sending identification information of the data slice to the site, the identification information including an identification of multimedia data to which the data slice belongs and an identification of the data slice;

[0014] When the data fragment is the starting fragment of the multimedia data to which the data fragment belongs, the identification information also includes a starting fragment identifier; when the data fragment is the ending fragment of the multimedia data to which the data fragment belongs, the identification information also includes an ending fragment identifier.

[0015] In some embodiments, the data further includes: a description file of the data slice;

[0016] The site is also used to:

[0017] After receiving the data fragments and the identification information, a description file of the data fragments is generated based on the identification information, wherein the description file is used to indicate the order and type of the data fragments in the multimedia data to which they belong, and the type is a start fragment, a middle fragment or an end fragment.

[0018] In some embodiments, the site is also used to:

[0019] The multimedia data to which the data slices belong is synthesized using the data slices according to the description file, and the multimedia data to which the data slices belong is stored locally.

[0020] In some embodiments, the site is also used to:

[0021] When the duration of caching the data locally exceeds a preset duration threshold, the cached data is formed into a unit data set based on the duration threshold and stored locally.

[0022] In some embodiments, the station is used to send the data of each of the image acquisition devices in parallel when the connection with the receiving device is normal, including:

[0023] The station is used to, when the connection with the receiving device is normal, send each of the unit data sets in order from the last to the first according to the cache time, and in the process of sending any one of the unit data sets, send the data of each of the image acquisition devices in any one of the unit data sets in parallel, or,

[0024] When the duration of caching the data locally does not exceed the preset duration threshold, each cached data is sent in order of cache time from the last to the first.

[0025] In some embodiments, the site is also used to:

[0026] In the process of sending the data of each image acquisition device to the receiving device in parallel, if the connection between the site and the receiving device is abnormal, the identification of the data whose transmission is interrupted is recorded, and after the connection between the site and the receiving device is normal, the data whose transmission is interrupted is uploaded preferentially based on the identification.

[0027] In some embodiments, the site is also used to:

[0028] Analyzing the multimedia data to obtain characteristic information of the target person;

[0029] Matching the characteristic information of the target person with the characteristic information configured in a preset database;

[0030] When the characteristic information of the target person matches the characteristic information configured in the preset database, a visit reminder of the associated person is sent to the receiving device.

[0031] In some embodiments, the site is also used to:

[0032] When the characteristic information of the target person does not match the characteristic information configured in the preset database, the target person is identified as a stranger.

[0033] In a second aspect, an embodiment of the present application provides a data transmission method, the data transmission method comprising:

[0034] Receiving multimedia data sent by multiple image acquisition devices;

[0035] When the connection with the receiving device is normal, sending the data of each of the image acquisition devices to the receiving device in parallel;

[0036] In case of an abnormal connection with the receiving device, caching the data locally;

[0037] Wherein, the data includes the multimedia data.

[0038] In a third aspect, an embodiment of the present application provides a storage medium, which includes a stored program, wherein the program, when executed by a processor, implements the data transmission method described in any implementation manner in the second aspect.

[0039] In a fourth aspect, an embodiment of the present application provides a device, the device comprising: a processor, a memory and a bus; the processor is connected to the memory via the bus;

[0040] The memory is used to store programs, and the processor is used to run programs, wherein when the program is run, the data transmission method described in any implementation manner in the second aspect is implemented.

[0041] The monitoring system provided by the present application includes a site and a plurality of image acquisition devices, the site and the plurality of image acquisition devices constitute a local area network, and the plurality of image acquisition devices are connected to the local area network through the site. The image acquisition device is used to collect multimedia data and send the multimedia data to the site. The site is used to send the multimedia data of each image acquisition device in parallel when the connection with the receiving device is normal, and cache the multimedia data locally when the connection with the receiving device is abnormal. It can be seen that the site, as an intermediate device between the image acquisition device and the receiving device, can centrally collect the multimedia data sent by the plurality of image acquisition devices, and send the multimedia data of the plurality of image acquisition devices in parallel when the connection with the receiving device is normal, thereby improving the utilization rate of the bandwidth. Moreover, when the connection with the receiving device is abnormal, the multimedia data is cached, thereby preventing the loss of the monitoring data, and after the connection with the receiving device is restored to normal, the multimedia data of the plurality of image acquisition devices are uploaded to the receiving device in parallel. It can be seen that the technical solution provided by the present application can make full use of network resources and effectively avoid the loss of monitoring data. BRIEF DESCRIPTION OF THE DRAWINGS

[0042] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the drawings required for use in the embodiments or the prior art descriptions are briefly introduced below. Obviously, the drawings described below are only some examples or embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on the provided drawings without creative work, and the present application can also be applied to other similar scenarios based on the provided drawings. Unless it is obvious from the language environment or otherwise explained, the same reference numerals in the figures represent the same structure or operation.

[0043] Figure 1 is an exemplary system architecture diagram in which some embodiments of the present application can be applied to a monitoring system;

[0044] Figure 2 is a flow chart of an embodiment of information interaction between various devices in a monitoring system according to the present application;

[0045] Figure 3 is a flow chart of an embodiment of information interaction between various devices in a monitoring system according to the present application;

[0046] Figure 4 is a flowchart of another embodiment of information interaction between various devices in the monitoring system according to the present application;

[0047] Figure 5 is a flow chart of an embodiment of a data transmission method according to the present application;

[0048] Figure 6is a flow chart of another embodiment of a data transmission method according to the present application;

[0049] Figure 7 is a schematic diagram of an exemplary system architecture that can be applied to a device according to some embodiments of the present application. DETAILED DESCRIPTION

[0050] The present application will be further described in detail below in conjunction with the accompanying drawings and examples. It will be understood that the specific embodiments described herein are only used to explain the relevant inventions, rather than to limit the invention. The described embodiments are only a part of the embodiments of the present application, rather than all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in the field without making creative work are within the scope of protection of the present application.

[0051] It should be noted that, for the convenience of description, only the parts related to the relevant invention are shown in the drawings. In the absence of conflict, the embodiments and features in the embodiments of the present application can be combined with each other.

[0052] It should be understood that the "system", "device", "unit" and / or "module" used in this application is a method for distinguishing different components, elements, parts, portions or assemblies at different levels. However, if other words can achieve the same purpose, the word can be replaced by other expressions.

[0053] As shown in this application and claims, unless the context clearly indicates an exception, the words "a", "an", "a kind" and / or "the" do not refer to the singular, but also include the plural. Generally speaking, the terms "include" and "comprise" only indicate the inclusion of clearly identified steps and elements, and these steps and elements do not constitute an exclusive list. The method or device may also include other steps or elements. The elements defined by the sentence "includes a..." do not exclude the existence of other identical elements in the process, method, commodity or device that includes the elements.

[0054] In the description of the embodiments of the present application, unless otherwise specified, " / " means or, for example, A / B can mean A or B; "and / or" in this article is only a description of the association relationship of associated objects, indicating that there can be three relationships, for example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. In addition, in the description of the embodiments of the present application, "multiple" means two or more than two.

[0055] In the following, the terms "first" and "second" are used for descriptive purposes only and are not to be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of the features.

[0056] Flowcharts are used in the present application to illustrate the operations performed by the system according to the embodiments of the present application. It should be understood that the preceding or following operations are not necessarily performed accurately in order. On the contrary, the various steps may be processed in reverse order or simultaneously. At the same time, other operations may also be added to these processes, or one or more operations may be removed from these processes.

[0057] The inventor of the present application has found through research that in the existing monitoring system, each camera is connected to the receiving device through the network, and the camera uploads the collected image or video to the receiving device. However, there is still a mismatch between the data uploaded by the camera and the network resources. Specifically, based on the characteristics of the monitoring system, compared with the network bandwidth, the amount of data collected by any camera is not large, especially for the monitoring system collected by biometric trigger (hereinafter taking infrared trigger as an example), when the image collection is not triggered, such as when no one enters the monitoring area, the network resources are idle. In addition, the amount of data collected by each camera may be uneven. For example, for the monitoring system collected by infrared trigger, the amount of data collected by the camera in the area with large flow of people is much larger than that of the camera in the area with small flow of people. It can be seen that when the network connection is normal, the network resources may be idle. In the case of abnormal network connection, because the storage capacity of the camera is limited, the monitoring data may not be uploaded in time and lost.

[0058] Therefore, the monitoring system provided by the embodiment of the present application can centrally collect multimedia data sent by multiple image acquisition devices, and send multimedia data of multiple image acquisition devices (such as cameras) in parallel when the connection with the receiving device is normal. In addition, the monitoring system provided by the embodiment of the present application caches multimedia data when the connection with the receiving device is abnormal, thereby preventing the loss of monitoring data, and uploads multimedia data of multiple image acquisition devices to the receiving device in parallel after the connection with the receiving device is restored to normal.

[0059] Figure 1 The schematic diagram of the architecture of the monitoring system provided in the embodiment of the present application includes:

[0060] A station 100 and a plurality of image acquisition devices 200 .

[0061] The site 100 and the plurality of image acquisition devices 200 constitute a local area network, and the plurality of image acquisition devices 200 are connected to the local area network through the site 100. In addition, the site 100 can be connected to the receiving device 300 through the Internet.

[0062] In this embodiment, the site 100 includes but is not limited to being a base station or a cloud server.

[0063] It should be noted that each image acquisition device 200 is connected to the local area network through the site 100, and multiple image acquisition devices 200 are connected to the site 100 through wireless communication and wired communication, and each image acquisition device 200 and the site 100 together constitute a local area network. In the local area network, the site 100 always maintains a listening state for access. After each image acquisition device 200 is connected, the site 100 opens the corresponding Transmission Control Protocol (TCP) channel to receive the multimedia data sent by the image acquisition device 200.

[0064] Based on the local area network composed of the site 100 and multiple image acquisition devices 200, the real-time data collected in the monitoring system is transmitted through the local area network. Compared with the case where all image acquisition devices are connected to the receiving device through the Internet, it can effectively prevent data leakage and improve the security of the monitoring system. In addition, the number of image acquisition devices 200 can be set by technicians according to actual conditions, thereby realizing "multi-channel monitoring".

[0065] Regarding the information interaction between the site 100, the image acquisition device 200 and the receiving device 300, such as Figure 2 As shown, the following steps are included:

[0066] S201: The image acquisition device acquires multimedia data.

[0067] The image acquisition device includes but is not limited to cameras and video cameras, and the multimedia data includes but is not limited to images and videos. In addition, the specific implementation process of the image acquisition device to acquire multimedia data is common knowledge familiar to those skilled in the art and will not be repeated here.

[0068] S202: The image acquisition device sends multimedia data to the site.

[0069] Among them, multiple image acquisition devices may send multimedia data to the site at the same time, or may not send it at the same time.

[0070] S203: The site determines whether the connection with the receiving device is normal.

[0071] If the connection between the site and the receiving device is normal, execute S204, otherwise execute S205.

[0072] S204: The station sends data to the receiving device.

[0073] The data at least includes multimedia data sent by each image acquisition device to the site.

[0074] In order to improve bandwidth utilization, the site sends the multimedia data sent to the site by each image acquisition device to the receiving device in parallel.

[0075] S205: The site caches the data locally.

[0076] S206: When the connection with the receiving device is restored to normal, the site sends the locally cached data to the receiving device.

[0077] This embodiment has the following beneficial effects:

[0078] Beneficial effect 1:

[0079] Multiple image acquisition devices send multimedia data to the site in parallel. When the site is connected to the receiving device normally, the site sends the multimedia data of each image acquisition device in parallel. When the site is connected to the receiving device abnormally, the site caches the multimedia data locally. It can be seen that the site, as an intermediate device between the image acquisition device and the receiving device, can centrally collect the multimedia data sent by multiple image acquisition devices, and when the connection with the receiving device is normal, send the multimedia data of multiple image acquisition devices in parallel, thereby improving the utilization of bandwidth.

[0080] Beneficial effect 2:

[0081] In the case of abnormal connection between the site and the receiving device, the multimedia data is cached to prevent the loss of monitoring data, and after the connection with the receiving device is restored to normal, the multimedia data of multiple image acquisition devices are uploaded to the receiving device in parallel. It can be seen that the technical solution provided by the present application can make full use of network resources and avoid the loss of monitoring data.

[0082] Beneficial effect three:

[0083] Compared with the prior art, the image acquisition device is connected to the receiving device through a local area network, and the site serves as a transfer between the image acquisition device and the receiving device. Therefore, the image acquisition device does not need to be connected to the external network, which can enhance the security of the entire data transmission.

[0084] It should be noted that in the above Figure 1 In the monitoring system shown, in order to improve the real-time performance of uploaded data, the image acquisition device will use the multimedia data acquired within a preset period of time as a data slice and send the data slice to the site to achieve "recording and transmitting at the same time".

[0085] Optionally, in the case where the image acquisition device sends data slices to the site, in the above monitoring system, the information interaction between the site, the image acquisition device and the receiving device is as follows: Figure 3 As shown, the following steps are included:

[0086] S301: The image acquisition device takes the multimedia data acquired within a preset time as a data slice.

[0087] The specific size of the preset duration can be set by the technician according to the actual situation, such as 10 minutes, 30 seconds, etc. It should be noted that the format of the data segment includes but is not limited to mp4, wav and other formats.

[0088] Specifically, taking the surveillance camera with infrared trigger collection as an example, the surveillance camera will only trigger the camera collection when an infrared-sensitive object (such as a person or an animal) appears in the monitoring area, until the infrared-sensitive object leaves the monitoring area. Therefore, the recording time of the surveillance camera cannot be estimated. In order to improve the real-time performance of the uploaded data, a collection time of 10s is set for the surveillance camera. Assuming that the infrared-sensitive object stays in the monitoring area for a total of 1 minute from entering the monitoring area to leaving the monitoring area, the 1-minute video is a piece of multimedia data, and the multimedia data obtained every 10 seconds of collection is a data slice.

[0089] It should be noted that the above specific implementation process is only used for illustration.

[0090] S302: The image acquisition device encrypts the data slices.

[0091] Among them, encrypting the data slices is a technical means commonly used by those skilled in the art, which will not be repeated here. The specific encryption method can be set by the technician according to the actual situation, such as using AES encryption, which is not limited in the embodiment of the present application. It should be noted that S302 is an optional step and may not be executed. The purpose of encryption is to improve the security of the data slices.

[0092] S303: The image acquisition device sends the encrypted data slices and identification information of the data slices to the site.

[0093] The identification information includes the identification of the multimedia data to which the data slice belongs and the identification of the data slice. In the case that S302 is not executed, the image acquisition device sends the unencrypted data slice and the identification information of the data slice to the site.

[0094] It should be emphasized that, when the data segment is the starting segment of the multimedia data to which the data segment belongs, the identification information also includes the starting segment identification. When the data segment is the ending segment of the multimedia data to which the data segment belongs, the identification information also includes the ending segment identification.

[0095] Each piece of multimedia data includes at least one data segment including a start segment identifier and one data segment including an end segment identifier. In an embodiment of the present application, for each data segment belonging to the same multimedia data, an identifier can be set for the data segment in the order of the data segment generation time from earliest to latest, and each data segment can be sent to the site.

[0096] Specifically, the target object stays for a total of 1 minute from entering the monitoring area of ​​the camera to leaving the monitoring area, so it is necessary to send this 1 minute video to the site. Taking 10 seconds of video as a data segment, every 10 seconds of video is sent to the site after recording, and so on, it is necessary to send 6 10 seconds of video to the site in sequence. The first 10 seconds of video sent is recorded as the starting segment and marked as 1 (marker for 1 minute video) -1 (marker for 10 seconds video). The second 10 seconds of video sent, the third 10 seconds of video sent, the fourth 10 seconds of video sent, and the fifth 10 seconds of video sent are respectively recorded as middle segments, and the corresponding marks are 1-2, 1-3, 1-4 and 1-5. The sixth 10 seconds of video sent is recorded as the ending segment and marked as 1-6. For the starting segment mark 1-1, the "start" field is added after the mark 1-1. For the end fragment identifier 1-6, an "end" field is added after the identifier 1-6.

[0097] It should be noted that the above specific implementation process is only used for illustration.

[0098] S304: The site decrypts the encrypted data fragments to obtain data fragments.

[0099] The specific implementation process of decrypting the encrypted data slices is a technical means commonly used by those skilled in the art, and will not be described in detail here. It should be noted that if S302 is not executed, S304 is also not executed.

[0100] S305: The site generates a description file of the data segment according to the identification information.

[0101] The description file is used to indicate the order and type of the data fragments in the multimedia data to which they belong, and the type is a start fragment, an intermediate fragment, or an end fragment. It should be noted that, based on the description file, the data fragments belonging to the same multimedia data can be combined into the multimedia data. In addition, the specific format of the description file can be set by the technician according to the actual situation.

[0102] Specifically, in combination with the example shown in S303 above, taking the m3u8 description file as an example, the starting fragment can be represented by a text description such as "1-1 (start)", the middle fragments can be represented by "1-2, 1-3, 1-4 and 1-5", and the ending fragment can be represented by "1-6 (end)".

[0103] It should be noted that the specific contents of the above description files are only used for illustration.

[0104] It should be emphasized that in order to enable the user to obtain the multimedia data collected by the image acquisition device locally through the local area network, the site can execute S314.

[0105] S306: The site determines whether the current connection with the receiving device is normal.

[0106] If the current connection between the site and the receiving device is normal, execute S307; otherwise, execute S308.

[0107] S307: The station sends the data to the receiving device.

[0108] The data includes the data slices sent by the image acquisition device and the description files of the data slices. In addition, the data slices can be encrypted using the key stored locally, and then the encrypted data slices are sent to the receiving device.

[0109] It can be seen that in the embodiment of the present application, the image acquisition device sends the collected data slices to the site in real time. When the site is normally connected to the receiving device, it immediately sends the data slices to the receiving device, thereby realizing "recording and transmitting at the same time".

[0110] S308: The site caches the data locally.

[0111] In which, due to the abnormal connection between the site and the receiving device, the site cannot send the data fragment to the receiving device. In order to improve the subsequent data transmission efficiency, the received data fragment is cached locally, and the connection with the receiving device is monitored in real time to see whether it is restored to normal. If it is restored to normal, S312 is executed. In addition, after executing S308, S309 can be executed next.

[0112] S309: The site determines whether the duration of the data cache locally exceeds a preset duration threshold.

[0113] The specific size of the preset duration threshold can be set by the technician according to the actual situation, such as one week, one day, etc. If the duration of the data cache locally exceeds the preset duration threshold, S310 is executed, otherwise S312 is executed.

[0114] S310: The site forms a unit data set of the cached data based on the time threshold and stores it locally.

[0115] Among them, since data is usually cached in the memory, it is limited by the storage capacity of the memory. If the data is cached for a long time, the data may be lost. Therefore, the cached data in the unit time is regarded as a unit data set based on the time threshold (for example, one day), and the unit data set is stored locally. After executing S310, continue to execute S311.

[0116] S311: After the connection with the receiving device is restored to normal, the site sends each unit data set stored locally to the receiving device.

[0117] The site can send each unit data set stored locally to the receiving device in the order of cache time from the last to the first. In addition, the locally stored unit data set can be encrypted using the locally stored key, and then the encrypted unit data set can be sent to the receiving device, greatly improving the security of the data.

[0118] S312: After the connection with the receiving device is restored to normal, the site sends the locally cached data to the receiving device.

[0119] The site can send each locally cached data slice to the receiving device in the order of cache time from the latest to the earliest. In addition, the locally cached data slice can be encrypted using a locally stored key, and then the encrypted data slice is sent to the receiving device.

[0120] In order to improve the reliability of uploaded data, after the connection with the receiving device is restored to normal, the site can give priority to sending the data fragments whose transmission was interrupted to the receiving device to achieve "breakpoint resumption".

[0121] Optionally, when the site is sending data from each image acquisition device to a receiving device, if the connection between the site and the receiving device is abnormal, the site records the identifier of the data whose transmission is interrupted, and after the connection between the site and the receiving device is normal, the site prioritizes uploading the data whose transmission is interrupted based on the identifier.

[0122] The data being transmitted between the site and the receiving device may fail to be transmitted due to abnormal connection. The identifier of the data whose transmission is interrupted is recorded. For example, if the data segments identified as 1-5 are interrupted during transmission, the identifiers 1-5 are recorded. After the connection between the site and the receiving device is restored to normal, the site will preferentially send the data segments identified as 1-5 to the receiving device.

[0123] S313: The receiving device stores and analyzes the data, and provides corresponding services to the user based on the analysis results of the data.

[0124] Among them, since the data sent by the site to the receiving device includes the description file of the data segments, based on the description file, the receiving device can combine the data segments belonging to the same multimedia data segment into multimedia data, and store and analyze the multimedia data segment. In addition, the corresponding services provided to the user based on the data analysis results include but are not limited to: playing multimedia data, pushing surveillance videos to the user in real time, and alerting the user of special events, etc.

[0125] It should be noted that, based on the above S307, the receiving device receives the data fragments sent by the site in real time, based on the above S311, the receiving device receives the unit data set sent by the site, and based on the above S312, the receiving device receives the cached data sent by the site. Of course, if the above S307, S311 and S312 send encrypted data, the receiving device will decrypt the encrypted data after receiving it. In addition, as long as the site is connected to the receiving device normally, S307, S311 and S312 can be executed in parallel without interference, that is, the receiving device can receive real-time data, unit data sets and cached data in parallel.

[0126] Based on the above S307, when the site is connected to the receiving device normally, the receiving device with audio playback function, or the receiving device with other external audio players, can play the data slices collected by each image acquisition device in real time, thereby realizing "recording and playing at the same time" and improving the applicability of the monitoring system.

[0127] It should be emphasized that the above S303 can be regarded as the first process run by the site, and the first process is used to receive data sent by each image acquisition device. The above S307, S311 and S312 can be regarded as the second process run by the site, and the second process is used to send data to the receiving device. In the embodiment of the present application, when the site is connected to the receiving device normally, the site can run the first process and the second process in parallel, and there is no restriction between the two processes. In other words, as long as the site is connected to the receiving device normally, the site can send data to the receiving device in parallel while receiving the data sent by the image acquisition device.

[0128] S314: The site uses the data slices to synthesize the multimedia data to which the data slices belong according to the description file, and locally stores the multimedia data to which the data slices belong.

[0129] The description file is used to indicate the order and type of the data segments in the multimedia data to which they belong, and the multimedia data to which the data segments belong is synthesized using the data segments according to the order and type of the multimedia data to which the data segments belong. For example, the data segments corresponding to the respective ones marked as 1-1 (start), 1-2, 1-3, 1-4, 1-5 and 1-6 (end) in the description file are synthesized into the multimedia data marked as 1. In other words, the recordings with shorter durations are synthesized into the recordings with preset durations.

[0130] It should be noted that the synthesized multimedia data can be stored in a local SD card or memory. In the form of local storage, the multimedia data can be stored in a folder marked with a time unit according to a preset time unit (such as a day, a week, etc.). For example, all multimedia data obtained on the same day are stored in the same folder.

[0131] Therefore, when users want to obtain multimedia data, they can not only obtain multimedia data from a receiving device (such as the cloud) through the Internet, but also obtain locally stored multimedia data from the site through a local area network, thereby improving the applicability of the monitoring system.

[0132] This embodiment has the following beneficial effects:

[0133] Beneficial effect 1:

[0134] The image acquisition device is used to treat the multimedia data collected within a preset time as a data slice and send the data slice to the site. The first process in the site is used to receive the data slice, and the second process is used to send the data slice to the receiving device when the site is connected to the receiving device normally. Because the data slice has a smaller data volume than the entire multimedia data, as long as the appropriate time is set in advance, if the connection between the site and the receiving device is normal, the collected multimedia data slices can be uploaded without waiting until all the multimedia data is collected and then uploaded, thus achieving "recording and transmitting at the same time".

[0135] Beneficial effect 2:

[0136] When the connection between the site and the receiving device is abnormal, the second process caches the data slices locally. After the connection between the site and the receiving device is normal, the second process uploads the data slices of each image acquisition device in parallel, thus achieving "delayed parallel upload".

[0137] In summary, the monitoring system disclosed in the embodiment of the present application can realize "record and upload immediately" and "delayed parallel upload", making full use of the connection status of the site and the receiving device to improve the upload efficiency of monitoring data. In addition, because the first process and the second process of the site run in parallel, data reception and data upload do not affect each other, further improving the upload efficiency of monitoring data.

[0138] Optionally, in the case where the image acquisition device sends multimedia data to the site (without data fragmentation, for example, after recording a video, a complete video is sent), in the above monitoring system, the information interaction between the site, the image acquisition device and the receiving device is as follows: Figure 4 As shown, the following steps are included:

[0139] S401: The image acquisition device acquires multimedia data.

[0140] The specific execution process and implementation principle of S401 are the same as those mentioned above. Figure 1 The specific execution process of S201 shown is consistent with the implementation principle and will not be repeated here.

[0141] S402: The image acquisition device sends multimedia data to the site.

[0142] Among them, the image acquisition device can encrypt the multimedia data and send the encrypted multimedia data to the site. Of course, the image acquisition device may not encrypt the multimedia data. In the embodiment of the present application, the specific encryption method can be set by the technician according to the actual situation.

[0143] It should be noted that, in order to enable the user to obtain the multimedia data collected by the image acquisition device through the local area network, the site may execute S408 after receiving the multimedia data.

[0144] S403: The site determines whether the current connection with the receiving device is normal.

[0145] If the site is currently connected to the receiving device normally, then S404 is executed; otherwise, S405 is executed.

[0146] S404: The station sends the data to the receiving device.

[0147] The data includes multimedia data sent by each image acquisition device. In addition, if the site receives encrypted data, it needs to decrypt the encrypted data. Of course, the data sent by the site to the receiving device can also be encrypted data. Therefore, if the site receives encrypted data, the site can directly send the encrypted data to the receiving device, or first decrypt the encrypted data and then use the local key to re-encrypt the data.

[0148] S405: The site caches the data locally.

[0149] Among them, due to the abnormal connection between the site and the receiving device, the site cannot send data to the receiving device. In order to improve the subsequent data transmission efficiency, the received data is cached locally, and the connection with the receiving device is monitored in real time to see whether it returns to normal. If it returns to normal, execute S406.

[0150] S406: After restoring the connection with the receiving device, the site sends the locally cached data to the receiving device.

[0151] The site may send the locally cached data to the receiving device in the order of cache time from the last to the first. In addition, the locally cached data may be encrypted using a locally stored key, and then the encrypted data may be sent to the receiving device.

[0152] It should be noted that the site can also send the locally cached data to the receiving device in the order of cache time from early to late. In addition, the locally cached data can also be sent to the receiving device in other orders. For example, a label is set for the locally cached data, and the label contains a priority attribute. The locally cached data is sent to the receiving device in the order from high to low priority indicated by the label.

[0153] S407: The receiving device stores and analyzes the data, and provides corresponding services to the user based on the analysis results of the data.

[0154] Among them, based on the above S404, the receiving device receives the real-time data sent by the site, and based on the above S406, the receiving device receives the cached data sent by the site. Of course, if the above S404 and S406 send encrypted data, the receiving device will decrypt the encrypted data after receiving it. In addition, as long as the site is connected to the receiving device normally, S404 and S406 can be executed in parallel without interference, that is, the receiving device can receive real-time data and cached data in parallel.

[0155] It should be emphasized that the above S402 can be regarded as the first process of the site operation, and the first process is used to receive the data sent by each image acquisition device. The above S404 and S406 can be regarded as the second process of the site operation, and the second process is used to send data to the receiving device. In the embodiment of the present application, when the site is connected to the receiving device normally, the site can run the first process and the second process in parallel, and there is no restriction between the two processes. In other words, as long as the site is connected to the receiving device normally, the site can send data to the receiving device in parallel while receiving the data sent by the image acquisition device.

[0156] S408: The site stores the multimedia data locally.

[0157] The site may store the multimedia data in a local SD card or memory. In the form of local storage, the multimedia data may be stored in a folder identified by a time unit according to a preset time unit (e.g., day, week, etc.). For example, each multimedia data obtained in the same day may be stored in the same folder.

[0158] Therefore, when users want to obtain multimedia data, they can not only obtain multimedia data from a receiving device (such as the cloud) through the Internet, but also obtain locally stored multimedia data from the site through a local area network, thereby improving the applicability of the monitoring system.

[0159] This embodiment has the following beneficial effects:

[0160] Beneficial effect 1:

[0161] The image acquisition device is used to send the collected multimedia data to the site. The first process in the site is used to receive data, which includes multimedia data sent by each image acquisition device. The second process is used to send data to the receiving device when the site is connected to the receiving device normally. If the site is connected to the receiving device normally, the complete multimedia data that has been collected can be uploaded.

[0162] Beneficial effect 2:

[0163] When the connection between the site and the receiving device is abnormal, the second process caches the data locally. After the connection between the site and the receiving device is normal, the second process uploads the data of each image acquisition device and the locally cached data in parallel, thereby realizing "delayed parallel upload".

[0164] In summary, the monitoring system disclosed in the embodiment of the present application can realize "delayed parallel upload", making full use of the connection status of the site and the receiving device to improve the upload efficiency of the monitoring data. In addition, because the first process and the second process of the site run in parallel, data reception and data upload do not affect each other, further improving the upload efficiency of the monitoring data.

[0165] Based on the monitoring system provided in the above embodiment of the present application, the embodiment of the present application also provides a data transmission method, which is applied to a site, including but not limited to a base station or a server, such as Figure 5 As shown, the following steps are included:

[0166] S501: receiving multimedia data sent by multiple image acquisition devices.

[0167] The site can receive the data slices sent by any image acquisition device and the identification information of the data slices. In addition, after receiving the data slices and the identification information, the site can generate a description file of the data slices according to the identification information, and synthesize the multimedia data to which the data slices belong using the data slices according to the description file, and locally store the multimedia data to which the data slices belong.

[0168] It should be noted that if the site receives encrypted data, the site can also decrypt the encrypted data. Of course, the process of decrypting the encrypted data is common knowledge familiar to those skilled in the art and will not be described in detail here.

[0169] S502: Determine whether the connection with the receiving device is normal.

[0170] If the connection with the receiving device is normal, execute S503, otherwise execute S504.

[0171] S503: Sending data of each image acquisition device to the receiving device in parallel.

[0172] The data at least includes multimedia data or data fragments sent by each image acquisition device. In addition, the site can use a local key to encrypt the data and then send the encrypted data to the receiving device.

[0173] S504: Cache the data locally.

[0174] If the data is cached locally for a period of time exceeding a preset time threshold, the site can form a unit data set of the cached data based on the time threshold and store it locally. In addition, the site monitors in real time whether the connection with the receiving device is restored to normal. If it is restored to normal, S505 is executed.

[0175] S505: After the connection with the receiving device is restored to normal, the locally cached data is sent to the receiving device.

[0176] The locally cached data includes data slices and / or unit data sets. In addition, the site can send each locally cached data slice and / or unit data set to the receiving device in the order of cache time from the last to the first. When the site is connected to the receiving device normally, the site can send real-time data and cached data to the receiving device at the same time, that is, the site can execute S503 and S505 at the same time.

[0177] It should be emphasized that the above S501 is the first process of the site, which is used to receive data sent by each image acquisition device. The above S503 and S505 are the second process of the site, which is used to send data to the receiving device. In the embodiment of the present application, the site can execute the first process and the second process in parallel.

[0178] This embodiment has the following beneficial effects:

[0179] Beneficial effect 1:

[0180] The site receives multimedia data sent by multiple image acquisition devices, and when the connection with the receiving device is normal, sends the data of each image acquisition device and the locally cached data to the receiving device in parallel. And when the connection with the receiving device is abnormal, the data is cached locally. It can be seen that the site, as an intermediate device between the image acquisition device and the receiving device, can centrally collect the multimedia data sent by multiple image acquisition devices, and when the connection with the receiving device is normal, send the multimedia data of multiple image acquisition devices in parallel, thereby improving the utilization of bandwidth.

[0181] Beneficial effect 2:

[0182] In the case of abnormal connection between the site and the receiving device, the multimedia data is cached to prevent the loss of monitoring data, and after the connection with the receiving device is restored to normal, the multimedia data of multiple image acquisition devices are uploaded to the receiving device in parallel. Therefore, network resources can be fully utilized and the loss of monitoring data can be effectively avoided.

[0183] Optionally, based on the monitoring system provided in the above embodiment of the present application, the embodiment of the present application further provides another data transmission method, which is applied to a site, including but not limited to a base station or a server, such as Figure 6 As shown, the following steps are included:

[0184] S601: Receive multimedia data sent by an image acquisition device.

[0185] S602: Analyze the multimedia data to obtain characteristic information of the target person.

[0186] The multimedia data may be a video, and the target person is the person who appears in the video. The characteristic information of the target person includes but is not limited to: facial features, gender, and age. In the embodiment of the present application, the specific implementation means of analyzing the multimedia data includes but is not limited to: performing face detection and face recognition operations on the multimedia data. Through face detection and face recognition, the facial features, gender, and age of the target person are obtained. These are technical means familiar to those skilled in the art and will not be described in detail here.

[0187] S603: Match the characteristic information of the target person with the characteristic information configured in the preset database.

[0188] S604: Based on the matching result, determine whether the target person has an association relationship with the user (ie, the user of the receiving device).

[0189] If the target person is acquainted with the user, then S605 is executed; otherwise, S606 is executed.

[0190] If the characteristic information of the target person matches the characteristic information of the security personnel configured in the preset database, it is determined that the target person is acquainted with the user, otherwise it is determined that the target person is not acquainted with the user. The so-called association relationship includes but is not limited to: family, friends, and colleagues, etc.

[0191] S605: Sending a reminder of the associated person's visit to the receiving device.

[0192] S606: Identify the target person as a stranger.

[0193] S607: Send the stranger's characteristic information to the receiving device.

[0194] After executing S607, continue to execute S609.

[0195] S608: Acquire a marking operation triggered by the user through a receiving device.

[0196] After executing S608 , continue to execute S609 .

[0197] Among them, the marking operation is used to mark strangers as non-strangers.

[0198] S609: When the marking operation indicates marking the stranger as a non-stranger, the feature information of the non-stranger is stored in a preset database.

[0199] Specifically, the process shown in S601-S609 above is introduced by taking the monitoring device installed at the door (a specific type of image acquisition device, the monitored devices include but are not limited to doors, safes and cars, etc., and the monitored areas include but are not limited to rooms and garages, etc.), the server (a specific type of site), and the mobile phone (a specific type of receiving device) as an example:

[0200] 1. When the target person appears at the door, the monitoring device uploads the video to the server.

[0201] 2. The server analyzes the video and determines whether a face is recognized. If a face is recognized, a face detection algorithm is used to capture the face image from the video.

[0202] 3. The server calls the face recognition process to identify the face image and obtain the feature information of the target person, including face features, age, gender and other information.

[0203] 4. The server matches the characteristic information of the target person with the characteristic information in the database. According to the matching result, if the characteristic information of the target person matches the characteristic information configured in the preset database, a prompt "XXX appears in front of the door" is sent to the mobile phone.

[0204] 5. If the server determines that the target person's feature information does not match the feature information configured in the preset database, it will output the face image, feature value, time and place of last appearance, and send a message to the mobile phone via SMS push.

[0205] 6. When the server mistakenly judges the target person as a stranger, the user can use the mobile phone to change it: If the stranger is determined to be a non-stranger, the user can use the mobile phone to manually mark it. Specifically, the user can judge whether the target person is a non-stranger based on the video. If the user determines that the target person is a non-stranger (such as a friend), the user can use the mobile phone to annotate the facial image and upload the annotated facial image to the server. The server stores the annotated facial image in the database and identifies the target person as a non-stranger.

[0206] It should be noted that the above specific implementation process is only used for illustration.

[0207] This embodiment has the following beneficial effects:

[0208] The site can obtain the characteristic information of the target person based on the multimedia data sent by the image acquisition device, and determine whether the target person is a stranger based on the characteristic information configured in the preset database, providing effective assistance for the security work of the portal, thereby realizing the full utilization of the monitoring data.

[0209] An embodiment of the present application provides a storage medium on which a program is stored. When the program is executed by a processor, the data transmission method is implemented.

[0210] An embodiment of the present application provides a processor, which is used to run a program, wherein the data transmission method is executed when the program is running.

[0211] The present application embodiment provides a device such as Figure 7 As shown, the device 700 includes at least one processor 701, at least one memory 702 connected to the processor 701, and a bus 703; wherein the processor 701 and the memory 702 communicate with each other through the bus 703; the processor 701 is used to call the program instructions in the memory 702 to execute the above-mentioned data transmission method. The device in this article can be a server, a PC, a PAD, a mobile phone, etc.

[0212] Among them, the devices, processors, storage media or computer program products provided in the above embodiments of the present application can all be used to execute the corresponding methods provided above. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding methods provided above, and will not be repeated here.

[0213] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0214] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0215] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0216] In a typical configuration, a computing device includes one or more processors (CPU), input / output interfaces, network interfaces, and memory.

[0217] The memory may include non-permanent memory in a computer-readable medium, random access memory (RAM) and / or non-volatile memory in the form of read-only memory (ROM) or flash memory. The memory is an example of a computer-readable medium.

[0218] Computer readable media include permanent and non-permanent, removable and non-removable media, and can be implemented by any method or technology to store information. Information can be computer readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (STRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, compact disk read-only memory (CD-ROM), digital versatile disk (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device. As defined herein, computer readable media does not include temporary computer readable media such as modulated data signals and carrier waves.

[0219] Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, systems or computer program products. Therefore, the present application may adopt the form of a complete hardware embodiment, a complete software embodiment or an embodiment in combination with software and hardware. Moreover, the present application may adopt the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) that contain computer-usable program code.

[0220] The above description is only a preferred embodiment of the present application and an explanation of the technical principles used, and is not intended to limit the present application. For those skilled in the art, the present application may have various modifications and variations. The scope of the invention involved in the present application is not limited to the technical solution formed by a specific combination of the above-mentioned technical features, but should also cover other technical solutions formed by any combination of the above-mentioned technical features or their equivalent features without departing from the above-mentioned inventive concept. For example, a technical solution formed by replacing the above-mentioned features with the technical features with similar functions disclosed in this application (but not limited to).

Claims

1. A monitoring system, characterized in that: include: sites and multiple image acquisition devices; The site and the plurality of image acquisition devices constitute a local area network; The image acquisition device is used to acquire multimedia data, and uses the multimedia data acquired in a preset time as a data slice, and sends the data slice to the site; The site is used to send the data of each image acquisition device to the receiving device in parallel when the connection with the receiving device is normal, cache the data locally when the connection with the receiving device is abnormal, and send the locally cached data to the receiving device after the connection with the receiving device is restored to normal, wherein the data includes the data slices; The site runs a first process and a second process in parallel, the first process is used to receive data from each of the image acquisition devices, and the second process is used to send data to the receiving device; When the site is connected to the receiving device normally, through the first process and the second process, the site sends data to the receiving device in parallel while receiving data from each of the image acquisition devices.

2. The system according to claim 1, characterized in that The image acquisition device is also used for: Sending identification information of the data slice to the site, the identification information including an identification of multimedia data to which the data slice belongs and an identification of the data slice; When the data fragment is the starting fragment of the multimedia data to which the data fragment belongs, the identification information also includes a starting fragment identifier; when the data fragment is the ending fragment of the multimedia data to which the data fragment belongs, the identification information also includes an ending fragment identifier.

3. The system according to claim 2, characterized in that The data also includes: a description file of the data slice; The site is also used to: After receiving the data fragments and the identification information, a description file of the data fragments is generated based on the identification information, wherein the description file is used to indicate the order and type of the data fragments in the multimedia data to which they belong, and the type is a start fragment, a middle fragment or an end fragment.

4. The system according to claim 3, characterized in that The site is also used to: The multimedia data to which the data slices belong is synthesized using the data slices according to the description file, and the multimedia data to which the data slices belong is stored locally.

5. The system according to any one of claims 1 to 4, characterized in that: The site is also used to: When the duration of caching the data locally exceeds a preset duration threshold, the cached data is formed into a unit data set based on the duration threshold and stored locally.

6. The system according to claim 5, characterized in that The station is used to send the data of each of the image acquisition devices in parallel when the connection with the receiving device is normal, including: The station is used to, when the connection with the receiving device is normal, send each of the unit data sets in order from the last to the first according to the cache time, and in the process of sending any of the unit data sets, send the real-time data collected by each of the image acquisition devices in parallel, or, When the duration of caching the data locally does not exceed the preset duration threshold, each cached data is sent in order of cache time from the last to the first.

7. The system according to any one of claims 1 to 4, characterized in that: The site is also used to: In the process of sending the data of each image acquisition device to the receiving device in parallel, if the connection between the site and the receiving device is abnormal, the identification of the data whose transmission is interrupted is recorded, and after the connection between the site and the receiving device is normal, the data whose transmission is interrupted is uploaded preferentially based on the identification.

8. The system according to claim 1, characterized in that The site is also used to: Analyzing the multimedia data to obtain characteristic information of the target person; Matching the characteristic information of the target person with the characteristic information configured in a preset database; When the characteristic information of the target person matches the characteristic information configured in the preset database, a visit reminder of the associated person is sent to the receiving device.

9. The system according to claim 8, characterized in that The site is also used to: When the characteristic information of the target person does not match the characteristic information configured in the preset database, the target person is identified as a stranger.

10. A data transmission method, characterized in that: The method is applied to a site, the site is used to run a first process and a second process in parallel, the first process is used to receive data from various image acquisition devices, and the second process is used to send data to the receiving device; When the station is connected to the receiving device normally, through the first process and the second process, the station sends data to the receiving device in parallel while receiving data from each image acquisition device, and the method includes: receiving data slices sent by multiple image acquisition devices; When the connection with the receiving device is normal, sending the data of each of the image acquisition devices to the receiving device in parallel; When the connection with the receiving device is abnormal, the data is cached locally, and after the connection with the receiving device is restored to normal, the locally cached data is sent to the receiving device; Wherein, the data includes the data slices.

11. A storage medium, characterized in that: The storage medium includes a stored program, wherein the program executes the data transmission method according to claim 10 .

12. A device, characterized in that: include: processor, memory, and bus; The processor is connected to the memory via the bus; The memory is used to store a program, and the processor is used to run the program, wherein the data transmission method according to claim 10 is executed when the program is run.

Images