An Internet of Things communication system and method based on communication protocol

Abstract

The present invention relates to the field of Internet of Things technology, and in particular to an Internet of Things communication method based on a communication protocol. The method includes data collection; data packaging; data transmission and playback; data response monitoring and adjustment of transmission strategy. The present invention ensures the efficient capture and transmission of audio and video data to the receiving end by using a communication protocol, uses timestamps and sequence numbers to achieve correct sorting and synchronous playback of data, and adjusts the transmission strategy and buffer size by analyzing the online growth packet loss rate and real-time correlation to effectively respond to changes in the network environment and ensure the stability of data transmission. By splitting the retransmission strategy, the problem of data packet loss is effectively dealt with to ensure that important data can be transmitted in time. By analyzing the transmission control error, the layout position of the AI ​​camera is adjusted to optimize the monitoring effect, and the quality of data transmission is effectively maintained to ensure the efficiency and reliability of the Internet of Things communication system based on the communication protocol in the AI ​​camera application.

Description

Technical Field

[0001] The present invention relates to the technical field of Internet of Things, and in particular to an Internet of Things communication method based on a communication protocol. Background Art

[0002] With the rapid development of Internet of Things technology and the popularization of smart hardware, better integration of AI cameras into the Internet of Things ecosystem, enabling AI cameras to achieve synchronous transmission and playback of audio and video data, and how to improve the accuracy of synchronization have become more and more topics of concern to relevant technical personnel. Therefore, there is an urgent need for an Internet of Things communication method based on a communication protocol. The communication protocol has the characteristics of high efficiency, reliability, and strong real-time performance, which can effectively improve the transmission efficiency of audio and video monitoring data and meet modern monitoring needs.

[0003] A Chinese patent document with publication number CN115695509A discloses an intelligent sewing system based on an Internet of Things communication protocol, comprising: a plurality of sewing machine devices, a data information collection unit, a data communication platform and an intelligent management and control center unit; the data information collection unit transmits the collected information data of the operation of the plurality of sewing machine devices to the intelligent management and control center unit through the data communication platform, the intelligent management and control center unit generates corresponding control instructions through intelligent analysis, transmits the control instructions to the plurality of sewing machine devices through the data communication platform, and the plurality of sewing machine devices operate according to the control instructions; wherein the data communication platform interacts and transmits information data according to the set data transmission frame format and communication process; it can be seen that the existing Internet of Things communication system lacks real-time monitoring of the network environment and timely adjustment of the transmission strategy, which makes the data transmission not smooth and the delay high, resulting in low transmission efficiency and poor monitoring effect. Summary of the invention

[0004] To this end, the present invention provides an Internet of Things communication method based on a communication protocol, which is used to overcome the problem in the prior art that due to the lack of analysis and regulation of the transmission status of monitoring data, it is difficult to adapt to various network environments for data transmission, resulting in low transmission efficiency.

[0005] To achieve the above object, the present invention provides an Internet of Things communication method based on a communication protocol, comprising:

[0006] Collecting monitoring data in a target monitoring area at a preset collection frequency, adding corresponding timestamps and encoding, dividing the encoded monitoring data into a plurality of data packets to be transmitted according to a preset number of divisions, and generating corresponding sequence numbers;

[0007] Sending the data packet to be transmitted to a data receiving end for transmission, monitoring the response of the data packet to be transmitted and the playback status of the data to be played in real time, so as to adjust the transmission strategy according to the response, and adjust the deployment parameters in the target monitoring area based on the playback status;

[0008] wherein, the data packets to be transmitted are received and decoded in the order of the sequence numbers to obtain the data to be played, and the data to be played are played in the order of the timestamps;

[0009] The deployment parameters include the deployment position of the AI ​​camera;

[0010] Adjusting the transmission strategy includes correcting the preset number of segmentations according to the online increasing packet loss rate during the transmission process; adjusting the buffer size based on the analysis results of the video surveillance data of any adjacent AI camera; and implementing a splitting and retransmission strategy for the current data packet to be transmitted.

[0011] Further, real-time monitoring of the response of the transmitted data packets to be transmitted and the playing status of the data to be played includes:

[0012] Analyze the response of the currently transmitted data packet received, and analyze the transmission status and adjust the transmission strategy according to the response;

[0013] The actual playback duration of the received audio surveillance data and video surveillance data is obtained in the current collection cycle, the transmission control error is calculated according to the real-time playback duration, and the deployment position of the AI ​​camera is determined according to the transmission control error.

[0014] The ratio of the actual playback time to the theoretical playback time is calculated to obtain the transmission control error.

[0015] Further, analyzing the response of the received transmission data packet of the current transmission includes:

[0016] Obtaining a real-time response duration of receiving a currently transmitted data packet, and determining the real-time response duration according to a first standard response duration and a second standard response duration;

[0017] Determine a response situation according to the determination result, wherein the response situation includes a first response situation, a second response situation, and a third response situation;

[0018] Analyzing the transmission status based on the response and adjusting the transmission strategy;

[0019] When the real-time response duration is less than the first standard response duration, the response status of the current data packet to be transmitted is determined to be the first response status, and the current transmission status is determined to be normal;

[0020] When the real-time response duration is greater than or equal to the first standard response duration and less than the second standard response duration, determining that the response status of the current data packet to be transmitted is the second response status, and determining that the current transmission state is that there is transmission jitter;

[0021] When the real-time response duration is greater than the second standard response duration, the response status of the current data packet to be transmitted is determined to be the third response status, and the current transmission status is determined to be that there is a long-term network interruption.

[0022] Further, adjusting the transmission strategy includes:

[0023] In the first response case, the transmission status of the next data packet to be transmitted is obtained, and the online growth packet loss rate in the current monitoring period is calculated, the online growth packet loss rate is analyzed, and the preset number of segmentations is adjusted based on the analysis result;

[0024] In the second response case, the video surveillance data of any adjacent AI camera in the current surveillance area is analyzed, and the buffer size is adjusted based on the analysis results;

[0025] In the third response case, a splitting and retransmission strategy is performed on the data packet to be transmitted.

[0026] Further, adjusting the preset number of divisions based on the analysis results includes:

[0027] Compare the online packet loss rate increase with the preset packet loss rate threshold.

[0028] If the online increasing packet loss rate is greater than the preset increasing packet loss rate threshold, the current segmentation number is calculated according to the online increasing packet loss rate, and the preset segmentation number is adjusted to the corrected segmentation number according to the current segmentation number;

[0029] If the online packet loss rate is less than or equal to the preset packet loss rate threshold, the preset number of splits is not adjusted;

[0030] The online growth packet loss rate is the ratio of the number of lost data packets to be transmitted to the total number of sent data packets in the current monitoring period.

[0031] Further, adjusting the buffer size based on the analysis result includes:

[0032] Obtain the video surveillance data of any adjacent AI camera in the current surveillance area as an adjacent video stream;

[0033] Recording the current video surveillance data as the current video stream, and calculating the real-time correlation between the adjacent video stream and the current video stream;

[0034] Determine whether to adjust the size of the buffer based on the real-time relevance to adapt to the current network environment.

[0035] Further, determining whether to adjust the size of the buffer according to the real-time relevance includes:

[0036] The real-time relevance is compared to the standard relevance, and the buffer size is increased when the real-time relevance is less than the standard relevance.

[0037] Furthermore, the split-and-retransmit strategy is to split the current data packet to be transmitted into sub-stream transmission data, and trigger a retransmission request.

[0038] Further, determining whether to adjust the placement position of the AI ​​camera according to the transmission control error includes:

[0039] The standard transmission error is compared with the transmission control error. When the transmission control error is greater than the standard transmission error, the layout position of the AI ​​camera is adjusted.

[0040] On the other hand, the present invention also provides an Internet of Things communication system based on a communication protocol, which is applied to the above-mentioned Internet of Things communication method based on a communication protocol, comprising:

[0041] A data acquisition module, which is used to collect monitoring data in a target monitoring area at a preset collection frequency, add corresponding timestamps and encode, divide the encoded monitoring data into a plurality of data packets to be transmitted according to a preset number of divisions, and generate corresponding sequence numbers;

[0042] A data transmission module, comprising an audio data transmission unit for transmitting the target audio monitoring data under a first network bandwidth and a video data transmission unit for transmitting the target video monitoring data under a second network bandwidth, wherein the data transmission module is used to send the data packet to be transmitted to a data receiving end for transmission;

[0043] The data receiving end is connected to the data transmission module, and is used to receive and decode the data packets to be transmitted in the order of the sequence numbers to obtain the data to be played, and play the data to be played in the order of the timestamps;

[0044] A data processing module, which is connected to the data receiving end and is used to monitor the response of the data packets to be transmitted and the playback status of the data to be played in real time, so as to adjust the transmission strategy according to the response status, and adjust the layout parameters in the target monitoring area based on the playback status;

[0045] The deployment parameters include the deployment position of the AI ​​camera;

[0046] Adjusting the transmission strategy includes correcting the preset number of segmentations according to the online increasing packet loss rate during the transmission process; adjusting the buffer size based on the analysis results of the video surveillance data of any adjacent AI camera; and implementing a splitting and retransmission strategy for the current data packet to be transmitted.

[0047] Compared with the prior art, the beneficial effects of the present invention lie in that the communication protocol is utilized to ensure the efficient capture of audio and video data, a high-sensitivity microphone array is used to capture faint sounds in the environment, a psychoacoustic model is used to remove sounds that are not easily perceived by the human ear in the audio monitoring data, the compression ratio is improved, the MQTT protocol is used to deliver the data packets to be transmitted to the receiving end, the timestamp and sequence number are used to achieve correct sorting and synchronous playback of data, the transmission strategy and buffer size are adjusted by analyzing the online growth packet loss rate and real-time correlation to effectively respond to changes in the network environment and ensure the stability of data transmission, the split retransmission strategy is used to effectively respond to the problem of data packet loss, ensure that important data can be transmitted in a timely manner, effectively maintain the quality of data transmission, and ensure the efficiency and reliability of the Internet of Things communication system based on the communication protocol in the AI ​​camera application. BRIEF DESCRIPTION OF THE DRAWINGS

[0048] Figure 1 A schematic diagram of a flow chart of an Internet of Things communication method based on a communication protocol according to an embodiment of the present invention;

[0049] Figure 2 A schematic diagram of a flow chart of real-time monitoring of the response status of a data packet to be transmitted and the playback status of data to be played according to an embodiment of the present invention;

[0050] Figure 3 A schematic diagram of a flow chart of analyzing a response to a received transmission data packet currently being transmitted according to an embodiment of the present invention;

[0051] Figure 4 The figure is a schematic diagram of the structure of an Internet of Things communication system based on a communication protocol according to an embodiment of the present invention. DETAILED DESCRIPTION

[0052] In order to make the objects and advantages of the present invention more clearly understood, the present invention is further described below in conjunction with embodiments; it should be understood that the specific embodiments described herein are only used to explain the present invention and are not used to limit the present invention.

[0053] The preferred embodiments of the present invention are described below with reference to the accompanying drawings. It should be understood by those skilled in the art that these embodiments are only used to explain the technical principles of the present invention and are not intended to limit the protection scope of the present invention.

[0054] It should be noted that, in the description of the present invention, terms such as "up", "down", "left", "right", "inside" and "outside" indicating directions or positional relationships are based on the directions or positional relationships shown in the drawings. This is merely for the convenience of description and does not indicate or imply that the device or element must have a specific orientation, be constructed and operated in a specific orientation. Therefore, it cannot be understood as a limitation on the present invention.

[0055] In addition, it should be noted that in the description of the present invention, unless otherwise clearly specified and limited, the terms "installed", "connected", and "connected" should be understood in a broad sense, for example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection, or it can be indirectly connected through an intermediate medium, or it can be the internal communication of two components. For those skilled in the art, the specific meanings of the above terms in the present invention can be understood according to specific circumstances.

[0056] See also Figure 1 As shown, it is a flow chart of an Internet of Things communication method based on a communication protocol according to an embodiment of the present invention. The present invention provides an Internet of Things communication method based on a communication protocol, including:

[0057] Step S1, collecting monitoring data in the target monitoring area at a preset collection frequency, adding corresponding timestamps and encoding;

[0058] Step S2, dividing the encoded monitoring data into a plurality of data packets to be transmitted according to a preset number of divisions, and generating corresponding sequence numbers;

[0059] Step S3, sending the data packet to be transmitted to a data receiving end for transmission;

[0060] Step S4, real-time monitoring of the response of the data packets to be transmitted and the playback status of the data to be played, so as to adjust the transmission strategy according to the response, and adjust the layout parameters in the target monitoring area based on the playback status;

[0061] wherein, the data packets to be transmitted are received and decoded in the order of the sequence numbers to obtain the data to be played, and the data to be played are played in the order of the timestamps;

[0062] The monitoring data includes the audio monitoring data and the video monitoring data, and the transmission strategy is to transmit the target audio monitoring data under a first network bandwidth and to transmit the target video monitoring data under a second network bandwidth;

[0063] Wherein, the first network bandwidth is greater than the second network bandwidth;

[0064] The deployment parameters include the deployment position of the AI ​​camera;

[0065] Adjusting the transmission strategy includes correcting the preset number of segmentations according to the online increasing packet loss rate during the transmission process; adjusting the buffer size based on the analysis results of the video surveillance data of any adjacent AI camera; and implementing a splitting and retransmission strategy for the current data packet to be transmitted.

[0066] The preset acquisition frequency set in this embodiment is related to the specific application scenario, and is generally set between 1-30 frames per second. Video data requires a higher bandwidth to ensure smoothness, while the bandwidth requirement for audio data is relatively low. Therefore, the first network bandwidth and the second network bandwidth are set to allocate different bandwidths for transmission to audio and video data respectively; by utilizing the communication protocol to ensure efficient capture of audio and video data, a high-sensitivity microphone array is used to capture weak sounds in the environment, and the psychoacoustic model is used to remove sounds that are not easily perceived by the human ear in the audio monitoring data, and the compression ratio is improved. The MQTT protocol is used to deliver the data packets to be transmitted to the receiving end, and the timestamp and sequence number are used to achieve correct sorting and synchronous playback of data. The transmission strategy and buffer size are adjusted by analyzing the online growth packet loss rate and real-time correlation to effectively respond to changes in the network environment and ensure the stability of data transmission. The split retransmission strategy is used to effectively respond to the problem of data packet loss, ensure that important data can be transmitted in a timely manner, effectively maintain the quality of data transmission, and ensure the efficiency and reliability of the Internet of Things communication system based on the communication protocol in the AI ​​camera application.

[0067] See also Figure 2 As shown, it is a schematic diagram of a process of real-time monitoring of the response status of the data packets to be transmitted and the playing status of the data to be played according to an embodiment of the present invention;

[0068] Specifically, real-time monitoring of the response of the data packets to be transmitted and the playback status of the data to be played includes:

[0069] Step S401, analyzing the response of the currently transmitted data packet received, analyzing the transmission status according to the response and adjusting the transmission strategy;

[0070] Step S402, obtaining the actual playback duration of the received audio monitoring data and video monitoring data in the current acquisition cycle, calculating the transmission control error according to the real-time playback duration, and determining whether to adjust the layout position of the AI ​​camera according to the transmission control error;

[0071] The ratio of the actual playback time to the theoretical playback time is calculated to obtain the transmission control error.

[0072] See also Figure 3As shown, it is a schematic diagram of a flow chart of analyzing a response status of a currently transmitted transmission data packet received according to an embodiment of the present invention;

[0073] Specifically, analyzing the response of the received transmission data packet of the current transmission includes:

[0074] Step S411, obtaining the real-time response duration of receiving the current transmission data packet, and determining the real-time response duration according to the first standard response duration and the second standard response duration;

[0075] Step S421, determining a response situation according to the determination result, wherein the response situation includes a first response situation, a second response situation, and a third response situation;

[0076] Step S431, analyzing the transmission status based on the response situation and adjusting the transmission strategy;

[0077] When the real-time response duration is less than the first standard response duration, the response status of the current data packet to be transmitted is determined to be the first response status, and the current transmission status is determined to be normal;

[0078] When the real-time response duration is greater than or equal to the first standard response duration and less than the second standard response duration, determining that the response status of the current data packet to be transmitted is the second response status, and determining that the current transmission state is that there is transmission jitter;

[0079] When the real-time response duration is greater than the second standard response duration, the response status of the current data packet to be transmitted is determined to be the third response status, and the current transmission status is determined to be that there is a long-term network interruption.

[0080] In this embodiment, the first standard response time represents the threshold for judging the normal state of the response, and the second standard response time represents the threshold for judging the existence of transmission jitter. The first standard response time is set to 100 milliseconds, and the second standard response time is set to 200 milliseconds, and is adjusted according to actual needs.

[0081] Specifically, adjusting the transmission strategy includes:

[0082] In the first response case, the transmission status of the next data packet to be transmitted is obtained, and the online growth packet loss rate in the current monitoring period is calculated, the online growth packet loss rate is analyzed, and the preset number of segmentations is adjusted based on the analysis result;

[0083] In the second response case, the video surveillance data of any adjacent AI camera in the current surveillance area is analyzed, and the buffer size is adjusted based on the analysis results;

[0084] In the third response case, a splitting and retransmission strategy is performed on the data packet to be transmitted.

[0085] In this embodiment, by monitoring the data transmission process in real time, in the case of jitter in the transmission data, it is analyzed whether the monitoring result of the current camera can be supplemented by the video surveillance data of the adjacent camera, that is, by evaluating the correlation between the video surveillance data collected by different AI cameras in the same monitoring area, that is, analyzing the content similarity of these video streams, and further judging whether the current transmission status is good. If the result obtained by the correlation analysis is lower than the preset standard, it means that the current transmission status is not good, and the similarity between the video data is low, and the monitoring result of the current camera cannot be effectively supplemented or corrected by the data of the adjacent cameras. In this case, the size of the buffer is adjusted to adapt to network jitter, improve the monitoring effect, and ensure the continuity of video playback.

[0086] Specifically, adjusting the preset number of segmentations based on the analysis results includes:

[0087] Compare the online packet loss rate increase with the preset packet loss rate threshold.

[0088] If the online increasing packet loss rate is greater than the preset increasing packet loss rate threshold, the current segmentation number is calculated according to the online increasing packet loss rate, and the preset segmentation number is adjusted to the corrected segmentation number according to the current segmentation number;

[0089] If the online packet loss rate is less than or equal to the preset packet loss rate threshold, the preset number of splits is not adjusted;

[0090] The online growth packet loss rate is the ratio of the number of lost data packets to be transmitted to the total number of sent data packets in the current monitoring period.

[0091] The preset increasing packet loss rate threshold in this embodiment represents a set acceptable packet loss rate range, the preset increasing packet loss rate is set to 5%, the monitoring period is set to 1 second, and the number of data packets sent is recorded by using a sending counter at the data receiving end, and the number of data packets received is recorded by using a receiving counter, and the number of lost data packets is determined by comparing the sent sequence number with the received sequence number. A set can be used to store the received data packet sequence number and record the current packet loss rate. By continuously monitoring the online increasing packet loss rate, the current transmission quality can be evaluated and predicted, and the changes in the network environment can be flexibly adapted to improve the transmission efficiency. If the online increasing packet loss rate exceeds the set threshold, the preset number of divisions is adjusted, the current number of divisions is calculated, and the current number of divisions is compared with the preset number of divisions. If the current number of divisions is greater than the preset number of divisions, the current number of divisions is recorded as the corrected number of divisions, and the preset number of divisions is corrected to the corrected number of divisions. If the current number of divisions is less than the preset number of divisions, an early warning prompt is given.

[0092] The current number of segmentations is equal to the product of the preset number of segmentations and the adjustment coefficient. The adjustment coefficient is the sum of 1 and the growth coefficient. The growth coefficient is the ratio of the online growth packet loss rate to the preset growth packet loss rate threshold.

[0093] Specifically, the buffer size is adjusted based on the analysis results, including:

[0094] Obtain the video surveillance data of any adjacent AI camera in the current surveillance area as an adjacent video stream;

[0095] Recording the current video surveillance data as the current video stream, and calculating the real-time correlation between the adjacent video stream and the current video stream;

[0096] Determine whether to adjust the size of the buffer based on the real-time relevance to adapt to the current network environment.

[0097] In this embodiment, the method for calculating the real-time relevance is based on comparing the content similarity of two video streams and calculating the real-time relevance based on the number of matched feature points and the total number of feature points, that is, by extracting one frame per second as a key frame in each video stream, using computer vision technology, such as SIFT, SURF, ORB, etc., extracting feature points and descriptors of each frame, using feature matching algorithms, such as FLANN, BFMatcher, etc., to match the features extracted from the two video streams, calculate the number of matched feature points, calculate the percentage of the number of matched feature points to the total number of feature points, and obtain the real-time relevance, and judge whether the relevance of the two video streams is high enough according to the set standard relevance. When the real-time relevance is lower than the standard relevance, the instability of the arrival time of the data packet is smoothed by increasing the buffer, so that the player has more time to process and play when receiving the data packet, thereby reducing the playback interruption caused by uneven arrival of the data packet and ensuring the monitoring effect. When the real-time relevance is greater than or equal to the standard relevance, since the monitoring result of the current camera can be supplemented or corrected by the data of the adjacent camera, the monitoring effect can be improved without adjusting the buffer size.

[0098] Specifically, determining whether to adjust the size of the buffer according to the real-time relevance includes:

[0099] Compare the real-time correlation with the standard correlation,

[0100] If the real-time relevance is less than the standard relevance, increase the buffer size;

[0101] If the real-time relevance is greater than or equal to the standard relevance, no adjustment is made to the buffer size.

[0102] In this embodiment, the initial buffer size is set to 5 seconds, and the maximum buffer size is set to 10 seconds. When the real-time relevance is less than the standard relevance, the buffer size is increased by a preset step size to the sum of the initial buffer size and the preset step size.

[0103] Specifically, the split-and-retransmit strategy is to split the current data packet to be transmitted into sub-stream transmission data, and trigger a retransmission request.

[0104] By splitting the transmitted data into sub-streams when a long interruption is detected, it allows for more flexible retransmission and simultaneous transmission through different paths. When a path fails, other paths can still maintain transmission, thereby enhancing the stability of data transmission.

[0105] Specifically, determining whether to adjust the placement of the AI ​​camera based on the transmission control error includes:

[0106] The standard transmission error is compared with the transmission control error. When the transmission control error is greater than the standard transmission error, the layout position of the AI ​​camera is adjusted.

[0107] The theoretical playback time in this embodiment refers to the total playback time of audio or video data under ideal conditions. The set value is related to factors such as the sampling rate, frame rate and data packet size of the data. For audio data, the theoretical playback time is the total bytes of audio data divided by the product of the preset sampling frequency and the current sample bytes. For video data, the theoretical playback time is the total bytes of video data divided by the product of the frame rate and the current frame bytes.

[0108] The standard transmission error represents the limit value set for judging whether the transmission control error is within an acceptable range. The set value is related to the actual application scenario and requirements. In this embodiment, it is set to ±5%. If the transmission control error is between -5% and +5%, the data transmission quality is considered to be acceptable. At this time, there is no need to adjust the layout position of the AI ​​camera.

[0109] Specifically, the present invention further provides an Internet of Things communication system based on a communication protocol, which is applied to the above-mentioned Internet of Things communication method based on a communication protocol, comprising:

[0110] A data acquisition module, which is used to collect monitoring data in a target monitoring area at a preset collection frequency, add corresponding timestamps and encode, divide the encoded monitoring data into a plurality of data packets to be transmitted according to a preset number of divisions, and generate corresponding sequence numbers;

[0111] A data transmission module, comprising an audio data transmission unit for transmitting the target audio monitoring data under a first network bandwidth and a video data transmission unit for transmitting the target video monitoring data under a second network bandwidth, wherein the data transmission module is used to send the data packet to be transmitted to a data receiving end for transmission;

[0112] The data receiving end is connected to the data transmission module, and is used to receive and decode the data packets to be transmitted in the order of the sequence numbers to obtain the data to be played, and play the data to be played in the order of the timestamps;

[0113] A data processing module, which is connected to the data receiving end and is used to monitor the response of the data packets to be transmitted and the playback status of the data to be played in real time, so as to adjust the transmission strategy according to the response status, and adjust the layout parameters in the target monitoring area based on the playback status;

[0114] The IoT communication system in this embodiment is applied to an AI camera device. The AI ​​camera collects data over the Internet through middleware and the MQTT IoT communication protocol. The AI ​​camera supports edge-side AI algorithms to improve response speed and reduce latency. It utilizes the modular combination of hardware and software of GIoT Mini OS and can be ported to different hardware with high compatibility, thereby enhancing the flexibility and efficiency of the IoT system. Traditional alarm methods rely on cloud push, while cameras combined with the IoT system can schedule and push alarms on edge devices, thereby enhancing the response speed and reliability of the system. Alarm processing is no longer completely dependent on the cloud, thereby improving the flexibility and efficiency of the system, enabling AI cameras to be better integrated into the IoT ecosystem and capable of intelligent monitoring and data processing in a variety of environments.

[0115] So far, the technical solutions of the present invention have been described in conjunction with the preferred embodiments shown in the accompanying drawings. However, it is easy for those skilled in the art to understand that the protection scope of the present invention is obviously not limited to these specific embodiments. Without departing from the principle of the present invention, those skilled in the art can make equivalent changes or substitutions to the relevant technical features, and the technical solutions after these changes or substitutions will fall within the protection scope of the present invention.

[0116] The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. For those skilled in the art, the present invention may have various modifications and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention shall be included in the protection scope of the present invention.

Claims

1. A communication method for the Internet of Things based on a communication protocol, characterized in that: include, Collecting monitoring data in a target monitoring area at a preset collection frequency, adding corresponding timestamps and encoding, dividing the encoded monitoring data into a plurality of data packets to be transmitted according to a preset number of divisions, and generating corresponding sequence numbers; Sending the data packet to be transmitted to a data receiving end for transmission, monitoring the response of the data packet to be transmitted and the playback status of the data to be played in real time, so as to adjust the transmission strategy according to the response, and adjust the deployment parameters in the target monitoring area based on the playback status; wherein, the data packets to be transmitted are received and decoded in the order of the sequence numbers to obtain the data to be played, and the data to be played are played in the order of the timestamps; Real-time monitoring of the response of the data packets to be transmitted and the playback status of the data to be played includes: Analyze the response of the currently transmitted data packet received, analyze the transmission status according to the response, and adjust the transmission strategy; The actual playback duration of the received audio surveillance data and video surveillance data is obtained in the current collection cycle, the transmission control error is calculated according to the real-time playback duration, and the deployment position of the AI ​​camera is determined according to the transmission control error. The ratio of the actual playback time to the theoretical playback time is calculated to obtain the transmission control error; Analyze the response of the received transmission data packet of the current transmission, including: Acquire the real-time response duration of receiving the current transmission data packet, and determine the real-time response duration according to the first standard response duration and the second standard response duration; Determine a response situation according to the determination result, wherein the response situation includes a first response situation, a second response situation, and a third response situation; Analyzing the transmission status based on the response and adjusting the transmission strategy; When the real-time response duration is less than the first standard response duration, the response status of the current data packet to be transmitted is determined to be the first response status, and the current transmission status is determined to be normal; When the real-time response duration is greater than or equal to the first standard response duration and less than the second standard response duration, determining that the response status of the current data packet to be transmitted is the second response status, and determining that the current transmission state is that there is transmission jitter; When the real-time response duration is greater than the second standard response duration, determining that the response status of the current data packet to be transmitted is a third response status, and determining that the current transmission status is that there is a long-term network interruption; Adjusting the transmission strategy includes: In the first response case, the transmission status of the next data packet to be transmitted is obtained, and the online growth packet loss rate in the current monitoring period is calculated, the online growth packet loss rate is analyzed, and the preset number of segmentations is adjusted based on the analysis result; In the second response case, the video surveillance data of any adjacent camera in the current surveillance area is analyzed, and the buffer size is adjusted based on the analysis result; In the third response case, a splitting and retransmission strategy is performed on the data packet to be transmitted; Adjustments to the buffer size based on the analysis results include: Obtain the video surveillance data of any adjacent AI camera in the current surveillance area as an adjacent video stream; Recording the current video surveillance data as the current video stream, and calculating the real-time correlation between the adjacent video stream and the current video stream; Determine whether to adjust the size of the buffer according to the real-time relevance to adapt to the current network environment; The deployment parameters include the deployment position of the AI ​​camera.

2. The Internet of Things communication method based on the communication protocol according to claim 1, characterized in that: Adjustments to the preset number of splits based on analysis results include: Compare the online packet loss rate increase with the preset packet loss rate threshold. If the online increasing packet loss rate is greater than the preset increasing packet loss rate threshold, the current segmentation number is calculated according to the online increasing packet loss rate, and the preset segmentation number is adjusted to the corrected segmentation number according to the current segmentation number; If the online packet loss rate is less than or equal to the preset packet loss rate threshold, the preset number of splits is not adjusted; The online growth packet loss rate is the ratio of the number of lost data packets to be transmitted to the total number of sent data packets in the current monitoring period.

3. The Internet of Things communication method based on the communication protocol according to claim 1, characterized in that: Determining whether to adjust the buffer size based on real-time relevance includes, The real-time relevance is compared to the standard relevance, and the buffer size is increased when the real-time relevance is less than the standard relevance.

4. The Internet of Things communication method based on the communication protocol according to claim 1, characterized in that: The split-retransmission strategy is to split the current data packet to be transmitted into sub-stream transmission data and trigger a retransmission request.

5. The Internet of Things communication method based on communication protocol according to claim 1, characterized in that: Determining whether to adjust the placement of the AI ​​camera based on the transmission control error includes: The standard transmission error is compared with the transmission control error. When the transmission control error is greater than the standard transmission error, the layout position of the AI ​​camera is adjusted.

6. An Internet of Things communication system based on a communication protocol, applied to the Internet of Things communication method based on a communication protocol according to any one of claims 1 to 5, characterized in that: include, A data acquisition module, which is used to collect monitoring data in a target monitoring area at a preset collection frequency, add corresponding timestamps and encode, divide the encoded monitoring data into a plurality of data packets to be transmitted according to a preset number of divisions, and generate corresponding sequence numbers; A data transmission module, comprising an audio data transmission unit for transmitting target audio monitoring data under a first network bandwidth and a video data transmission unit for transmitting target video monitoring data under a second network bandwidth, wherein the data transmission module is used to send the data packet to be transmitted to a data receiving end for transmission; The data receiving end is connected to the data transmission module, and is used to receive and decode the data packets to be transmitted in the order of the sequence numbers to obtain the data to be played, and play the data to be played in the order of the timestamps; A data processing module, which is connected to the data receiving end and is used to monitor the response of the data packets to be transmitted and the playback status of the data to be played in real time, so as to adjust the transmission strategy according to the response status, and adjust the layout parameters in the target monitoring area based on the playback status; The deployment parameters include the deployment position of the AI ​​camera; Adjusting the transmission strategy includes correcting the preset number of segmentations according to the online increasing packet loss rate during the transmission process; adjusting the buffer size based on the analysis results of the video surveillance data of any adjacent AI camera; and implementing a splitting and retransmission strategy for the current data packet to be transmitted.

Images