Intra-coded frame sending method, device, electronic device and computer-readable medium

Abstract

Embodiments of the present disclosure disclose an intra-coded frame sending method, apparatus, electronic device, and computer-readable medium. A specific implementation of the method includes: obtaining camera information of each camera to obtain a set of camera information; performing time-point sequence generation processing on the initial time point, preset time interval, and authentication data value included in each camera information to generate a time-point sequence, obtaining a set of time-point sequences; controlling each camera to send the generated intra-coded frame sequence to a monitoring server; recording the sending time point of each intra-coded frame to generate recording information, obtaining a set of recording information; receiving a set of feedback information sent by the monitoring server; and updating the set of time-point sequences based on the set of feedback information and the set of camera information to obtain an updated set of time-point sequences. This implementation reduces the risk superimposed in the channel during the sending of intra-coded frames, making the monitoring video viewed by users smoother.

Description

Technical Field

[0001] Embodiments of the present disclosure relate to the field of computer technologies, and more particularly, to a method, an apparatus, an electronic device, and a computer-readable medium for sending intra-coded frames. Background Art

[0002] An intra-coded frame, also known as an internal picture, is an important frame in intra-frame compression coding. It can reconstruct a complete image independently without referring to other frames. Currently, multiple cameras usually send intra-coded frames to a target display in a random manner.

[0003] However, when multiple cameras usually send intra-coded frames to a target display in a random manner, the following technical problems often occur:

[0004] First, since multiple cameras randomly send intra-coded frames to a target display, the possibility of intra-coded frames overlapping in the channel increases. As a result, the data volume of the intra-coded frames in the channel exceeds the upper limit of the network bandwidth, causing network congestion. Furthermore, there is a significant delay in the monitoring video that users view.

[0005] Second, since the time for each camera to send an intra-coded frame is not limited, there is still a possibility that a small number of intra-coded frames overlap. As a result, the smoothness of the monitoring video is reduced. Summary of the Invention

[0006] This section of the present disclosure is used to introduce concepts in a brief form, which will be described in detail in the subsequent Detailed Description section. This section of the present disclosure is not intended to identify the key features or essential features of the claimed technical solution, nor is it intended to limit the scope of the claimed technical solution.

[0007] Some embodiments of the present disclosure propose a method, an apparatus, an electronic device, and a computer-readable medium for sending intra-coded frames to solve one or more of the technical problems mentioned in the above Background Art section.

[0008] In a first aspect, some embodiments of the present disclosure provide a method for sending intra-coded frames, the method comprising: obtaining camera information of each camera in a camera group to obtain a set of camera information; performing a time point sequence generation process on the initial time point, preset time interval, and authentication data value included in each piece of camera information in the set of camera information to generate a time point sequence, thereby obtaining a set of time point sequences; controlling each camera in the camera group to send the generated intra-coded frame sequence to a monitoring server based on the set of time point sequences and each transmission protocol information included in the set of camera information; recording the transmission time points of each intra-coded frame in each intra-coded frame sequence in the generated set of intra-coded frame sequences to generate recording information, thereby obtaining a set of recording information; receiving a set of feedback information sent by the monitoring server, wherein the set of feedback information is a set of feedback information generated based on the set of recording information; and updating the set of time point sequences based on the set of feedback information and the set of camera information to obtain an updated set of time point sequences.

[0009] In a second aspect, some embodiments of the present disclosure provide an apparatus for sending intra-coded frames, the apparatus comprising: an obtaining unit configured to obtain camera information of each camera in a camera group to obtain a set of camera information; a time point sequence generation processing unit configured to perform a time point sequence generation process on the initial time point, preset time interval, and authentication data value included in each piece of camera information in the set of camera information to generate a time point sequence, thereby obtaining a set of time point sequences; a sending unit configured to control each camera in the camera group to send the generated intra-coded frame sequence to a monitoring server based on the set of time point sequences and each transmission protocol information included in the set of camera information; a recording unit configured to record the transmission time points of each intra-coded frame in each intra-coded frame sequence in the generated set of intra-coded frame sequences to generate recording information, thereby obtaining a set of recording information; a receiving unit configured to receive a set of feedback information sent by the monitoring server, wherein the set of feedback information is a set of feedback information generated based on the set of recording information; and an updating unit configured to update the set of time point sequences based on the set of feedback information and the set of camera information to obtain an updated set of time point sequences.

[0010] In a third aspect, some embodiments of the present disclosure provide an electronic device, comprising: one or more processors; a storage device having stored thereon one or more programs, which, when executed by the one or more processors, cause the one or more processors to implement the method described in any implementation manner of the first aspect.

[0011] Fourthly, some embodiments of the present disclosure provide a computer-readable medium storing a computer program, where the program, when executed by a processor, implements the method described in any implementation manner of the first aspect above.

[0012] The above various embodiments of the present disclosure have the following beneficial effects: Through the intra-coded frame sending method of some embodiments of the present disclosure, the latency of the monitoring screen viewed by the user is reduced. Specifically, the reason for the relatively large latency of the monitoring screen is that: since multiple cameras randomly send intra-coded frames to the display, the possibility of intra-coded frames overlapping in the channel increases. Based on this, the intra-coded frame sending method of some embodiments of the present disclosure. First, obtain the camera information of each camera in the camera group to obtain a camera information set. And perform time point sequence generation processing on the initial time point, preset time interval, and authentication data value included in each camera information in the above camera information set to generate a time point sequence, obtaining a time point sequence set. Thus, a time point sequence corresponding to the above camera is obtained, and thereby, the time for the camera to send intra-coded frames is determined, facilitating the control of the data volume of intra-coded frames in the channel. Secondly, based on the above time point sequence set and each transmission protocol information included in the above camera information set, control each camera in the above camera group to send the generated intra-coded frame sequence to the monitoring server. Send the above camera to the monitoring server the intra-coded frame sequence according to the above time point sequence. Thus, it is convenient to control the time for sending intra-coded frames. Thereby, it is convenient to adjust the data volume of intra-coded frames in the channel. Then, record the sending time point of each intra-coded frame in each intra-coded frame sequence in the generated intra-coded frame sequence set to generate record information, obtaining a record information set. Recording the time point information facilitates querying the sending situation of the intra-coded frame sequence. Then, receive the feedback information set sent by the above monitoring server. Thus, it is convenient to adjust the sending time of the above intra-coded frame sequence according to the feedback information. Finally, based on the above feedback information set and the above camera information set, update the time point sequence set to obtain an updated time point sequence set. Since the above camera is controlled to send the intra-coded frame sequence according to the time point sequence. Thus, the data volume of intra-coded frames in the network bandwidth can be reduced, so that the data volume of intra-coded frames remains within the upper limit that the network bandwidth can accommodate. Furthermore, the latency of the monitoring screen viewed by the user is reduced. BRIEF DESCRIPTION OF THE DRAWINGS

[0013] In combination with the accompanying drawings and with reference to the following specific embodiments, the above and other features, advantages, and aspects of the various embodiments of the present disclosure will become more apparent. Throughout the drawings, the same or similar reference numerals denote the same or similar elements. It should be understood that the drawings are schematic and the elements and elements are not necessarily drawn to scale.

[0014] Figure 1 It is a schematic diagram of an application scenario of an intra-coded frame transmission method according to some embodiments of the present disclosure;

[0015] Figure 2 It is a flowchart of some embodiments of the intra-coded frame transmission method according to the present disclosure;

[0016] Figure 3 It is a schematic structural diagram of some embodiments of an intra-coded frame transmission apparatus according to the present disclosure;

[0017] Figure 4 It is a schematic structural diagram of an electronic device of the intra-coded frame transmission method according to the present disclosure. Detailed implementation manners

[0018] Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although some embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as limited to the embodiments set forth herein. On the contrary, these embodiments are provided to more thoroughly and completely understand the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are only for exemplary purposes and are not used to limit the protection scope of the present disclosure.

[0019] In addition, it should be noted that for the sake of convenience of description, only parts related to the relevant invention are shown in the drawings. Without conflict, the embodiments in the present disclosure and the features in the embodiments can be combined with each other.

[0020] It should be noted that the concepts such as "first" and "second" mentioned in the present disclosure are only used to distinguish different devices, modules or units, and are not used to limit the order or interdependence relationship of the functions performed by these devices, modules or units.

[0021] It should be noted that the modifications of "one" and "multiple" mentioned in the present disclosure are illustrative rather than restrictive. Those skilled in the art should understand that unless otherwise clearly specified in the context, it should be understood as "one or more".

[0022] The names of the messages or information exchanged between multiple devices in the embodiments of the present disclosure are only for illustrative purposes and are not used to limit the scope of these messages or information.

[0023] The present disclosure will be described in detail below with reference to the drawings and in combination with the embodiments.

[0024] Figure 1 It is a schematic diagram of an application scenario of intra-coded frame transmission according to some embodiments of the present disclosure.

[0025] In Figure 1In the application scenario, first, the computing device 101 can obtain the camera information of each camera in the camera group 102 to obtain the camera information set 103. Among them, the above-mentioned camera is a camera used to generate an intra-coded frame sequence, and the above-mentioned camera information includes: an initial time point, a preset time interval, an authentication data value, and a transmission protocol information; perform time point sequence generation processing on the initial time point 1031, the preset time interval 1032, and the authentication data value 1033 included in each camera information in the above-mentioned camera information set 103 to generate a time point sequence, and obtain a time point sequence set 104. Among them, each time point in the above-mentioned time point sequence corresponds to each intra-coded frame in the intra-coded frame sequence generated by the above-mentioned camera; based on the above-mentioned time point sequence set 104 and each transmission protocol information 105 included in the above-mentioned camera information set, control each camera in the above-mentioned camera group to send the generated intra-coded frame sequence 106 to the monitoring server 107; record the sending time points of each intra-coded frame in each intra-coded frame sequence in the generated intra-coded frame sequence set to generate record information, and obtain a record information set 108; receive the feedback information set 109 sent by the monitoring server 107, where the feedback information set 109 is a feedback information set generated based on the above-mentioned record information set; based on the feedback information set 109 and the above-mentioned camera information set 103, update the time point sequence set to obtain an updated time point sequence set 110.

[0026] It should be noted that the above-mentioned computing device 101 can be hardware or software. When the computing device is hardware, it can be implemented as a distributed cluster composed of multiple servers or terminal devices, or can be implemented as a single server or a single terminal device. When the computing device is embodied as software, it can be installed in the above-mentioned listed hardware devices. It can be implemented as, for example, multiple software or software modules for providing distributed services, or can be implemented as a single software or software module. No specific limitation is made here.

[0027] It should be understood that Figure 1 the number of computing devices in

[0028] Continue to refer to Figure 2 , which shows the flow 200 of some embodiments of the intra-coded frame sending method according to the present disclosure. The intra-coded frame sending method includes the following steps:

[0029] Step 201, obtain the camera information of each camera in the camera group to obtain a camera information set.

[0030] In some embodiments, the execution subject of the intra-coded frame sending method (such as Figure 1The computing device 101) shown can obtain the camera information of each camera in the camera group through a wired connection or a wireless connection to obtain a camera information set. Among them, the above-mentioned camera can be a camera used to generate an intra-coded frame sequence, and the above-mentioned camera information can include: an initial time point, a preset time interval, an authentication data value, and a transmission protocol information. Among them, the above-mentioned transmission protocol information can include, but is not limited to, at least one of the following: a reliable transmission protocol, an unreliable protocol. The above-mentioned initial time point can be the time point when the camera generates the first intra-coded frame. The above-mentioned preset time interval can be the time interval between each intra-coded frame in the intra-coded frame sequence generated by the camera set in advance. The above-mentioned authentication data value can be the value when the physical address of the camera is converted to decimal, and the above-mentioned authentication data value can be used as the unique identification value of each camera. The above-mentioned transmission protocol information can be the transmission protocol information of computer communication. The above-mentioned reliable transmission protocol can be a protocol that relies on a private algorithm and has security. The above-mentioned unreliable protocol can be an unreliable wireless connection datagram protocol.

[0031] As an example, the above-mentioned initial time point can be 0 milliseconds. The above-mentioned preset time interval can be 4000 milliseconds. The above-mentioned authentication data value can be 345052807176. The above-mentioned transmission protocol information can be a reliable transmission protocol or an unreliable protocol. The reliable transmission protocol can be the Transmission Control Protocol. The unreliable protocol can be the User Datagram Protocol. The above-mentioned camera information can be {0 milliseconds, 4000 milliseconds, 345052807176, reliable transmission protocol}.

[0032] Step 202, perform a time point sequence generation process on the initial time point, preset time interval, and authentication data value included in each camera information in the camera information set to generate a time point sequence, and obtain a time point sequence set.

[0033] In some embodiments, the above-mentioned execution subject can perform a time point sequence generation process on the initial time point, preset time interval, and authentication data value included in each camera information in the camera information set to generate a time point sequence, and obtain a time point sequence set. Among them, each time point in the above-mentioned time point sequence corresponds to each intra-coded frame in the intra-coded frame sequence generated by the camera. The time point sequence generation process can be a technique for processing time points and factors affecting time, so as to generate a time point sequence.

[0034] In some optional implementation manners of some embodiments, the above-mentioned execution subject can perform a time point sequence generation process on the initial time point, preset time interval, and authentication data value included in each camera information in the camera information set to generate a time point sequence, which can include the following steps:

[0035] Input the initial time point, preset time interval, and authentication data value included in the above camera information into the following formula to generate a time point sequence:

[0036]

[0037] where t represents the time point in the time point sequence corresponding to the intra-coded frame sequence generated by the above camera. t 1 represents the first time point in the time point sequence corresponding to the intra-coded frame sequence generated by the above camera. mod[] represents the modulo operation. D represents the time interval coefficient for the above camera to generate intra-coded frames. The value range of D is D > T and D and T are relatively prime numbers. i represents the sequence number. t i represents the i-th time point in the time point sequence corresponding to the intra-coded frame sequence generated by the above camera. M represents the above authentication data value. T represents the above preset time interval. t i-1 represents the (i - 1)-th time point in the time point sequence corresponding to the intra-coded frame sequence generated by the above camera. N represents the preset threshold. t N represents the N-th time point in the time point sequence corresponding to the intra-coded frame sequence generated by the above camera. f represents the above time point sequence.

[0038] As an example, the above initial time point can be 0 milliseconds. The above preset time interval can be 4000 milliseconds. The above authentication data value can be 345052807176. The time interval coefficient for the above camera to generate intra-coded frames can be 4139. The above preset threshold can be 3. The number of time points in the above time point sequence can be 3. Then the above time point sequence can be {(1: 3176 milliseconds), (2: 7176 milliseconds), (3: 7816 milliseconds)} (the calculation process is as follows):

[0039] The above formula, as an inventive point of an embodiment of the present disclosure, solves Technical Problem 2 mentioned in the background art, "Since the time for each camera to send intra-coded frames is not limited, there is still a possibility of superposition of a small number of intra-coded frames. Furthermore, this results in a reduction in the smoothness of the monitoring video." The factors that often lead to a low smoothness of the monitoring video are as follows: Since the time for each camera to send intra-coded frames is not limited. If the above factors are solved, the effect of improving the smoothness of the monitoring video can be achieved. To achieve this effect, first, the present disclosure introduces a time interval coefficient for the camera to generate intra-coded frames, an authentication data value, an initial time point, and a preset time interval. Thus, the time point when the first intra-coded frame is generated is obtained. Then, based on the time point when the first intra-coded frame is generated and the above preset time interval, the time point when the second intra-coded frame is generated is obtained. After that, the next time point within the preset threshold is generated in sequence according to the previous time point. The time points within the preset threshold are the time points generated based on the time point when the previous intra-coded frame is generated, the time interval coefficient for the camera to generate intra-coded frames, the authentication data value, and the preset time interval. Finally, the obtained time points are sorted to obtain the time point sequence when the camera sends the intra-coded frame sequence. Thus, the time for each camera to send intra-coded frames is limited. As a result, the possibility of superposition of intra-coded frames is reduced. Furthermore, the smoothness of the monitoring video is improved.

[0040] Step 203: Based on each transmission protocol information included in the time point sequence set and the camera information set, control each camera in the camera group to send the generated intra-coded frame sequence to the monitoring server.

[0041] In some embodiments, the above execution subject may control each camera in the above camera group to send the generated intra-coded frame sequence to the monitoring server based on each transmission protocol information included in the above time point sequence set and the above camera information set.

[0042] As an example, the above time point sequence may be {(1: 3176 milliseconds), (2: 7176 milliseconds), (3: 11176 milliseconds)}. The above transmission protocol information may be a reliable transmission protocol. The above camera group may send the first intra-coded frame to the monitoring server at the first time point (1: 3176 milliseconds). The above camera group may send the second intra-coded frame to the monitoring server at the second time point (2: 7176 milliseconds). The above camera group may send the third intra-coded frame to the monitoring server at the third time point (3: 7816 milliseconds).

[0043] In some alternative implementations of some embodiments, the above-mentioned execution entity may control each camera in the above-mentioned camera group to send the generated intra-coded frame sequence to the monitoring server based on each transmission protocol information included in the above-mentioned time point sequence set and the above-mentioned camera information set. In practice, for each camera in the above-mentioned camera group, the intra-coded frame sequence is sent to the above-mentioned monitoring server according to the time point sequence corresponding to the intra-coded frame sequence generated by the camera. Among them, the above-mentioned camera may use the above-mentioned reliable transmission protocol or the above-mentioned unreliable protocol to send the generated intra-coded frame sequence to the above-mentioned monitoring server.

[0044] Optionally, the above implementation may include the following steps:

[0045] First step, screen out the camera information that meets the first preset condition from the above-mentioned camera information set as the first camera information to obtain the first camera information set. Among them, the above-mentioned first preset condition may be that the transmission protocol information is a reliable transmission protocol. The above-mentioned first camera information may be that the transmission protocol information is a reliable transmission protocol.

[0046] Second step, use the camera corresponding to each first camera information in the above-mentioned first camera information set as the first camera to obtain the first camera group. Among them, the first camera may be a camera that uses a reliable transmission protocol to send the intra-coded frame sequence.

[0047] Third step, according to the time point sequence corresponding to the intra-coded frame sequence generated by each first camera in the above-mentioned first camera group, the intra-coded frame sequence generated by the above-mentioned first camera may be sent to the above-mentioned monitoring server using the above-mentioned reliable transmission protocol.

[0048] Optionally, the above implementation may further include the following steps:

[0049] First step, screen out the camera information that does not meet the above-mentioned first preset condition from the above-mentioned camera information set as the second camera information to obtain the second camera information set. Among them, the above-mentioned second camera information may be that the transmission protocol information is an unreliable protocol.

[0050] Second step, use the camera corresponding to each second camera information in the above-mentioned second camera information set as the second camera to obtain the second camera group. Among them, the second camera may be a camera that uses an unreliable protocol to send the intra-coded frame sequence.

[0051] Third step, according to the time point sequence corresponding to the intra-coded frame sequence generated by each second camera in the above-mentioned second camera group, the intra-coded frame sequence generated by the above-mentioned second camera may be sent to the above-mentioned monitoring server using the above-mentioned unreliable protocol.

[0052] Step 204, record the transmission time points of each intra-coded frame in each intra-coded frame sequence in the generated intra-coded frame sequence set to generate record information, obtaining a set of record information.

[0053] In some embodiments, the above-mentioned execution entity may record the transmission time points of each intra-coded frame in each intra-coded frame sequence in the generated intra-coded frame sequence set to generate record information, obtaining a set of record information. Among them, the above-mentioned record information may be the transmission time points of each intra-coded frame in each intra-coded frame sequence in the intra-coded frame sequence set. The time points recorded by the above-mentioned record information may be inconsistent with the time points in the above-mentioned time point sequence.

[0054] As an example, the above-mentioned record information may be {(1: 3176 milliseconds), (3: 7816 milliseconds)}.

[0055] Step 205, receive the set of feedback information sent by the monitoring server.

[0056] In some embodiments, the above-mentioned execution entity may receive the set of feedback information sent by the above-mentioned monitoring server. Among them, the above-mentioned set of feedback information is a set of feedback information generated based on the above-mentioned set of record information.

[0057] As an example, when the above-mentioned camera uses the above-mentioned reliable transmission protocol to send the above-mentioned intra-coded frame sequence to the above-mentioned monitoring server. The above-mentioned feedback information may be the time point information of frame loss generated due to factors such as slow network speed, insufficient graphics card performance, and computer viruses when the above-mentioned camera sends the above-mentioned intra-coded frame sequence to the above-mentioned monitoring server. When the above-mentioned camera uses the above-mentioned unreliable protocol to send the above-mentioned intra-coded frame sequence to the above-mentioned monitoring server. Then the above-mentioned feedback information may be when the above-mentioned camera sends the above-mentioned intra-coded frame sequence to the above-mentioned monitoring server. Due to occasional bitrate superposition of intra-coded frames in the channel and exceeding the network bandwidth limit, the time point information of the transmission delay of intra-coded frames is caused. The above-mentioned feedback information may be (2: 7176 milliseconds).

[0058] Step 206, based on the set of feedback information and the set of camera information, update the set of time point sequences, obtaining an updated set of time point sequences.

[0059] In some embodiments, the above-mentioned execution entity may update the set of time point sequences based on the above-mentioned set of feedback information and the above-mentioned set of camera information, obtaining an updated set of time point sequences. The above-mentioned updated set of time point sequences may be generated according to the feedback information, the initial time point included in the camera information, the preset time interval, the authentication data value, and the generation method of the time point sequence, to generate an updated set of time point sequences.

[0060] As an example, the updated time point sequence described above can be {(4: 9416 milliseconds), (5: 13416 milliseconds), (6: 17416 milliseconds)}.

[0061] Optionally, the updated time point sequence set described above is sent to the camera group for the camera group to send an intra-coded frame sequence set according to the updated time point sequence set.

[0062] In some embodiments, the executing entity can send the updated time point sequence set to the camera group for the camera group to send an intra-coded frame sequence set according to the updated time point sequence set. Among them, the executing entity can use a reliable transmission protocol or an unreliable protocol to send the intra-coded frame sequence to the monitoring server.

[0063] As an example, the camera described above can sequentially send the intra-coded frame sequence to the monitoring server according to the updated time point sequence {(4: 9416 milliseconds), (5: 13416 milliseconds), (6: 17416 milliseconds)}.

[0064] The above-mentioned various embodiments of the present disclosure have the following beneficial effects: Through the intra-coded frame sending method of some embodiments of the present disclosure, the latency of the monitored video that users view is reduced. Specifically, the reason for the large latency in the monitored video is that since multiple cameras randomly send intra-coded frames to the display, the possibility of intra-coded frames overlapping in the channel increases. Based on this, the intra-coded frame sending method of some embodiments of the present disclosure. First, obtain the camera information of each camera in the camera group to obtain a set of camera information. And perform time-point sequence generation processing on the initial time point, preset time interval, and authentication data value included in each camera information in the above set of camera information to generate a time-point sequence, and obtain a set of time-point sequences. Thus, a time-point sequence corresponding to the above camera is obtained, and thereby, the time for the camera to send intra-coded frames is determined, which is convenient for controlling the data volume of intra-coded frames in the channel. Secondly, based on the above set of time-point sequences and each transmission protocol information included in the above set of camera information, control each camera in the above camera group to send the generated intra-coded frame sequence to the monitoring server. Send the intra-coded frame sequence to the monitoring server according to the above time-point sequence by the above camera. Thus, it is convenient to control the time for sending intra-coded frames. Thereby, it is convenient to adjust the data volume of intra-coded frames in the channel. Then, record the sending time point of each intra-coded frame in each intra-coded frame sequence in the generated set of intra-coded frame sequences to generate record information, and obtain a set of record information. Recording the time point information is convenient for querying the sending situation of the intra-coded frame sequence. Then, receive the set of feedback information sent by the above monitoring server. Thus, it is convenient to adjust the sending time of the above intra-coded frame sequence according to the feedback information. Finally, based on the above set of feedback information and the above set of camera information, update the set of time-point sequences to obtain an updated set of time-point sequences. Since the above camera is controlled to send the intra-coded frame sequence according to the time-point sequence. Thus, the data volume of intra-coded frames in the network bandwidth can be reduced, so that the data volume of intra-coded frames remains within the upper limit that the network bandwidth can accommodate. Furthermore, the latency of the monitored video that users view is reduced.

[0065] Further referring to Figure 3 , as an implementation of the above methods in the above figures, the present disclosure provides some embodiments of an intra-coded frame sending device. These device embodiments correspond to Figure 2 the above method embodiments, and the device can be specifically applied to various electronic devices.

[0066] As Figure 3As shown, the intra-coded frame transmitting apparatus 300 of some embodiments includes: an obtaining unit 301, a time point sequence generating processing unit 302, a transmitting unit 303, a recording unit 304, a receiving unit 305, and an updating unit 306. Among them, the obtaining unit 301 is configured to obtain the camera information of each camera in the camera group to obtain a set of camera information; the time point sequence generating processing unit 302 is configured to perform time point sequence generating processing on the initial time point, preset time interval, and authentication data value included in each camera information in the set of camera information to generate a time point sequence, and obtain a set of time point sequences; the transmitting unit 303 is configured to control each camera in the camera group to send the generated intra-coded frame sequence to the monitoring server based on the set of time point sequences and the respective transmission protocol information included in the set of camera information; the recording unit 304 is configured to record the transmission time points of each intra-coded frame in each intra-coded frame sequence in the generated set of intra-coded frame sequences to generate recording information, and obtain a set of recording information; the receiving unit 305 is configured to receive the set of feedback information sent by the monitoring server, where the set of feedback information is a set of feedback information generated based on the set of recording information; the updating unit 306 is configured to update the set of time point sequences based on the set of feedback information and the set of camera information to obtain an updated set of time point sequences.

[0067] It can be understood that the units described in the apparatus 300 correspond to the respective steps in the method described with reference to Figure 2 Therefore, the operations, features, and beneficial effects described above for the method also apply to the apparatus 300 and the units included therein, and will not be elaborated here.

[0068] Next, with reference to Figure 4 , which shows a schematic structural diagram of an electronic device (e.g., Figure 1 the computing device 101 in Figure 4 400) suitable for implementing some embodiments of the present disclosure.

[0069] As shown in Figure 4As shown, the electronic device 400 may include a processing device (such as a central processing unit, a graphics processing unit, etc.) 401, which may perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 402 or a program loaded from a storage device 408 into a random access memory (RAM) 403. In the RAM 403, various programs and data required for the operation of the electronic device 400 are also stored. The processing device 401, the ROM 402, and the RAM 403 are connected to each other through a bus 404. An input / output (I / O) interface 404 is also connected to the bus 404.

[0070] Generally, the following devices may be connected to the I / O interface 404: an input device 406 including, for example, a touch screen, a touch pad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, etc.; an output device 407 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; a storage device 408 including, for example, a magnetic tape, a hard disk, etc.; and a communication device 409. The communication device 409 may allow the electronic device 400 to communicate with other devices wirelessly or wiredly to exchange data. Although Figure 4 the electronic device 400 with various devices is shown, it should be understood that it is not required to implement or have all the shown devices. More or fewer devices may be implemented or had alternatively. Figure 4 Each block shown in may represent a device or, as needed, multiple devices.

[0071] In particular, according to some embodiments of the present disclosure, the processes described above with reference to the flowcharts may be implemented as computer software programs. For example, some embodiments of the present disclosure include a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes program codes for performing the methods shown in the flowcharts. In such some embodiments, the computer program may be downloaded and installed from a network through the communication device 409, or installed from the storage device 408, or installed from the ROM 402. When the computer program is executed by the processing device 401, the above functions defined in the methods of some embodiments of the present disclosure are executed.

[0072] It should be noted that the computer-readable media described in some embodiments of the present disclosure may be a computer-readable signal medium, a computer-readable storage medium, or any combination of the two. A computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the above. More specific examples of the computer-readable storage medium may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In some embodiments of the present disclosure, the computer-readable storage medium may be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system, apparatus, or device. In some embodiments of the present disclosure, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, which carries computer-readable program code. Such a propagated data signal may take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. The computer-readable signal medium may also be any computer-readable medium other than the computer-readable storage medium, and the computer-readable signal medium may send, propagate, or transmit a program for use by or in conjunction with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium may be transmitted using any appropriate medium, including but not limited to: wires, optical cables, RF (radio frequency), etc., or any suitable combination of the above.

[0073] In some embodiments, the client and the server may communicate using any currently known or future-developed network protocol such as HTTP (HyperText Transfer Protocol), and may be interconnected with digital data communication in any form or medium (e.g., a communication network). Examples of communication networks include local area networks ("LANs"), wide area networks ("WANs"), the Internet (e.g., the Internet), and end-to-end networks (e.g., ad hoc end-to-end networks), as well as any currently known or future-developed networks.

[0074] The above computer-readable medium may be included in the above device; or may exist separately without being assembled into the electronic device. The above computer-readable medium carries one or more programs, and when the one or more programs are executed by the electronic device, the electronic device is caused to: obtain camera information of each camera in the camera group to obtain a camera information set; perform time-point sequence generation processing on the initial time point, preset time interval, and authentication data value included in each camera information in the above camera information set to generate a time-point sequence, and obtain a time-point sequence set; based on the above time-point sequence set and each transmission protocol information included in the above camera information set, control each camera in the above camera group to send the generated intra-coded frame sequence to the monitoring server; record the transmission time points of each intra-coded frame in each intra-coded frame sequence in the generated intra-coded frame sequence set to generate record information, and obtain a record information set; receive the feedback information set sent by the above monitoring server, where the above feedback information set is a feedback information set generated based on the above record information set; based on the above feedback information set and the above camera information set, update the time-point sequence set to obtain an updated time-point sequence set.

[0075] Computer program code for performing the operations of some embodiments of the present disclosure may be written in one or more programming languages or combinations thereof. The above programming languages include object-oriented programming languages - such as Java, Smalltalk, C++; and also include conventional procedural programming languages - such as the "C" language or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, executed as a stand-alone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network - including a local area network (LAN) or a wide area network (WAN) - or may be connected to an external computer (for example, by using an Internet service provider to connect through the Internet).

[0076] The flowcharts and block diagrams in the accompanying drawings illustrate the possible architectures, functions, and operations of systems, methods, and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagram may represent a module, a segment of a program, or a part of code that contains one or more executable instructions for implementing the specified logical function. It should also be noted that in some alternative implementations, the functions noted in the blocks may occur in a different order than that noted in the accompanying drawings. For example, two consecutive blocks shown may actually be executed substantially in parallel, and they may sometimes be executed in the reverse order, depending on the functions involved. It should also be noted that each block in the block diagram and / or flowchart, and combinations of blocks in the block diagram and / or flowchart, can be implemented by a dedicated hardware-based system that performs the specified functions or operations, or can be implemented by a combination of dedicated hardware and computer instructions.

[0077] The units described in some embodiments of the present disclosure can be implemented in software or in hardware. The described units can also be provided in a processor. For example, it can be described as: a processor includes an acquisition unit, a time point sequence generation processing unit, a sending unit, a recording unit, a receiving unit, and an updating unit. Among them, the names of these units do not constitute a limitation to the unit itself in some cases. For example, the acquisition unit can also be described as "the unit that acquires the camera information of each camera in the camera group to obtain the camera information set".

[0078] The functions described above can be performed at least in part by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that can be used include: Field Programmable Gate Arrays (FPGAs), Application Specific Integrated Circuits (ASICs), Application Specific Standard Products (ASSPs), Systems on Chip (SOCs), Complex Programmable Logic Devices (CPLDs), and so on.

[0079] The above description is only some preferred embodiments of the present disclosure and an explanation of the technical principles applied. Those skilled in the art should understand that the scope of the invention involved in the embodiments of the present disclosure is not limited to the technical solutions formed by the specific combination of the above technical features, and should also cover other technical solutions formed by any combination of the above technical features or their equivalent features without departing from the above inventive concept. For example, the technical solutions formed by mutually replacing the above features with the (but not limited to) technical features with similar functions disclosed in the embodiments of the present disclosure.

Claims

1. A method for sending intra-coded frames, including: obtaining the camera information of each camera in a camera group to obtain a camera information set; performing time point sequence generation processing on the initial time point, preset time interval, and authentication data value included in each camera information in the camera information set to generate a time point sequence, obtaining a time point sequence set, and the authentication data value is used as the unique identification value of each camera; controlling each camera in the camera group to send the generated intra-coded frame sequence to a monitoring server based on the time point sequence set and the respective transmission protocol information included in the camera information set; recording the sending time point of each intra-coded frame in each intra-coded frame sequence in the generated intra-coded frame sequence set to generate recording information, obtaining a recording information set; receiving a feedback information set sent by the monitoring server, where the feedback information set is a feedback information set generated based on the recording information set. When the camera uses a reliable transmission protocol to send the intra-coded frame sequence to the monitoring server, the feedback information is the time point information of the dropped frames generated due to slow network speed, insufficient graphics card performance, and computer virus factors when the camera sends the intra-coded frame sequence to the monitoring server. When the camera uses an unreliable protocol to send the intra-coded frame sequence to the monitoring server, the feedback information is the time point information of the delay in sending the intra-coded frame caused by the superposition of the intra-coded frame code rates in the channel exceeding the network bandwidth limit when the camera sends the intra-coded frame sequence to the monitoring server; updating the time point sequence set based on the feedback information set and the camera information set to obtain an updated time point sequence set, where the updated time point sequence set is generated according to the feedback information, the initial time point, preset time interval, authentication data value included in the camera information, and the generation method of the time point sequence; wherein, the performing time point sequence generation processing on the initial time point, preset time interval, and authentication data value included in each camera information in the camera information set to generate a time point sequence includes: obtaining the time point of the generation of the first intra-coded frame according to the time interval coefficient of frame generation of the camera, the authentication data value, the initial time point, and the preset time interval; obtaining the time point of the generation of the second intra-coded frame through the time point of the generation of the first intra-coded frame and the preset time interval; sequentially generating the next time point within a preset threshold according to the previous time point, and the time point at the preset threshold is the time point generated according to the time point of the generation of the previous intra-coded frame, the time interval coefficient of frame generation of the camera, the authentication data value, and the preset time interval; sorting the obtained time points to obtain the time point sequence when the camera sends the intra-coded frame sequence.

2. The method according to claim 1, wherein, the method further includes: Send the updated time point sequence set to the camera group for the camera group to send an intra-coded frame sequence set according to the updated time point sequence set.

3. The method according to claim 2, wherein the transmission protocol information includes at least one of the following: a reliable transmission protocol and an unreliable protocol.

4. The method according to claim 3, wherein, Based on the time point sequence set and the respective transmission protocol information included in the camera information set, controlling each camera in the camera group to send the generated intra-coded frame sequence to the monitoring server includes: For each camera in the camera group, according to the time point sequence corresponding to the intra-coded frame sequence generated by the camera, send the intra-coded frame sequence to the monitoring server, wherein the camera uses the reliable transmission protocol or the unreliable protocol to send the generated intra-coded frame sequence to the monitoring server.

5. The method according to claim 4, wherein, For each camera in the camera group, according to the time point sequence corresponding to the intra-coded frame sequence generated by the camera, sending the intra-coded frame sequence to the monitoring server includes: Screen out the camera information that meets the first preset condition from the camera information set as the first camera information to obtain a first camera information set; Take the camera corresponding to each first camera information in the first camera information set as the first camera to obtain a first camera group; According to the time point sequence corresponding to the intra-coded frame sequence generated by each first camera in the first camera group, use the reliable transmission protocol to send the intra-coded frame sequence generated by the first camera to the monitoring server.

6. The method according to claim 5, wherein, For each camera in the camera group, according to the time point sequence corresponding to the intra-coded frame sequence generated by the camera, sending the intra-coded frame sequence to the monitoring server further includes: Screen out the camera information that does not meet the first preset condition from the camera information set as the second camera information to obtain a second camera information set; Take the camera corresponding to each second camera information in the second camera information set as the second camera to obtain a second camera group; According to the time point sequence corresponding to the intra-coded frame sequence generated by each second camera in the second camera group, use the unreliable protocol to send the intra-coded frame sequence generated by the second camera to the monitoring server.

7. The method according to claim 6, wherein, The camera is a camera for generating an intra-coded frame sequence, and the camera information includes: an initial time point, a preset time interval, an authentication data value, and transmission protocol information, and each time point in the time point sequence corresponds to each intra-coded frame in the intra-coded frame sequence generated by the camera.

8. An intra-coded frame sending device, comprising: An acquisition unit, configured to acquire camera information of each camera in a camera group to obtain a camera information set; A time point sequence generation processing unit, configured to perform time point sequence generation processing on an initial time point, a preset time interval, and an authentication data value included in each camera information in the camera information set to generate a time point sequence, obtaining a time point sequence set, where the authentication data value serves as a unique identification value for each camera. Among them, the performing time point sequence generation processing on the initial time point, the preset time interval, and the authentication data value included in each camera information in the camera information set to generate a time point sequence includes: obtaining the time point when the first intra-coded frame is generated according to a time interval coefficient for the camera to generate an intra-coded frame, the authentication data value, the initial time point, and the preset time interval; obtaining the time point when the second intra-coded frame is generated through the time point when the first intra-coded frame is generated and the preset time interval; sequentially generating the next time point within a preset threshold according to the previous time point, and the time point at the preset threshold is a time point generated according to the time point when the previous intra-coded frame is generated, the time interval coefficient for the camera to generate an intra-coded frame, the authentication data value, and the preset time interval; sorting the obtained time points to obtain the time point sequence when the camera sends the intra-coded frame sequence; A sending unit, configured to control each camera in the camera group to send the generated intra-coded frame sequence to a monitoring server based on the time point sequence set and each transmission protocol information included in the camera information set; A recording unit, configured to record the sending time points of each intra-coded frame in each intra-coded frame sequence in the generated intra-coded frame sequence set to generate recording information, obtaining a recording information set; A receiving unit, configured to receive a feedback information set sent by the monitoring server, where the feedback information set is a feedback information set generated based on the recording information set. Among them, when the camera uses a reliable transmission protocol to send the intra-coded frame sequence to the monitoring server, the feedback information is the time point information of the lost frames generated due to slow network speed, insufficient graphics card performance, and computer virus factors when the camera sends the intra-coded frame sequence to the monitoring server. When the camera uses an unreliable protocol to send the intra-coded frame sequence to the monitoring server, the feedback information is the time point information of the delay in sending the intra-coded frame caused by the superposition of the intra-coded frame code rate in the channel exceeding the network bandwidth limit when the camera sends the intra-coded frame sequence to the monitoring server; An updating unit, configured to update the time point sequence set based on the feedback information set and the camera information set to obtain an updated time point sequence set, where the updated time point sequence set is generated according to the feedback information, the initial time point, the preset time interval, the authentication data value included in the camera information, and the generation method of the time point sequence to generate the updated time point sequence set.

9. An electronic device, comprising: One or more processors; A storage device storing one or more programs; When the one or more programs are executed by the one or more processors, the one or more processors implement the method according to any one of claims 1-7.

10. A computer-readable medium storing a computer program, wherein, when the program is executed by a processor, it implements the method according to any one of claims 1-7.

Images