Video stream transmission method and device and electronic equipment

Abstract

The invention relates to a video stream transmission method and device and electronic equipment, and the method comprises the steps: obtaining a transmission quality parameter of a video stream when a transmitting end transmits the video stream to a receiving end; adjusting a current video quality parameter of the video stream according to the transmission quality parameter to obtain a target video quality parameter; and controlling the video stream to be transmitted to a receiving end according to the target video quality parameter. The transmission delay can be reduced, and the transmission efficiency can be improved.

Description

Technical Field

[0001] The present disclosure relates to the field of video processing technology, and in particular to a video stream transmission method, device and electronic device. Background Art

[0002] At present, the real-time transmission method of video streams in intelligent driving is mainly to integrate the video transmission software development kit at the sending end and the receiving end of the video stream, and then realize the real-time transmission of the video stream through the transmission process of the sending end's software development kit, the video cloud transmission module and the receiving end's software development kit. In this method, only video stream transmission is carried out between the sending end, the video cloud transmission module and the receiving end. However, if abnormal situations such as network freezes and video frame loss occur during the video stream transmission, there is no way to deal with the above abnormal situations, resulting in problems such as increased video stream transmission delay and low efficiency. Summary of the invention

[0003] In order to solve the above technical problems, the present disclosure provides a video stream transmission method, device and electronic device.

[0004] According to one aspect of the present disclosure, a video stream transmission method is provided, the method comprising:

[0005] When the sending end transmits the video stream to the receiving end, obtaining the transmission quality parameter of the video stream;

[0006] Adjusting a current video quality parameter of the video stream according to the transmission quality parameter to obtain a target video quality parameter;

[0007] The video stream is controlled to be transmitted to the receiving end according to the target video quality parameter.

[0008] According to another aspect of the present disclosure, a video stream transmission device is also provided, the device comprising:

[0009] A transmission parameter acquisition module, used to acquire the transmission quality parameters of the video stream when the sending end transmits the video stream to the receiving end;

[0010] A video parameter adjustment module, used to adjust the current video quality parameter of the video stream according to the transmission quality parameter to obtain a target video quality parameter;

[0011] A video stream transmission module is used to control the transmission of the video stream to the receiving end according to the target video quality parameter.

[0012] According to another aspect of the present disclosure, an electronic device is provided, the electronic device comprising:

[0013] processor;

[0014] a memory for storing instructions executable by the processor;

[0015] The processor is used to read the executable instructions from the memory and execute the instructions to implement the above method.

[0016] According to another aspect of the present disclosure, a computer-readable storage medium is provided, wherein the storage medium stores a computer program, and the computer program is used to execute the above method.

[0017] Compared with the prior art, the technical solution provided by the embodiments of the present disclosure has the following advantages:

[0018] The technical solution provided by the embodiment of the present disclosure includes: when the sending end transmits the video stream to the receiving end, the transmission quality parameters of the video stream are obtained; the current video quality parameters of the video stream are adjusted according to the transmission quality parameters to obtain the target video quality parameters; and the video stream is controlled to be transmitted to the receiving end according to the target video quality parameters. By obtaining the transmission quality parameters in the process of video stream transmission, the technical solution can make adaptive adjustments to the current video quality parameters based on the transmission quality parameters, so that the transmission of the video stream is optimized on demand, and the video stream is controlled to be transmitted to the receiving end according to the adjusted target video quality parameters. The target video quality parameters obtained after adjustment are more adapted to the transmission quality parameters, which can achieve efficient video transmission, reduce transmission delay, and improve transmission efficiency; moreover, the solution adjusts the current video quality parameters of the video stream according to the transmission quality parameters, which better realizes the management of video stream transmission tasks and the standardization of host factory video transmission, reduces the host factory's dependence on video transmission suppliers, and effectively improves the adaptation problems of the sending end and the receiving end of the video stream caused by changes in different suppliers. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the present disclosure.

[0020] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.

[0021] Figure 1 A flow chart of a video stream transmission method provided by an embodiment of the present disclosure;

[0022] Figure 2 A schematic diagram of a system architecture for video stream transmission provided by an embodiment of the present disclosure;

[0023] Figure 3A structural block diagram of a video stream transmission device provided by an embodiment of the present disclosure;

[0024] Figure 4 A schematic diagram of the structure of an electronic device provided in an embodiment of the present disclosure. DETAILED DESCRIPTION

[0025] In order to more clearly understand the above-mentioned objectives, features and advantages of the present disclosure, the scheme of the present disclosure will be further described below. It should be noted that the embodiments of the present disclosure and the features in the embodiments can be combined with each other without conflict.

[0026] In the following description, many specific details are set forth to facilitate a full understanding of the present disclosure, but the present disclosure may also be implemented in other ways different from those described herein; it is obvious that the embodiments in the specification are only part of the embodiments of the present disclosure, rather than all of the embodiments.

[0027] In view of the problems of increased video stream transmission delay and low efficiency in existing real-time video stream transmission methods, the embodiments of the present disclosure provide a video stream transmission method, device and electronic device. For ease of understanding, the embodiments of the present disclosure are described below.

[0028] Figure 1 The present invention provides a flowchart of a video stream transmission method according to an embodiment of the present invention. The method can be executed by a video stream transmission device, and the device can be implemented by software and / or hardware. Figure 1 The video stream transmission method provided in this embodiment may include the following steps.

[0029] S102, when the sending end transmits the video stream to the receiving end, the transmission quality parameter of the video stream is obtained.

[0030] In order to facilitate understanding of the method provided in this embodiment, the system architecture involved and applicable to the video stream transmission method in this embodiment is first described. Figure 2 As shown in , the system architecture mainly includes: a transmitting end, a video transmission end, a receiving end and a video management end. Among them, the transmitting end transmits the video stream to the receiving end through the video transmission end; the receiving end may include a video player, or the video player may also be a device independent of the receiving end and connected to the receiving end. The video management end is respectively connected to the transmitting end, the video transmission end, and the receiving end, and specifically can be a cloud server, a vehicle-mounted host, and a PC (personal computer). The video stream transmission method provided in this embodiment can be executed by the video management end.

[0031] In the existing video stream transmission mode, the video stream sending end and receiving end integrate the video software development kit, which seriously occupies resources. To address this problem, the present embodiment can establish a video transmission protocol based on RTMP / RTSP between the sending end and the video transmission end and between the video transmission end and the receiving end. By unifying the video transmission protocol between the sending end, the video transmission end and the receiving end, it is no longer necessary to integrate the video software development kit at the sending end and the receiving end, thereby releasing the resources of the sending end and the receiving end.

[0032] In this embodiment, the video management end establishes a video upload address and a video loading address; and, the video management end transmits the video upload address to the sending end, so that the sending end uploads the video stream according to the video upload address; the video management end transmits the video loading address to the receiving end, so that the receiving end loads the video stream according to the video loading address.

[0033] When the sender transmits a video stream to the receiver, the transmission quality parameters that affect the delay and efficiency of the video stream transmission can be obtained. There can be multiple transmission quality parameters, such as: network status, the sequence number of each video frame in the video stream, the black screen at the receiver, and the transmission failure information fed back by the video transmission end. Among them, the quality of the network status can be reflected in multiple aspects such as network quality, network signal strength, network rate, network jitter, and round-trip delay of the video stream; the sequence number of each video frame in the video stream can indicate whether frame loss occurs during the video stream transmission process; the transmission failure information fed back by the video transmission end can reflect whether the video transmission end is capable of transmitting the video stream.

[0034] Regarding the method of obtaining transmission quality parameters, the display interface of the receiving end can be monitored through the video management end to detect the black screen of the receiving end. When the video transmission end transmits the video stream of the sending end to the receiving end, the network status during the video stream transmission, the sequence number of each video frame in the video stream, the transmission failure information fed back by the video transmission end, and other transmission quality parameters are collected; the video transmission end then feeds back the collected transmission quality parameters to the video management end.

[0035] S104: Adjust the current video quality parameter of the video stream according to the transmission quality parameter to obtain a target video quality parameter.

[0036] It is understandable that parameters related to video quality, such as video transmission speed, video resolution, and video frame rate, will interact with transmission quality parameters. For example, the higher the video resolution, the better the network status required.

[0037] Based on this, after acquiring the transmission quality parameters such as the network status, the sequence number of each video frame in the video stream, the black screen image of the receiving end, and the transmission failure information fed back by the video transmission end, this embodiment can adjust the current video quality parameters of the video stream according to the transmission quality parameters, so that the target video quality parameters obtained after the adjustment are more compatible with the transmission quality parameters, and efficient video transmission can be achieved. The following will describe step S104 in detail through multiple embodiments.

[0038] S106, controlling the video stream to be transmitted to the receiving end according to the target video quality parameter.

[0039] The target video quality parameter in this embodiment is a parameter that is adaptively adjusted according to the transmission quality parameter. The target video quality parameter and the transmission quality parameter can match each other, thereby reducing the video transmission delay and improving the video transmission efficiency.

[0040] With respect to the above step S104, in one embodiment, the transmission quality parameter may include: network status; the implementation process of step S104 may refer to the following.

[0041] Detect whether the network status meets the preset network abnormality condition; wherein the network abnormality condition includes at least one of the following: network quality is lower than the quality threshold, network signal strength is lower than the strength threshold, network rate is lower than the rate threshold, and network jitter is greater than the jitter threshold;

[0042] When the network abnormality condition is met, the video transmission speed and the video resolution in the current video quality parameters of the video stream are reduced to obtain the target video quality parameters.

[0043] Specifically, if the detected network status meets any of the above network abnormality conditions, it means that the current network status is not good. In this case, the video management end can reduce the video transmission speed and video resolution of the sending end in real time, and at the same time, reduce the transmission speed and video resolution of the video stream transmitted by the video transmission end to the receiving end. Furthermore, by reducing the video transmission speed and video resolution, the continuity of video stream transmission is guaranteed when the network is not good.

[0044] After that, the method provided in this embodiment may further include: generating and sending video transmission abnormality prompt information to the receiving end, so that the receiving end displays the video transmission abnormality prompt information. The abnormality prompt information may be in the form of text, pattern or voice, and is used to prompt the user on the video player of the receiving end that the current network status is not good.

[0045] In one embodiment, the implementation process of step S104 may be as follows.

[0046] Detecting whether the network status meets a preset network congestion condition; wherein the network congestion condition includes: the round-trip delay of the video stream is greater than a preset round-trip delay threshold;

[0047] When the network congestion condition is met, the video transmission speed in the current video quality parameter of the video stream is reduced to obtain the target video quality parameter.

[0048] Specifically, if the detected network state meets the above network congestion condition, it means that the transmission of the current video stream is congested. In this case, the video management end can reduce the video transmission speed of the sending end.

[0049] Then, video transmission abnormality prompt information is generated and sent to the receiving end, so that the receiving end displays the video transmission abnormality prompt information.

[0050] In one embodiment, the transmission quality parameter includes: the sequence number of each video frame in the video stream; accordingly, the implementation process of step S104 can be referred to as follows.

[0051] Detect whether the sequence numbers of the video frames in the video stream are continuous; if they are not continuous, determine whether the video stream has lost frames during transmission, and increase the video transmission speed and video frame rate in the current video quality parameters of the video stream to obtain the target video quality parameters. In addition, the method also includes: performing frame callback on the first video frame corresponding to the lost sequence number, and performing frame alignment on the current video stream received by the receiving end according to the first video frame to obtain the video stream to be played.

[0052] Specifically, if the sequence numbers of the video frames in the detected video stream are not continuous, it means that the current video stream transmission has frame loss. In this case, the video management end increases the video transmission speed and video frame rate of the sending end in real time, and at the same time, increases the transmission speed and video frame rate of the video stream transmitted by the video transmission end to the receiving end. Furthermore, by reducing the video transmission speed and video frame rate, the continuity of video stream transmission when frame loss occurs is ensured.

[0053] This embodiment can also determine the lost sequence number according to the continuity between the sequence numbers of the video frames, and use the video frame identified by the lost sequence number as the first video frame; perform frame callback on the first video frame, and perform frame alignment on the current video stream received by the receiving end according to the first video frame to obtain a complete video stream to be played. This can improve the integrity of the video stream viewed by the receiving end.

[0054] In one embodiment, the transmission quality parameter includes: a black screen at the receiving end; accordingly, the implementation process of step S104 can be referred to as follows.

[0055] Detect whether the duration and / or number of times a black screen appears on the receiving end is greater than a preset duration threshold and / or number threshold. A brief black screen on the receiving end may be an occasional phenomenon, and is not a problem that occurs during the video transmission process. Therefore, this embodiment can set the duration and / or number of times to more accurately detect the black screen on the receiving end. In specific implementation, it can be detected whether the duration of the black screen on the receiving end is greater than a preset duration threshold, and whether the number of times a black screen appears on the receiving end is greater than a preset number threshold; if the duration is greater than the preset duration threshold, and / or the number of times is greater than the preset number threshold, it can be considered that the black screen on the receiving end is a problem that occurs during the video transmission process.

[0056] Furthermore, when the duration of the black screen is greater than the duration threshold and / or the number of black screen images is greater than the number threshold, a pause transmission instruction is generated; wherein the pause transmission instruction is used as a target video quality parameter; and the pause transmission instruction is sent to the sending end so that the sending end pauses transmitting the video stream to the receiving end.

[0057] In this embodiment, when the duration of the black screen is greater than the duration threshold and / or the number of black screen images is greater than the number threshold, the video management end informs the sending end to pause the transmission of the video stream through a pause transmission instruction, and resumes the transmission after the video playback on the receiving end is normal.

[0058] In this embodiment, the display interface of the receiving end can be monitored by the video management end. When the receiving end displays the playback screen normally and continuously for a specified time, it is determined that the video playback of the receiving end is normal. At this time, the video management end generates and sends a continue transmission instruction to the sending end, so that the sending end continues to transmit the video stream to the receiving end at the current time node through the video transmission end.

[0059] In one embodiment, the transmission quality parameter includes: transmission failure information fed back by a video transmission end arranged between a transmitting end and a receiving end; the transmission failure information indicates that the video transmission end is unable to perform the video stream transmission task due to equipment failure, etc. Accordingly, the implementation process of step S104 can refer to the following.

[0060] If it is detected that there is transmission failure information fed back by the video transmission end, the sequence number of the second video frame corresponding to the transmission failure information is determined, and a stop transmission instruction and a pause playback instruction are generated; wherein the sequence number of the second video frame, the stop transmission instruction and the pause playback instruction are used as target video quality parameters;

[0061] Sending a stop transmission instruction to the sending end so that the sending end stops transmitting the remaining video frames after the sequence number of the second video frame in the video stream to the receiving end;

[0062] A pause play instruction is sent to the receiving end so that the receiving end temporarily plays the remaining video frames after the sequence number of the second video frame.

[0063] Then, the video management end generates and sends video transmission abnormality prompt information to the receiving end, so that the receiving end displays the video transmission abnormality prompt information.

[0064] In summary, the video stream transmission method provided by the embodiment of the present disclosure includes: when the sending end transmits the video stream to the receiving end, obtaining the transmission quality parameters of the video stream; adjusting the current video quality parameters of the video stream according to the transmission quality parameters to obtain the target video quality parameters; and controlling the video stream to be transmitted to the receiving end according to the target video quality parameters. By obtaining the transmission quality parameters in the process of video stream transmission, the technical scheme can make adaptive adjustments to the current video quality parameters based on the transmission quality parameters, so that the transmission of the video stream is optimized on demand, and control the video stream to be transmitted to the receiving end according to the adjusted target video quality parameters. The target video quality parameters obtained after adjustment are more adapted to the transmission quality parameters, which can achieve efficient video transmission, reduce transmission delay, and improve transmission efficiency; moreover, the scheme adjusts the current video quality parameters of the video stream according to the transmission quality parameters, which better realizes the management of video stream transmission tasks and the standardization of host factory video transmission, reduces the host factory's dependence on video transmission suppliers, and effectively improves the adaptation problems of the sending end and the receiving end of the video stream caused by changes in different suppliers.

[0065] Figure 3 This is a structural block diagram of a video stream transmission device provided by an embodiment of the present disclosure. The device can be used to implement the above-mentioned video stream transmission method. The device can be implemented by software and / or hardware. Figure 3 The video stream transmission device provided in this embodiment may include the following modules.

[0066] The transmission parameter acquisition module 210 is used to acquire the transmission quality parameter of the video stream when the transmitting end transmits the video stream to the receiving end;

[0067] A video parameter adjustment module 220, configured to adjust a current video quality parameter of the video stream according to the transmission quality parameter to obtain a target video quality parameter;

[0068] The video stream transmission module 230 is used to control the video stream transmission to the receiving end according to the target video quality parameter.

[0069] The implementation principle and technical effects of the device provided in this embodiment are the same as those of the aforementioned method embodiment. For the sake of brief description, for matters not mentioned in the device embodiment, reference may be made to the corresponding contents in the aforementioned method embodiment.

[0070] Figure 4 The structure diagram of an electronic device provided by the embodiment of the present disclosure is shown in FIG. Figure 4As shown, the electronic device 300 includes one or more processors 301 and a memory 302 .

[0071] The processor 301 may be a central processing unit (CPU) or other forms of processing units having data processing capabilities and / or instruction execution capabilities, and may control other components in the electronic device 300 to perform desired functions.

[0072] The memory 302 may include one or more computer program products, and the computer program product may include various forms of computer-readable storage media, such as volatile memory and / or non-volatile memory. The volatile memory may include, for example, a random access memory (RAM) and / or a cache memory (cache), etc. The non-volatile memory may include, for example, a read-only memory (ROM), a hard disk, a flash memory, etc. One or more computer program instructions may be stored on the computer-readable storage medium, and the processor 301 may run the program instructions to implement the video stream transmission method of the embodiment of the present disclosure described above and / or other desired functions. Various contents such as input signals, signal components, noise components, etc. may also be stored in the computer-readable storage medium.

[0073] In one example, the electronic device 300 may further include: an input device 303 and an output device 304 , and these components are interconnected via a bus system and / or other forms of connection mechanisms (not shown).

[0074] In addition, the input device 303 may also include, for example, a keyboard, a mouse, and the like.

[0075] The output device 304 can output various information to the outside, including the determined distance information, direction information, etc. The output device 304 can include, for example, a display, a speaker, a printer, a communication network and a remote output device connected thereto, and the like.

[0076] Of course, to simplify, Figure 4 Only some of the components related to the present disclosure in the electronic device 300 are shown, and components such as a bus, an input / output interface, etc. are omitted. In addition, according to specific application situations, the electronic device 300 may also include any other appropriate components.

[0077] Furthermore, this embodiment also provides a computer-readable storage medium, wherein the storage medium stores a computer program, and the computer program is used to execute the above-mentioned video stream transmission method.

[0078] The computer program product of a video stream transmission method, device, electronic device and medium provided in the embodiments of the present disclosure includes a computer-readable storage medium storing program code. The instructions included in the program code can be used to execute the method described in the previous method embodiments. The specific implementation can be found in the method embodiments, which will not be repeated here.

[0079] It should be noted that, in this article, relational terms such as "first" and "second" are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the existence of other identical elements in the process, method, article or device including the elements.

[0080] The above description is only a specific embodiment of the present disclosure, so that those skilled in the art can understand or implement the present disclosure. Various modifications to these embodiments will be apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present disclosure. Therefore, the present disclosure will not be limited to the embodiments described herein, but will conform to the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. A video stream transmission method, characterized in that: The method comprises: When the sending end transmits the video stream to the receiving end, obtaining the transmission quality parameter of the video stream; Adjusting a current video quality parameter of the video stream according to the transmission quality parameter to obtain a target video quality parameter; The video stream is controlled to be transmitted to the receiving end according to the target video quality parameter.

2. The method according to claim 1, characterized in that The transmission quality parameter includes: a network state; and adjusting the current video quality parameter of the video stream according to the transmission quality parameter to obtain a target video quality parameter includes: Detect whether the network status meets a preset network abnormality condition; wherein the network abnormality condition includes at least one of the following: network quality is lower than a quality threshold, network signal strength is lower than a strength threshold, network rate is lower than a rate threshold, and network jitter is greater than a jitter threshold; When the network abnormality condition is met, the video transmission speed and the video resolution in the current video quality parameters of the video stream are reduced to obtain the target video quality parameters.

3. The method according to claim 2, characterized in that The step of adjusting the current video quality parameter of the video stream according to the transmission quality parameter to obtain a target video quality parameter includes: Detecting whether the network state meets a preset network congestion condition; wherein the network congestion condition includes: the round-trip delay of the video stream is greater than a preset round-trip delay threshold; When the network congestion condition is met, the video transmission speed in the current video quality parameter of the video stream is reduced to obtain a target video quality parameter.

4. The method according to claim 1, characterized in that: The transmission quality parameter includes: the sequence number of each video frame in the video stream; the current video quality parameter of the video stream is adjusted according to the transmission quality parameter to obtain the target video quality parameter, including: Detecting whether the sequence numbers of the video frames in the video stream are continuous; In the case of discontinuity, determining that the video stream has frame loss during transmission, and increasing the video transmission speed and the video frame rate in the current video quality parameters of the video stream to obtain the target video quality parameters; Furthermore, the method further includes: performing frame callback on the first video frame corresponding to the lost sequence number, and performing frame alignment on the current video stream received by the receiving end according to the first video frame to obtain the video stream to be played.

5. The method according to claim 1, characterized in that The transmission quality parameter includes: a black screen image at the receiving end; and adjusting the current video quality parameter of the video stream according to the transmission quality parameter to obtain a target video quality parameter includes: Detecting whether the duration and / or number of times the black screen appears on the receiving end is greater than a preset duration threshold and / or number threshold; In the case where the duration threshold and / or the number threshold are greater than the duration threshold and / or the number threshold, a transmission pause instruction is generated; wherein the transmission pause instruction is used as a target video quality parameter; The transmission pause instruction is sent to the sending end, so that the sending end pauses transmitting the video stream to the receiving end.

6. The method according to claim 1, characterized in that The transmission quality parameter includes: transmission failure information fed back by a video transmission end arranged between the transmitting end and the receiving end; the current video quality parameter of the video stream is adjusted according to the transmission quality parameter to obtain a target video quality parameter, including: If it is detected that there is transmission failure information fed back by the video transmission end, the sequence number of the second video frame corresponding to the transmission failure information is determined, and a stop transmission instruction and a pause playback instruction are generated; wherein the sequence number of the second video frame, the stop transmission instruction and the pause playback instruction are used as target video quality parameters; Sending the transmission stop instruction to the sending end, so that the sending end stops transmitting the remaining video frames after the sequence number of the second video frame in the video stream to the receiving end; The pause play instruction is sent to the receiving end so that the receiving end temporarily plays the remaining video frames after the sequence number of the second video frame.

7. The method according to claim 6, characterized in that The method further comprises: A video transmission protocol based on RTMP / RTSP is established between the sending end and the video transmission end and between the video transmission end and the receiving end.

8. The method according to claim 1, characterized in that After adjusting the current video quality parameter of the video stream according to the transmission quality parameter to obtain the target video quality parameter, the method further includes: Generate and send video transmission abnormality prompt information to the receiving end, so that the receiving end displays the video transmission abnormality prompt information.

9. A video stream transmission device, characterized in that: The device comprises: A transmission parameter acquisition module, used to acquire the transmission quality parameters of the video stream when the sending end transmits the video stream to the receiving end; A video parameter adjustment module, used to adjust the current video quality parameter of the video stream according to the transmission quality parameter to obtain a target video quality parameter; A video stream transmission module is used to control the transmission of the video stream to the receiving end according to the target video quality parameter.

10. An electronic device, characterized in that: The electronic device comprises: processor; a memory for storing instructions executable by the processor; The processor is used to read the executable instructions from the memory and execute the instructions to implement the method according to any one of claims 1 to 8.

Images