Video stream processing method and device

Abstract

The present invention provides a video stream processing method and device. The method comprises: obtaining a terminal identifier and video playback parameters corresponding to a video stream to be processed; obtaining authorization to play a multicast video stream according to the terminal identifier, and switching the video stream to be processed to a multicast video stream; confirming that the parameter value of the video playback parameter exceeds the corresponding preset parameter threshold, switching the multicast video stream to the unicast video stream; wherein the parameter value includes a single parameter value and / or a comprehensive parameter value. The video stream processing method and device provided by the present invention can realize adaptive video stream processing and switching, reduce system overhead, and thus improve user experience.

Description

Technical Field

[0001] The present invention relates to the technical field of multimedia information processing, and in particular to a video stream processing method and device. Background Art

[0002] With the development of communication and computer technology, more and more intelligent terminals support video, and the networking environment is becoming more and more complex. Due to the rise of various live broadcast apps, the demand for public media live broadcast, personal live broadcast and Internet live broadcast is becoming more and more vigorous. The processing of video streams has become more and more difficult to handle with the rise of live broadcast and similar live broadcast needs. A video service often has more than one type of traffic from the front end to the back end, and it may be mixed traffic, so this puts higher requirements on the terminal, network and system as a whole.

[0003] Currently, video streams are generally processed in unicast or multicast mode, and the supported judgment methods are very simple, which cannot meet the video playback needs of various households, various networking environments, and various types of smart terminals. Summary of the invention

[0004] The present invention provides a video stream processing method and device, which are used to solve the technical problem of single video stream processing mode in the prior art and realize adaptive video stream processing and switching.

[0005] The present invention provides a video stream processing method, comprising:

[0006] Obtain the terminal identifier and video playback parameters corresponding to the video stream to be processed;

[0007] According to the terminal identifier, obtaining authorization to play the multicast video stream, and switching the to-be-processed video stream to the multicast video stream;

[0008] Confirming that a parameter value of the video playback parameter exceeds a corresponding preset parameter threshold, switching the multicast video stream to the unicast video stream;

[0009] The parameter value includes a single parameter value and / or a comprehensive parameter value.

[0010] In one embodiment, the video playback parameter includes: at least one of: packet loss rate, blue screen parameter, distorted screen parameter, delay, real-time bit rate, network jitter parameter, and disorder parameter;

[0011] The single parameter value is the value of any of the video playback parameters;

[0012] The comprehensive parameter value is the sum of the values ​​of multiple video playback parameters.

[0013] In one embodiment, the step of confirming that the parameter value of the video playback parameter exceeds the corresponding preset parameter threshold and switching the multicast video stream to the unicast video stream includes:

[0014] Confirming that the single parameter value exceeds the corresponding preset parameter threshold, switching the multicast video stream to the unicast video stream;

[0015] and / or confirming that the comprehensive parameter value exceeds the corresponding preset parameter threshold, switching the multicast video stream to the unicast video stream.

[0016] In one embodiment, the video stream processing method further includes:

[0017] When the number of terminals playing the unicast video stream exceeds a preset threshold, it is confirmed that the parameter value of the terminal does not exceed the preset parameter threshold, and the unicast video stream corresponding to the terminal is switched to the multicast video stream.

[0018] In one embodiment, the switching of the multicast video stream to the unicast video stream comprises:

[0019] When the parameter value does not exceed the preset parameter threshold, the unicast video stream is switched to the multicast video stream.

[0020] In one embodiment, the video stream processing method further includes:

[0021] When the authorization for playing the multicast video stream fails and / or the comprehensive parameter value decreases, the video stream to be processed is switched to a unicast video stream.

[0022] The present invention provides a video stream processing device, comprising:

[0023] An acquisition module is used to obtain a terminal identifier and video playback parameters corresponding to the video stream to be processed;

[0024] A first switching module, configured to obtain authorization to play a multicast video stream according to the terminal identifier, and switch the video stream to be processed to a multicast video stream;

[0025] A second switching module is used to confirm that the video playback parameter exceeds the corresponding preset parameter threshold and switch the multicast video stream to the unicast video stream;

[0026] The video playback parameters include single parameters and comprehensive parameters.

[0027] In one embodiment, the video playback parameter includes: at least one of a packet loss rate, a blue screen parameter, a distorted screen parameter, a network jitter parameter, and a disorder parameter;

[0028] The single parameter value is the value of any of the video playback parameters;

[0029] The comprehensive parameter value is the sum of the values ​​of multiple video playback parameters.

[0030] The present invention provides an electronic device, comprising a memory and a memory storing a computer program, wherein the processor implements the steps of any one of the above-mentioned video stream processing methods when executing the program.

[0031] The present invention provides a processor-readable storage medium, wherein the processor-readable storage medium stores a computer program, and the computer program is used to enable the processor to execute the steps of any one of the above-mentioned video stream processing methods.

[0032] The present invention provides a video stream processing method and device, which obtains authorization to play a multicast video stream through a terminal identifier corresponding to a video stream to be processed, and automatically switches a default multicast video stream to a unicast video stream when it is determined that a video playback parameter corresponding to the video stream to be processed exceeds a corresponding preset parameter threshold. Corresponding processing can be performed according to the playback status of the video stream to be processed, thereby realizing adaptive video stream processing and switching, reducing system overhead, and improving user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0033] In order to more clearly illustrate the technical solutions in the present invention or the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0034] Figure 1 It is a flow chart of the video stream processing method provided by the present invention;

[0035] Figure 2 It is a structural schematic diagram of a video stream processing device provided by the present invention;

[0036] Figure 3 It is a schematic diagram of the physical structure of the electronic device provided by the present invention. DETAILED DESCRIPTION

[0037] In order to make the purpose, technical solution and advantages of the present invention clearer, the technical solution of the present invention will be clearly and completely described below in conjunction with the drawings of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0038] Figure 1 The following is a flow chart of the video stream processing method provided by the present invention. Figure 1 The video stream processing method provided by the present invention includes:

[0039] S110, obtaining a terminal identifier and video playback parameters corresponding to the video stream to be processed;

[0040] S120, obtaining authorization to play the multicast video stream according to the terminal identifier, and switching the to-be-processed video stream to the multicast video stream;

[0041] S130, confirming that the parameter value of the video playback parameter exceeds the corresponding preset parameter threshold, switching the multicast video stream to the unicast video stream;

[0042] The parameter value includes a single parameter value and / or a comprehensive parameter value.

[0043] The execution subject of the video stream processing method provided by the present invention can be a video stream processing system. The video stream processing system supports processing and switching video streams in different networking scenarios and different intelligent terminals in units of regions.

[0044] The following takes a video stream processing system as a family unit executing the video stream processing method provided by the present invention as an example to describe the technical solution of the present invention in detail.

[0045] It should be noted that the video stream processing system based on a family unit may include an intelligent terminal processing module, an intelligent networking terminal, and an intelligent gateway distribution module.

[0046] The existing common intelligent terminal processing module is located on the intelligent terminal, which is generally connected to the intelligent networking terminal wirelessly or wired. The intelligent networking terminal is often composed of routers, powerline cats, POE routing switches and other terminals with wired or wireless coverage capabilities. Generally, routers, powerline cats, POE routing switches are connected by wire, and devices such as MESH routers and wireless repeaters are connected to the intelligent gateway distribution module wirelessly. However, there are often multiple intelligent terminals, multiple intelligent networking terminals, and one intelligent gateway distribution module in a family. As the area of ​​the family increases, the number of various terminals increases greatly, the networking topology and environment are also very complex, and the number of devices will also increase greatly. At the same time, the intelligent networking terminal also has different working modes such as bridging and routing, which makes it impossible for traditional multicast and unicast working modes to work together effectively and cannot achieve the best implementation effect.

[0047] Optionally, in step S110, the intelligent terminal processing module of the video stream processing system obtains the terminal identification and video playback parameters corresponding to the video stream to be processed. The video stream to be processed may include a variety of different unicast and multicast video code streams; the home intelligent terminal processing module is the point closest to the user side, and can provide real-time feedback on the terminal video playback status and terminal load status, so it is required to accurately feedback the corresponding data and provide the gateway distribution module with corresponding data reference; the terminal identification includes device type, model, software and hardware parameters, multicast or unicast support status, region and other related information; the video playback parameters are parameters that reflect the video playback status.

[0048] Optionally, in step S120, the intelligent networking terminal of the video stream processing system authorizes the multicast video stream to be played according to the terminal identification reported by the intelligent terminal processing module. The multicast video stream can be played after the authorization authentication is passed, and only the unicast video stream can be played if the authorization authentication is not passed.

[0049] Ordinary terminals that do not support the home smart terminal processing module can also watch ordinary on-demand program sources, but cannot obtain multicast-like live broadcast experience. For those that support the home smart terminal processing module, after authentication and authorization are passed, multicast video streams are played for live broadcast traffic by default.

[0050] Optionally, in step S130, the intelligent gateway distribution module confirms that the parameter value of the video playback parameter exceeds the corresponding preset parameter threshold, and the intelligent gateway distribution module notifies the intelligent terminal processing module to switch the multicast video stream to the unicast video stream. The parameter value includes a single parameter value and / or a comprehensive parameter value.

[0051] When the traffic of the multicast video stream reaches a certain threshold pressure, that is, the parameter value of the video playback parameter exceeds the corresponding preset parameter threshold, it means that the current system has generated network jitter, abnormal changes in the networking environment or other video playback parameters. At this time, in order to ensure the playback of the video stream, the intelligent terminal processing module will actively switch to the unicast video stream mode, reduce the impact of network jitter on the video stream through caching, and notify the intelligent networking terminal and intelligent gateway distribution module at the same time to reduce the multicast replication overhead.

[0052] The intelligent gateway distribution module interactively identifies the intelligent terminals connected to it, notifies the intelligent networking terminals and the devices connected to the intelligent terminals whether they support multicast and the corresponding switching identification mechanism, so that the devices connected to it can understand their own network topology and support status; the intelligent gateway distribution module also performs multicast distribution to the connected home intelligent networking terminals or directly connected home intelligent terminal processing modules. At the same time, it interacts with the intelligent terminals and intelligent networking terminals, and actively determines the switching of on-demand and multicast streams in the home according to the number, type and operation status of the intelligent terminals and intelligent networking terminals in the home. When network quality problems are found, the intelligent gateway distribution module will promptly notify the intelligent networking terminals and intelligent terminal processing modules under it to switch. When changes in the networking environment are found, the intelligent networking module and the intelligent terminal processing module will be notified in time to perform status detection and switching.

[0053] The video stream processing method provided by the present invention obtains the authorization to play the multicast video stream through the terminal identifier corresponding to the video stream to be processed, and automatically switches the default multicast video stream to a unicast video stream when it is judged that the video playback parameter corresponding to the video stream to be processed exceeds the corresponding preset parameter threshold. Corresponding processing can be performed according to the playback situation of the video stream to be processed, thereby realizing adaptive video stream processing and switching, reducing system overhead, and improving user experience.

[0054] In one embodiment, the video playback parameter includes: at least one of: packet loss rate, blue screen parameter, distorted screen parameter, delay, real-time bit rate, network jitter parameter, and disorder parameter;

[0055] The single parameter value is the value of any of the video playback parameters;

[0056] The comprehensive parameter value is the sum of the values ​​of multiple video playback parameters.

[0057] Optionally, the effect of video playback or network access cannot be determined by a single parameter, so it is necessary to comprehensively consider the impact of single parameters and comprehensive parameters. Video playback parameters can be parameters that reflect the video playback status of different dimensions, including: packet loss rate, blue screen parameters, flower screen parameters, delay, real-time bit rate, network jitter parameters, disorder parameters, small packet loss rate, large packet loss rate and other parameters of segmented scenarios. At the same time, background adjustments and user customization can be performed according to the terminal configuration, cache size, network bandwidth, etc. The single parameter value is the value of any of the video playback parameters, and the comprehensive parameter value is the sum of the single parameter values ​​of multiple different video playback parameters. The parameter value of each video playback parameter has a corresponding preset parameter threshold.

[0058] The video stream processing method provided by the present invention can adjust the video stream according to the state of video playback in real time by setting preset parameter thresholds for different video playback parameters.

[0059] In one embodiment, the step of confirming that the parameter value of the video playback parameter exceeds the corresponding preset parameter threshold and switching the multicast video stream to the unicast video stream includes:

[0060] Confirming that the single parameter value exceeds the corresponding preset parameter threshold, switching the multicast video stream to the unicast video stream;

[0061] and / or confirming that the comprehensive parameter value exceeds the corresponding preset parameter threshold, switching the multicast video stream to the unicast video stream.

[0062] Optionally, the intelligent gateway distribution module evaluates parameters such as packet loss rate, blue screen / flower screen parameters, network speed jitter, etc., and notifies the intelligent terminal processing module to perform corresponding switching operations when one and / or multiple parameters reach a threshold.

[0063] An example of the video playback parameter evaluation process is as follows:

[0064] Suppose the packet loss rate parameter is A. When the packet loss rate is greater than 0.5%, the parameter is 0.5. When the packet loss rate is greater than 1%, the parameter is 1. The packet loss rate changes linearly between 0 and 1. The preset parameter threshold is 0.5.

[0065] Suppose the blue screen / flowered screen parameter is B. When the duration exceeds 5 seconds, it is 0.5, and when it exceeds 10 seconds, it is 1. The blue screen / flowered screen parameter changes linearly between 0 and 1, and the preset parameter threshold is 0.5.

[0066] Suppose the network speed jitter parameter is C. When the jitter exceeds 50%, it is 0.5, and when it exceeds 100%, it is 1. The network speed jitter parameter changes linearly between 0-1 and caps at 1. The preset parameter threshold is 0.5.

[0067] When the intelligent gateway distribution module confirms that a single parameter value exceeds the preset parameter threshold, that is, A>=0.5 or B>=0.5 or C=0.5, it can be known that the network quality is poor. At this time, the intelligent terminal processing module is notified to switch the multicast video stream to a unicast video stream.

[0068] When the intelligent gateway distribution module confirms that the comprehensive parameter value exceeds the preset parameter threshold, that is, A+B+C>0.5, it can be known that the network quality is poor. At this time, the intelligent terminal processing module is notified to switch the multicast video stream to a unicast video stream.

[0069] The video stream processing method provided by the present invention can maximize the advantages of small delay and low network load of multicast video streams for different video playback parameters, and the advantages of large cache support for unicast video streams to avoid network jitter and blue screen, etc., by setting preset parameter thresholds for different video playback parameters and making judgments.

[0070] In one embodiment, the video stream processing method further includes:

[0071] When the number of terminals playing the unicast video stream exceeds a preset threshold, it is confirmed that the parameter value of the terminal does not exceed the preset parameter threshold, and the unicast video stream corresponding to the terminal is switched to the multicast video stream.

[0072] Optionally, when the number of terminals under the intelligent networking terminal exceeds a preset threshold number (for example, the number of terminals accounting for 40% of the total number of terminals under the intelligent networking terminal), it is confirmed that the parameter value of the terminal does not exceed the preset parameter threshold, that is, when there is no network quality problem with the current terminal, the intelligent gateway distribution module notifies the intelligent terminal processing module to switch the unicast video stream to the multicast video stream.

[0073] The intelligent networking terminal will interact with the intelligent terminal processing module and report the home networking topology environment, including whether the routing mode or the bridging mode is adopted, whether the second-layer switching device or the direct connection is adopted in the middle, whether there is a multi-layer cascade, etc. At the same time, when it is in the routing mode, the multicast authentication and authorization of the intelligent terminal processing module under it will be completed. In general, if the user uses an ordinary networking device and sets it to the routing mode, the intelligent terminal under it often cannot obtain the multicast authentication authorization of the gateway. The intelligent networking terminal of the present invention supports the multicast authentication authorization of its home intelligent terminal processing module in the routing mode, and reports the relevant information to the intelligent gateway distribution module. While supporting the user to flexibly configure the networking environment, it can also enable the home intelligent terminal processing module in the case of multi-level networking to perform normal multicast and on-demand switching to obtain the best playback experience and reduce the load.

[0074] The video stream processing method provided by the present invention can solve the scale jamming phenomenon in advance, avoid switching after a long period of jamming, and reduce the unicast traffic pressure and the home traffic bandwidth by judging that the number of terminals exceeding a preset threshold switches the multicast video stream to unicast, and the smart terminal switched to unicast switches back to multicast when the preset parameter threshold is met.

[0075] In one embodiment, the switching of the multicast video stream to the unicast video stream comprises:

[0076] When the parameter value does not exceed the preset parameter threshold, the unicast video stream is switched to the multicast video stream.

[0077] Optionally, the intelligent terminal processing module confirms that the parameter value does not exceed the preset parameter threshold, that is, the parameter value has recovered below the preset parameter threshold, and the intelligent gateway distribution module will notify the intelligent terminal processing module to automatically switch the unicast video stream back to the multicast video stream. That is, when the network quality returns to normal, the intelligent terminal processing module will switch back to the multicast video stream mode at an appropriate time when playing the video stream (for example: when the video changes channels, pauses or switches), and notify the intelligent networking terminal and the intelligent gateway distribution module.

[0078] The video stream processing method provided by the present invention switches the unicast video stream back to the multicast video stream when the parameter value does not exceed the preset parameter threshold, that is, when the network quality returns to normal, thereby realizing a playback mode of the video stream without perceiving the transition, and reducing the live broadcast overhead.

[0079] In one embodiment, the video stream processing method further includes:

[0080] When the authorization for playing the multicast video stream fails and / or the comprehensive parameter value decreases, the video stream to be processed is switched to a unicast video stream.

[0081] Optionally, for a video source that only supports unicast playback or a video source that originally supported both multicast and unicast and whose multicast video stream authorization suddenly expires or whose comprehensive parameter value decreases, the intelligent gateway distribution module will notify its subordinate intelligent networking terminals to switch to unicast video stream mode, and the intelligent networking terminals will notify their subordinate home intelligent terminal processing modules to switch to unicast video stream mode.

[0082] The video stream processing method provided by the present invention enables the multicast video stream and the unicast video stream to collaborate effectively by adjusting the resources of the multicast video stream.

[0083] In one embodiment, the video stream processing system may further include a cloud-based intelligent processing platform.

[0084] Optionally, the cloud-based intelligent processing platform can count and automatically analyze the support status of the downstream devices. When a problem occurs on the platform side, the downstream devices are actively informed to switch. In order to reduce interaction and reduce overhead, only the corresponding intelligent gateway distribution module or intelligent networking module needs to be informed, and it will automatically notify the downstream devices to interact. According to the hardware configuration of each home gateway and networking terminal, the corresponding comprehensive parameters are issued as a reference for adjusting the multicast and unicast strategies of the home and within the home.

[0085] The cloud-based intelligent processing platform receives all the downstream information and combines it with regional parameters. It can automatically adjust multicast resources, on-demand resources, and operations in the corresponding area by dynamically analyzing the playback conditions of some areas or some families. It automatically issues corresponding prompts to newly entered devices to reduce their switching and waiting cycles. It issues the corresponding recommended number of terminal accesses based on the hardware configuration of each home gateway and networking terminal as a reference for adjusting the multicast and unicast strategies for the home and within the home.

[0086] The cloud-based intelligent processing platform can support multicast and unicast configuration for specific users, which can serve as a supplement to automatic identification and dynamic adjustment.

[0087] Optionally, the intelligent terminal processing module can provide real-time feedback on the terminal video playback status and terminal load status, and provide corresponding data reference to the gateway distribution module and the cloud intelligent processing platform;

[0088] The intelligent terminal processing module detects the surrounding network environment and feeds back the corresponding terminal identification to the gateway distribution module and the cloud intelligent processing platform;

[0089] The intelligent terminal processing module evaluates the video playback parameters, and when one or more parameters reach the preset parameter threshold, it notifies the gateway distribution module and the cloud intelligent processing platform to perform corresponding switching operations;

[0090] After authentication and authorization, the intelligent terminal processing module performs multicast request and playback for live broadcast traffic by default. When the parameter value of the video playback parameter reaches the preset parameter threshold, the intelligent terminal processing module will actively switch to unicast mode and notify the intelligent networking terminal, intelligent gateway distribution module and cloud intelligent processing platform. When it returns to below the preset parameter threshold, it will automatically switch back to multicast video streaming;

[0091] The intelligent gateway distribution module monitors that its upstream port reaches the preset parameter threshold corresponding to the comprehensive parameter value, and then switches the video stream to unicast as a whole. When the number of terminals under it is too large, exceeding 1 times the recommended value issued by the cloud intelligent processing platform, it is recommended that the intelligent terminals that have switched to unicast video streams be switched back to multicast when they meet the single-unit threshold value, so as to reduce the unicast traffic pressure within the home and reduce the downstream traffic bandwidth pressure of the entire home;

[0092] The number of smart terminals connected to a smart networking terminal in the home is too large, exceeding 1 times the recommended value sent by the cloud-based intelligent processing platform. At this time, it is recommended to switch the smart terminals that are switched to unicast video streams back to multicast when the single-unit threshold is met, so as to reduce the unicast traffic pressure in the home and reduce the traffic bandwidth in the home.

[0093] Optionally, the compatible deployment and conversion adjustment of unicast and multicast support of smart terminals can be completed by linking smart terminals, smart networking terminals, and smart gateway distribution modules on the terminal side to the platform side on a household basis. By utilizing the surrounding environment of network terminals, network status of similar terminals, network usage of other similar households, and network conversion deployment strategies, the adaptation modes of unicast and multicast in each household can be analyzed and dynamically executed, and corresponding debugging can be performed according to real-time usage.

[0094] The hierarchical architecture of smart terminals, smart networking terminals, and smart gateway distribution modules in the home can meet the needs of home networking environments in different scenarios. This is mainly reflected in the fact that the smart terminal processing module records the playback status after receiving the video code stream, detects the surrounding network environment, identifies the terminal identification and video playback parameters, and performs parameter evaluation on the acquired information, and then issues the terminal selection network mode instruction, and automatically switches according to the real-time playback status; while the smart networking terminal performs multicast distribution according to the playback instruction, covers the entire policy instruction on other terminals in the home that are classified in the same way, and achieves the purpose of coordinated operation in the home unit networking environment, and timely reduces the load in the entire networking environment; at the same time, the smart gateway distribution module is used to interact with the home terminal to timely feedback the jamming phenomenon, so that its overall architecture can quickly respond to different network environment changes; finally, the cloud-based intelligent processing platform is used to perform big data statistics and utilization, and similar status strategies are counted and used in subsequent network deployment and policy execution. At the same time, it can be combined with the regional characteristics under the platform to achieve targeted policy reference, which is conducive to the accuracy of architecture execution and customer satisfaction.

[0095] Optionally, the platform side uses the family as a unit, including terminal information and other integration methods, and supports the acquisition of family terminal information and the authorization, identification and selection switching of unicast and multicast based on the region, home gateway and home networking. This makes it possible to discover related playback experience problems in the same region, home and networking device in advance, and automatically switch to avoid experience problems. Analyzing and solving existing problems in advance according to different levels of support and network playback conditions can improve user video playback satisfaction.

[0096] The video stream processing method provided by the present invention completes the compatible deployment and conversion adjustment of unicast and multicast support of intelligent terminals through the linkage mode of intelligent terminals, intelligent networking terminals, and intelligent gateway distribution modules to the platform side; utilizes the network environment, the network status of the same type of terminals, the usage status of other similar networks, and the network conversion deployment strategy to analyze the adaptation mode of unicast and multicast in each area and dynamically execute it, and can perform corresponding debugging according to the real-time usage situation to reduce the system overhead and obtain the best playback experience; can solve the multicast / unicast support problem of different areas, different networking scenarios, and different intelligent terminals under multiple unicast and multicast mixed traffic conditions; can flexibly support the switching of multicast video streams and unicast-multicast video streams according to the relevant playback conditions within the home, under the networking equipment, and between different areas.

[0097] Figure 2 A schematic diagram of the structure of the video stream processing device provided by the present invention is shown in FIG. Figure 2 As shown, the device comprises:

[0098] The acquisition module 210 is used to acquire the terminal identification and video playback parameters corresponding to the video stream to be processed;

[0099] A first switching module 220, configured to obtain authorization to play a multicast video stream according to the terminal identifier, and switch the to-be-processed video stream to a multicast video stream;

[0100] A second switching module 230, configured to confirm that the video playback parameter exceeds a corresponding preset parameter threshold, and switch the multicast video stream to the unicast video stream;

[0101] The video playback parameters include single parameters and comprehensive parameters.

[0102] In one embodiment, the video playback parameter includes: at least one of a packet loss rate, a blue screen parameter, a distorted screen parameter, a network jitter parameter, and a disorder parameter;

[0103] The single parameter value is the value of any of the video playback parameters;

[0104] The comprehensive parameter value is the sum of the values ​​of multiple video playback parameters.

[0105] In one embodiment, the second switching module 230 is further specifically configured to:

[0106] Confirming that the single parameter value exceeds the corresponding preset parameter threshold, switching the multicast video stream to the unicast video stream;

[0107] and / or confirming that the comprehensive parameter value exceeds the corresponding preset parameter threshold, switching the multicast video stream to the unicast video stream.

[0108] In one embodiment, the video stream processing device further includes:

[0109] When the number of terminals playing the unicast video stream exceeds a preset threshold, it is confirmed that the parameter value of the terminal does not exceed the preset parameter threshold, and the unicast video stream corresponding to the terminal is switched to the multicast video stream.

[0110] In one embodiment, the switching of the multicast video stream to the unicast video stream comprises:

[0111] When the parameter value does not exceed the preset parameter threshold, the unicast video stream is switched to the multicast video stream.

[0112] In one embodiment, the video stream processing device further includes:

[0113] When the authorization for playing the multicast video stream fails and / or the comprehensive parameter value decreases, the video stream to be processed is switched to a unicast video stream.

[0114] The video stream processing device provided by the present invention obtains the authorization to play the multicast video stream through the terminal identifier corresponding to the video stream to be processed, and automatically switches the default multicast video stream to a unicast video stream when it is determined that the video playback parameter corresponding to the video stream to be processed exceeds the corresponding preset parameter threshold. Corresponding processing can be performed according to the playback situation of the video stream to be processed, thereby realizing adaptive video stream processing and switching, reducing system overhead, and thus improving user experience.

[0115] Figure 3 An example of a physical structure diagram of an electronic device is shown in FIG. Figure 3 As shown, the electronic device may include: a processor 310, a communication interface 320, a memory 330 and a communication bus 340, wherein the processor 310, the communication interface 320 and the memory 330 communicate with each other through the communication bus 340. The processor 310 may call a computer program in the memory 330 to execute the steps of the video stream processing method, for example including:

[0116] Obtain the terminal identifier and video playback parameters corresponding to the video stream to be processed;

[0117] According to the terminal identifier, obtaining authorization to play the multicast video stream, and switching the to-be-processed video stream to the multicast video stream;

[0118] Confirming that a parameter value of the video playback parameter exceeds a corresponding preset parameter threshold, switching the multicast video stream to the unicast video stream;

[0119] The parameter value includes a single parameter value and / or a comprehensive parameter value.

[0120] In addition, the logic instructions in the above-mentioned memory 330 can be implemented in the form of a software functional unit and can be stored in a computer-readable storage medium when it is sold or used as an independent product. Based on such an understanding, the technical solution of the present invention is essentially or the part that contributes to the prior art or the part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions to enable a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present invention. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), disk or optical disk and other media that can store program codes.

[0121] On the other hand, the present invention further provides a computer program product, the computer program product comprising a computer program stored on a non-transitory computer-readable storage medium, the computer program comprising program instructions, when the program instructions are executed by a computer, the computer can execute the video stream processing method provided by the above methods, the method comprising:

[0122] Obtain the terminal identifier and video playback parameters corresponding to the video stream to be processed;

[0123] According to the terminal identifier, obtaining authorization to play the multicast video stream, and switching the to-be-processed video stream to the multicast video stream;

[0124] Confirming that a parameter value of the video playback parameter exceeds a corresponding preset parameter threshold, switching the multicast video stream to the unicast video stream;

[0125] The parameter value includes a single parameter value and / or a comprehensive parameter value.

[0126] On the other hand, an embodiment of the present application further provides a processor-readable storage medium, wherein the processor-readable storage medium stores a computer program, wherein the computer program is used to enable the processor to execute the video stream processing method provided in the above embodiments, for example, including:

[0127] Obtain the terminal identifier and video playback parameters corresponding to the video stream to be processed;

[0128] According to the terminal identifier, obtaining authorization to play the multicast video stream, and switching the to-be-processed video stream to the multicast video stream;

[0129] Confirming that a parameter value of the video playback parameter exceeds a corresponding preset parameter threshold, switching the multicast video stream to the unicast video stream;

[0130] The parameter value includes a single parameter value and / or a comprehensive parameter value.

[0131] The processor-readable storage medium can be any available medium or data storage device that can be accessed by the processor, including but not limited to magnetic storage (such as floppy disks, hard disks, magnetic tapes, magneto-optical disks (MO), etc.), optical storage (such as CD, DVD, BD, HVD, etc.), and semiconductor storage (such as ROM, EPROM, EEPROM, non-volatile memory (NANDFLASH), solid-state drive (SSD)), etc.

[0132] The device embodiments described above are merely illustrative, wherein the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the scheme of this embodiment. Ordinary technicians in this field can understand and implement it without paying creative labor.

[0133] Through the description of the above implementation methods, those skilled in the art can clearly understand that each implementation method can be implemented by means of software plus a necessary general hardware platform, and of course, it can also be implemented by hardware. Based on this understanding, the above technical solution is essentially or the part that contributes to the prior art can be embodied in the form of a software product, and the computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, a disk, an optical disk, etc., including a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods described in each embodiment or some parts of the embodiments.

[0134] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

1. A video stream processing method, characterized in that: Based on the implementation of the video stream processing system, the video stream processing system includes an intelligent terminal processing module, an intelligent networking terminal, and an intelligent gateway distribution module. The intelligent networking terminal interacts with the intelligent terminal processing module to report the home networking topology environment, including whether the routing mode or the bridging mode is adopted, whether the second-layer switching device is adopted in the middle or the direct connection is adopted, and whether there is a multi-layer cascade. When the intelligent networking terminal is in the routing mode, the multicast authentication and authorization of the intelligent terminal processing module under it are completed; the method includes: Obtain the terminal identification and video playback parameters corresponding to the video stream to be processed; the terminal identification includes device type, model, software and hardware parameters, multicast or unicast support status, and region; According to the terminal identifier, obtaining authorization to play the multicast video stream, and switching the to-be-processed video stream to the multicast video stream; Confirming that a parameter value of the video playback parameter exceeds a corresponding preset parameter threshold, switching the multicast video stream to a unicast video stream; Wherein, the parameter value includes a single parameter value and / or a comprehensive parameter value; The method further comprises: When the number of terminals playing the unicast video stream exceeds a preset threshold number, confirming that the parameter value of the terminal does not exceed the preset parameter threshold, switching the unicast video stream corresponding to the terminal to the multicast video stream; The video stream processing system also includes a cloud-based intelligent processing platform, which collects statistics and automatically analyzes the support status of downstream devices; when a problem occurs on the platform side, it actively informs the downstream devices to switch, and only informs the corresponding intelligent gateway distribution module or intelligent networking module, which automatically interacts with the downstream devices and sends corresponding comprehensive parameters according to the hardware configuration of each home gateway and networking terminal as a reference for adjusting the multicast and unicast strategies of the home and within the home; The intelligent terminal processing module provides real-time feedback on the terminal video playback status and terminal load status, and provides corresponding data reference to the gateway distribution module and the cloud intelligent processing platform; The intelligent terminal processing module detects the surrounding network environment and feeds back the corresponding terminal identification to the gateway distribution module and the cloud intelligent processing platform; The intelligent terminal processing module evaluates the video playback parameters, and when one or more parameters reach the preset parameter threshold, it notifies the gateway distribution module and the cloud intelligent processing platform to perform corresponding switching operations; After authentication and authorization, the intelligent terminal processing module performs multicast request and playback for live broadcast traffic by default; when the parameter value of the video playback parameter reaches the preset parameter threshold, the intelligent terminal processing module actively switches to unicast mode and notifies the intelligent networking terminal, intelligent gateway distribution module and cloud intelligent processing platform at the same time. When it recovers to below the preset parameter threshold, it automatically switches back to multicast video streaming; The intelligent gateway distribution module monitors that its upstream port reaches the preset parameter threshold corresponding to the comprehensive parameter value, and then switches the video stream to unicast as a whole; when the number of terminals under it is too large, exceeding 1 times the recommended value issued by the cloud intelligent processing platform, the intelligent terminal that is switched to unicast video stream under it will be switched back to multicast when it meets the single-unit threshold value, so as to reduce the unicast traffic pressure within the home and reduce the downstream traffic bandwidth pressure of the entire home; If the number of smart terminals under a smart networking terminal in a home is too large and exceeds 1 times the recommended value issued by the cloud-based smart processing platform, the smart terminals that are switched to unicast video streams will be switched back to multicast when the single-unit threshold is met, so as to reduce the unicast traffic pressure in the home and reduce the traffic bandwidth in the home.

2. The video stream processing method according to claim 1, characterized in that: The video playback parameters include: at least one of: packet loss rate, blue screen parameter, distorted screen parameter, delay, real-time bit rate, network jitter parameter, and disorder parameter; The single parameter value is the value of any of the video playback parameters; The comprehensive parameter value is the sum of the values ​​of multiple video playback parameters.

3. The video stream processing method according to claim 1, characterized in that: The confirming that the parameter value of the video playback parameter exceeds the corresponding preset parameter threshold and switching the multicast video stream to the unicast video stream includes: Confirming that the single parameter value exceeds the corresponding preset parameter threshold, switching the multicast video stream to the unicast video stream; and / or confirming that the comprehensive parameter value exceeds the corresponding preset parameter threshold, switching the multicast video stream to the unicast video stream.

4. The video stream processing method according to claim 1, characterized in that: The step of switching the multicast video stream to the unicast video stream comprises: When the parameter value does not exceed the preset parameter threshold, the unicast video stream is switched to the multicast video stream.

5. The video stream processing method according to claim 1, characterized in that: Also includes: When the authorization for playing the multicast video stream fails and / or the comprehensive parameter value decreases, the video stream to be processed is switched to a unicast video stream.

6. A video stream processing device, characterized in that: The method for processing a video stream according to any one of claims 1 to 5 comprises: An acquisition module is used to obtain a terminal identifier and video playback parameters corresponding to the video stream to be processed; A first switching module, configured to obtain authorization to play a multicast video stream according to the terminal identifier, and switch the video stream to be processed to a multicast video stream; A second switching module, configured to confirm that a parameter value of the video playback parameter exceeds a corresponding preset parameter threshold, and switch the multicast video stream to a unicast video stream; The parameter value includes a single parameter value and / or a comprehensive parameter value.

7. The video stream processing device according to claim 6, characterized in that: The video playback parameters include: at least one of: packet loss rate, blue screen parameter, distorted screen parameter, delay, real-time bit rate, network jitter parameter, and disorder parameter; The single parameter value is the value of any of the video playback parameters; The comprehensive parameter value is the sum of the values ​​of multiple video playback parameters.

8. An electronic device comprising a processor and a memory storing a computer program, characterized in that: When the processor executes the computer program, the steps of the video stream processing method according to any one of claims 1 to 5 are implemented.

9. A processor-readable storage medium, characterized in that: The processor-readable storage medium stores a computer program, and the computer program is used to enable the processor to execute the steps of the video stream processing method according to any one of claims 1 to 5.

Images