A mobile live push streaming quality detection method and device

Abstract

The application discloses a mobile live broadcast push stream quality detection method and device, comprising: collecting push stream related data in real time in the process of mobile live broadcast of a first device, wherein the push stream related data comprises push stream quality data and space-time data; reporting the push stream related data to a server, so that a second device obtains the push stream related data from the server, and comprehensively processes the push stream quality data and the space-time data to obtain a visual push stream quality map. The push stream quality data obtained by the scheme is obtained depending on a real mobile live broadcast scene, and the movement of the first device on a set route can guarantee covering any blind area on a path, so that the network fluctuation in the mobile live broadcast process can be truly reflected; in addition, the space-time data is collected synchronously in the mobile live broadcast process, and the space-time data can be associated and analyzed in combination with the push stream quality data subsequently, so that the accuracy of the push stream quality detection result is further ensured.

Description

Technical Field

[0001] This application relates to the field of communication technology, and more specifically, to a method and apparatus for detecting the quality of mobile live streaming. Background Technology

[0002] Mobile live streaming is a live streaming method in which the host uses a mobile device to push audio and video data, and the audience uses a playback device to watch the received audio and video content. Because mobile live streaming, such as outdoor live streaming, is highly dependent on the mobile network environment, in order to ensure the quality of the live stream, it is necessary to test the live streaming quality in advance according to the predetermined live streaming route, at different locations, at different times, and under different network conditions.

[0003] Traditional live streaming quality testing typically involves deploying testing equipment at pre-set locations and periodically sending test data packets to measure network metrics. However, this static testing method cannot reflect network fluctuations during movement and cannot cover blind spots along the movement path. Summary of the Invention

[0004] In view of the above, this application provides the following technical solution:

[0005] The first aspect of this application provides a method for detecting the quality of mobile live streaming, applied to a first device, comprising:

[0006] During the live streaming process of the first device, streaming-related data is collected in real time, including streaming quality data and spatiotemporal data. The first device is fixed on the moving object, and the moving object moves according to a set route.

[0007] The streaming-related data is reported to the server so that the second device can obtain the streaming-related data from the server. The streaming quality data and the spatiotemporal data are processed together to obtain a visualized streaming quality map. The streaming quality map includes the set route, and different streaming qualities have different presentation attributes.

[0008] In one possible implementation, the streaming quality data includes at least one of the following: bitrate, frame rate, frame drop rate, and latency; the spatiotemporal data includes time data and location data.

[0009] One possible implementation also includes:

[0010] The auxiliary judgment data of the first device is obtained and reported to the server, so that the second device can determine the mapping relationship between the auxiliary judgment data and the streaming quality data, so that when the streaming quality map is triggered to display detailed information, the streaming quality data and the auxiliary judgment data are associated and output.

[0011] The auxiliary judgment data includes at least one of the following: performance data, network type, and device information.

[0012] A second aspect of this application provides a method for detecting the quality of mobile live streaming, applied to a second device, comprising:

[0013] Obtain streaming-related data from the first device, which is data collected in real time by the first device during mobile live streaming, including streaming quality data and spatiotemporal data. The first device is fixed on a mobile object, which moves according to a set route.

[0014] Based on the streaming quality data and the spatiotemporal data, a visualized streaming quality map of the first device is obtained. The streaming quality map includes the set route, and different streaming qualities have different presentation attributes.

[0015] The output displays the push quality map.

[0016] In one possible implementation, obtaining the streaming-related data of the first device includes:

[0017] Obtain the streaming data related to the first device from the server's database.

[0018] In one possible implementation, the step of comprehensively processing the streaming quality data and the spatiotemporal data to obtain a visualized streaming quality map includes:

[0019] Based on the jetting quality data and the spatiotemporal data, a quality presentation diagram of the first device on the set route is determined. The quality presentation diagram includes at least one of the following: jetting quality curve, jetting quality heat map, and jetting quality scatter plot.

[0020] The quality rendering map is fused with a map containing the set route to obtain a visualized streaming quality map of the first device.

[0021] One possible implementation also includes:

[0022] Obtain streaming-related data from other devices, and process the streaming-related data from other devices to obtain a quality rendering map of the other devices. The set route corresponding to the other devices is the same as the set route of the first device.

[0023] The control integrates the quality rendering maps of the other devices into the push flow quality map.

[0024] One possible implementation also includes:

[0025] Obtain auxiliary judgment data for the first device and the other devices, wherein the auxiliary judgment data includes at least one of the following: performance data, network type, and device information;

[0026] Determine the mapping relationship between the auxiliary judgment data and the streaming quality data corresponding to the same device, so that when the streaming quality map is triggered to display detailed information, the streaming quality data and the auxiliary judgment data are associated and output.

[0027] A third aspect of this application provides a mobile live streaming quality testing device, applied to a first device, comprising:

[0028] The data collection module is used to collect streaming-related data in real time during the live streaming of the first device. The streaming-related data includes streaming quality data and spatiotemporal data. The first device is fixed on the moving object, and the moving object moves according to a set route.

[0029] The data reporting module is used to report the streaming-related data to the server so that the second device can obtain the streaming-related data from the server, perform comprehensive processing on the streaming quality data and the spatiotemporal data, and obtain a visualized streaming quality map. The streaming quality map includes the set route, and different streaming qualities have different presentation attributes.

[0030] A fourth aspect of this application provides a mobile live streaming quality testing device, applied to a second device, comprising:

[0031] The data acquisition module is used to acquire streaming-related data of the first device. The streaming-related data is data collected in real time by the first device during mobile live streaming, including streaming quality data and spatiotemporal data. The first device is fixed on a mobile object, and the mobile object moves according to a set route.

[0032] The data processing module is used to perform comprehensive processing based on the streaming quality data and the spatiotemporal data to obtain a visualized streaming quality map of the first device. The streaming quality map includes the set route, and different streaming qualities have different presentation attributes.

[0033] The map display module is used to output and display the streaming quality map.

[0034] As can be seen from the above technical solution, this application discloses a method and apparatus for detecting the quality of mobile live streaming, including: collecting streaming-related data in real time during the mobile live streaming process of a first device, the streaming-related data including streaming quality data and spatiotemporal data, the first device being fixed on a moving object, the moving object moving according to a set route; reporting the streaming-related data to a server so that a second device can obtain the streaming-related data from the server; comprehensively processing the streaming quality data and the spatiotemporal data to obtain a visualized streaming quality map, the streaming quality map including the set route, and different streaming qualities having different presentation attributes. The streaming quality data obtained by this solution depends on the real mobile live streaming scenario, and the movement of the first device along the set route can ensure coverage of any blind spots on the path, thereby truly reflecting network fluctuations during the mobile live streaming process; in addition, spatiotemporal data is collected synchronously during the mobile live streaming process, and the spatiotemporal data can be combined with the streaming quality data for correlation analysis to further ensure the accuracy of the streaming quality detection results. Attached Figure Description

[0035] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only embodiments of this application. For those skilled in the art, other drawings can be obtained based on the provided drawings without creative effort.

[0036] Figure 1 This is a flowchart of a mobile live streaming quality detection method disclosed in an embodiment of this application;

[0037] Figure 2 This is a flowchart of another mobile live streaming quality detection method disclosed in an embodiment of this application;

[0038] Figure 3 This is a flowchart illustrating the process of obtaining a streaming quality map as disclosed in an embodiment of this application;

[0039] Figure 4 This application discloses the functional architecture of the first and second devices in its embodiments.

[0040] Figure 5 This is a schematic diagram of the structure of a mobile live streaming quality testing device disclosed in an embodiment of this application;

[0041] Figure 6 This is a schematic diagram of another mobile live streaming quality testing device disclosed in an embodiment of this application. Detailed Implementation

[0042] For the sake of clarity and citation, the explanations, abbreviations, or acronyms used in the following text are summarized below:

[0043] Mobile live streaming: Live audio and video streaming via mobile devices.

[0044] Broadcaster end: Mobile devices that push audio and video content.

[0045] Viewer end: Mobile devices that play audio and video content.

[0046] APP: Application, short for Application.

[0047] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0048] Figure 1 This is a flowchart of a mobile live streaming quality detection method disclosed in an embodiment of this application. Figure 1 The method shown is applied to the first device, see [link / reference]. Figure 1 As shown, mobile live streaming quality testing methods may include:

[0049] Step 101: During the live streaming process of the first device, real-time streaming-related data is collected. The streaming-related data includes streaming quality data and spatiotemporal data. The first device is fixed on the moving object, and the moving object moves according to a set route.

[0050] The first device can be a mobile phone or other portable mobile device. During the implementation of this application, staff can hold the first device or place it on a mobile phone holder and walk along a set route to simulate a real live broadcast scene; or for scenarios with a long set route, the first device can be placed on a mobile vehicle and moved slowly.

[0051] The first device is in live streaming mode and needs to push the video captured by the camera to the server in real time. During this process, additional streaming-related data from the first device needs to be collected. This related data includes at least streaming quality data and spatiotemporal data. The streaming quality data includes parameters such as bitrate, frame rate, frame drop rate, and latency. The spatiotemporal data includes data and location data. The time data is directly determined based on the system clock time of the networked first device, while the location data can be provided by the positioning and control module within the first device.

[0052] The collection of streaming-related data can be performed at a set frequency, for example, once per second. This set frequency is configurable and can be flexibly configured according to the detection accuracy requirements and the performance of the first device. It is important to emphasize that the first device collects streaming-related data synchronously during the mobile live broadcast, rather than simply detecting network signals at different locations along a set route to determine signal quality. Fixed-location detection cannot capture the instantaneous quality fluctuations caused by base station switching and signal obstruction during mobile live broadcasts, leading to deviations between the detection results and the actual streaming scenario. The actual live broadcast process ensures more accurate streaming quality data that closely reflects the real-world scenario.

[0053] Step 102: The streaming-related data is reported to the server so that the second device can obtain the streaming-related data from the server, perform comprehensive processing on the streaming quality data and the spatiotemporal data to obtain a visualized streaming quality map. The streaming quality map includes the set route, and different streaming qualities have different presentation attributes.

[0054] After the first device collects the streaming-related data, it reports this data to the server in real time. Specifically, it can report data at each time point to the server interface via HTTP requests, and the interface writes the data to the database for storage. That is, the app in the first device used to collect streaming-related data reports the data to the server through the server-side interface, and the server program records it in the server database. The app can be a standalone app with data collection capabilities, or it can be an existing live streaming app that integrates data collection functionality.

[0055] The streaming-related data stored in the database on the server can be obtained by other devices and analyzed to obtain a visualized streaming quality map containing the set route. In the streaming quality map, different streaming qualities have different presentation attributes, such as using different colors to distinguish different streaming qualities.

[0056] Since the data related to the flow in this application includes not only flow quality data but also spatiotemporal data, a correlation model of "geographic location - network conditions - flow quality" can be established during analysis to determine the correlation between spatiotemporal data and flow quality, thereby accurately locating road sections with high incidence of traffic jams.

[0057] The mobile live streaming quality detection method described in this embodiment obtains streaming quality data based on real mobile live streaming scenarios, and the movement of the first device along the set route can ensure coverage of any blind spots on the path, thereby truly reflecting network fluctuations during the mobile live streaming process; in addition, spatiotemporal data is collected synchronously during the mobile live streaming process, and the spatiotemporal data can be combined with streaming quality data for correlation analysis to further ensure the accuracy of the streaming quality detection results.

[0058] In other implementations, the mobile live streaming quality detection method may further include: obtaining auxiliary judgment data from the first device and reporting it to the server, so that the second device determines the mapping relationship between the auxiliary judgment data and the streaming quality data, so that when the streaming quality map is triggered to display detailed information, the streaming quality data and the auxiliary judgment data are associated and output; the auxiliary judgment data includes at least one of the following: performance data, network type, and device information.

[0059] Among them, performance data includes CPU (central processing unit) performance and memory space; network type includes mobile operators and CDN (Content Delivery Network) nodes; and device information includes operating system and device model.

[0060] Considering that the streaming devices and networks used in mobile live streaming may differ in actual applications, which may lead to differences in the quality of live streaming, this solution can simultaneously test the quality of mobile live streaming on multiple first devices during implementation. At least one of the performance data, network type, and device information of the multiple first devices must be different.

[0061] In this implementation, in addition to streaming quality data and spatiotemporal data, the data collected by the first device also includes auxiliary judgment data to facilitate a more comprehensive understanding of the impact of different types of devices and network types on live streaming quality. The solution can complete the detection using existing mobile devices without the need to deploy professional signal acquisition equipment, supporting large-scale route pre-inspection needs, synchronizing live streaming data with the network environment in real time, and adapting to the diverse needs of outdoor live streaming scenarios.

[0062] Figure 2 This is a flowchart of another mobile live streaming quality detection method disclosed in an embodiment of this application. Figure 2 The method shown is applied to the second device, combined with Figure 2 As shown, mobile live streaming quality testing methods may include:

[0063] Step 201: Obtain streaming-related data of the first device. The streaming-related data is data collected in real time by the first device during the mobile live streaming process, including streaming quality data and spatiotemporal data. The first device is fixed on the mobile object, and the mobile object moves according to a set route.

[0064] The streaming data of the first device is not obtained directly from the first device. Instead, the first device uploads its streaming data to the server, where it is stored in the server's database. The second device then obtains the streaming data of the first device stored in the server interface.

[0065] The first device can be a mobile phone or other portable mobile device. In implementation, staff can carry the first device and move along a set route on foot or by vehicle, and the first device is in live streaming mode. While pushing the video captured by the camera to the server in real time, the streaming-related data of the first device will be collected additionally. The streaming quality data includes bitrate, frame rate, frame drop rate, latency, etc., and the spatiotemporal data includes data and location data.

[0066] Step 202: Based on the streaming quality data and the spatiotemporal data, perform comprehensive processing to obtain a visualized streaming quality map of the first device. The streaming quality map includes the set route, and different streaming qualities have different presentation attributes.

[0067] After obtaining the streaming-related data from the server, the second device can analyze and process the streaming quality data and the spatiotemporal data to obtain a visualized streaming quality map containing the set route. In the streaming quality map, different streaming qualities are presented with different attributes, such as using different colors to distinguish different streaming qualities. The analysis process can determine the correlation between spatiotemporal data and streaming quality, and accurately determine the streaming quality of each road segment.

[0068] Step 203: Output and display the push quality map.

[0069] After obtaining the streaming quality map, the controller can output and display it on the visual interactive system (corresponding to the second device), so that relevant personnel can understand the mobile live streaming quality along the set route in real time. In implementation, the second device can obtain the real-time streaming-related data from the first device for real-time interactive analysis of live streaming quality data.

[0070] The mobile live streaming quality detection method described in this embodiment obtains streaming quality data based on real mobile live streaming scenarios, and the movement of the first device along the set route can ensure coverage of any blind spots on the path, thereby truly reflecting network fluctuations during the mobile live streaming process; in addition, spatiotemporal data is collected synchronously during the mobile live streaming process, and the spatiotemporal data can be combined with streaming quality data for correlation analysis to further ensure the accuracy of the streaming quality detection results.

[0071] In the above embodiments, obtaining the streaming-related data of the first device includes: obtaining the streaming-related data of the first device from the database of the server. In implementation, the database can provide a data acquisition interface for the second device to support the second device in obtaining streaming-related data from the server for analysis. Simultaneously, this data acquisition interface also supports the second device (visualization system) in performing filtering functions, facilitating users to filter out the detailed data they need based on their requirements.

[0072] Figure 3 This is a flowchart illustrating the process of obtaining a streaming quality map as disclosed in an embodiment of this application. See also... Figure 3 As shown, the process of comprehensively processing the streaming quality data and the spatiotemporal data to obtain a visualized streaming quality map may include:

[0073] Step 301: Based on the push flow quality data and the spatiotemporal data, determine the quality presentation map of the first device on the set route.

[0074] The quality presentation diagram includes at least one of the following: a flow quality curve, a flow quality heat map, and a flow quality scatter plot.

[0075] Step 302: The quality rendering map is fused with the map containing the set route to obtain a visualized streaming quality map of the first device.

[0076] The functional structure architecture of the first and second equipment is as follows: Figure 4 As shown. Combined with Figure 4 The first device corresponds to Figure 4 The data collection APP includes a positioning module, which is used to obtain the location data of the first device in real time and transmit it to the reporting module; a streaming module is used for mobile live streaming and transmits the streaming quality data to the reporting module; the reporting module is used to report the data received by the mobile phone to the server, and the server side completes the data collection.

[0077] The second device corresponds to Figure 4 The visualization system includes a GIS (Geographic Information System) module, a timeline module, and a function filtering module.

[0078] The GIS module can overlay visual graphics on a map and supports presenting push quality data in the form of line graphs, heat maps, and scatter plots.

[0079] Line graph: The reported data from each device is plotted on a map using a curve, and different colors are used on the curve to distinguish the streaming quality of corresponding points. The color gradient clearly presents the streaming quality of the mobile live streaming device corresponding to the current route point to the analyst. Furthermore, by clicking on a point on the curve, detailed data at the current reporting time can be viewed.

[0080] Scatter plot:

[0081] When the analyst selects a specific time point, the graph transforms into a scatter plot of the reported points filtered for that time point. Clicking on a point in the scatter plot will also display detailed data for that current reporting time point.

[0082] Heatmap: When the map zoom level is too low and the system determines that the route is not clear enough to see the details, the system automatically converts the curve graph into a heatmap (which reflects the live streaming quality of the area corresponding to multiple points in the route). The heatmap allows you to see the general situation of a certain area on a large scale.

[0083] The timeline module serves as a time filter, allowing users to choose to view data for a specific time period or select a specific point in time to analyze the data at that particular time.

[0084] The function filtering module can filter reported data based on network type (mobile operator CDN node) and device information (operating system, model) through its filtering function. Data of different types of maps in the map module will be filtered and changed synchronously.

[0085] The visual interactive system can dynamically and vividly display the streaming quality map, meet the different needs of users, and enable users to understand the streaming quality data at any location on the set route from different dimensions and scales.

[0086] In other implementations, the mobile live streaming quality detection method may further include: obtaining auxiliary judgment data from the first device, wherein the auxiliary judgment data includes at least one of the following: performance data, network type, and device information. The auxiliary judgment data is also collected by the first device and reported to the server, and the second device can obtain it from the server. The auxiliary judgment data of the first device is stored in association with streaming-related data, so that when the streaming quality map displayed in the visual interactive system is triggered to display detailed information, the streaming quality data and the auxiliary judgment data are output in association.

[0087] This includes performance data such as CPU performance and memory space; network type such as mobile operator and CDN node; and device information such as operating system and device model.

[0088] Considering that the streaming devices and networks used in mobile live streaming may differ in actual applications, which may lead to differences in the quality of live streaming, this solution can simultaneously test the quality of mobile live streaming on multiple first devices during implementation. At least one of the performance data, network type, and device information of the multiple first devices must be different.

[0089] Therefore, the method may further include: obtaining streaming-related data from other devices, and processing the streaming-related data from other devices to obtain a quality rendering map of the other devices, wherein the set route corresponding to the other devices is the same as the set route of the first device; and controlling the fusion of the quality rendering map of the other devices into the streaming quality map.

[0090] In other words, streaming quality data from multiple different primary devices can be displayed together on the same map, making it easier for users to compare the streaming quality of different devices. The streaming quality data from different primary devices will have different display attributes on the streaming quality map, including but not limited to line thickness, line type, and line color.

[0091] When multiple first devices exist, the mapping relationship between the auxiliary judgment data and the streaming quality data corresponding to the same device is determined, so that when the streaming quality map is triggered to display detailed information, the streaming quality data and the auxiliary judgment data are associated and output.

[0092] In this implementation, in addition to streaming quality data and spatiotemporal data, the data collected by the first device also includes auxiliary judgment data to facilitate a more comprehensive understanding of the impact of different types of devices and network types on live streaming quality. The solution can complete the detection using existing mobile devices without the need to deploy professional signal acquisition equipment, supporting large-scale route pre-inspection needs, synchronizing live streaming data with the network environment in real time, and adapting to the diverse needs of outdoor live streaming scenarios.

[0093] This application proposes a method for real-time collection of multi-dimensional spatiotemporal quality data from mobile live streams and provides a visualization system for real-time interactive data analysis. Specifically, it overcomes the static limitations of fixed-node detection by binding streaming quality and spatiotemporal data (such as GPS trajectory and network latency) to the mobile device in real time. It can accurately identify momentary stuttering caused by base station switching and signal attenuation in mobile live streams, providing data support for route optimization. The cloud-based GIS visualization system aggregates and interacts with multi-dimensional data (time, location, network parameters), replacing traditional offline log analysis. Detection results are presented in real time, shortening problem location time and improving the efficiency of pre-detection route planning.

[0094] In summary, the proposed solution can be implemented through an edge-cloud architecture, which has the following advantages: multi-dimensional data fusion: for the first time, streaming quality data is bound to high-precision spatiotemporal trajectories in real time; lightweight deployment: detection is completed using existing mobile devices without the need for dedicated hardware; interactive analysis: by linking GIS heatmaps with timelines, the bottleneck time periods / areas can be quickly located.

[0095] For the foregoing method embodiments, in order to simplify the description, they are all described as a series of actions. However, those skilled in the art should understand that this application is not limited to the described order of actions, because according to this application, some steps can be performed in other orders or simultaneously. Furthermore, those skilled in the art should also understand that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily essential to this application.

[0096] The methods described in the above-disclosed embodiments of this application are detailed in terms of the methods. The methods of this application can be implemented by various forms of apparatus. Therefore, this application also discloses an apparatus. Specific embodiments are given below for detailed description.

[0097] Figure 5 This is a schematic diagram of the structure of a mobile live streaming quality testing device disclosed in an embodiment of this application. Figure 5 The device shown is applied to the first apparatus. See also Figure 5 As shown, the mobile live streaming quality testing device 50 may include:

[0098] The data collection module 501 is used to collect streaming-related data in real time during the live streaming of the first device. The streaming-related data includes streaming quality data and spatiotemporal data. The first device is fixed on the moving object, and the moving object moves according to a set route.

[0099] The data reporting module 502 is used to report the streaming-related data to the server so that the second device can obtain the streaming-related data from the server, perform comprehensive processing on the streaming quality data and the spatiotemporal data, and obtain a visualized streaming quality map. The streaming quality map includes the set route, and different streaming qualities have different presentation attributes.

[0100] The mobile live streaming quality testing device described in this embodiment obtains streaming quality data based on real mobile live streaming scenarios, and the first device can ensure coverage of any blind spots on the path when moving along a set route, thereby truly reflecting network fluctuations during the mobile live streaming process; in addition, spatiotemporal data is collected synchronously during the mobile live streaming process, and the spatiotemporal data can be combined with streaming quality data for correlation analysis to further ensure the accuracy of the streaming quality testing results.

[0101] Figure 6 This is a schematic diagram of another mobile live streaming quality testing device disclosed in an embodiment of this application. Figure 6 The device shown is used in the second device. See also Figure 6 As shown, the mobile live streaming quality testing device 60 may include:

[0102] The data acquisition module 601 is used to acquire streaming-related data of the first device. The streaming-related data is data collected in real time by the first device during mobile live streaming, including streaming quality data and spatiotemporal data. The first device is fixed on a mobile object, and the mobile object moves according to a set route.

[0103] The data processing module 602 is used to perform comprehensive processing based on the streaming quality data and the spatiotemporal data to obtain a visualized streaming quality map of the first device. The streaming quality map includes the set route, and different streaming qualities have different presentation attributes.

[0104] The map display module 603 is used to output and display the streaming quality map.

[0105] The mobile live streaming quality testing device described in this embodiment obtains streaming quality data based on real mobile live streaming scenarios, and the first device can ensure coverage of any blind spots on the path when moving along a set route, thereby truly reflecting network fluctuations during the mobile live streaming process; in addition, spatiotemporal data is collected synchronously during the mobile live streaming process, and the spatiotemporal data can be combined with streaming quality data for correlation analysis to further ensure the accuracy of the streaming quality testing results.

[0106] The specific implementation of the aforementioned mobile live streaming quality testing device and its various modules, as well as other possible implementations, can be found in the relevant sections of the method embodiments, and will not be repeated here.

[0107] The mobile live streaming quality detection device described in the above embodiments includes a processor and a memory. The data collection module, data reporting module, data acquisition module, data processing module, map display module, etc. in the above embodiments are all stored as program modules in the memory, and the processor executes the above program modules stored in the memory to realize the corresponding functions.

[0108] The processor contains a kernel, which retrieves the corresponding program modules from memory. One or more kernels can be configured, and the processing of backtracking data can be achieved by adjusting kernel parameters.

[0109] The memory may include non-permanent memory in computer-readable media, such as random access memory (RAM) and / or non-volatile memory, such as read-only memory (ROM) or flash RAM, and the memory includes at least one memory chip.

[0110] In an exemplary embodiment, a computer-readable storage medium is also provided, which can be directly loaded into the internal memory of a computer and contains software code. After being loaded and executed by the computer, the computer program can implement the steps shown in any embodiment of the mobile live streaming quality detection method described above.

[0111] In an exemplary embodiment, a computer program product is also provided, which can be directly loaded into the internal memory of a computer and contains software code. After being loaded and executed by the computer, the computer program can implement the steps shown in any embodiment of the mobile live streaming quality detection method described above.

[0112] The various embodiments in this specification are described in a progressive manner, with each embodiment focusing on its differences from other embodiments. Similar or identical parts between embodiments can be referred to interchangeably. For the apparatus disclosed in the embodiments, since they correspond to the methods disclosed in the embodiments, the description is relatively simple; relevant parts can be referred to the method section.

[0113] It should also be noted that, in this document, relational terms such as "first" and "second" are used only to distinguish one entity or operation from another, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Furthermore, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes said element.

[0114] The steps of the methods or algorithms described in conjunction with the embodiments disclosed herein can be implemented directly by hardware, a software module executed by a processor, or a combination of both. The software module can be located in random access memory (RAM), main memory, read-only memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, hard disk, removable disk, CD-ROM, or any other form of storage medium known in the art.

[0115] The above description of the disclosed embodiments enables those skilled in the art to make or use this application. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of this application. Therefore, this application is not to be limited to the embodiments shown herein, but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. A method for detecting the quality of mobile live streaming, applied to a first device, characterized in that, include: During the live streaming process of the first device, streaming-related data is collected in real time. The streaming-related data includes streaming quality data and spatiotemporal data. The first device is fixed on the moving object, and the moving object moves according to a set route. The spatiotemporal data includes time data and location data. The location data is provided by the positioning module inside the first device. The streaming-related data is reported to the server so that the second device can obtain the streaming-related data from the server. Based on the streaming quality data and the spatiotemporal data, the quality presentation map of the first device on the set route is determined. The quality presentation map is fused with a map containing the set route to obtain a visualized streaming quality map. The streaming quality map contains the set route, and different streaming qualities have different presentation attributes.

2. The mobile live streaming quality detection method according to claim 1, characterized in that, The streaming quality data includes at least one of the following: bitrate, frame rate, frame drop rate, and latency.

3. The mobile live streaming quality detection method according to claim 1, characterized in that, Also includes: The auxiliary judgment data of the first device is obtained and reported to the server, so that the second device can determine the mapping relationship between the auxiliary judgment data and the streaming quality data, so that when the streaming quality map is triggered to display detailed information, the streaming quality data and the auxiliary judgment data are associated and output. The auxiliary judgment data includes at least one of the following: performance data, network type, and device information.

4. A method for detecting the quality of mobile live streaming, applied to a second device, characterized in that, include: Obtain streaming-related data from the first device, which is data collected in real time by the first device during mobile live streaming, including streaming quality data and spatiotemporal data. The first device is fixed on a mobile object, which moves according to a set route. Based on the streaming quality data and the spatiotemporal data, a quality rendering map of the first device on the set route is determined. The quality rendering map is then fused with a map containing the set route to obtain a visualized streaming quality map of the first device. The streaming quality map includes the set route, and different streaming qualities have different rendering attributes. The spatiotemporal data includes time data and location data, and the location data is provided by the positioning module inside the first device. The output displays the push quality map.

5. The mobile live streaming quality detection method according to claim 4, characterized in that, The acquisition of streaming-related data from the first device includes: Obtain the streaming data related to the first device from the server's database.

6. The mobile live streaming quality detection method according to claim 4, characterized in that, The quality presentation diagram includes at least one of the following: a flow quality curve, a flow quality heat map, and a flow quality scatter plot.

7. The mobile live streaming quality detection method according to claim 6, characterized in that, Also includes: Obtain streaming-related data from other devices, and process the streaming-related data from other devices to obtain a quality rendering map of the other devices. The set route corresponding to the other devices is the same as the set route of the first device. The control integrates the quality rendering maps of the other devices into the push flow quality map.

8. The mobile live streaming quality detection method according to claim 7, characterized in that, Also includes: Obtain auxiliary judgment data for the first device and the other devices, wherein the auxiliary judgment data includes at least one of the following: performance data, network type, and device information; Determine the mapping relationship between the auxiliary judgment data and the streaming quality data corresponding to the same device, so that when the streaming quality map is triggered to display detailed information, the streaming quality data and the auxiliary judgment data are associated and output.

9. A mobile live streaming quality testing device, applied to a first device, characterized in that, include: The data collection module is used to collect streaming-related data in real time during the live streaming of the first device. The streaming-related data includes streaming quality data and spatiotemporal data. The first device is fixed on the moving object, and the moving object moves according to a set route. The spatiotemporal data includes time data and location data. The location data is provided by the positioning module inside the first device. The data reporting module is used to report the streaming-related data to the server so that the second device can obtain the streaming-related data from the server. Based on the streaming quality data and the spatiotemporal data, the module determines the quality presentation map of the first device on the set route. The module then merges the quality presentation map with a map containing the set route to obtain a visualized streaming quality map. The streaming quality map contains the set route, and different streaming qualities have different presentation attributes.

10. A mobile live streaming quality testing device, applied to a second device, characterized in that, include: The data acquisition module is used to acquire streaming-related data of the first device. The streaming-related data is data collected in real time by the first device during mobile live streaming, including streaming quality data and spatiotemporal data. The first device is fixed on a moving object, and the moving object moves according to a set route. The spatiotemporal data includes time data and location data. The location data is provided by the positioning module inside the first device. The data processing module is used to determine the quality presentation map of the first device on the set route based on the streaming quality data and the spatiotemporal data, and to fuse the quality presentation map with a map containing the set route to obtain a visualized streaming quality map of the first device. The streaming quality map contains the set route, and different streaming qualities have different presentation attributes. The map display module is used to output and display the streaming quality map.

Images