Playing mode switching method and device

Abstract

The invention relates to the field of intelligent television playing, and provides a playing mode switching method and device in order to improve the watching experience of a user. When the high-definition video is played, the intelligent switching of the playing mode is realized by intelligently identifying the video source parameters, analyzing the system resource occupation condition in real time and combining with the comprehensive study and judgment of the use scene of the user, so that the video playing fluency and stability are remarkably improved, the power consumption is reduced, and the user experience is improved.

Description

Technical Field

[0001] The present invention relates to the field of smart television playback, and in particular to a playback mode switching method and device. Background Art

[0002] In the field of smart TVs, the traditional common playback mode includes audio and video stream demultiplexing, decoding, audio and video synchronization, and rendering, which are usually completed by the application processor (AP). Although this method has strong compatibility, it has defects such as large resource consumption, high power consumption, playback delay, and inaccurate synchronization. The main technical limitations include low CPU decoding efficiency, software parsing dependence on the CPU, system scheduling delay, and limited GPU graphics processing capabilities.

[0003] The Tunneled Playback Mode transfers the video decoding, audio and video synchronization, and rendering work to a dedicated signal processor (DSP), bypassing the traditional application code and Android graphics stack, and can avoid the timing problem caused by the potential deviation between the time when Android requests to render the video and the actual time of the hardware Vsync, thereby providing a more accurate video rhythm and accurately synchronizing to the selected clock (PRC, STC or audio), thereby improving performance and reducing power consumption. However, this mode may have exclusive requirements for DSP resources, may not support multi-channel decoding, and may have defects such as insufficient source format or source fault tolerance compatibility. Summary of the invention

[0004] In order to improve the user's viewing experience, the present application provides a playback mode switching method and device.

[0005] The technical solution adopted by the present invention to solve the above problems is:

[0006] The playback mode switching method includes:

[0007] Step 1: Obtain the parameters of the input video stream, and determine whether the video stream is suitable for entering the tunnel playback mode according to the parameters, and perform numerical processing on the determination result to obtain W1;

[0008] Step 2: collect the current system resource usage in real time, determine whether there are enough remaining resources to support the start of the tunnel playback mode, and perform numerical processing on the determination result to obtain W2;

[0009] Step 3: Identify the user's current usage scenario, determine whether the usage scenario is suitable for entering the tunnel playback mode, and perform numerical processing on the determination result to obtain W3;

[0010] Step 4: Based on W1, W2 and W3, it is comprehensively determined whether it is suitable to enter the tunnel playback mode. If so, switch to the tunnel playback mode, otherwise use the normal playback mode.

[0011] Furthermore, the parameters of the input video stream include resolution, bit rate and encoding format.

[0012] Furthermore, system resources include CPU, memory and GPU.

[0013] Furthermore, usage scenarios include watching movies, live broadcasts and games.

[0014] Furthermore, step 4 is specifically as follows: weights S1, S2 and S3 are set for W1, W2 and W3 respectively, and a decision index T is calculated, T=W1×S1+W2×S2+W3×S3. When T is greater than a threshold, it is suitable to enter the tunnel playback mode. At this time, the tunnel playback mode is switched, otherwise the normal playback mode is used.

[0015] The playback mode switching device comprises:

[0016] Source identification module: used to obtain the parameters of the input video stream;

[0017] Equipment software and hardware resource analysis module: used to collect the resource usage of the current system in real time;

[0018] Scene recognition module: used to identify the user's current usage scenario;

[0019] Mode switching control module: judges whether it is suitable to enter the tunnel playback mode according to the data obtained by the film source recognition module, the equipment software and hardware resource analysis module and the scene recognition module, and performs numerical processing on the judgment results. According to the numerical processing results, it is comprehensively judged whether it is suitable to enter the tunnel playback mode. If so, it switches to the tunnel playback mode, otherwise, it uses the normal playback mode;

[0020] Video decoder: used to handle video decoding tasks in tunnel playback mode;

[0021] Direct rendering module: used to render the video decoded by the video decoder directly to the screen.

[0022] Compared with the prior art, the beneficial effect of the present invention is that when a smart TV plays high-definition video, it realizes intelligent switching of playback modes by intelligently identifying video source parameters, real-time analysis of system resource occupancy, and comprehensive judgment based on user usage scenarios, thereby significantly improving the smoothness and stability of video playback, reducing power consumption, and improving user experience, especially when playing high-definition video content, thereby enhancing the flexibility and adaptability of the system. BRIEF DESCRIPTION OF THE DRAWINGS

[0023] Figure 1 This is a flowchart of the playback mode switching method. DETAILED DESCRIPTION

[0024] In order to make the purpose, technical solution and advantages of the present invention more clearly understood, the present invention is further described in detail below in conjunction with the embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not used to limit the present invention.

[0025] like Figure 1 As shown, the playback mode switching method includes:

[0026] Step 1: Obtain the parameters of the input video stream, and determine whether the video stream is suitable for entering the tunnel playback mode based on the parameters, and perform numerical processing on the determination result to obtain W1; the parameters of the input video stream include resolution, bit rate and encoding format.

[0027] Step 2: collect the current system resource usage in real time, determine whether there are enough remaining resources to support the start of the tunnel playback mode, and digitize the determination result to obtain W2; the system resources include CPU, memory and GPU.

[0028] Step 3: Identify the user's current usage scenario, determine whether the usage scenario is suitable for entering the tunnel playback mode, and digitize the determination result to obtain W3; usage scenarios include watching movies, live broadcasts, and games.

[0029] Step 4: Based on W1, W2 and W3, it is comprehensively determined whether it is suitable to enter the tunnel playback mode. If so, switch to the tunnel playback mode, otherwise use the normal playback mode.

[0030] W1, W2 and W3 can be judged separately, such as only when W1, W2 and W3 reach the corresponding preset values, it is considered suitable to enter the tunnel playback mode. W1, W2 and W3 can also be judged comprehensively, such as when their sum reaches a certain threshold, it is considered suitable to enter the tunnel playback mode. The two methods can also be combined, that is, when they reach the corresponding preset values ​​and the sum reaches a certain threshold, it is considered suitable to enter the tunnel playback mode.

[0031] In this embodiment, a comprehensive judgment method is adopted to set weights S1, S2 and S3 for W1, W2 and W3 respectively. The weight values ​​can be set according to actual conditions, and the decision index T is calculated, T = W1×S1+W2×S2+W3×S3. When T is greater than the threshold, it is suitable to enter the tunnel playback mode. At this time, switch to the tunnel playback mode, otherwise use the normal playback mode.

[0032] Assume that the resolution of the current input video stream is 4096x2048, the bit rate is 24Mbps, and the encoding format is H.265. Based on these parameters, the score of the video stream parameters is 85 (full score is 100), that is, W1=85, and the weight S1=0.4 is set.

[0033] The CPU usage of the current system is 30%, the memory usage is 40%, and the GPU usage is 20%. According to the usage of the CPU, memory, GPU and other resources of the current system, the system resource score is set to 75 (the full score is 100), that is, W2=75, and the weight S2=0.3 is set.

[0034] Assume that the user is currently watching a movie. According to the user's usage scenario, the usage scenario score is set to 90 (the full score is 100), that is, W3=90, and the weight S3=0.3 is set.

[0035] Calculate the final switching decision index T = W1×S1+W2×S2+W3×S3=85×0.4+75×0.3+90×0.3=34+22.5+27=83.5.

[0036] Assume that the set threshold is 80. Since T=83.5≥80, the switching condition is met and switching to the tunnel mode is allowed.

[0037] Before enabling tunnel mode, query the AudioTrack session ID from AudioManager. Configure the video decoder in tunnel mode, set MediaCodec to support tunnel playback mode, create AudioTrack using the queried session ID, and set the AudioAttributes flag FLAG_HW_AV_SYNC; once entering tunnel playback mode, hand over the video decoding task to the dedicated hardware decoder. For the video decoder, do not call the dequeueOutputBuffer and releaseOutputBuffer methods, use the AudioTrack write API, which will automatically build additional header information containing the timestamp corresponding to the data being written; ensure accurate synchronization of the video playback clock through the high-precision clock synchronization module; and render the decoded video directly to the screen by the display controller through the direct rendering module.

[0038] The playback mode switching device comprises:

[0039] Source identification module: used to obtain the parameters of the input video stream;

[0040] Equipment software and hardware resource analysis module: used to collect the resource usage of the current system in real time;

[0041] Scene recognition module: used to identify the user's current usage scenario;

[0042] Mode switching control module: judge whether it is suitable to enter the tunnel playback mode according to the data obtained by the film source identification module, the equipment software and hardware resource analysis module and the scene identification module, and perform numerical processing on the judgment results. According to the numerical processing results, it is comprehensively judged whether it is suitable to enter the tunnel playback mode. If so, switch to the tunnel playback mode, otherwise use the normal playback mode.

Claims

1. A playback mode switching method, characterized in that: include: Step 1: Obtain the parameters of the input video stream, and determine whether the video stream is suitable for entering the tunnel playback mode according to the parameters, and perform numerical processing on the determination result to obtain W1; Step 2: collect the current system resource usage in real time, determine whether there are enough remaining resources to support the start of the tunnel playback mode, and perform numerical processing on the determination result to obtain W2; Step 3: Identify the user's current usage scenario, determine whether the usage scenario is suitable for entering the tunnel playback mode, and perform numerical processing on the determination result to obtain W3; Step 4: Based on W1, W2 and W3, it is comprehensively determined whether it is suitable to enter the tunnel playback mode. If so, switch to the tunnel playback mode, otherwise use the normal playback mode.

2. The playback mode switching method according to claim 1, characterized in that: The parameters of the input video stream include resolution, bit rate and encoding format.

3. The playback mode switching method according to claim 1, characterized in that: System resources include CPU, memory, and GPU.

4. The playback mode switching method according to claim 1, characterized in that: Usage scenarios include watching movies, live shows and games.

5. The playback mode switching method according to any one of claims 1 to 4, characterized in that: Step 4 is specifically as follows: weights S1, S2 and S3 are set for W1, W2 and W3 respectively, and the decision index T is calculated, T = W1×S1+W2×S2+W3×S3. When T is greater than the threshold, it is suitable to enter the tunnel playback mode. At this time, switch to the tunnel playback mode, otherwise use the normal playback mode.

6. A playback mode switching device, characterized in that: include: Source identification module: used to obtain the parameters of the input video stream; Equipment software and hardware resource analysis module: used to collect the resource usage of the current system in real time; Scene recognition module: used to identify the user's current usage scenario; Mode switching control module: judges whether it is suitable to enter the tunnel playback mode according to the data obtained by the film source recognition module, the equipment software and hardware resource analysis module and the scene recognition module, and performs numerical processing on the judgment results. According to the numerical processing results, it is comprehensively judged whether it is suitable to enter the tunnel playback mode. If so, it switches to the tunnel playback mode, otherwise, it uses the normal playback mode; Video decoder: used to handle video decoding tasks in tunnel playback mode; Direct rendering module: used to render the video decoded by the video decoder directly to the screen.

Images