Display device and video image quality adjusting method

Abstract

The invention provides a display device and a video image quality adjusting method. After the display device starts playing the first video, the video state of the first video is monitored through the video adaptation module. And if the first video is provided by the homepage video application, starting playing timing of the first video when the video state called back by the homepage video application is playing start. Since the playing start of the homepage video application callback can accurately represent the playing start of the feature film content, the playing time of the first video after starting to play the feature film can be accurately reflected based on the playing timing of the playing start of the homepage video application callback. Based on the playing timing, the video picture corresponding to the feature film content can be accurately captured, and it is ensured that the user stays for enough time in the first video, so that the validity of the picture quality parameter determined based on the picture screenshot is ensured.

Description

Technical Field

[0001] This application relates to the field of display device technology, and in particular to a display device and a method for adjusting video quality. Background Technology

[0002] Display devices refer to terminal devices capable of outputting specific display images, such as smart TVs, mobile terminals, smart advertising screens, and projectors. Taking smart TVs as an example, smart TVs are television products based on Internet application technologies, possessing open operating systems and chips, and having open application platforms. They enable two-way human-computer interaction and integrate multiple functions such as audio-visual, entertainment, and data to meet diverse and personalized user needs.

[0003] When a display device plays a video, it can use Artificial Intelligence Picture Quality (AIPQ) technology to analyze the currently playing video frame, determine the picture quality parameters that match the current video frame, and use these picture quality parameters to process the video frame to improve the video's picture quality.

[0004] Each third-party video application develops its own AIPQ interface to support AIPQ functionality. If a third-party video application does not provide an AIPQ interface, or if the provided AIPQ interface is incompatible with the AIPQ module in the display device, the display device will be unable to perform AIPQ processing on the video provided by that third-party video application, thus failing to adjust the image quality parameters for the real-time video content. Furthermore, before using AIPQ technology to analyze the video frame, it is necessary to take screenshots of the video frame; these screenshots serve as the image data for the analysis. However, if the timing of screenshot processing cannot be accurately determined, the screenshots may not accurately represent the main content of the video, resulting in the subsequently determined image quality parameters failing to meet the video's quality requirements. Summary of the Invention

[0005] This application provides a display device and a method for adjusting video quality, which can perform AIPQ processing on videos provided by third-party video applications and effectively capture screenshots representing the main content of the video.

[0006] In a first aspect, this application provides a display device, comprising:

[0007] monitor;

[0008] The controller, coupled to the display, is configured to:

[0009] In response to the start-up command of the first video, the video status of the first video is monitored through the video adaptation module;

[0010] After the video adaptation module listens to the first video status called back by the platform playback framework, it identifies the first video source corresponding to the first video and reads the recorded video status corresponding to the first video recorded in the video adaptation module.

[0011] If the first video source is a homepage video application, and the recorded video status is stopped playing while the first video status is started playing, the video adaptation module is controlled not to start the playback timer for the first video.

[0012] After the video adaptation module detects the second video status callback from the homepage video application and the second video status is "start playing", it controls the video adaptation module to start the playback timer for the first video and updates the recorded video status to "start playing".

[0013] When the playback time reaches the first duration threshold, a screenshot is taken of the video frame corresponding to the current playback progress to obtain the first screenshot.

[0014] Artificial intelligence image quality optimization technology is used to perform image recognition on the first screenshot to obtain a first image quality parameter that matches the first screenshot.

[0015] Control the display to play the first video with the first image quality parameters.

[0016] The above technical solution has the following beneficial effects or advantages:

[0017] After the display device starts playing the first video, it monitors the video status of the first video through the video adaptation module. If the first video is provided by the homepage video application, and the recorded video status is "stopped," the playback timer for the first video will not be started when the video status is "started" according to the platform playback framework callback. The playback timer will only be started when the video status is "started" according to the homepage video application callback. Since the "started playback" callback from the homepage video application accurately represents the start of the main content playback, the playback timer started based on this callback can accurately reflect the duration of the first video playback after the main content begins. Based on this playback timer, the video frame corresponding to the main content can be accurately captured, ensuring that the user stays on the first video for a sufficient amount of time, thereby guaranteeing the validity of the image quality parameters determined based on this screenshot.

[0018] In some embodiments of this application, the controller is further configured to:

[0019] If the first video source is a third-party video application, when the recorded video status is stopped and the first video status is started, the video adaptation module is controlled to start the playback timer for the first video and update the recorded video status to start playback.

[0020] When the playback time reaches the second duration threshold, a screenshot is taken of the video frame corresponding to the current playback progress to obtain a second screenshot.

[0021] Artificial intelligence image quality optimization technology is used to perform image recognition on the second screenshot to obtain second image quality parameters that match the second screenshot;

[0022] Control the display to play the first video with the second image quality parameters.

[0023] The above technical solution has the following beneficial effects or advantages:

[0024] If the first video is provided by a third-party video application, playback timing for the first video is initiated when the platform's playback framework callback indicates that playback has started. Since the platform's playback framework cannot accurately determine whether the main content of the first video has begun playing, a second duration threshold sufficient to start playback is set, and the decision to begin playback is based on the first video's playback timing. Based on this, when the playback timing duration is greater than or equal to the second duration threshold, the video frame corresponding to the main content can be accurately captured, thus ensuring the validity of the image quality parameters determined based on this screenshot.

[0025] In some embodiments of this application, before the controller identifies the first video source corresponding to the first video and reads the recorded video status corresponding to the first video recorded in the video adaptation module, it is further configured to:

[0026] The video adaptation module listens for video information that is called back by the platform playback framework in response to the start-up command.

[0027] After the video adaptation module detects the video information called back by the platform playback framework, it identifies the total video duration included in the video information.

[0028] If the total duration of the video is greater than or equal to a preset duration threshold, the image quality parameter adjustment function is enabled. After the image quality parameter adjustment function is enabled, the first video source corresponding to the first video is identified, and the recorded video status corresponding to the first video recorded in the video adaptation module is read.

[0029] If the total video duration is less than the preset duration threshold, the image quality parameter adjustment function remains off.

[0030] The above technical solution has the following beneficial effects or advantages:

[0031] The display device can listen to the video information callbackd by the platform playback framework through the video adaptation module, and thus determine the total duration of the first video. Based on this, the display device can activate the image quality parameter adjustment function when the total video duration is long enough, and not activate the image quality parameter adjustment function when the total video duration is short, so as to avoid adjusting the image quality parameters too frequently due to the video ending too quickly.

[0032] In some embodiments of this application, the controller controls the video adaptation module to start timing the playback of the first video, specifically configured as follows:

[0033] In response to the pause command of the first video, after the video adaptation module detects that the status of the first video is paused playback as called back by the platform playback framework, the recorded video status corresponding to the first video is read from the video adaptation module.

[0034] When the recorded video status is "start playing", the video adaptation module is controlled to pause the playback timing of the first video and update the recorded video status to "pause playing".

[0035] In response to the playback command of the first video, after the video adaptation module detects that the status of the first video, which is called by the platform playback framework, is "start playing", the recorded video status corresponding to the first video is read from the video adaptation module.

[0036] When the recorded video is in a paused playback state, the video adaptation module is controlled to resume the playback timing of the first video and update the recorded video status to start playback.

[0037] The above technical solution has the following beneficial effects or advantages:

[0038] After the display device starts timing the playback of the first video, it can accurately monitor the paused and resumed playback status of the first video through the video adaptation module. Based on the monitored video status, it controls the pause and resume timing to accurately count the effective playback duration of the first video, and thus more accurately determine whether to start playing the main content of the first video.

[0039] In some embodiments of this application, after the controller controls the video adaptation module to start timing the playback of the first video, it is further configured to:

[0040] In response to the stop playback command of the first video, after the video adaptation module detects that the status of the first video is stopped by the callback of the platform playback framework, the recorded video status corresponding to the first video is read from the video adaptation module.

[0041] When the recorded video is in a state of start playing or paused playing, the video adaptation module is controlled to turn off the playback timer for the first video and update the recorded video state to stop playing.

[0042] The above technical solution has the following beneficial effects or advantages:

[0043] After the display device starts the playback timer for the first video, it can accurately monitor the video status when the first video stops playing through the video adaptation module, and control the termination of the timer based on the monitored video status to terminate the process of adjusting the image quality parameters of the first video.

[0044] In some embodiments of this application, after the controller controls the video adaptation module to start timing the playback of the first video, it is further configured to:

[0045] In response to the progress adjustment instruction of the first video, after the progress adjustment event of the first video is detected by the platform playback framework through the video adaptation module, the recorded video status corresponding to the first video is read from the video adaptation module.

[0046] When the recorded video is in a state of start playing or paused playing, the video adaptation module is controlled to restart the playback timing of the first video and update the recorded video state to start playing.

[0047] The above technical solution has the following beneficial effects or advantages:

[0048] After the display device starts the playback timer for the first video, it can accurately monitor the progress adjustment event of the first video through the video adaptation module. Based on the monitored progress adjustment event, it controls the restart of the playback timer to accurately count the playback duration of the first video after the playback progress is adjusted. Based on this re-counted duration, it can not only ensure that the main content of the first video is captured, but also accurately determine whether the user has stayed for a sufficient amount of time after the playback progress of the first video is adjusted, so as to ensure the validity of the captured video footage.

[0049] In some embodiments of this application, the controller is further configured to:

[0050] The video adaptation module listens to the scene mode of the first video called back by the homepage video application; wherein, in different scene modes, the display area of ​​the video image on the screen is different;

[0051] When the playback timer reaches a first duration threshold, the controller takes a screenshot of the video frame corresponding to the current playback progress to obtain a first screenshot, which is specifically configured as follows:

[0052] Based on the scene mode of the first video received by the homepage video application through the video adaptation module, and the pre-stored correspondence between scene modes and screenshot modes, the first screenshot mode corresponding to the scene mode of the first video is determined; wherein, in different screenshot modes, the screenshot area on the screen is different, and the screenshot area matches the display area of ​​the video screen on the screen in the scene mode corresponding to the screenshot mode.

[0053] When the playback time reaches the first duration threshold, a screenshot is taken of the video frame corresponding to the current playback progress according to the first screenshot mode to obtain the first screenshot.

[0054] The above technical solution has the following beneficial effects or advantages:

[0055] If the first video is provided by the homepage video application, the homepage video application can also provide the scene mode of the first video. In this way, the display device can accurately determine the corresponding first screenshot mode based on the scene mode of the first video, and perform screenshot processing on the video screen of the first video in the first screenshot mode to ensure that the obtained first screen screenshot can be adapted to the effective video screen and minimize invalid screens such as black borders in the video.

[0056] In some embodiments of this application, the controller, in response to a start-up command for the first video, after monitoring the video status of the first video through the video adaptation module, is further configured to:

[0057] After the video adaptation module detects a video playback event called back by the platform playback framework, it identifies the path information corresponding to the first video included in the video playback event.

[0058] Using the path information as the key and the recorded video status corresponding to the first video as the value, a key-value pair corresponding to the first video is created; wherein, the initial recorded video status corresponding to the first video is stopped playing.

[0059] The above technical solution has the following beneficial effects or advantages:

[0060] After the first video starts playing, the display device maintains the recorded video status corresponding to the first video in key-value pairs through the video adaptation module. Using the video path information as the key ensures the uniqueness, accuracy, and stability of the key-value pairs, thereby guaranteeing the accuracy of the recorded video status and the accuracy of playback timing based on the recorded video status, ultimately ensuring the validity of subsequent screenshots.

[0061] Secondly, embodiments of this application also provide a method for adjusting video quality, applied to a display device, the method comprising:

[0062] In response to the start-up command of the first video, the video status of the first video is monitored through the video adaptation module;

[0063] After the video adaptation module listens to the first video status called back by the platform playback framework, it identifies the first video source corresponding to the first video and reads the recorded video status corresponding to the first video recorded in the video adaptation module.

[0064] If the first video source is a homepage video application, and the recorded video status is stopped playing while the first video status is started playing, the video adaptation module is controlled not to start the playback timer for the first video.

[0065] After the video adaptation module detects the second video status callback from the homepage video application and the second video status is "start playing", it controls the video adaptation module to start the playback timer for the first video and updates the recorded video status to "start playing".

[0066] When the playback time reaches the first duration threshold, a screenshot is taken of the video frame corresponding to the current playback progress to obtain the first screenshot.

[0067] Artificial intelligence image quality optimization technology is used to perform image recognition on the first screenshot to obtain a first image quality parameter that matches the first screenshot.

[0068] Play the first video with the first image quality parameters.

[0069] The above technical solution has the following beneficial effects or advantages:

[0070] After the display device starts playing the first video, it monitors the video status of the first video through the video adaptation module. If the first video is provided by the homepage video application, and the recorded video status is "stopped," the playback timer for the first video will not be started when the video status is "started" according to the platform playback framework callback. The playback timer will only be started when the video status is "started" according to the homepage video application callback. Since the "started playback" callback from the homepage video application accurately represents the start of the main content playback, the playback timer started based on this callback can accurately reflect the duration of the first video playback after the main content begins. Based on this playback timer, the video frame corresponding to the main content can be accurately captured, ensuring that the user stays on the first video for a sufficient amount of time, thereby guaranteeing the validity of the image quality parameters determined based on this screenshot.

[0071] In some embodiments of this application, the method further includes:

[0072] If the first video source is a third-party video application, when the recorded video status is stopped and the first video status is started, the video adaptation module is controlled to start the playback timer for the first video and update the recorded video status to start playback.

[0073] When the playback time reaches the second duration threshold, a screenshot is taken of the video frame corresponding to the current playback progress to obtain a second screenshot.

[0074] Artificial intelligence image quality optimization technology is used to perform image recognition on the second screenshot to obtain second image quality parameters that match the second screenshot;

[0075] Play the first video with the second image quality parameters.

[0076] The above technical solution has the following beneficial effects or advantages:

[0077] If the first video is provided by a third-party video application, playback timing for the first video is initiated when the platform's playback framework callback indicates that playback has started. Since the platform's playback framework cannot accurately determine whether the main content of the first video has begun playing, a second duration threshold sufficient to start playback is set, and the decision to begin playback is based on the first video's playback timing. Based on this, when the playback timing duration is greater than or equal to the second duration threshold, the video frame corresponding to the main content can be accurately captured, thus ensuring the validity of the image quality parameters determined based on this screenshot. Attached Figure Description

[0078] To more clearly illustrate the technical solution of this application, the drawings used in the embodiments will be briefly introduced below. Obviously, for those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0079] Figure 1 This is a schematic diagram illustrating the operation scenario between the display device 200 and the control device 100 in an embodiment of this application;

[0080] Figure 2 This is a hardware configuration block diagram of the display device 200 in this embodiment of the application;

[0081] Figure 3 This is a diagram showing the operating system configuration of the display device 200 in this embodiment of the application;

[0082] Figure 4 This is a flowchart illustrating how the display device 200 adjusts video quality in an embodiment of this application.

[0083] Figure 5 This is a timing diagram of the display device 200 adjusting video quality in an embodiment of this application;

[0084] Figure 6 A flowchart illustrating the creation of a media asset information list by the display device 200 in this application embodiment;

[0085] Figure 7 This is a schematic diagram of the data structure of the media asset information list in an embodiment of this application;

[0086] Figure 8 This is another flowchart illustrating how the display device 200 adjusts video quality in an embodiment of this application;

[0087] Figure 9 This is a flowchart illustrating how the display device 200 determines whether to enable the image quality parameter adjustment function in an embodiment of this application.

[0088] Figure 10 This is a flowchart illustrating how the display device 200 times the playback of the first video in an embodiment of this application.

[0089] Figure 11 This is a timing diagram showing the timing of the display device 200 playing the first video in an embodiment of this application.

[0090] Figure 12 This is another flowchart illustrating how the display device 200 times the playback of the first video in an embodiment of this application.

[0091] Figure 13 This is another flowchart illustrating how the display device 200 times the playback of the first video in an embodiment of this application.

[0092] Figure 14 This is a flowchart illustrating how the display device 200 performs screenshot processing on video images based on scene modes in this embodiment of the application. Detailed Implementation

[0093] The embodiments will now be described in detail, examples of which are illustrated in the accompanying drawings. When the following description relates to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The embodiments described below do not represent all embodiments consistent with this application. They are merely examples of systems and methods consistent with some aspects of this application as detailed in the claims.

[0094] It should be noted that the brief descriptions of terms in this application are only for the convenience of understanding the embodiments described below, and are not intended to limit the embodiments of this application. Unless otherwise stated, these terms should be understood in their ordinary and common meaning.

[0095] The terms "first," "second," "third," etc., used in the specification, claims, and accompanying drawings of this application are used to distinguish similar or related objects or entities, and do not necessarily imply a specific order or sequence, unless otherwise specified. It should be understood that such terms are interchangeable where appropriate.

[0096] The terms “comprising” and “having”, and any variations thereof, are intended to cover but not exclude inclusion, for example, a product or device that includes a range of components is not necessarily limited to all of the components that are clearly listed, but may include other components that are not clearly listed or that are inherent to such product or device.

[0097] In this application embodiment, "display device" refers to a device with screen display and data processing capabilities. For example, display devices include, but are not limited to, smart TVs, mobile terminals, computers, monitors, advertising screens, wearable devices, virtual reality devices, and augmented reality devices.

[0098] Figure 1 This is a schematic diagram illustrating an operational scenario between a display device and a control device provided in some embodiments of this application. For example... Figure 1 As shown, users can operate the display device 200 via touch, voice, mobile terminal 300, and control device 100. For example, control device 100 can be a remote control, stylus, gamepad, etc.

[0099] like Figure 1 The diagram also shows that the display device 200 communicates with the server 400 via various communication methods. This allows the display device 200 to communicate via a local area network (LAN), a wireless local area network (WLAN), and other networks.

[0100] Display device 200 can provide broadcast television reception function, and can also be equipped with intelligent network television function that provides computer support, including but not limited to network television, smart television, Internet Protocol television (IPTV), etc.

[0101] Figure 2 Provided for some embodiments of this application Figure 1 Hardware configuration block diagram of display device 200.

[0102] In some embodiments, the display device 200 may include at least one of a tuner 210, a communication device 220, a detector 230, a device interface 240, a controller 250, a display 260, an audio output device 270, a user input interface 280, a memory, and a power supply.

[0103] In some embodiments, the communication device 220 is a component for communicating with external devices or the server 400 according to various communication protocol types. The display device 200 may be equipped with multiple communication devices 220 depending on the supported communication methods. The communication devices 220 can enable the display device 200 to communicate with the external devices or the server 400 via wireless or wired connections.

[0104] In some embodiments, detector 230 is used to acquire signals from the external environment or to interact with the outside world. For example, detector 230 includes a light receiver, a sensor for acquiring ambient light intensity; or, detector 230 includes an image acquisition device, such as a camera, which can be used to acquire external environmental scenes, user attributes, or user interaction gestures; or, detector 230 includes a sound acquisition device, such as a microphone, for receiving external sounds.

[0105] In some embodiments, device interface 240 is used to connect to an external device.

[0106] In some embodiments, the controller 250 is used to control the overall operation of the display device 200. The controller 250 may include at least one of a central processing unit (CPU), a video processor, an audio processor, a graphics processing unit (GPU), and a power processor, and a first to an nth interface for input / output. The controller 250 controls the operation of the display device 200 and responds to user operations through various software control programs stored in memory.

[0107] In some embodiments, the controller 250 and the tuner 210 may be located in different separate devices, that is, the tuner 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box.

[0108] In some embodiments, the display 260 is used to receive and display image signals output from the controller 250. The display 260 may include display function components for presenting images and driving components for driving image display.

[0109] In some embodiments, a user can input user commands on a graphical user interface (GUI) displayed on a display 260, and a user input interface 280 can receive user commands through the GUI.

[0110] In some embodiments, the audio output device 270 may be a built-in speaker of the display device 200 or an external audio output device connected to the display device 200.

[0111] In some embodiments, the user input interface 280 can be used to receive instructions from user input.

[0112] In some embodiments, the video wall device 200 may run an operating system to enable user interaction. An operating system is a computer program used to manage and control the hardware and software resources of the video wall device 200.

[0113] The operating system can be a native operating system based on a specific operating platform, a third-party operating system that is deeply customized based on a specific operating platform, or an independent operating system specifically developed for splicing screen devices.

[0114] An operating system can be divided into different modules or levels based on the functions it implements, for example... Figure 3 As shown, in some embodiments, the system can be divided into four layers, from top to bottom: the Applications layer (referred to as the "Application Layer"), the Application Framework layer (referred to as the "Framework Layer"), the System Runtime Library layer, and the Kernel Layer.

[0115] In some embodiments, the application layer provides services and interfaces for applications, enabling the video wall device 200 to run applications and interact with users based on the applications. For example, the application layer may include a voice assistant, which provides voice interaction functionality, allowing users to interact with the display device via voice.

[0116] The framework layer provides application programming interfaces (APIs) and programming frameworks for applications. The application framework layer includes predefined functions. It acts as a central processing unit, determining the actions taken by applications within the application layer. Through the API, applications can access system resources and obtain system services during execution.

[0117] In some embodiments, the system runtime library layer can provide support for the framework layer. When the framework layer is used, the operating system runs the instruction library contained in the system runtime library layer, such as the C / C++ instruction library, to implement the functions to be performed by the framework layer.

[0118] In some embodiments, the kernel layer is a functional layer between the hardware and software of the video wall device 200. The kernel layer can implement functions such as hardware abstraction, multitasking, and memory management.

[0119] It should be noted that the above examples are merely a simple division of operating system functions and do not limit the specific operating system form of the splicing screen device 200 in this application embodiment. Depending on factors such as the function of the display device and the type of operating system, the number of layers and the specific type of the operating system may take other forms.

[0120] When playing a video, the display device 200 can use Artificial Intelligence Picture Quality (AIPQ) technology to analyze the currently playing video frame, determine the picture quality parameters that match the current video frame, and use the picture quality parameters to process the video frame to improve the picture quality effect of the video.

[0121] Each third-party video application develops its own AIPQ interface to support AIPQ functionality. If a third-party video application does not provide an AIPQ interface, or if the provided AIPQ interface is incompatible with the AIPQ module in the display device, the display device 200 will be unable to perform AIPQ processing on the video provided by that third-party video application, thus failing to adjust the image quality parameters for the real-time video content. Furthermore, before using AIPQ technology to analyze the video frame, it is necessary to take screenshots of the video frame; these screenshots serve as the image data for the image analysis. However, if the timing of the screenshot processing cannot be accurately determined, the screenshots may not accurately represent the main content of the video, resulting in the subsequently determined image quality parameters failing to meet the video's image quality requirements.

[0122] To address the aforementioned issues, the display device 200 provided in this application embodiment supports a quality adjustment function that adjusts the image quality of videos provided by different video sources. The display device 200 adds a configured video adaptation module to uniformly monitor the video status provided by different video sources. Based on the video status monitored by the video adaptation module and the system's screenshot function, the display device 200 accurately captures valid video frames and performs AIPQ processing on the screenshots to determine the target image quality parameters matching the screenshots. This not only allows for accurate control of the timing of screenshot processing but also meets the need for AIPQ processing on videos provided by various video sources (including third-party video applications).

[0123] In some embodiments, reference may be made to Figure 3 The operating system shown here, in order to implement the image quality adjustment function of the display device 200 in this embodiment, includes a homepage video application and a third-party video application in its application layer.

[0124] The homepage video application is a native media asset application of the display device 200. The third-party video application is a media asset application provided by a third party and downloaded and installed onto the display device 200. The image quality application is used to support processing video images according to the set image quality parameters.

[0125] The operating system's framework layer includes image quality adjustment services, video adaptation modules, and platform playback frameworks.

[0126] Among them, the image quality adjustment service is a system service used to support the image quality adjustment function. The image quality adjustment service can manage the execution of screenshot processing, the execution of AIPQ processing, and the setting of image quality parameters.

[0127] The video adaptation module serves the system and is used to collaboratively manage the video status of multiple video sources. The video adaptation module may include a status management module, a playback timing module, and a media asset information module. The status management module records the video status (referred to as "record video status" in this embodiment, and can be denoted as "last_status"). The playback timing module is used to calculate the effective playback duration of the video. The media asset information module records video-related information.

[0128] The platform playback framework provides a unified media playback control API for managing the underlying decoding and rendering processes.

[0129] The operating system's runtime library layer includes APIs for screenshot functionality and APIs for AIPQ functionality.

[0130] Based on such Figure 3The operating system shown indicates that the display device 200 can support AIPQ processing of videos from different video sources and adjust the image quality.

[0131] Figure 4 This is a flowchart illustrating how the display device 200 adjusts video quality in an embodiment of this application. The specific steps are as follows:

[0132] Step S401: In response to the start playback command of the first video, the video status of the first video is monitored through the video adaptation module.

[0133] After the display device 200 is powered on, it starts a picture quality adjustment service to provide picture quality adjustment functions. After starting, the picture quality adjustment service performs a pre-loading process. This pre-loading process includes controlling the loading of the server providing AIPQ functionality and controlling the loading of the video adaptation module. After the pre-loading process is completed, if a video is started and picture quality adjustment processing is applied to it, the video adaptation module and AIPQ functionality can be quickly invoked to improve the efficiency of picture quality adjustment.

[0134] Figure 5 This is a timing diagram showing the adjustment of video quality by the display device 200 in an embodiment of this application. (In conjunction with...) Figure 5 After the device boots up, it starts the image quality adjustment service, and then controls the loading of the video adaptation module.

[0135] Combination Figure 5 During the loading process, the video adaptation module registers video playback event listeners with both the homepage video application and the platform playback framework. The homepage video application registers listeners for video playback initiation operations. The platform playback framework also registers listeners for video playback initiation operations.

[0136] Based on the listener-callback mechanism, after the homepage video application detects the operation to launch the homepage video, it calls back the corresponding playback event to the video adaptation module. Similarly, after the platform playback framework detects the operation to launch a video (either a video provided by the homepage video application or a video provided by a third-party video application), it calls back the corresponding playback event to the video adaptation module.

[0137] In some embodiments, the playback event corresponding to the video includes: video path information, video information, and video status. The video status monitored by the video adaptation module can be denoted as current_status.

[0138] In some embodiments, video information may include the total video duration.

[0139] In some embodiments, the video status may include start, idle, and pause.

[0140] In some embodiments, the video source corresponding to the first video can be a homepage video application, that is, the first video is a homepage video; the video source corresponding to the first video can be a third-party video application, that is, the first video is a third-party video.

[0141] In some embodiments, the start command for the first video can be an instruction entered by the user when selecting the media asset item of the first video.

[0142] In some embodiments, the instruction to start playing the first video can be a power-on instruction, and the display device 200 is configured to power on and play the first video.

[0143] In some embodiments, the start command for the first video can be a media asset switching command input by the user.

[0144] In some embodiments, the start instruction for the first video can be a playback instruction for the next video (the first video) generated after the display device 200 detects that the previous video has finished playing.

[0145] In response to the start-up command of the first video, the display device 200 can accurately monitor the video status of the first video through the video adapter module.

[0146] In some embodiments, the display device 200 manages information related to the currently displayed video, such as path information, recorded video status, and video information, through a media asset information list.

[0147] In some embodiments, the currently displayed video can be a single video. The currently displayed video can be multiple videos, such as multiple videos playing simultaneously in a multi-window mode (e.g., picture-in-picture mode, split-screen mode, free split-screen mode, etc.).

[0148] In some embodiments, the currently displayed video can be a video group, such as a video group consisting of an advertisement and a main feature. In this case, the currently displayed videos are each video in that video group in sequence. If the platform's playback framework decodes each video in the video group, the media asset information list includes relevant information for each video in the video group.

[0149] Figure 6 The flowchart for creating a media asset information list for the display device 200 in this application embodiment is as follows:

[0150] Step S601: After the video playback event called back by the platform playback framework is detected by the video adaptation module, the path information corresponding to the first video included in the video playback event is identified.

[0151] After the display device 200 listens to the video playback event called back by the platform playback framework through the video adaptation module, it can identify the path information corresponding to the first video from the video playback event through the video adaptation module.

[0152] In some embodiments, the display device 200 can also identify video information and video status corresponding to the first video from the video playback event through the video adaptation module.

[0153] Step S602: Create a key-value pair corresponding to the first video, using the path information as the key and the recorded video status corresponding to the first video as the value.

[0154] The video adaptation module identifies whether the media asset information list includes the path information corresponding to the first video. If the media asset information list does not include the path information corresponding to the first video, a key-value pair corresponding to the first video is created, where the path information of the first video is the key and the recorded video status corresponding to the first video is the value.

[0155] In some embodiments, when creating the key-value pair corresponding to the first video, the initial recorded video state corresponding to the first video is stopped playing.

[0156] If the media asset information list is found to include the path information corresponding to the first video, the value data in the key-value pair corresponding to the first video can be updated using the video information and video status identified this time.

[0157] In some embodiments, the display device 200 can also listen to video playback events called back by the homepage video application through the video adaptation module, and create or update key-value pairs corresponding to the first video based on the listened video playback events. This process can be referred to steps S601 to S602. That is, the video adaptation module manages the media asset information list based on the video playback events called back by the homepage video application and the video playback events called back by the platform playback framework.

[0158] The video playback event called back by the homepage video application can include path information, video information, video status, etc., corresponding to the first video.

[0159] The video information provided by the homepage video application may include scene modes, etc.

[0160] The video status provided by the homepage video application can include start playing and stop playing.

[0161] For the same video, the path information of the homepage video application callback is consistent with the path information of the platform playback framework callback.

[0162] In some embodiments, the list of media asset information stored in the video adaptation module is a media bean data type.

[0163] Taking the simultaneous display of two videos (Video 1 and Video 2) on display device 200 as an example, you can refer to... Figure 7 The media asset information list shown includes relevant information for Video 1 and Video 2, stored using the Media Bean data type. The list includes the path information for Video 1 (e.g., path_1), video status (e.g., status_idle), and total video duration (e.g., duration_60000ms). The list also includes the path information for Video 2 (e.g., path_2), video status (e.g., status_idle), and total video duration (e.g., duration_3600000ms).

[0164] Based on the above embodiments, using the video path information as the key can ensure the uniqueness, accuracy, and stability of the key-value pairs, thereby ensuring the accuracy of the recorded video state of the first video and the accuracy of subsequent tasks based on the recorded video state, such as playback timing, and thus ensuring the validity of subsequent screenshots.

[0165] Step S402: After listening to the first video status callback from the platform playback framework through the video adaptation module, identify the first video source corresponding to the first video, and read the recorded video status corresponding to the first video recorded in the video adaptation module.

[0166] After the display device 200 listens to the video playback event called back by the platform playback framework through the video adaptation module, the video adaptation module can identify the video state of the first video, i.e., the first video state, from the video playback event.

[0167] Combination Figure 5 After the video adaptation module detects the status of the first video, it identifies the first video source corresponding to the first video.

[0168] In some embodiments, when the platform playback framework calls back a video playback event, it can access the name of the currently running application through the application management interface. The platform playback framework can then add the application name to the video playback event and call back to the video adaptation module. After recognizing the application name from the video playback event, the video adaptation module can identify the first video source corresponding to the first video based on the application name.

[0169] If the application name belongs to the pre-stored application list, the first video source corresponding to the first video can be determined to be the homepage video application, and it is recorded as source=local.

[0170] If the application name does not belong to the pre-stored application list, it can be determined that the first video source corresponding to the first video is a third-party video application, and it is recorded as source=other.

[0171] The pre-stored application list includes the application names of each homepage video application.

[0172] After determining the first video source, the video adaptation module can update the key-value pairs corresponding to the first video based on the determined first video source. In one example, if source = local, the video adaptation module can add source = local to the value data corresponding to the first video.

[0173] The display device 200 also reads the currently recorded video status from the video adapter module.

[0174] In some embodiments, the video adaptation module searches for the corresponding recorded video status from the media asset information list based on the path information of the first video.

[0175] In one example, when the first video is started playing, the video adaptation module can read that the recorded video status is last_status = idle.

[0176] Step S403: If the first video source is the homepage video application, and the recorded video status is stopped playing while the first video status is started playing, the video adaptation module is controlled not to start the playback timer for the first video.

[0177] If the recorded video is in a stopped playback state while the first video is in a started playback state, it indicates that the first video is in the initial playback state. At this point, a screenshot of the first video needs to be taken to adjust its image quality. However, the screenshot must capture the exact frame corresponding to the main content of the first video.

[0178] It's important to note that the platform's playback framework callbacks the physical playback state of the video. This physical playback state represents the working state of the media decoder and is unrelated to the video content being played (i.e., whether it's the main feature or not). Therefore, when the platform's playback framework callback indicates that the first video has started playing, it only means that the first video has started playing. However, at this time, non-main feature content within the first video may be playing, such as an advertisement at the beginning of the video.

[0179] The homepage video application can call back the logical playback state of the video. This logical playback state can represent the state of the video at the business logic level. That is, the video playback state is called back when the main content of the video starts playing, rather than when the video playback state is called back at the beginning of the video playback.

[0180] Based on this, combined Figure 5 If the first video is provided by the homepage video application, even if the video adaptation module listens to the start playback status of the video (last_status=idle, current_status=start) called back by the platform playback framework, it will not recognize it as the start of the main content of the first video. Therefore, the playback timer will not be started, and the recorded video status of the first video will not be updated.

[0181] Step S404: After the video adaptation module detects the second video status callback from the homepage video application and the second video status is "start playing", the video adaptation module is controlled to start the playback timer for the first video and the recorded video status is updated to "start playing".

[0182] Combination Figure 5 When the display device 200 detects a video status (i.e., the second video status) callback from the homepage video application via the video adaptation module, and the second video status is set to "start playback" (last_status = idle, current_status = start in the homepage video application callback), it indicates that the main content of the first video has begun playing. At this time, the display device 200 controls the video adaptation module to start timing the playback of the first video.

[0183] The display device 200 can control the playback timing module in the startup video adapter module to start the playback timing of the first video.

[0184] Combination Figure 5 The video adaptation module will also record the video status, updating it from idle to start, with the updated last_status = start.

[0185] Step S405: When the playback time reaches the first duration threshold, take a screenshot of the video frame corresponding to the current playback progress to obtain the first screenshot.

[0186] The playback time for the first video is the duration of playback after the main content has been played. When the playback time reaches the first duration threshold, it means that the user has stayed on the first video for a sufficient amount of time, and the first video is the video that the user is interested in. The video quality of the first video can then be adjusted.

[0187] After the playback timer reaches a first duration threshold, the display device 200 determines the current playback progress of the first video. This current playback progress is equal to the playback progress accumulated from the initial playback progress at the start of the main feature, plus the first duration threshold.

[0188] In some embodiments, after the video adaptation module listens to the start playback status of the video in the homepage video application callback, it can request the playback progress corresponding to the first video from the platform playback framework. This playback progress is the first playback progress corresponding to the start of the main feature.

[0189] The display device 200 controls the capture of a frame of video corresponding to the current playback progress to obtain the first frame screenshot.

[0190] Combination Figure 5 After the playback timer reaches a first duration threshold, the video adaptation module sends a first message to the image quality adjustment service. This first message includes the current playback progress of the first video. Based on this current playback progress, the image quality adjustment service calls the screenshot API to capture a screenshot of the video frame corresponding to the current playback progress, thus obtaining the first screenshot.

[0191] Step S406: Use artificial intelligence image quality optimization technology to perform image recognition on the first screenshot to obtain the first image quality parameters that match the first screenshot.

[0192] Combination Figure 5 The image quality adjustment service calls the API of the AIPQ function to perform AIPQ processing on the first screenshot to obtain image quality parameters that match the first screenshot, i.e., the first image quality parameters.

[0193] In some embodiments, AIPQ technology is used to perform image recognition on the first screenshot in order to determine the level or value of each image quality parameter that matches the image content contained in the first screenshot.

[0194] In one example, image quality parameters include: filminess, color temperature (color_temp), and saturation. Filminess is divided into four levels from 0 to 3, ranging from low to high. Color temperature can range from -100 to +100. Saturation can also range from -100 to +100.

[0195] Step S407: Play the first video with the first image quality parameters.

[0196] Combination Figure 5 The image quality adjustment service adjusts the system image quality parameters to the first image quality parameter so that the first video can be played using the first image quality parameter.

[0197] Based on the above embodiments, when the first video to be played is provided by the homepage video application, since the start playback callback of the homepage video application accurately represents the start of the main content playback, the playback timing initiated based on the start playback callback of the homepage video application can accurately reflect the duration of the first video playback after the main content begins. Based on this playback timing, not only can the video frame corresponding to the main content be accurately captured, but it can also ensure that the user stays on the first video for a sufficiently long time, thereby ensuring the validity of the image quality parameters determined based on the screenshot.

[0198] Figure 8 Here is another flowchart illustrating how the display device 200 adjusts video quality in this embodiment of the application. The specific steps are as follows:

[0199] Step S801: If the first video source is a third-party video application, and the recorded video status is stopped playing while the first video status is started playing, control the video adaptation module to start the playback timing of the first video.

[0200] When the first video source is a third-party video application, it indicates that the first video is a third-party video. Since the display device 200 can only monitor the video status of third-party videos through the platform playback framework, and the platform playback framework cannot identify whether the main content has started playing, in order to bypass the non-main content in the first video and capture the video frame corresponding to the main content, the display device 200 is configured to, after the video adaptation module detects the start of playback status of the video called back by the platform playback framework, control the video adaptation module to start a playback timer for the first video, so as to determine whether the main content has started playing based on the duration of the playback timer.

[0201] Combination Figure 5 If the first video source corresponding to the first video is a third-party video application, when the video adaptation module listens for the first video status callback from the platform playback framework, and the first video status is "started playback" (last_status = idle, current_status callback from the platform playback framework = start), it indicates that the first video has started playing. At this time, the display device 200 controls the video adaptation module to start the playback timer for the first video. The video adaptation module will also update the video status from idle to start, and the updated last_status = start.

[0202] Step S802: When the playback time reaches the second duration threshold, a screenshot is taken of the video frame corresponding to the current playback progress to obtain the second screenshot.

[0203] Step S802 can be referred to step S405, and will not be repeated here.

[0204] In some embodiments, the second duration threshold is greater than the first duration threshold. The second duration threshold can be set by referring to the duration of non-main content in the video and the duration of the video the user is focused on. That is, when the playback timer reaches the second duration threshold, it indicates that the main content of the video has been played, and the user has remained on the first video for a sufficiently long time, meaning the first video is the video the user is focused on.

[0205] Step S803: Use artificial intelligence image quality optimization technology to perform image recognition on the second screenshot to obtain second image quality parameters that match the second screenshot.

[0206] Step S804: Play the first video with the second quality parameters.

[0207] Steps S803 to S804 can be referred to steps S406 to S407, and will not be repeated here.

[0208] In some embodiments, the process of adjusting image quality increases the load on the CPU and memory. If the currently playing video is short, it will end playback quickly and switch to another video, resulting in image quality adjustments being performed on different videos within a short period of time. This leads to excessive resource consumption and affects other performance aspects of the display device 200. To address this issue, the display device 200 is configured to adjust image quality only for videos with a total duration greater than or equal to a preset duration threshold, thereby avoiding intensive image quality adjustments.

[0209] Figure 9 This is a flowchart illustrating how the display device 200 determines whether to enable the image quality parameter adjustment function in this embodiment of the application. The specific steps are as follows:

[0210] Step S901: Listen to the video information in response to the start-up command callback by the platform playback framework through the video adaptation module.

[0211] Step S901 can be referred to step S401, and will not be repeated here.

[0212] Step S902: After listening to the video information called back by the platform playback framework through the video adaptation module, identify the total video duration included in the video information.

[0213] Combination Figure 5 After listening to the video information callback from the platform's playback framework, the video adaptation module identifies the total video duration included in the video information.

[0214] Before activating the image quality parameter adjustment function, the video adaptation module first determines whether to adjust the image quality of the first video based on the total video duration and the preset duration threshold, that is, whether to enable the image quality parameter adjustment function.

[0215] Step S903: If the total video duration is greater than or equal to the preset duration threshold, enable the image quality parameter adjustment function, and after enabling the image quality parameter adjustment function, identify the first video source corresponding to the first video, and read the recorded video status corresponding to the first video recorded in the video adaptation module.

[0216] Combination Figure 5 If the total duration of the video is greater than or equal to the preset duration threshold, it means that the total duration of the first video is long enough, and the image quality parameter adjustment function can be enabled. After enabling the image quality parameter adjustment function, the display device 200 can continue to execute step S402 to adjust the image quality of the first video.

[0217] Step S904: If the total video duration is less than the preset duration threshold, keep the image quality parameter adjustment function off.

[0218] Combination Figure 5 If the total video duration is less than the preset duration threshold, it means that the total duration of the first video is too short. In order to avoid performing image quality adjustment tasks intensively, the image quality of the first video will not be adjusted, that is, the image quality parameter adjustment function will remain off.

[0219] In some embodiments, after the display device 200 controls the video adaptation module to start the playback timing of the first video, it needs to accurately control the playback timing process based on the changes in the video state of the first video to ensure the effectiveness of the playback timing.

[0220] In some embodiments, the platform playback framework uniformly monitors and calls back to the video adaptation module the paused and stopped playback status of the videos provided by each video source.

[0221] Figure 10 This is a flowchart illustrating how the display device 200 times the playback of the first video in an embodiment of this application. The specific steps are as follows:

[0222] Step S1001: In response to the pause command of the first video, after the video adaptation module detects that the status of the first video, which is paused by the platform playback framework, is detected as paused, the recorded video status corresponding to the first video is read from the video adaptation module.

[0223] When a user needs to pause the playback of the first video, they can input a pause command into the display device 200. The display device 200 will respond to the pause command and control the pause playback of the first video.

[0224] Figure 11 This is a timing diagram showing the timing of the display device 200 playing the first video in an embodiment of this application.

[0225] Combination Figure 11In response to a pause command, after the display device 200 detects that the first video status, which is paused, is detected by the video adaptation module via the platform playback framework, it reads the recorded video status corresponding to the first video from the video adaptation module. For example, if the first video status is current_status = paused and the recorded video status is last_status = start, the display device 200 reads the recorded video status.

[0226] Step S1002: When the recorded video status is "start playing", control the video adaptation module to pause the playback timing of the first video and update the recorded video status to "pause playing".

[0227] If the recorded video status is `last_status = start`, and the status of the first video (recalled by the platform's playback framework) is `current_status = pause`, it indicates that playback of the first video is paused. At this point, combined with... Figure 11 The video adaptation module pauses the playback timer for the first video to avoid counting the duration when the first video is not playing, i.e., invalid duration. Furthermore, the video adaptation module will update the video status from start to pause, with the updated last_status equal to pause.

[0228] Step S1003: In response to the playback command of the first video, after the video adaptation module detects that the status of the first video, which is called back by the platform playback framework, has started playing, the recorded video status corresponding to the first video is read from the video adaptation module.

[0229] When a user needs to resume playback of the first video, they can input a playback command into the display device 200. The display device 200 will respond to the playback command and control the resumption of playback of the first video.

[0230] Combination Figure 11 In response to a playback command, after the display device 200 detects that the first video status, which is called back by the platform playback framework, is "start playback" through the video adaptation module, it reads the recorded video status corresponding to the first video from the video adaptation module. For example, the first video status called back by the platform playback framework is "current_status = start," and the recorded video status is "last_status = pause."

[0231] Step S1004: When the recorded video is in a paused playback state, control the video adaptation module to resume the playback timing of the first video and update the recorded video status to start playback.

[0232] If the recorded video status is `last_status = pause`, and the status of the first video (recalled by the platform's playback framework) is `current_status = start`, then playback of the first video will resume. At this point, combined with... Figure 11 The video adaptation module then resumes the playback timing for the first video. Furthermore, the video adaptation module will update the recorded video status from paused to start, with the updated last_status equal to start.

[0233] Based on the above embodiments, after the display device 200 starts the playback timing of the first video, it can accurately monitor the paused and resumed playback status of the first video through the video adaptation module, and control the pause timing and resume timing based on the monitored video status, so as to accurately count the effective playback duration of the first video, and thus more accurately determine whether to start playing the main content of the first video.

[0234] Figure 12 The following is another flowchart illustrating the timing of playback of the first video by the display device 200 in this embodiment of the application. The specific steps are as follows:

[0235] Step S1201: In response to the stop playback command of the first video, after the video adaptation module detects that the status of the first video, which is called back by the platform playback framework, is stopped playing, the recorded video status corresponding to the first video is read from the video adaptation module.

[0236] When a user wants to stop playing the first video or switch to playing another video, they can input a stop playback command into the display device 200. The display device 200 will respond to the stop playback command and control the stop playback of the first video.

[0237] Combination Figure 11 In response to a stop playback command, after the display device 200 detects that the first video status, which is called back by the platform playback framework, is stopped playing, it reads the recorded video status corresponding to the first video from the video adaptation module. For example, if the first video status called back by the platform playback framework is current_status = idle, the recorded video status is last_status = start / pause.

[0238] Step S1202: When the recorded video status is either start playing or paused playing, control the video adaptation module to turn off the playback timer for the first video and update the recorded video status to stop playing.

[0239] If the recorded video status is `last_status = start / pause`, and the status of the first video (recalled by the platform's playback framework) is `last_status = idle`, it indicates that playback of the first video has stopped. At this point, combined with... Figure 11 The video adaptation module disables the playback timer for the first video. Furthermore, the video adaptation module updates the recorded video status from start / pause to idle, with the updated last_status equal to idle.

[0240] In some embodiments, when the video adaptation module detects that the first video status is idle as a callback from the platform playback framework, it can delete information related to the first video from the media asset information list.

[0241] Based on the above embodiments, after the display device 200 starts the playback timing of the first video, it can accurately monitor the video status of the first video when playback stops through the video adaptation module, and control the termination timing based on the monitored video status to terminate the process of adjusting the image quality parameters of the first video.

[0242] In some embodiments, the platform playback framework uniformly listens for and sends callbacks to the video adaptation module to the progress adjustment events (seek) of the videos provided by each video source. These progress adjustment events include the adjusted playback progress.

[0243] Figure 13 The following is another flowchart illustrating how the display device 200 times the playback of the first video in this embodiment of the application. The specific steps are as follows:

[0244] Step S1301: In response to the progress adjustment instruction of the first video, after the progress adjustment event of the first video is detected by the video adaptation module and called back by the platform playback framework, the recorded video status corresponding to the first video is read from the video adaptation module.

[0245] When a user wants to adjust the playback progress of the first video (such as adjusting the playback progress backward or forward), the user can input a progress adjustment command into the display device 200. In response to the progress adjustment command, the display device 200 will start playing the first video from the target playback progress indicated by the user.

[0246] Combination Figure 11 In response to a progress adjustment command, the display device 200, after detecting a progress adjustment event for the first video status callback from the platform playback framework via the video adaptation module, reads the recorded video status corresponding to the first video from the video adaptation module. For example, the recorded video status is last_status = start / pause.

[0247] Step S1302: When the recorded video status is either "start playing" or "paused playing", control the video adaptation module to restart the playback timing of the first video and update the recorded video status to "start playing".

[0248] When the recorded video status is last_status = start / pause, and the platform playback framework calls back the progress adjustment event, it indicates that playback of the first video begins from the target playback progress indicated by the progress adjustment event. At this point, combined with... Figure 11 The video adaptation module restarts the playback timer for the first video. Furthermore, the video adaptation module updates the recorded video status from start / pause to start, with the updated last_status equal to start.

[0249] Based on the above embodiments, after the display device 200 starts the playback timing of the first video, it can accurately listen to the progress adjustment event of the first video through the video adaptation module, and control the restart of the playback timing based on the listened progress adjustment event, so as to accurately count the playback duration of the first video after the playback progress is adjusted. Based on the re-counted duration, it can not only ensure that the video frame of the main content of the first video is captured, but also accurately determine whether the user stays for a sufficient amount of time after the playback progress of the first video is adjusted, so as to ensure the validity of the captured video frame.

[0250] In some embodiments, if the first video source corresponding to the first video is a homepage video application, the video information called back by the homepage video application and listened to by the video adaptation module by the display device 200 may include the scene mode of the first video.

[0251] In different scene modes, the area of ​​the video image displayed on the screen varies. The display area includes the position of the video image on the screen and the display ratio of the video image.

[0252] In one example, the display position can include the center position, the border position, the top corner position, full screen, etc. The display ratio can include aspect ratios such as 4:3, 16:9, etc.

[0253] In other words, in different scene modes, in addition to the video image, there may be invalid images such as black borders on the screen.

[0254] In some embodiments, a scene mode has a corresponding identifier, and the identifier of the scene mode corresponds to the display area of ​​the video image on the screen.

[0255] In one example, Scene Mode=1 represents a movie scene, with the corresponding display area centered and an aspect ratio of 16:9.

[0256] In another example, Scene Mode=2 represents a scene from an episode, with a full-screen display area and an aspect ratio of 4:3.

[0257] Figure 14 This is a flowchart illustrating the process by which the display device 200 performs screenshot processing on the video frame based on a scene mode, as described in this application embodiment. The specific steps are as follows:

[0258] Step S1401: Listen to the scene mode of the first video called back by the homepage video application through the video adaptation module.

[0259] Combination Figure 5 When the first video source corresponding to the first video is the homepage video application, the video adaptation module can identify the scene mode corresponding to the first video from the video playback event callback of the homepage video application. The video adaptation module then feeds back the scene mode to the image quality adjustment service.

[0260] Step S1402: Based on the scene mode of the first video that is listened to by the video adaptation module and called back by the homepage video application, and the correspondence between the pre-stored scene modes and screenshot modes, determine the first screenshot mode corresponding to the scene mode of the first video.

[0261] The image quality adjustment service can pre-store the correspondence between various scene modes and screenshot modes.

[0262] In different screenshot modes, the screenshot area on the screen is different, and this screenshot area matches the display area of ​​the video on the screen in the scene mode corresponding to the screenshot mode.

[0263] In one example, the scene mode is Scene Mode=1, a movie scene. In the corresponding screenshot mode, the screenshot area is centered and the aspect ratio is 16:9.

[0264] Combination Figure 5 The image quality adjustment service can determine the corresponding first screenshot mode based on the scene mode fed back by the video adaptation module.

[0265] Step S1403: When the playback time reaches the first duration threshold, take a screenshot of the video frame corresponding to the current playback progress according to the first screenshot mode to obtain the first screenshot.

[0266] If the screenshot conditions are met, the display device 200 performs screenshot processing on the video frame corresponding to the current playback progress according to the first screenshot mode to obtain the first screenshot.

[0267] Combination Figure 5The image quality adjustment service calls the screenshot function API and performs screenshot processing according to the first screenshot mode to obtain the first screenshot.

[0268] Based on the above embodiments, if the first video is provided by the homepage video application, the homepage video application can also provide the scene mode of the first video. In this way, the display device 200 can accurately determine the corresponding first screenshot mode based on the scene mode of the first video, and perform screenshot processing on the video screen of the first video in the first screenshot mode, so as to ensure that the obtained first screen screenshot can be adapted to the effective video screen and minimize invalid screens such as black borders in the video.

[0269] For ease of explanation, the above description has been provided in conjunction with specific embodiments. However, the discussion in some embodiments is not intended to be exhaustive or to limit the embodiments to the specific forms disclosed above. Various modifications and variations can be obtained based on the above teachings. The selection and description of the above embodiments are for the purpose of better explaining the contents of this disclosure, thereby enabling those skilled in the art to better utilize the embodiments.

Claims

1. A display device, characterized in that, include: monitor; The controller, coupled to the display, is configured to: In response to the start-up command of the first video, the video status of the first video is monitored through the video adaptation module; After the video adaptation module listens to the first video status called back by the platform playback framework, it identifies the first video source corresponding to the first video and reads the recorded video status corresponding to the first video recorded in the video adaptation module. If the first video source is a homepage video application, and the recorded video status is stopped playing while the first video status is started playing, the video adaptation module is controlled not to start the playback timer for the first video. After the video adaptation module detects the second video status callback from the homepage video application and the second video status is "start playing", it controls the video adaptation module to start the playback timer for the first video and updates the recorded video status to "start playing". When the playback time reaches the first duration threshold, a screenshot is taken of the video frame corresponding to the current playback progress to obtain the first screenshot. Artificial intelligence image quality optimization technology is used to perform image recognition on the first screenshot to obtain a first image quality parameter that matches the first screenshot. Control the display to play the first video with the first image quality parameters.

2. The display device according to claim 1, characterized in that, The controller is also configured to: If the first video source is a third-party video application, when the recorded video status is stopped and the first video status is started, the video adaptation module is controlled to start the playback timer for the first video and update the recorded video status to start playback. When the playback time reaches the second duration threshold, a screenshot is taken of the video frame corresponding to the current playback progress to obtain a second screenshot. Artificial intelligence image quality optimization technology is used to perform image recognition on the second screenshot to obtain second image quality parameters that match the second screenshot; Control the display to play the first video with the second image quality parameters.

3. The display device according to claim 1 or 2, characterized in that, Before the controller identifies the first video source corresponding to the first video and reads the recorded video status corresponding to the first video recorded in the video adaptation module, it is further configured to: The video adaptation module listens for video information that is called back by the platform playback framework in response to the start-up command. After the video adaptation module detects the video information called back by the platform playback framework, it identifies the total video duration included in the video information. If the total duration of the video is greater than or equal to a preset duration threshold, the image quality parameter adjustment function is enabled. After the image quality parameter adjustment function is enabled, the first video source corresponding to the first video is identified, and the recorded video status corresponding to the first video recorded in the video adaptation module is read. If the total video duration is less than the preset duration threshold, the image quality parameter adjustment function remains off.

4. The display device according to claim 1 or 2, characterized in that, After the controller controls the video adaptation module to start timing the playback of the first video, it is further configured to: In response to the pause command of the first video, after the video adaptation module detects that the status of the first video is paused playback as called back by the platform playback framework, the recorded video status corresponding to the first video is read from the video adaptation module. When the recorded video status is "start playing", the video adaptation module is controlled to pause the playback timing of the first video and update the recorded video status to "pause playing". In response to the playback command of the first video, after the video adaptation module detects that the status of the first video, which is called by the platform playback framework, is "start playing", the recorded video status corresponding to the first video is read from the video adaptation module. When the recorded video is in a paused playback state, the video adaptation module is controlled to resume the playback timing of the first video and update the recorded video status to start playback.

5. The display device according to claim 4, characterized in that, After the controller controls the video adaptation module to start timing the playback of the first video, it is further configured to: In response to the stop playback command of the first video, after the video adaptation module detects that the status of the first video is stopped by the callback of the platform playback framework, the recorded video status corresponding to the first video is read from the video adaptation module. When the recorded video is in a state of start playing or paused playing, the video adaptation module is controlled to turn off the playback timer for the first video and update the recorded video state to stop playing.

6. The display device according to claim 4, characterized in that, After the controller controls the video adaptation module to start timing the playback of the first video, it is further configured to: In response to the progress adjustment instruction of the first video, after the progress adjustment event of the first video is detected by the platform playback framework through the video adaptation module, the recorded video status corresponding to the first video is read from the video adaptation module. When the recorded video is in a state of start playing or paused playing, the video adaptation module is controlled to restart the playback timing of the first video and update the recorded video state to start playing.

7. The display device according to claim 1, characterized in that, The controller is also configured to: The video adaptation module listens to the scene mode of the first video called back by the homepage video application; wherein, in different scene modes, the display area of ​​the video image on the screen is different; When the playback timer reaches a first duration threshold, the controller takes a screenshot of the video frame corresponding to the current playback progress to obtain a first screenshot, which is specifically configured as follows: Based on the scene mode of the first video received by the homepage video application through the video adaptation module, and the pre-stored correspondence between scene modes and screenshot modes, the first screenshot mode corresponding to the scene mode of the first video is determined; wherein, in different screenshot modes, the screenshot area on the screen is different, and the screenshot area matches the display area of ​​the video screen on the screen in the scene mode corresponding to the screenshot mode. When the playback time reaches the first duration threshold, a screenshot is taken of the video frame corresponding to the current playback progress according to the first screenshot mode to obtain the first screenshot.

8. The display device according to claim 1, characterized in that, In response to the start-up command of the first video, the controller, after monitoring the video status of the first video through the video adaptation module, is further configured to: After the video adaptation module detects a video playback event called back by the platform playback framework, it identifies the path information corresponding to the first video included in the video playback event. Using the path information as the key and the recorded video status corresponding to the first video as the value, a key-value pair corresponding to the first video is created; wherein, the initial recorded video status corresponding to the first video is stopped playing.

9. A method for adjusting video image quality, applied to a display device, characterized in that, The method includes: In response to the start-up command of the first video, the video status of the first video is monitored through the video adaptation module; After the video adaptation module listens to the first video status called back by the platform playback framework, it identifies the first video source corresponding to the first video and reads the recorded video status corresponding to the first video recorded in the video adaptation module. If the first video source is a homepage video application, and the recorded video status is stopped playing while the first video status is started playing, the video adaptation module is controlled not to start the playback timer for the first video. After the video adaptation module detects the second video status callback from the homepage video application and the second video status is "start playing", it controls the video adaptation module to start the playback timer for the first video and updates the recorded video status to "start playing". When the playback time reaches the first duration threshold, a screenshot is taken of the video frame corresponding to the current playback progress to obtain the first screenshot. Artificial intelligence image quality optimization technology is used to perform image recognition on the first screenshot to obtain a first image quality parameter that matches the first screenshot. Play the first video with the first image quality parameters.

10. The method according to claim 9, characterized in that, The method further includes: If the first video source is a third-party video application, when the recorded video status is stopped and the first video status is started, the video adaptation module is controlled to start the playback timer for the first video and update the recorded video status to start playback. When the playback time reaches the second duration threshold, a screenshot is taken of the video frame corresponding to the current playback progress to obtain a second screenshot. Artificial intelligence image quality optimization technology is used to perform image recognition on the second screenshot to obtain second image quality parameters that match the second screenshot; Play the first video with the second image quality parameters.

Images