Video processing method and electronic device

Abstract

The present application relates to the technical field of electronics. Provided in the embodiments of the present application are a video processing method and an electronic device. The method may be applied to the electronic device, the method comprising: the electronic device may send to a server a video acquisition request for a target video and receive from the server information for adjusting the video quality of the target video and video stream information of the target video; and the electronic device may also acquire video data corresponding to the video stream information according to the video stream information of the target video, and, according to the information for adjusting the video quality of the target video, perform image processing on the video data corresponding to the video stream information and display same. Thus, by taking into account the video quality of the target video, the embodiments of the present application may perform image processing on the video data and display same, so as to avoid the problem of over-adjustment of the video data, thereby further improving the display effect of the video data and improving user experience.

Description

Video processing method and electronic equipment

[0001] This application claims priority to the Chinese patent application filed with the State Intellectual Property Office on August 25, 2023, with application number 202311086459.3 and application name “A Video Processing Method and Electronic Device”, the entire contents of which are incorporated by reference into this application. Technical Field

[0002] The present application relates to the field of electronic technology, and in particular to a video processing method and electronic equipment. Background Art

[0003] The rapid adoption of electronic devices such as televisions, mobile phones, and computers has brought a wealth of convenience and enjoyment to people's lives. People can use these devices to watch videos for entertainment or learning. When playing videos, these devices typically retrieve the corresponding video data from a cloud server, pre-process the video data to improve the display quality, and finally control the display to display the video.

[0004] At present, in order to balance the display effects of most video resources, electronic devices usually use the same adjustment method to adjust the video data during the pre-processing process of the video data. For example, the clarity of the video data is increased by 20%. It is understandable that the video data corresponding to each video resource is different. Some video data have higher clarity, while some video data have lower clarity. If a unified adjustment is made for most video resources, the problem of over-adjustment of the video resources will arise. As a result, when the electronic device plays the video resources, the display effect of the video resources is poor, which reduces the user experience.

[0005] Summary of the Invention

[0006] Embodiments of the present application provide a video processing method and electronic device. The electronic device can receive information sent by a server for adjusting the video quality of a target video, and perform image processing and display on the video data based on the video quality information of the target video. The image processing and display of the video data are performed based on consideration of the video quality of the target video. This avoids the problem of excessive adjustment of the video data, thereby improving the display quality of the video data.

[0007] To achieve the above objectives, the embodiments of the present application adopt the following technical solutions:

[0008] In a first aspect, embodiments of the present application provide a video processing method that can be applied to an electronic device. The method includes: the electronic device may send a video acquisition request for a target video to a server, and receive information for adjusting the video quality of the target video and video stream information of the target video from the server. The electronic device may also obtain video data corresponding to the video stream information based on the video stream information of the target video. Furthermore, image processing may be performed on the video data corresponding to the video stream information based on the information for adjusting the video quality of the target video, and the video data may be displayed.

[0009] In other words, the electronic device can receive information sent by the server for adjusting the video quality of the target video and perform image processing and display on the video data based on the video quality information of the target video. This allows the electronic device to process and display the video data based on the video quality of the target video, avoiding the problem of excessive adjustment of the video data. This improves the display quality of the video data and enhances the user experience.

[0010] In one possible implementation of the first aspect, during image processing and display of video data corresponding to the video stream information based on information used to adjust the video quality of the target video, the electronic device may determine target quality parameter information based on the information used to adjust the video quality of the target video. The target quality parameter information matches the display capabilities of the electronic device, and at least one parameter in the target quality parameter information differs from a parameter in the information used to adjust the video quality of the target video. The electronic device may also perform image processing and display of the video data corresponding to the video stream information based on the target quality parameter information.

[0011] That is, the electronic device can determine target quality parameter information based on the information used to adjust the video quality of the target video. The target quality parameter information is matched with the display capability of the electronic device.

[0012] In this way, electronic devices can use target quality parameter information to process and display video data based on the target video's quality and their own display capabilities. This avoids wasting display capacity and excessive image processing of the video data. Because the processed video data matches their own display capabilities, the electronic device can improve the display quality of the target video when displaying the video data. This, in turn, enhances the user experience.

[0013] Furthermore, some or all of the parameters in the target quality parameter information may differ from the parameters in the information used to adjust the video quality of the target video. This allows the electronic device to process and display the video data based on some or all of the parameters in the video quality information of the target video, thereby increasing processing flexibility during image processing.

[0014] In an implementation manner of the first aspect, the information used to adjust the video quality of the target video includes target quality parameter information, and the target quality parameter information matches the display capability of the electronic device.

[0015] In the process of performing image processing and displaying the video data corresponding to the video stream information according to the information for adjusting the video quality of the target video, the electronic device can perform image processing and display the video data corresponding to the video stream information according to the target quality parameter information.

[0016] That is, the electronic device can receive information sent by the server for adjusting the video quality of the target video, which includes target quality parameter information, and the target quality parameter information is matched with the display capability of the electronic device. In this way, the electronic device can directly perform image processing and display the video data based on the target quality parameter information sent by the server. This will neither waste the display capability of the electronic device nor perform excessive image processing on the video data. Since the video data after image processing matches its own display capability, the electronic device can improve the display effect corresponding to the target video during the process of displaying the video data. In turn, this improves the user experience.

[0017] In one implementation of the first aspect, the information about the target video quality includes original quality parameter information. When the electronic device performs image processing on the video data corresponding to the video stream information and displays the image based on the target quality parameter information, the electronic device may adjust the original quality parameter of the video data corresponding to the video stream to be consistent with the target quality parameter information based on the target quality parameter information and display the image.

[0018] That is, in some examples, the target quality parameter information can be one or more specific parameters, such as a clarity parameter 50, a color parameter 30, and a contrast parameter 30. Based on these specific parameters, the electronic device can adjust the original quality parameters of the video data corresponding to the video stream to be consistent with these specific parameters and display them. This avoids wasting the display capacity of the electronic device and also prevents excessive image processing of the video data.

[0019] In one implementation of the first aspect, the target quality parameter information includes an adjustment value corresponding to at least one parameter in the information used to adjust the video quality of the target video. When the electronic device processes and displays the video data corresponding to the video stream information based on the target quality parameter information, the electronic device may process and display the video data corresponding to the video stream information based on the adjustment value corresponding to the at least one parameter.

[0020] That is, in some examples, the target quality parameter information can be the values ​​of one or more parameters that need to be adjusted, that is, it can indicate the degree to which one or more parameters need to be adjusted. In this way, the electronic device can also perform image processing and display on the video data based on the values ​​of the one or more parameters that need to be adjusted. Similarly, neither the display capacity of the electronic device is wasted nor excessive image processing is performed on the video data.

[0021] In an implementation manner of the first aspect, the information used to adjust the video quality of the target video includes information used to adjust the image quality of at least one frame of image in the target video.

[0022] In the process of performing image processing and displaying video data corresponding to video stream information based on information used to adjust the video quality of the target video, the electronic device can perform image processing and display at least one frame of image in the video data corresponding to the video stream information based on information used to adjust the image quality of at least one frame of image in the target video.

[0023] That is, the electronic device can receive information sent by the server for adjusting the image quality of at least one frame of the target video, and based on the information about the image quality of at least one frame of the target video, perform image processing on and display the at least one frame of the video data. In this way, the electronic device can process and display the at least one frame of the video data based on the image quality of the at least one frame of the target video. This allows for refined processing of at least one frame of the video data, improving the flexibility and sophistication of the processing process.

[0024] In an implementation manner of the first aspect, the method further includes: outputting prompt information, where the prompt information is used to prompt that the video quality of the target video has been improved.

[0025] As can be seen, after the electronic device processes the video data, it can output a prompt message to inform the user that the video quality of the target video has been improved, thereby improving the interactivity between the user and the electronic device and the flexibility of the video display process.

[0026] In an implementation method of the first aspect, the information used to adjust the video quality of the target video includes one or more of a clarity parameter, a color parameter, a contrast parameter, a brightness parameter, a noise parameter, a smoothness parameter, a grayscale parameter, a saturation parameter, a background blur parameter, a vignetting parameter or a color temperature parameter.

[0027] In an implementation manner of the first aspect, the video acquisition request includes a video identifier of the target video; or the video stream information of the target video includes a video stream address of the target video.

[0028] In an implementation manner of the first aspect, the display capability of the electronic device includes at least one of a display hardware capability and a display software capability of the electronic device.

[0029] In a second aspect, embodiments of the present application further provide a video processing method, applied to a server, comprising: the server may receive a video acquisition request for a target video sent by an electronic device, and, based on the video acquisition request, obtain information for adjusting the video quality of the target video and video stream information of the target video. The server may also transmit the information for adjusting the video quality of the target video and the video stream information of the target video to the electronic device, wherein the video quality information of the target video is used to adjust the video quality of the target video displayed on the device.

[0030] In other words, the server can obtain information for adjusting the video quality of the target video. This information is used to adjust the video quality of the target video displayed on the device. Furthermore, the server can transmit this information to the electronic device, allowing the electronic device to subsequently process and display the video data based on the target video quality. This avoids excessive adjustments to the video data and, in turn, improves the display quality of the video data.

[0031] In an implementation manner of the second aspect, before receiving a video acquisition request for a target video sent by an electronic device, the server may perform image quality detection on video data corresponding to the target video to obtain information for adjusting the video quality of the target video.

[0032] In other words, the server can pre-detect the image quality of the video data corresponding to the target video to obtain information used to adjust the video quality of the target video. This information can then be sent to the electronic device, allowing the electronic device to process and display the video data based on the target video quality. This avoids the problem of excessive adjustment of the video data.

[0033] In one possible implementation of the second aspect, before receiving a video acquisition request for a target video from an electronic device, the server may further perform image quality detection on the video data corresponding to the target video to obtain information for adjusting the video quality of the target video. Target quality parameter information may then be determined based on the information for adjusting the video quality of the target video. The target quality parameter information matches the display capabilities of the electronic device. The server may further transmit the target quality parameter information and video stream information of the target video to the electronic device.

[0034] In other words, the server can determine target quality parameter information based on information used to adjust the video quality of the target video. The target quality parameter information matches the server's own display capabilities. The server then sends the target quality parameter information and the video stream information of the target video to the electronic device. This allows the subsequent electronic device to use the target quality parameter information to perform image processing and display on the video data, taking into account the video quality of the target video and its own display capabilities. This avoids wasting its own display capabilities and prevents excessive image processing of the video data. Because the processed video data matches its own display capabilities, the display effect of the target video can also be improved.

[0035] In one implementation of the second aspect, the video acquisition request includes a video identifier of the target video; or the video stream information of the target video includes a video stream address of the target video. When the server acquires the information for adjusting the video quality of the target video and the video stream information of the target video according to the video acquisition request, the server may acquire the information for adjusting the video quality of the target video and the video stream address of the target video based on the video identifier of the target video.

[0036] In a third aspect, an embodiment of the present application provides an interactive system, which includes an electronic device and a server.

[0037] The electronic device is configured to send a video acquisition request of a target video to a server.

[0038] The server is configured to receive a video acquisition request sent by an electronic device, and acquire information for adjusting the video quality of a target video and video stream information of the target video.

[0039] The server is further configured to send information for adjusting the video quality of the target video and video stream information of the target video to the electronic device.

[0040] The electronic device is further configured to receive information for adjusting the video quality of the target video and the video stream information of the target video sent by the server, and obtain video data corresponding to the video stream information according to the video stream information of the target video.

[0041] The electronic device is further configured to perform image processing on the video data corresponding to the video stream information and display the image according to the information used to adjust the video quality of the target video.

[0042] As can be seen, the electronic device can receive information sent by the server for adjusting the video quality of the target video and the video stream information of the target video, and perform image processing and display on the video data based on the video quality information of the target video. In this way, the electronic device can perform image processing and display on the video data based on the video quality of the target video, avoiding the problem of excessive adjustment of the video data. Furthermore, the display quality of the video data is improved, enhancing the user experience.

[0043] In a fourth aspect, an embodiment of the present application provides a server, which includes: a memory and a processor, wherein program instructions are stored in the memory, and the processor executes the video processing method described in the second aspect above by running the program instructions.

[0044] In the fifth aspect, an embodiment of the present application provides an electronic device, which includes: a memory, a processor and a display screen. The memory and the display screen are coupled to the processor. The display screen is used to display the video screen corresponding to the target video. The memory is used to store computer-readable instructions. When the processor reads the computer-readable instructions from the memory, the electronic device executes the video processing method described in the first aspect above.

[0045] In a sixth aspect, an embodiment of the present application provides a computer-readable storage medium, which includes a computer program. When the computer program runs on an electronic device, the electronic device executes the video processing method described in the first aspect above. BRIEF DESCRIPTION OF THE DRAWINGS

[0046] FIG1 is a schematic diagram of a process flow of a related technology 1 provided in an embodiment of the present application;

[0047] FIG2 is a flow chart of a related technology 2 provided in an embodiment of the present application;

[0048] FIG3 is a schematic diagram of the hardware structure of a smart screen provided in an embodiment of the present application;

[0049] FIG4 is a schematic diagram of the software structure of a smart screen provided in an embodiment of the present application;

[0050] FIG5 is a schematic diagram of the structure of an interactive system provided in an embodiment of the present application;

[0051] FIG6 is a flow chart of a video processing method provided in an embodiment of the present application;

[0052] FIG7 is a flow chart of an application scenario provided by an embodiment of the present application;

[0053] FIG8 is a schematic diagram of a process flow between a smart screen and a server provided in an embodiment of the present application;

[0054] FIG9 is a second schematic diagram of a process between a smart screen and a server provided in an embodiment of the present application;

[0055] FIG10 is a third schematic diagram of a process between a server and a smart screen provided in an embodiment of the present application;

[0056] FIG11 is a schematic diagram of an interface for prompting information provided in an embodiment of the present application;

[0057] FIG12 is a schematic structural diagram of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0058] The technical solutions in the embodiments of the present application will be described below in conjunction with the drawings in the embodiments of the present application. Among them, in the description of the present application, unless otherwise specified, " / " indicates that the objects associated before and after are in an "or" relationship. For example, A / B can represent A or B; "and / or" in the present application is only a description of the association relationship of the associated objects, indicating that there can be three relationships. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone, where A and B can be singular or plural. In addition, in the description of the present application, unless otherwise specified, "multiple" refers to two or more than two. "At least one of the following" or similar expressions refers to any combination of these items, including any combination of single or plural items. For example, at least one of a, b, or c can represent: a, b, c, ab, ac, bc, or abc, where a, b, c can be single or multiple. In addition, in order to facilitate a clear description of the technical solutions of the embodiments of the present application, in the embodiments of the present application, words such as "first" and "second" are used to distinguish identical or similar items with basically the same functions and effects.

[0059] Those skilled in the art will understand that words such as "first" and "second" do not limit the quantity and execution order, and words such as "first" and "second" do not necessarily limit differences. At the same time, in some embodiments of the present application, words such as "exemplary" or "for example" are used to indicate examples, illustrations or explanations. Any embodiment or design described as "exemplary" or "for example" in the embodiments of the present application should not be interpreted as being more preferred or more advantageous than other embodiments or design. Specifically, the use of words such as "exemplary" or "for example" is intended to present related concepts in a concrete way for easy understanding.

[0060] In addition, the network architecture and business scenarios described in the embodiments of the present application are intended to more clearly illustrate the technical solutions of the embodiments of the present application, and do not constitute a limitation on the technical solutions provided in the embodiments of the present application. Ordinary technicians in this field can know that with the evolution of network architecture and the emergence of new business scenarios, the technical solutions provided in the embodiments of the present application are also applicable to similar technical problems.

[0061] When playing video resources, electronic devices usually obtain video data corresponding to the video from a cloud server, pre-process the video data to improve the display effect of the video resources, and finally control the display screen to display the video picture.

[0062] Currently, in order to balance the display effects of most video resources, each electronic device usually uses the same adjustment method to adjust the video data during the process of pre-processing the video data.

[0063] For example, the clarity of a video resource can be increased by 20%. It is understandable that the video data corresponding to each video resource is different, with some video data corresponding to higher clarity and some video data corresponding to lower clarity. If a uniform adjustment is made for most video resources, there will be problems such as over-adjustment of the video resources or failure to adjust the video resources to match the display hardware capabilities. This will result in poor display quality when the electronic device plays the video resources, reducing the user experience.

[0064] Related technologies provide a method for adjusting image modes. As shown in Figure 1, an electronic device captures the currently playing video and uses a classification model to identify the video. The device then obtains the recognition result and issues a recognition command. Based on the recognition command, the electronic device then calls a local model for the scene, loads the classification label, performs model matching, and obtains a matching result. The electronic device then automatically adjusts the audio and image modes based on the matching result.

[0065] It can be seen that the above solution is based on a deep learning network classification model, which recognizes video images in real time to determine the video category. By adjusting different image modes for videos of different categories. When an electronic device determines the category of a corresponding video based on a certain frame of an image in a video, such as sports videos and animation videos, it may make incorrect category judgments, with a high error rate. At the same time, different categories of videos correspond to different sound modes and image modes. However, fixed image parameters are still used for unified adjustment of videos of the same category. The problem of excessive or insufficient adjustment still exists during the video adjustment process. As a result, the display effect of video resources is poor when electronic devices play video resources.

[0066] Related technologies also provide a method for automatic image mode matching (see Figure 2). In this approach, an electronic device obtains an image sequence of the currently playing video content, segments each frame in the sequence into multiple image regions, and calculates the average grayscale value corresponding to each image region. Then, based on the average grayscale value of each image region, the electronic device determines that the video content is a movie, and switches the video content's image mode to a preset movie image mode.

[0067] It can be seen that the above solution only adjusts the image for movie-type videos, and the movie image mode has corresponding image parameters. At the same time, it also uniformly adjusts the fixed image parameters used by all movie-type videos. However, there is still the problem of adjusting the degree too high or too low during the video adjustment process. As a result, when electronic devices play video resources, the display effect of video resources is poor. At the same time, some current movie-type videos do not have the characteristics of upper and lower black borders. In this way, judging that the video content is a movie video based on the characteristics of upper and lower black borders in the video will result in incorrect judgments and a high error rate.

[0068] As can be seen from the above, the currently provided video processing methods all have the problem of over-adjusting the video resources or failing to adjust the video resources to a suitable display effect, thereby resulting in poor display effect of the video resources when the electronic device plays the video resources.

[0069] Embodiments of the present application provide a video processing method and electronic device. The method can be applied to an electronic device. The method includes: the electronic device can send a video acquisition request for a target video to a server, and receive information for adjusting the video quality of the target video and video stream information of the target video from the server. The electronic device can also obtain video data corresponding to the video stream information based on the video stream information of the target video. Furthermore, based on the information for adjusting the video quality of the target video, the electronic device performs image processing on the video data corresponding to the video stream information and displays the image.

[0070] That is, in the embodiment of the present application, before playing the target video, the electronic device can receive information for adjusting the video quality of the target video and the video stream information sent by the server. Furthermore, the electronic device can perform image processing on the video data corresponding to the video stream based on the information for adjusting the video quality of the target video, and display the processed video data.

[0071] It is understood that the electronic device can pre-acquire the information sent by the server for adjusting the video quality of the target video, and perform image processing on the video data based on the video quality of the target video before displaying it. This prevents excessive processing of the video data. Furthermore, when displaying the video data, the electronic device can enhance the display quality corresponding to the target video, thereby improving the user experience.

[0072] The video processing method provided in the embodiments of the present application can be applied to electronic devices. In some embodiments, the electronic devices may include, for example, smart screens, mobile phones, tablet computers, personal computers (PCs), personal digital assistants (PDAs), smart watches, netbooks, wearable devices, augmented reality (AR) devices, virtual reality (VR) devices, in-vehicle devices, and smart cars, etc. The embodiments of the present application do not impose any particular restrictions on the specific form of the electronic devices.

[0073] The operating system installed on the electronic device includes but is not limited to This application does not limit the specific type of electronic device and the type of operating system when an operating system is installed.

[0074] For example, taking the electronic device as a smart screen as an example, (A) in Figure 3 shows a structural diagram of the smart screen 100.

[0075] The smart screen 100 may include a processor 110, an external memory interface 120, an internal memory 121, an antenna and wireless communication module 130, a charging management module 140, a power management module 141, a battery 142, an audio module 150, a speaker 150A, a sensor module 160, a camera 170, and a display screen 180. Among them, the sensor module 160 includes an image sensor 160A.

[0076] It is understood that the structures illustrated in the embodiments of this application do not constitute a specific limitation on the smart screen 100. In other embodiments of this application, the smart screen 100 may include more or fewer components than shown, or may combine or separate certain components, or arrange the components differently. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0077] The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU). The different processing units may be independent devices or integrated into one or more processors.

[0078] Among them, the controller can be the nerve center and command center of the smart screen 100. The controller can generate operation control signals based on instruction opcodes and timing signals to complete the control of instruction fetching and execution.

[0079] Processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in processor 110 is a cache memory. This memory can store instructions or data that have just been used or are being recycled by processor 110. If processor 110 needs to use the same instruction or data again, it can directly retrieve it from the memory. This avoids duplicate accesses, reduces processor 110 latency, and thus improves system efficiency.

[0080] The wireless communication function of the smart screen 100 can be realized through an antenna, a wireless communication module 130, a modem processor, and a baseband processor.

[0081] The wireless communication module 130 can provide wireless communication solutions including Wireless Local Area Networks (WLAN) (such as Wireless Fidelity (Wi-Fi) network), Bluetooth (BT), Global Navigation Satellite System (GNSS), Frequency Modulation (FM), Near Field Communication (NFC), Infrared (IR), etc. applied to the smart screen 100. The wireless communication module 130 can be one or more devices that integrate at least one communication processing module. The wireless communication module 130 receives electromagnetic waves via an antenna, frequency modulates and filters the electromagnetic wave signal, and sends the processed signal to the processor 110. The wireless communication module 130 can also receive the signal to be sent from the processor 110, frequency modulate it, amplify it, and convert it into electromagnetic waves for radiation through the antenna.

[0082] The Smart Screen 100 implements its display functionality through a GPU, display screen 180, and an application processor. The GPU is a microprocessor for image processing that connects the display screen 180 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs, which execute program instructions to generate or modify display information.

[0083] The display screen 180 is used to display images, video images corresponding to the target video, etc. The display screen 180 includes a display panel. In some embodiments, the smart screen 100 may include 1 or N display screens 180, where N is a positive integer greater than 1.

[0084] The smart screen 100 can realize the shooting function through ISP, camera 170, video codec, GPU, display screen 180 and application processor.

[0085] The ISP processes data fed back by camera 170. For example, when taking a photo, the shutter is opened, and light is transmitted through the lens to the camera's photosensitive element. The light signal is converted into an electrical signal, which is then passed to the ISP for processing and transformed into a visible image. The ISP can also perform algorithmic optimization for image noise, brightness, and skin tone. It can also optimize parameters such as exposure and color temperature of the captured scene. In some embodiments, the ISP can be located within camera 170.

[0086] The camera 170 is used to capture still images or videos. The object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal oxide semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, which is then passed to the ISP for conversion into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard format such as RGB or YUV.

[0087] In some embodiments, the smart screen 100 may include 1 or N cameras 170 , where N is a positive integer greater than 1.

[0088] Here, the camera 170 can be set in the smart screen 100. Of course, it can also be a component of the electronic device. In some implementations, the camera can also be set outside the electronic device and connected to the electronic device via a wired or wireless connection. For example, the camera and the electronic device can be connected via Bluetooth or a mobile hotspot. The electronic device can control the camera by sending or receiving commands to the camera.

[0089] The camera 170 may also include a camera module, which may be disposed inside the camera. Of course, it may also be disposed elsewhere within the smart screen 100. The camera module includes a lens, a focus motor, a base, a circuit board, and a photosensitive element.

[0090] The base is fixedly connected to one side of the circuit board. The focus motor is located on the side of the base away from the circuit board and is fixedly connected to the periphery of the base. The lens is mounted in the middle of the focus motor. The photosensitive element is fixed to the side of the circuit board facing the lens.

[0091] The lens is used to collect light signals reflected by the subject. The focus motor is used to drive the lens to move in a direction parallel to the optical axis. The optical axis refers to the line passing through the center of the lens. In some embodiments, the Smart Screen 100 can control the focus motor to move the lens to the focus position, thereby completing the focusing process.

[0092] In some embodiments, the focus motor may be a voice coil motor (VCM), a shape memory alloy (SMA) motor, a piezo motor (PM), a stepper motor (STM), or the like.

[0093] In some embodiments of the present application, the camera 170 may be an artificial intelligence (AI) camera, and the AI ​​camera may further include an AI processor. In one conceivable embodiment, the AI ​​processor may be used for face and / or human figure recognition, image processing, video processing, posture detection, and the like.

[0094] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the smart screen 100. The external memory card communicates with the processor 110 through the external memory interface 120 to implement data storage functions. For example, files such as music and videos can be saved on the external memory card.

[0095] The internal memory 121 can be used to store computer executable program code, which includes instructions. The processor 110 executes the instructions stored in the internal memory 121 to execute various functional applications and data processing of the smart screen 100. The internal memory 121 can include a program storage area and a data storage area.

[0096] The smart screen 100 can implement audio functions such as music playback and recording through the audio module 150, the speaker 150A, and the application processor.

[0097] In other embodiments, the image sensor 160A can be used to detect objects within the range captured by the camera, with each photosensitive unit corresponding to a pixel in the image sensor. The image sensor 160A may include a first color (red, green, and blue, RGB) image sensor, a second color (red, yellow, and blue, RYB) image sensor, a black and white image sensor, and an infrared image sensor, etc., which are not limited in this embodiment of the present application. The image sensor 160A is used to capture images within the range captured by the camera 170, where the images may include RGB images, RYB images, black and white images, and infrared images, etc.

[0098] The image sensor 160A may also be provided in one or more cameras 170. The embodiment of the present application does not specifically limit the arrangement of components.

[0099] Typically, the smart screen 100 can also be equipped with a remote control. This remote control is used to control the smart screen 100. As shown in Figure 3 (B), a schematic diagram of the structure of a remote control 190 is shown. The remote control 190 may include multiple buttons, such as an up button 191, a down button 192, a left button 193, a right button 194, an OK button 195, and a power button 196. The buttons on the remote control 190 may be mechanical buttons or touch buttons. The remote control 190 can receive key inputs, generate key signal inputs related to user settings and function control of the smart screen 100, and send corresponding signals to the smart screen 100 to control the smart screen 100. For example, when a user presses the up button 191, down button 192, left button 193, right button 194, OK button 195, or power button 196, the button may emit a corresponding signal and send the signal to the smart screen 100 via Bluetooth, infrared, or other methods. The smart screen 100 receives the corresponding signal of the key through the wireless communication module 130 and can perform the corresponding operation based on the signal.

[0100] It is understandable that the remote control 190 may also include other buttons and components, such as a volume button, a Bluetooth interface, an infrared interface, a battery storage cavity (for installing batteries to power the remote control), etc. The embodiments of this application will not be described in detail.

[0101] Figure 4 is a software structure block diagram of the smart screen 100 according to an embodiment of the present application.

[0102] The layered architecture divides the software into several layers, each with a clear role and division of labor. The layers communicate with each other through software interfaces. In some embodiments, The system is divided into four layers, from top to bottom: application layer, application framework layer, Runtime (Android runtime) and system libraries and kernel layer.

[0103] The application layer can include a series of application packages.

[0104] As shown in Figure 4, the application package may include applications such as camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, short message, etc. In some embodiments, the video application can play video resources.

[0105] The application framework layer provides an application programming interface (API) and programming framework for applications in the application layer. The application framework layer includes some predefined functions.

[0106] As shown in FIG. 4 , the application framework layer may include a window manager, a content provider, a view system, a telephony manager, a resource manager, a notification manager, and the like.

[0107] The window manager is used to manage window programs. The window manager can obtain the display size, determine whether there is a status bar, lock the screen, take screenshots, etc.

[0108] Content providers are used to store and retrieve data and make it accessible to applications. The data may include videos, images, audio, calls made and received, browsing history and bookmarks, phone books, etc.

[0109] The view system includes visual controls, such as those for displaying text and images. The view system is used to build applications. A display interface can consist of one or more views. For example, a display interface containing a text notification icon might include a view for displaying text and a view for displaying images.

[0110] The phone manager is used to provide communication functions for smart watches, such as managing call status (including answering, hanging up, etc.).

[0111] The resource manager provides various resources for applications, such as localized strings, icons, images, layout files, video files, and so on.

[0112] The Notification Manager allows applications to display notifications in the status bar. These messages can be displayed briefly and then disappear automatically, without requiring user interaction. For example, the Notification Manager can be used to notify users of completed downloads and message reminders. The Notification Manager can also display notifications in the top status bar as icons or scrolling text, such as notifications from background applications, or as dialog windows on the screen. Examples include text messages in the status bar, beeping sounds, vibrating smartwatches, and flashing indicator lights.

[0113] The runtime includes the core libraries and the virtual machine. The runtime is responsible for scheduling and management of the Android system.

[0114] The core library consists of two parts: one is the function that the Java language needs to call, and the other is The core library.

[0115] The application layer and application framework layer run in a virtual machine. The virtual machine executes Java files in the application layer and application framework layer as binary files. The virtual machine manages object lifecycles, stack management, thread management, security and exception management, and garbage collection.

[0116] The system library can include multiple functional modules, such as dynamic parameter adjustment module and image enhancement module.

[0117] In some embodiments of the present application, the dynamic parameter adjustment module is configured to determine target quality parameter information based on information used to adjust the video quality of the target video, and the image enhancement module is configured to perform image processing on the video data based on the target quality parameter information determined by the dynamic parameter adjustment module to improve the video quality corresponding to the video data. The video data includes multiple frames of images, and the video quality corresponding to the video data can also be understood as the image quality corresponding to the video data.

[0118] The kernel layer is the layer between hardware and software. The kernel layer includes at least display driver, camera driver, audio driver, and sensor driver.

[0119] The posture detection method provided in the embodiment of the present application can be applied to an interactive system. Referring to Figure 5, an interactive system provided in the embodiment of the present application includes a first device 100 (such as a user's smart screen) and a second device 101 (such as a server).

[0120] In some embodiments, a communication connection may be established between the first device 100 and the second device 101. The communication connection may include a wireless connection.

[0121] Among them, the wireless communication technology for establishing a wireless communication connection includes but is not limited to at least one of the following: wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT) (for example, traditional Bluetooth or Bluetooth low energy (BLE) Bluetooth), near field communication (NFC), Zigbee, frequency modulation (FM), infrared (IR), etc.

[0122] For ease of description, the following description uses a smart screen as an example of the first device 100. Unlike traditional televisions, this smart screen features wireless signal transmission and reception, allowing it to play a wider range of roles in the home. The smart screen is not only a home audio and video entertainment center, but also an information sharing center, a control and management center, and a multi-device interaction center. The smart screen can connect with multiple devices to enable information exchange.

[0123] In some embodiments of the present application, a smart screen can obtain video data corresponding to a target video from a server. The server then sends information for adjusting the video quality of the target video and the video stream information of the target video to the smart screen. The smart screen can determine target quality parameter information based on the information for adjusting the video quality of the target video. Based on the target quality parameter information, the smart screen can perform image processing on the video data corresponding to the video stream information to improve the video quality corresponding to the video data. This, in turn, improves the display quality of the target video during display.

[0124] The interactive system provided in the embodiment of the present application may also include other electronic devices in addition to the first device 100 and the second device 101. The interactive system provided in the embodiment of the present application includes but is not limited to interaction between three devices, or interaction between one device and multiple devices. Those skilled in the art can determine the type and number of electronic devices based on actual needs, and such designs do not exceed the scope of protection of the embodiment of the present application.

[0125] The following embodiments will be combined with the accompanying drawings to illustrate the video processing method provided by the embodiment of the present application, taking the device as a smart screen having the structure shown in Figure 3 as an example. Referring to Figure 6, the method may include:

[0126] S601. The smart screen receives information sent by the server for adjusting the video quality of the target video and the video stream information of the target video.

[0127] In some embodiments of the present application, the target video can be any type of video that can be played on the smart screen. For example, the target video can include one or more of the following: movie videos, TV series videos, variety shows, sports videos, game videos, documentaries, short videos, educational videos, or live broadcast videos.

[0128] The target application in the smart screen can support the selection and playback of the above-mentioned target videos. Among them, the target application can include video applications, game applications, social applications, educational applications, conference applications, and player applications, etc., which have the function of playing videos. The target application can be a system application in the smart screen or a third-party application. Of course, the target application can be an application that is installed when the smart screen leaves the factory, or it can be an application downloaded from the Internet or obtained from other devices while the user is using the smart screen.

[0129] Typically, a user can select a target video in a target application to watch or learn. For example, a user selects a first movie video in a video application. For another example, a user selects a game tutorial video in a game application. For another example, a user selects a recorded video shared by other users in a social application. For another example, a user selects an instructional video in an instructional application. It can be seen that the core scenarios involved in the embodiments of the present application include scenarios in which users select and watch streaming media.

[0130] For ease of understanding, the application scenarios involved in the embodiments of the present application are preliminarily described in conjunction with FIG7 .

[0131] In some embodiments of the present application, the user can select the video he wants to watch in the video application in the smart screen. For example: Movie A. After the smart screen detects the user's selection operation for Movie A, it sends a video acquisition request to the server. The server receives the video acquisition request, searches for the video stream information corresponding to Movie A according to the video acquisition request, and sends the video stream information corresponding to Movie A to the smart screen. The smart screen receives the video stream information corresponding to Movie A and decodes the video data corresponding to the video stream information. Then, the smart screen displays the decoded video data corresponding to Movie A. In this way, the user can watch Movie A through the smart screen.

[0132] It should be noted that the embodiment of the present application only takes the example of a user being able to select a video to watch in a video application in a smart screen. The embodiment of the present application does not impose specific restrictions on application types and video types.

[0133] The following will describe in detail the interaction process between the smart screen and the server in the embodiment of the present application with reference to (A) in FIG8 .

[0134] In some embodiments of the present application, the smart screen can send a video acquisition request for the target video to the server.

[0135] In some examples, the smart screen can detect the user's trigger operation on the target video and send a video acquisition request for the target video to the server.

[0136] The server receives a video acquisition request for a target video and, based on the video acquisition request, obtains the video stream information of the target video and information for adjusting the video quality of the target video. The server then sends the video stream information and information for adjusting the video quality of the target video to the smart screen. The video quality information of the target video is used to adjust the video quality of the target video displayed on the device. The smart screen can receive the video stream information of the target video and information for adjusting the video quality of the target video sent by the server.

[0137] In some examples, the video acquisition request may include a video identifier of the target video; or the video stream information of the target video may include the video stream address of the target video. Furthermore, the video identifier is a mark that can uniquely identify the target video. The video identifier may include a video name and a video ID, etc.

[0138] Specifically, the server may obtain information for adjusting the video quality of the target video and the video stream address of the target video according to the video identifier of the target video.

[0139] Referring to (B) in FIG. 8 , in some embodiments of the present application, the server includes a video generation system and a video operation platform. The video generation system includes a preprocessing module and an encoding module. Video operators can transcode and process the source data corresponding to the target video through the video generation system. In other words, the preprocessing module in the video generation system is used to perform image processing on the source data corresponding to the target video. The encoding module in the video generation system is used to encode the video data after image processing to generate video data.

[0140] Specifically, the preprocessing module can perform image processing on the source data corresponding to the target video. The processed source data includes information used to adjust the video quality of the target video. Furthermore, the preprocessing module can send the processed source data to the encoding module. The encoding module can then encode the processed source data to generate video data corresponding to the target video.

[0141] Among them, the information used to adjust the video quality of the target video may include one or more of clarity parameters, color parameters, contrast parameters, brightness parameters, noise parameters, smoothness parameters, grayscale parameters, saturation parameters, background blur parameters, dark corner parameters or color temperature parameters.

[0142] Exemplarily, the information used to adjust the video quality of the target video may include a clarity parameter of 50, a color parameter of 30, a contrast parameter of 30, a brightness parameter of 40, a noise parameter of 32, a smoothness parameter of 12, a grayscale parameter of 50, a saturation parameter of 43, a background blur parameter of 50, a vignetting parameter of 55, and a color temperature parameter of 68.

[0143] It should be noted that the embodiments of the present application are merely illustrative of the information for adjusting the video quality of the target video, and do not specifically limit the types of parameters and each parameter in the information for adjusting the video quality of the target video.

[0144] In some embodiments of the present application, the information used to adjust the video quality of target videos included in the video data of different target videos may be different. The information used to adjust the video quality of target videos included in the video data of different types of target videos may also be different.

[0145] For example, movie-type videos may require a slightly darker and less saturated visual effect, while sports-type videos may require a clearer and more vivid visual effect. Thus, movie-type videos may have lower grayscale and saturation parameters, while having a higher background blur parameter, compared to sports-type videos. Sports-type videos may have higher clarity, color, and brightness parameters, compared to movie-type videos.

[0146] In some embodiments of the present application, referring to (B) in FIG8 , the encoding module may send the video data of the target video to the video operation platform. The video operation personnel may configure information of the video data through the video operation platform.

[0147] For example, the video operation platform can bind the video data with the video stream information, the video identifier, and the information for adjusting the video quality of the target video. That is, a correspondence is established between the video data and the video stream information, the video identifier, and the information for adjusting the video quality of the target video, so that the video data is associated with the corresponding video stream information, the video identifier, and the information for adjusting the video quality of the target video.

[0148] As another example, the video operation platform may also establish a correspondence between the video data and the video stream information, video information, and information for adjusting the video quality of the target video of the target video; wherein the video information includes the video identifier and video type corresponding to the target video.

[0149] Furthermore, the server may also include a video information database. After establishing the corresponding relationship, the video operation platform may store the corresponding relationship in the video information database of the server.

[0150] In some embodiments, the pre-processing module may also send the video data, information for adjusting the video quality of the target video, video information, or video identification to the encoding module. After encoding the source data to generate video data, the encoding module sends the video data, information for adjusting the video quality of the target video, video information, or video identification to the video operation platform.

[0151] In this way, after receiving the video acquisition request of the target video sent by the smart screen, the server can obtain the video stream information of the target video and the information for adjusting the video quality of the target video based on the video identifier and the corresponding relationship. And send the video stream information and the information for adjusting the video quality of the target video to the smart screen.

[0152] In some embodiments, after receiving the video acquisition request for the target video sent by the smart screen, the server can also send the video information or video identifier of the target video to the smart screen.

[0153] In some embodiments, after receiving the video acquisition request for the target video sent by the smart screen, the server can also directly send the above-mentioned correspondence to the smart screen.

[0154] As can be seen, in the embodiment of the present application, the server can not only pre-process the source data of the target video to obtain information for adjusting the video quality of the target video, but also configure the information of the video data after image processing. The video stream information of the target video, the information for adjusting the video quality of the target video, the video information, or the video identifier are sent to the smart screen. In this way, the smart screen can subsequently perform image processing on the video data and display it based on the information for adjusting the video quality of the target video.

[0155] In some embodiments of the present application, referring to FIG9 , the server includes a video generation system, a quality detection module, and a video operation platform. The video generation system includes a preprocessing module and an encoding module. The preprocessing module in the server can adjust the source data corresponding to the target video according to a preset resolution and / or frame rate. Then, the encoding module encodes the adjusted source data to obtain video data corresponding to the target video. The video data is sent to the quality detection module. The quality detection module can perform image quality detection on the video data, obtain information corresponding to the target video for adjusting the video quality of the target video, and send the information for adjusting the video quality of the target video and the video stream information to the video operation platform.

[0156] Similarly, video operators can configure video data through the video operation platform. The video operation platform can establish a correspondence between the video data and the target video's video stream information, information for adjusting the target video's video quality, video identifiers, or video information. After establishing the correspondence, the video operation platform can store the correspondence in the server's video information database.

[0157] In some embodiments, the server may perform image quality detection on video data corresponding to the target video to obtain information for adjusting the video quality of the target video.

[0158] Specifically, the preprocessing module may also send the adjusted source data, video information, or video identifier to the encoding module. After encoding the adjusted source data to generate video data, the encoding module sends the video data, video information, or video identifier to the quality detection module. After performing quality detection on the video data, the quality detection module obtains information used to adjust the video quality of the target video and then sends the information used to adjust the video quality of the target video, the video data, video information, or video identifier to the video operation platform.

[0159] In some embodiments of the present application, the quality detection module in the server may include a quality detection algorithm or a quality detection model. The quality detection algorithm or the quality detection model is used to perform image quality detection on the video data to obtain information corresponding to the video data for adjusting the video quality of the target video.

[0160] Among them, the quality detection algorithm may include a noise detection algorithm, a motion image detection algorithm, a video jitter detection algorithm, and the like.

[0161] The quality detection model can use convolutional neural networks (CNN), region proposal network (RPN), regions with CNN features (RCNN), fast RCNN network and residual network, or a combination of multiple networks to extract the video quality information of the target video.

[0162] It should be noted that the quality detection model provided in the embodiment of the present application may include one or more of the YOLO algorithm, the SSD algorithm, and the DenseBox algorithm. These algorithms all have the advantages of high speed and high accuracy. Of course, the embodiment of the present application will also train the quality detection model. When training the quality detection model, a large amount of video data and image quality parameters can be used as training samples to enable the quality detection model to learn the ability to identify the information corresponding to the video data for adjusting the video quality of the target video. The embodiment of the present application does not limit the specific form of the quality detection algorithm and the quality detection model.

[0163] It can be seen that the server provided in the embodiment of the present application can generate video data corresponding to the target video by simply adjusting the resolution or frame rate of the source data of the target video. And by adding a quality detection module on the server side, it is possible to obtain information corresponding to the video data for adjusting the video quality of the target video. Similarly, it is convenient for the subsequent smart screen to obtain the video quality corresponding to the video data based on the information used to adjust the video quality of the target video, and perform image processing and display on the video data.

[0164] S602. The smart screen performs image processing and displays the video data corresponding to the video stream information based on the information used to adjust the video quality of the target video.

[0165] In some embodiments of the present application, the smart screen can determine target quality parameter information based on information used to adjust the video quality of the target video. The target quality parameter information matches the display capability of the smart screen, and at least one parameter in the target quality parameter information is different from the parameter in the information used to adjust the video quality of the target video. The display capability of the smart screen includes at least one of the display hardware capability and display software capability of the smart screen. The smart screen can also perform image processing and display on the video data corresponding to the video stream information based on the target quality parameter information.

[0166] Specifically, after receiving the video stream information of the video data sent by the server, the information for adjusting the video quality of the target video, the video information or the video identifier, the smart screen can determine the target quality parameter information based on the information for adjusting the video quality of the target video.

[0167] In some examples, target quality parameter information is determined based on information for adjusting the video quality of a target video, configuration information, video information, or a video identifier. The configuration information includes at least one of information for adjusting the video quality of the target video corresponding to the video identifier or video information, and target quality parameter information corresponding to the information for adjusting the video quality of the target video.

[0168] That is, the smart screen provided in the embodiment of the present application may pre-store configuration information, the configuration information including one or more video identifiers or information corresponding to the video quality of the target video and target quality parameter information corresponding to the information for adjusting the video quality of the target video. The smart screen may interact with the server in advance, associate the information for adjusting the video quality of the target video on the server side with the target quality parameter information, establish a corresponding relationship between the two, and obtain the configuration information.

[0169] In some embodiments, the configuration information may be implemented in the form of a configuration table. The configuration information may also be implemented using preset rules or preset algorithms. Of course, the embodiments of the present application do not specifically limit the implementation of the data structure corresponding to the configuration information.

[0170] In some embodiments of the present application, at least one parameter in the target quality parameter information is different from the information used to adjust the video quality of the target video. That is, all parameters in the target quality parameter information may be different from all parameters in the information used to adjust the video quality of the target video, and some parameters in the target quality parameter information may also be different from some parameters in the information used to adjust the video quality of the target video. In this way, when the smart screen subsequently performs image processing based on the target quality parameter information, it can perform image processing based on one or more parameters in the adjusted video parameters.

[0171] In some embodiments of the present application, the target quality parameter information can be dynamically configured based on the information used to adjust the video quality of the target video. The smart screen can configure different target quality parameter information corresponding to different information used to adjust the video quality of the target video based on its own display capabilities.

[0172] For example, each video may correspond to a piece of information for adjusting the video quality of the target video, and each piece of information for adjusting the video quality of the target video may also correspond to a piece of target quality parameter information.

[0173] In some embodiments of the present application, different information for adjusting the video quality of a target video may also refer to different information corresponding to different videos. The smart screen may configure target quality parameter information corresponding to each information for adjusting the video quality of a target video based on its own display capabilities and video type.

[0174] For example, the information corresponding to the first video for adjusting the video quality of the target video is the first quality parameter, and the information corresponding to the second video for adjusting the video quality of the target video is the second quality parameter. The configuration table in the smart screen may include the correspondence between the first quality parameter and the third quality parameter. In addition, it may also include the correspondence between the second quality parameter and the fourth quality parameter. Then, when the smart screen receives the first quality parameter corresponding to the first video, the third quality parameter can be determined based on the first video, the first quality parameter and the configuration table. When the smart screen receives the second quality parameter corresponding to the second video, the fourth quality parameter can be determined based on the second video, the second quality parameter and the configuration table.

[0175] As another example, different information for adjusting the video quality of the target video may also refer to different information corresponding to different types of videos. In scenarios where the same information for adjusting the video quality of the target video corresponds to the same video type, that is, each type of video may correspond to one information for adjusting the video quality of the target video. The smart screen can configure the target quality parameter information corresponding to each information for adjusting the video quality of the target video based on its own display capabilities and video type.

[0176] For example, Movie A and Movie B are both movie-type videos. The information corresponding to Movie A and Movie B used to adjust the video quality of the target video is the first quality parameter. The configuration table in the smart screen may include the correspondence between the first quality parameter and the second quality parameter. Then, when the smart screen receives the first quality parameter corresponding to Movie A or Movie B, it can determine the second quality parameter based on Movie A or Movie B, the first quality parameter, and the configuration table.

[0177] In scenarios where the same type of video corresponds to different information for adjusting the target video's video quality, that is, each type of video can correspond to multiple pieces of information for adjusting the target video's video quality. The Smart Screen can also configure target quality parameter information corresponding to each piece of information for adjusting the target video's video quality based on its own display capabilities and video type.

[0178] For example, movie A and movie B are both movie-type videos. The information corresponding to movie A for adjusting the video quality of the target video is the third quality parameter, and the information corresponding to movie B for adjusting the video quality of the target video is the fourth quality parameter. The configuration table in the smart screen may include the correspondence between the third quality parameter and the fifth quality parameter. In addition, it may also include the correspondence between the fourth quality parameter and the sixth quality parameter. Then, when the smart screen receives the third quality parameter corresponding to movie A, it can determine the fifth quality parameter based on movie A, the third quality parameter and the configuration table. When the smart screen receives the fourth quality parameter corresponding to movie B, it can determine the sixth quality parameter based on movie B, the fourth quality parameter and the configuration table.

[0179] In some embodiments of the present application, different smart screens can also configure corresponding different target quality parameter information for the same information for adjusting the video quality of the target video according to their own display capabilities.

[0180] Take the display hardware capabilities of smart screens as an example. The display corresponding to smart screen A is a 2K (2K resolution) display, that is, the resolution is 2560×1440. The display corresponding to smart screen B is a 4K display, that is, the resolution is 3840×2160. It can be seen that the display hardware capabilities corresponding to smart screen A are lower than the display hardware capabilities corresponding to smart screen B. In this way, since the display hardware capabilities of smart screens A and B are different, when smart screens A and B display the same video data, smart screen B needs to improve the video quality corresponding to the video data to a greater extent, so that the video quality of the video data matches its own display hardware capabilities. For example, one or some parameters in the target quality parameter information set by smart screen B are higher than one or some parameters in the target quality parameter information set by smart screen A.

[0181] It should be noted that the video quality directly reflects the user experience quality. The target quality parameter information can be configured through subjective evaluation, which assesses image quality based on the viewer's subjective perception. Of course, the target quality parameter information can also be configured through objective evaluation, which calculates a quantitative value of the image quality corresponding to the video data.

[0182] The embodiments of the present application do not limit the specific implementation form of the target quality parameter information, or the specific implementation manner of the correspondence between the information configured to adjust the video quality of the target video and the target quality parameter information.

[0183] In some embodiments of the present application, the information for adjusting the video quality of the target video may include target quality parameter information. In other words, the server may also determine the target quality parameter information based on the information for adjusting the video quality of the target video.

[0184] Specifically, the server can perform image quality detection on the video data corresponding to the target video to obtain information used to adjust the video quality of the target video. Furthermore, target quality parameter information can be determined based on the information used to adjust the video quality of the target video. Of course, the target quality parameter information matches the display capabilities of the electronic device. The server can directly send the target quality parameter information and the video stream information of the target video to the electronic device.

[0185] In this way, the smart screen can directly process and display the video data corresponding to the video stream information according to the target quality parameter information while performing image processing and displaying the video data corresponding to the video stream information according to the information used to adjust the video quality of the target video.

[0186] It can be seen that the smart screen can determine the target quality parameter information based on the information sent by the server for adjusting the video quality of the target video. The target quality parameter information matches its own display capability. It is understandable that the information used to adjust the video quality of the target video can characterize the video quality of the target video on the server side. In other words, the smart screen can determine the degree of optimization of the video data corresponding to the video quality based on the information used to adjust the video quality of the target video within its own display capability, that is, determine the target quality parameter information.

[0187] In this way, the smart screen can use the target quality parameter information to process and display the video data based on the video quality of the target video and its own display capabilities, without wasting its own display capabilities or performing excessive image processing on the video data.

[0188] Moreover, in the embodiment of the present application, the server side can determine the target quality parameter information in advance based on the information used to adjust the video quality of the target video. Of course, the target quality parameter information matches the display capability of the smart screen. In this way, the smart screen can directly use the target quality parameter information to process and display the video data. Not only can it reduce its own workload, but it can also improve the display effect corresponding to the target video during the display of video data. In turn, it improves the user experience.

[0189] In some embodiments of the present application, the smart screen can obtain video data corresponding to the video stream information, and perform image processing and display on the video data corresponding to the video stream information according to the target quality parameter information.

[0190] In some embodiments, the target video quality information includes original quality parameter information, and the target quality parameter information includes one or more specific parameters, i.e., specific values. In this way, the smart screen can directly adjust the original quality parameters of the video data corresponding to the video stream information to be consistent with the target quality parameter information based on the target quality parameter information.

[0191] For example, the target quality parameter information includes a clarity parameter of 50, a color parameter of 30, a contrast parameter of 30, and a brightness parameter of 40. After the smart screen performs image processing on the video data, the clarity parameter of the processed video data is 50, the color parameter is 30, the contrast parameter is 30, and the brightness parameter is 40.

[0192] In some embodiments, the target quality parameter information may further include an adjustment value corresponding to at least one parameter in the information used to adjust the video quality of the target video. That is, the target quality parameter information may indicate the degree to which one or more parameters require adjustment. In this way, the smart screen may also process and display the video data corresponding to the video stream information based on the adjustment value corresponding to the at least one parameter.

[0193] For another example, the information for adjusting the video quality of the target video includes a clarity parameter of 10, a color parameter of 20, a contrast parameter of 30, and a brightness parameter of 40. The target quality parameter information includes a clarity parameter of 5, a color parameter of 6, a contrast parameter of 7, and a brightness parameter of 10. After the smart screen performs image processing on the video data, the clarity parameter of the processed video data is 15, the color parameter is 26, the contrast parameter is 37, and the brightness parameter is 40.

[0194] In some embodiments of the present application, the smart screen can call the target application programming interface to perform image processing on the video data based on the target quality parameter information.

[0195] That is, the methods provided in various embodiments of the present application can call a target application programming interface to perform image processing on video data. It should be understood that the target application programming interface can be an interface provided by the framework layer or the application framework layer, and can provide the function of performing image processing on video data based on target quality parameter information. Furthermore, different applications can correspond to different target application programming interfaces for performing image processing on video data.

[0196] In some embodiments of the present application, referring to FIG10 , the smart screen may include a target application, a dynamic parameter adjustment module, and an image enhancement module. After the target application in the smart screen receives the video stream information of the target video, the information for adjusting the video quality of the target video, the video information, or the video identification sent by the server, the video stream information, the information for adjusting the video quality of the target video, the video information, or the video identification is sent to the dynamic parameter adjustment module. The dynamic parameter adjustment module obtains the target quality parameter information based on the video information or the video identification, the information for adjusting the video quality of the target video, and the configuration table. In addition, the dynamic parameter adjustment module can call the target application programming interface to send the video stream information, the target quality parameter information, the video information, or the video identification to the image enhancement module. The image enhancement module can obtain the video data corresponding to the video stream information, and perform image processing on the video data corresponding to the video stream information according to the target quality parameter information.

[0197] In some embodiments of the present application, the image enhancement module may further configure different application programming interfaces for different target applications, so that different target applications can adjust the intensity of image processing corresponding to the video data according to their own needs.

[0198] For example, the first application and the second application are both video applications. The image enhancement module can be configured with a first interface for the first application and a second interface for the second application. When the first application wants to perform image enhancement on video data using a first processing intensity, it can call the image enhancement module through the first interface. Similarly, when the second application wants to perform image enhancement on video data using a second processing intensity, it can call the image enhancement module through the second interface. In this way, different applications can flexibly configure the image processing intensity, thereby improving usage flexibility.

[0199] In some embodiments of the present application, some or all of the parameters in the target quality parameter information may be different from the parameters in the information used to adjust the video quality of the target video. In this way, the smart screen can process and display the video data based on some or all of the parameters in the video quality information of the target video. In other words, the smart screen can adjust the parameters corresponding to the video data separately. This enables more refined processing of video data, improving processing flexibility during image processing.

[0200] In some embodiments of the present application, the target video may include multiple frames of images. The information used to adjust the video quality of the target video includes information used to adjust the image quality of at least one frame of image in the target video.

[0201] The server can also send information for adjusting the image quality of at least one frame of the target video and video stream information to the smart screen. The smart screen can process and display the at least one frame of the video data corresponding to the video stream information based on the information for adjusting the image quality of at least one frame of the target video.

[0202] Among them, the information used to adjust the image quality of at least one frame of image in the target video may include one or more of clarity parameters, color parameters, contrast parameters, brightness parameters, noise parameters, smoothness parameters, grayscale parameters, saturation parameters, background blur parameters, dark corner parameters or color temperature parameters.

[0203] That is, the smart screen can receive information sent by the server for adjusting the image quality of at least one frame of the target video, and perform image processing on the at least one frame of the video data and display it based on the information about the image quality of the at least one frame of the target video. In this way, the smart screen can perform image processing on the at least one frame of the video data and display it based on the image quality corresponding to the at least one frame of the video data. This enables refined processing of at least one frame of the video data, improving the flexibility and sophistication of the processing process.

[0204] In some embodiments of the present application, after the smart screen performs image processing on the video data according to the target quality parameter information, it can display the video picture corresponding to the target video, and the video picture is rendered based on the video data after image processing.

[0205] That is, after the image enhancement module processes the video data according to the target quality parameter information, it can control the display screen to display the processed video data. In this way, the user can watch the target video with better display effect through the smart screen.

[0206] In some embodiments of the present application, the smart screen can also output prompt information, which is used to prompt that the video quality of the target video has been improved.

[0207] For example, after the user selects Movie A on the details page of the target application, the smart screen detects the user's selection of Movie A, performs image processing on the video data corresponding to Movie A, and displays the processed video image corresponding to Movie A. While displaying the video image corresponding to Movie A, the smart screen can also output a prompt message.

[0208] The prompt information may include one or more of pop-up prompt information, text prompt information, voice prompt information or video prompt information.

[0209] As shown in Figure 11 , the smart screen can display a prompt message on the playback interface of the current movie A. The prompt message can be implemented as the text "The video quality of movie A has been improved." Of course, the smart screen can also control the speaker to play the prompt message. The prompt message can be implemented as a prompt tone such as "The video quality of movie A has been improved."

[0210] As can be seen, after the smart screen processes the video data, it can output a prompt message to the user that the video quality of the target video has been improved. This further improves the interactivity between the user and the smart screen and the flexibility of the video display process.

[0211] In some embodiments, multiple embodiments of the present application may be combined and the combined embodiments may be implemented. Optionally, some operations in the processes of the various method embodiments may be optionally combined, and / or the order of some operations may be optionally changed. Furthermore, the execution order between the steps of each process is merely exemplary and does not constitute a limitation on the execution order between the steps. Other execution orders may also be used between the steps. This is not intended to indicate that the execution order is the only order in which these operations may be performed.

[0212] Those skilled in the art will appreciate various ways to reorder the operations described in the embodiments of the present application. In addition, it should be noted that the process details involved in a certain embodiment of the present application are also applicable to other embodiments in a similar manner, or different embodiments can be used in combination.

[0213] Furthermore, some steps in the method embodiments may be equivalently replaced with other possible steps. Alternatively, some steps in the method embodiments may be optional and may be deleted in certain usage scenarios. Alternatively, other possible steps may be added to the method embodiments.

[0214] Furthermore, the various method embodiments may be implemented separately or in combination.

[0215] An embodiment of the present application also provides an electronic device, such as the above-mentioned smart screen. As shown in Figure 12, the electronic device may include one or more processors 1910, a memory 1920 and a communication interface 1930.

[0216] The memory 1920 and the communication interface 1930 are coupled to the processor 1910. For example, the memory 1920, the communication interface 1930 and the processor 1910 may be coupled together via a bus 1940.

[0217] The communication interface 1930 is used to transmit data with other devices. The memory 1920 stores computer program code. The computer program code includes computer instructions. When the computer instructions are executed by the processor 1910, the electronic device executes the video processing method in the embodiment of the present application.

[0218] The processor 1910 may be a processor or controller, such as a central processing unit (CPU), a general-purpose processor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA), or other programmable logic devices, transistor logic devices, hardware components, or any combination thereof. It may implement or execute the various exemplary logic blocks, modules, and circuits described in conjunction with the present disclosure. The processor may also be a combination that implements computing functions, such as a combination of one or more microprocessors, a combination of a DSP and a microprocessor, and the like.

[0219] Bus 1940 may be a Peripheral Component Interconnect (PCI) bus or an Extended Industry Standard Architecture (EISA) bus. Bus 1940 may be divided into an address bus, a data bus, a control bus, and the like. For ease of illustration, FIG12 shows only one thick line, but this does not necessarily indicate that there is only one bus or only one type of bus.

[0220] An embodiment of the present application provides an interactive system, which includes an electronic device and a server. The electronic device is configured to send a video acquisition request for a target video to the server. The server is configured to receive the video acquisition request sent by the electronic device, and obtain information for adjusting the video quality of the target video and video stream information of the target video. The server is also configured to send information for adjusting the video quality of the target video and video stream information of the target video to the electronic device. The electronic device is also configured to receive information for adjusting the video quality of the target video and video stream information of the target video sent by the server, and obtain video data corresponding to the video stream information based on the video stream information of the target video. The electronic device is also configured to perform image processing on the video data corresponding to the video stream information and display it based on the information for adjusting the video quality of the target video.

[0221] An embodiment of the present application provides a server, which includes: a memory and a processor, wherein program instructions are stored in the memory, and the processor executes the relevant method steps in the above method embodiment by running the program instructions.

[0222] An embodiment of the present application also provides an electronic device, which includes: a memory, a processor and a display screen. The memory and the display screen are coupled to the processor. The display screen is used to output video images, and the memory is used to store computer-readable instructions. When the processor reads the computer-readable instructions from the memory, the electronic device executes the relevant method steps in the above method embodiment.

[0223] An embodiment of the present application further provides a computer-readable storage medium, in which computer program code is stored. When the processor executes the computer program code, the electronic device executes the relevant method steps in the above method embodiment.

[0224] An embodiment of the present application further provides a computer program product, which, when executed on a computer, enables the computer to execute the relevant method steps in the above method embodiment.

[0225] An embodiment of the present application also provides a chip system, including: a processor, the processor is coupled to a memory, the memory is used to store programs or instructions, and when the program or instructions are executed by the processor, the chip system implements the method in any of the above method embodiments.

[0226] Optionally, there may be one or more processors in the chip system. The processor may be implemented in hardware or software. When implemented in hardware, the processor may be a logic circuit, an integrated circuit, etc. When implemented in software, the processor may be a general-purpose processor implemented by reading software code stored in a memory.

[0227] Optionally, the memory in the chip system may be one or more. The memory may be integrated with the processor or may be provided separately from the processor, which is not limited in the embodiments of the present application. For example, the memory may be a non-transient processor, such as a read-only memory (ROM), which may be integrated with the processor on the same chip or provided on different chips. The embodiments of the present application do not specifically limit the type of memory or the configuration of the memory and the processor.

[0228] Exemplarily, the chip system may be a field programmable gate array (FPGA), an application specific integrated circuit (ASIC), a system on chip (SoC), a central processor unit (CPU), a network processor (NP), a digital signal processor (DSP), a microcontroller unit (MCU), a programmable logic device (PLD) or other integrated chips.

[0229] Among them, the electronic device, computer storage medium or computer program product provided in this application is used to execute the corresponding method provided above. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding method provided above, and will not be repeated here.

[0230] Through the description of the above implementation methods, technical personnel in the relevant field can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional modules is used as an example. In actual applications, the above-mentioned functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.

[0231] In the several embodiments provided in this application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are merely schematic. For example, the division of modules or units is only a logical function division. In actual implementation, there may be other division methods, such as multiple units or components can be combined or integrated into another device, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0232] Units described as separate components may or may not be physically separate, and components shown as units may be one physical unit or multiple physical units, located in one place or distributed across multiple locations. Some or all of the units may be selected to achieve the purpose of this embodiment according to actual needs.

[0233] In addition, the functional units in the various embodiments of the present application may be integrated into a single processing unit, or each unit may exist physically separately, or two or more units may be integrated into a single unit. The aforementioned integrated units may be implemented in the form of hardware or software functional units.

[0234] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application is essentially or the contributing part or all or part of the technical solution can be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for enabling a device (which can be a single-chip microcomputer, chip, etc.) or a processor to execute all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.

[0235] The above content is only a specific embodiment of this application, but the scope of protection of this application is not limited to this. Any changes or replacements within the technical scope disclosed in this application should be included in the scope of protection of this application. Therefore, the scope of protection of this application should be based on the scope of protection of the claims.

Claims

1. A video processing method, characterized in that: Applied to electronic equipment, the method comprises: Send a video acquisition request for the target video to the server; receiving information for adjusting the video quality of the target video and video stream information of the target video from the server; According to the video stream information of the target video, obtaining video data corresponding to the video stream information; According to the information for adjusting the video quality of the target video, the video data corresponding to the video stream information is image processed and displayed.

2. The method according to claim 1, characterized in that The performing image processing and displaying of the video data corresponding to the video stream information according to the information for adjusting the video quality of the target video includes: Determining target quality parameter information according to the information used to adjust the video quality of the target video; the target quality parameter information matches the display capability of the electronic device, and at least one parameter in the target quality parameter information is different from a parameter in the information used to adjust the video quality of the target video; According to the target quality parameter information, image processing is performed on the video data corresponding to the video stream information and the image is displayed.

3. The method according to claim 1, characterized in that The information for adjusting the video quality of the target video includes target quality parameter information, and the target quality parameter information matches the display capability of the electronic device; and performing image processing and displaying the video data corresponding to the video stream information according to the information for adjusting the video quality of the target video includes: According to the target quality parameter information, image processing is performed on the video data corresponding to the video stream information and the image is displayed.

4. The method according to claim 2 or 3, characterized in that: The information of the video quality of the target video includes original quality parameter information, and performing image processing and displaying the video data corresponding to the video stream information according to the target quality parameter information includes: According to the target quality parameter information, the original quality parameter of the video data corresponding to the video stream is adjusted to be consistent with the target quality parameter information and displayed.

5. The method according to claim 2 or 3, characterized in that: The target quality parameter information includes an adjustment value corresponding to at least one parameter in the information for adjusting the video quality of the target video; and performing image processing and displaying the video data corresponding to the video stream information according to the target quality parameter information includes: According to the adjustment value corresponding to the at least one parameter, image processing is performed on the video data corresponding to the video stream information and the image is displayed.

6. The method according to any one of claims 1 to 5, characterized in that: The information used to adjust the video quality of the target video includes information used to adjust the image quality of at least one frame of image in the target video; The performing image processing and displaying of the video data corresponding to the video stream information according to the information for adjusting the video quality of the target video includes: According to the information for adjusting the image quality of at least one frame of the target video, image processing is performed on at least one frame of the video data corresponding to the video stream information and the image is displayed.

7. The method according to any one of claims 1 to 6, characterized in that: The method further comprises: Outputting prompt information, wherein the prompt information is used to prompt that the video quality of the target video has been improved.

8. The method according to any one of claims 1 to 7, characterized in that: The information used to adjust the video quality of the target video includes one or more of a clarity parameter, a color parameter, a contrast parameter, a brightness parameter, a noise parameter, a smoothness parameter, a grayscale parameter, a saturation parameter, a background blur degree parameter, a dark corner parameter or a color temperature parameter.

9. The method according to any one of claims 1 to 8, characterized in that: The video acquisition request includes the video identifier of the target video; or, The video stream information of the target video includes the video stream address of the target video.

10. The method according to any one of claims 2 to 5, characterized in that: The display capability of the electronic device includes at least one of a display hardware capability and a display software capability of the electronic device.

11. A video processing method, characterized in that: Applied to a server, the method comprises: Receiving a video acquisition request for a target video sent by an electronic device; Acquire, according to the video acquisition request, information for adjusting the video quality of the target video and video stream information of the target video; The information for adjusting the video quality of the target video and the video stream information of the target video are sent to the electronic device, wherein the information of the video quality of the target video is used to adjust the video quality of the target video displayed on the device.

12. The method according to claim 11, characterized in that Before receiving the video acquisition request of the target video sent by the electronic device, the method further includes: Image quality detection is performed on the video data corresponding to the target video to obtain information for adjusting the video quality of the target video.

13. The method according to claim 11, characterized in that Before receiving the video acquisition request of the target video sent by the electronic device, the method further includes: Performing image quality detection on video data corresponding to the target video to obtain information for adjusting the video quality of the target video; Determining target quality parameter information according to information used to adjust the video quality of the target video; the target quality parameter information matches the display capability of the electronic device; The sending the information for adjusting the video quality of the target video and the video stream information of the target video to the electronic device includes: The target quality parameter information and the video stream information of the target video are sent to the electronic device.

14. The method according to any one of claims 11 to 13, characterized in that: The video acquisition request includes the video identifier of the target video; or the video stream information of the target video includes the video stream address of the target video; The acquiring, according to the video acquisition request, information for adjusting the video quality of the target video and video stream information of the target video comprises: According to the video identifier of the target video, information for adjusting the video quality of the target video and the video stream address of the target video are acquired.

15. An interactive system, characterized in that: The interactive system includes an electronic device and a server; The electronic device is configured to send a video acquisition request for a target video to the server; The server is configured to receive the video acquisition request sent by the electronic device, and acquire information for adjusting the video quality of the target video and video stream information of the target video; The server is further configured to send the information for adjusting the video quality of the target video and the video stream information of the target video to the electronic device; The electronic device is further configured to receive the information for adjusting the video quality of the target video and the video stream information of the target video sent by the server, and acquire video data corresponding to the video stream information according to the video stream information of the target video; The electronic device is further configured to perform image processing and display on the video data corresponding to the video stream information according to the information used to adjust the video quality of the target video.

16. A server, characterized in that: The server comprises: a memory and a processor, wherein program instructions are stored in the memory, and the processor executes the video processing method according to any one of claims 11 to 14 by running the program instructions.

17. An electronic device, characterized in that: The electronic device includes: a memory, a processor and a display screen, wherein the memory and the display screen are coupled to the processor, the display screen is used to display a video screen corresponding to a target video, and the memory is used to store computer-readable instructions. When the processor reads the computer-readable instructions from the memory, the electronic device executes the video processing method as described in any one of claims 1 to 10.

18. A computer-readable storage medium, characterized in that: The computer-readable storage medium includes a computer program, and when the computer program is executed on an electronic device, the electronic device executes the video processing method according to any one of claims 1 to 10.

Images