Video processing method and electronic equipment

Abstract

The embodiment of the invention provides a video processing method and electronic equipment, and relates to the technical field of electronics, the method can be applied to the electronic equipment, and the method comprises the following steps: the electronic equipment can send a video acquisition request of a target video to a server, and receiving information for adjusting the video quality of the target video and video stream information of the target video from the server. The electronic device can also obtain video data corresponding to the video stream information according to the video stream information of the target video. And according to the information used for adjusting the video quality of the target video, performing image processing on the video data corresponding to the video stream information and displaying the video data. Therefore, according to the embodiment of the invention, the video data can be subjected to image processing and displayed on the basis of considering the video quality of the target video. And the problem of excessive adjustment of the video data is avoided. And furthermore, the display effect of the video data is improved, and the user experience is improved.

Description

Technical Field

[0001] The present application relates to the field of electronic technology, and in particular to a video processing method and electronic equipment. Background Art

[0002] With the rapid popularization of electronic devices such as televisions, mobile phones and computers, people's lives have been brought a lot of convenience and enjoyment. People can use electronic devices to watch some video resources for entertainment or learning. When playing video resources, electronic devices usually obtain the video data corresponding to the video from the cloud server, pre-process the video data in advance to improve the display effect of the video resources, and finally control the display screen to display the video picture.

[0003] At present, in order to balance the display effects of most video resources, electronic devices usually use the same adjustment method to adjust the video data during the pre-processing of the video data. For example, the clarity corresponding to the video data is increased by 20%. It is understandable that the video data corresponding to each video resource is different, some video data have higher clarity, and some video data have lower clarity. If a unified adjustment is made for most video resources, there will be a problem of over-adjustment of the video resources. As a result, when the electronic device plays the video resources, the display effect of the video resources is poor, which reduces the user experience. Summary of the invention

[0004] The embodiment of the present application provides a video processing method and an electronic device, wherein the electronic device can receive information sent by a server for adjusting the video quality of a target video, and perform image processing and display on the video data according to the information of the video quality of the target video. The video data is image processed and displayed based on the video quality of the target video. The problem of over-adjustment of the video data is avoided. Thus, the display effect of the video data is improved.

[0005] To achieve the above objectives, the embodiments of the present application adopt the following technical solutions:

[0006] In a first aspect, an embodiment of the present application provides a video processing method, which can be applied to an electronic device, and the method includes: the electronic device can send a video acquisition request of a target video to a server, and receive information for adjusting the video quality of the target video and video stream information of the target video from the server. The electronic device can also obtain video data corresponding to the video stream information according to the video stream information of the target video. And, according to the information for adjusting the video quality of the target video, image processing is performed on the video data corresponding to the video stream information and displayed.

[0007] That is, the electronic device can receive the information sent by the server for adjusting the video quality of the target video, and perform image processing and display on the video data according to the information of the video quality of the target video. In this way, the electronic device can perform image processing and display on the video data based on the video quality of the target video. The problem of excessive adjustment of the video data is avoided. In addition, the display effect of the video data is improved, and the user experience is improved.

[0008] In an implementation manner of the first aspect, in a process of performing image processing and displaying video data corresponding to the video stream information according to the information for adjusting the video quality of the target video, the electronic device may determine the target quality parameter information according to the information for adjusting the video quality of the target video. The target quality parameter information matches the display capability of the electronic device, and at least one parameter in the target quality parameter information is different from the parameter in the information for adjusting the video quality of the target video. The electronic device may also perform image processing and display on the video data corresponding to the video stream information according to the target quality parameter information.

[0009] That is, the electronic device can determine the target quality parameter information based on the information used to adjust the video quality of the target video. The target quality parameter information is matched with its own display capability.

[0010] In this way, the electronic device can use the target quality parameter information to process and display the video data based on the video quality of the target video and its own display capability. It will neither waste its own display capability nor perform excessive image processing on the video data. Since the video data after image processing matches its own display capability, the electronic device can improve the display effect corresponding to the target video in the process of displaying the video data. In turn, it improves the user experience.

[0011] Furthermore, some or all of the parameters in the target quality parameter information may be different from the parameters in the information for adjusting the video quality of the target video. In this way, the electronic device may perform image processing and display on the video data based on some or all of the parameters in the information for adjusting the video quality of the target video, thereby improving the processing flexibility in the image processing process.

[0012] In an implementation manner of the first aspect, the information used to adjust the video quality of the target video includes target quality parameter information, and the target quality parameter information matches the display capability of the electronic device.

[0013] In the process of performing image processing and displaying video data corresponding to the video stream information according to information for adjusting the video quality of the target video, the electronic device may perform image processing and displaying the video data corresponding to the video stream information according to the target quality parameter information.

[0014] That is to say, the electronic device can receive information sent by the server for adjusting the video quality of the target video, which includes target quality parameter information, and the target quality parameter information matches the display capability of the electronic device. In this way, the electronic device can directly process and display the video data according to the target quality parameter information sent by the server. Neither will the display capability of the electronic device be wasted, nor will the electronic device perform excessive image processing on the video data. Since the video data after image processing matches its own display capability, the electronic device can improve the display effect corresponding to the target video in the process of displaying the video data. In turn, the user's experience is improved.

[0015] In an implementation manner of the first aspect, the information on the video quality of the target video includes original quality parameter information. In the process of performing image processing and displaying the video data corresponding to the video stream information according to the target quality parameter information, the electronic device can adjust the original quality parameter of the video data corresponding to the video stream to be consistent with the target quality parameter information according to the target quality parameter information and display it.

[0016] That is, in some examples, the target quality parameter information may be one or more specific parameters. For example, a clarity parameter 50, a color parameter 30, and a contrast parameter 30. The electronic device may adjust the original quality parameters of the video data corresponding to the video stream to be consistent with the above specific parameters and display them according to the specific parameters. This will neither waste the display capability of the electronic device nor perform excessive image processing on the video data.

[0017] In an implementation manner of the first aspect, the target quality parameter information includes an adjustment value corresponding to at least one parameter in the information for adjusting the video quality of the target video. In the process of performing image processing and displaying the video data corresponding to the video stream information according to the target quality parameter information, the electronic device may perform image processing and display the video data corresponding to the video stream information according to the adjustment value corresponding to the at least one parameter.

[0018] That is, in some examples, the target quality parameter information may be a value corresponding to one or more parameters that needs to be adjusted, that is, it may represent the degree to which one or more parameters need to be adjusted. In this way, the electronic device may also process and display the video data according to the value corresponding to one or more parameters that needs to be adjusted. Similarly, the display capability of the electronic device will not be wasted, nor will the video data be subjected to excessive image processing.

[0019] In an implementation manner of the first aspect, the information used to adjust the video quality of the target video includes information used to adjust the image quality of at least one frame of image in the target video.

[0020] In the process of performing image processing and displaying video data corresponding to video stream information based on information used to adjust the video quality of the target video, the electronic device can perform image processing and display at least one frame of image in the video data corresponding to the video stream information based on information used to adjust the image quality of at least one frame of image in the target video.

[0021] That is, the electronic device can receive information sent by the server for adjusting the image quality of at least one frame of the target video, and perform image processing and display on at least one frame of the video data according to the information of the image quality of at least one frame of the target video. In this way, the electronic device can perform image processing and display on at least one frame of the video data based on the image quality corresponding to at least one frame of the image. It is possible to finely process at least one frame of the video data, thereby improving the flexibility and fineness of the processing process.

[0022] In an implementation manner of the first aspect, the method further includes: outputting prompt information, where the prompt information is used to prompt that the video quality of the target video has been improved.

[0023] It can be seen that after the electronic device processes the video data, it can output prompt information to prompt the user that the video quality of the target video has been improved, thereby improving the interactivity between the user and the electronic device and the flexibility of the video display process.

[0024] In an implementation method of the first aspect, the information used to adjust the video quality of the target video includes one or more of a clarity parameter, a color parameter, a contrast parameter, a brightness parameter, a noise parameter, a smoothness parameter, a grayscale parameter, a saturation parameter, a background blur degree parameter, a vignetting parameter or a color temperature parameter.

[0025] In an implementation manner of the first aspect, the video acquisition request includes a video identifier of the target video; or the video stream information of the target video includes a video stream address of the target video.

[0026] In an implementation manner of the first aspect, the display capability of the electronic device includes at least one of a display hardware capability and a display software capability of the electronic device.

[0027] In a second aspect, an embodiment of the present application further provides a video processing method, which is applied to a server, and the method includes: the server can receive a video acquisition request for a target video sent by an electronic device, and acquire information for adjusting the video quality of the target video and video stream information of the target video according to the video acquisition request. The server can also send information for adjusting the video quality of the target video and video stream information of the target video to the electronic device, wherein the information on the video quality of the target video is used to adjust the video quality of the target video displayed on the device.

[0028] That is, the server can obtain information for adjusting the video quality of the target video, and the information of the video quality of the target video is used to adjust the video quality of the target video displayed on the device. In addition, the server can send the information of the video quality of the target video to the electronic device, so that the subsequent electronic device can perform image processing and display on the video data based on the video quality of the target video. Avoid the problem of excessive adjustment of the video data. In turn, improve the display effect of the video data.

[0029] In an implementation manner of the second aspect, before receiving a video acquisition request for a target video sent by an electronic device, the server may perform image quality detection on video data corresponding to the target video to obtain information for adjusting the video quality of the target video.

[0030] That is, the server can perform image quality detection on the video data corresponding to the target video in advance to obtain information for adjusting the video quality of the target video. In this way, the information for adjusting the video quality of the target video can be sent to the electronic device later, so that the electronic device can perform image processing and display on the video data based on the video quality of the target video. This avoids the problem of excessive adjustment of the video data.

[0031] In an implementation of the second aspect, before receiving the video acquisition request of the target video sent by the electronic device, the server may also perform image quality detection on the video data corresponding to the target video to obtain information for adjusting the video quality of the target video. And according to the information for adjusting the video quality of the target video, the target quality parameter information is determined. The target quality parameter information matches the display capability of the electronic device. The server may also send the target quality parameter information and the video stream information of the target video to the electronic device.

[0032] That is to say, the server can determine the target quality parameter information based on the information used to adjust the video quality of the target video. The target quality parameter information matches its own display capability. And the target quality parameter information and the video stream information of the target video are sent to the electronic device. It can facilitate subsequent electronic devices to use the target quality parameter information to perform image processing and display on the video data based on the consideration of the video quality of the target video and its own display capability. It will neither waste its own display capability nor perform excessive image processing on the video data. Since the video data after image processing matches its own display capability, it can also improve the display effect corresponding to the target video.

[0033] In an implementation manner of the second aspect, the video acquisition request includes a video identifier of the target video; or the video stream information of the target video includes a video stream address of the target video. In the process of acquiring information for adjusting the video quality of the target video and the video stream information of the target video according to the video acquisition request, the server may acquire information for adjusting the video quality of the target video and the video stream address of the target video according to the video identifier of the target video.

[0034] In a third aspect, an embodiment of the present application provides an interactive system, which includes an electronic device and a server.

[0035] The electronic device is configured to send a video acquisition request of a target video to a server.

[0036] The server is configured to receive a video acquisition request sent by an electronic device, and acquire information for adjusting the video quality of a target video and video stream information of the target video.

[0037] The server is further configured to send information for adjusting the video quality of the target video and video stream information of the target video to the electronic device.

[0038] The electronic device is further configured to receive information for adjusting the video quality of the target video and the video stream information of the target video sent by the server, and to obtain video data corresponding to the video stream information according to the video stream information of the target video.

[0039] The electronic device is further configured to perform image processing and display on the video data corresponding to the video stream information according to the information used to adjust the video quality of the target video.

[0040] It can be seen that the electronic device can receive the information for adjusting the video quality of the target video and the video stream information of the target video sent by the server, and perform image processing and display on the video data according to the information of the video quality of the target video. In this way, the electronic device can perform image processing and display on the video data based on the video quality of the target video. Avoid the problem of excessive adjustment of the video data. Further, improve the display effect of the video data and enhance the user experience.

[0041] In a fourth aspect, an embodiment of the present application provides a server, the server comprising: a memory and a processor, the memory storing program instructions, and the processor executing the video processing method as described in the second aspect above by running the program instructions.

[0042] In a fifth aspect, an embodiment of the present application provides an electronic device, comprising: a memory, a processor and a display screen, wherein the memory and the display screen are coupled to the processor, the display screen is used to display a video screen corresponding to a target video, and the memory is used to store computer-readable instructions. When the processor reads the computer-readable instructions from the memory, the electronic device executes the video processing method described in the first aspect above.

[0043] In a sixth aspect, an embodiment of the present application provides a computer-readable storage medium, which includes a computer program. When the computer program runs on an electronic device, the electronic device executes the video processing method described in the first aspect above. BRIEF DESCRIPTION OF THE DRAWINGS

[0044] Figure 1 A schematic diagram of a process flow of a related technology 1 provided in an embodiment of the present application;

[0045] Figure 2 A schematic diagram of a process flow of a related technology 2 provided in an embodiment of the present application;

[0046] Figure 3 A schematic diagram of the hardware structure of a smart screen provided in an embodiment of the present application;

[0047] Figure 4 A schematic diagram of the software structure of a smart screen provided in an embodiment of the present application;

[0048] Figure 5 A schematic diagram of the structure of an interactive system provided in an embodiment of the present application;

[0049] Figure 6 A schematic diagram of a video processing method provided in an embodiment of the present application;

[0050] Figure 7 A flowchart of an application scenario provided in an embodiment of the present application;

[0051] Figure 8 A schematic diagram of interaction between a smart screen and a server provided in an embodiment of the present application;

[0052] Fig. 9 A schematic diagram of a process between a server and a smart screen provided in an embodiment of the present application;

[0053] Fig.10 A schematic diagram of another process between a server and a smart screen provided in an embodiment of the present application;

[0054] Fig.11 A schematic diagram of an interface for prompting information provided in an embodiment of the present application;

[0055] Fig.12 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0056] The technical solutions in the embodiments of the present application will be described below in conjunction with the drawings in the embodiments of the present application. Among them, in the description of the present application, unless otherwise specified, " / " indicates that the objects associated before and after are in an "or" relationship, for example, A / B can represent A or B; "and / or" in the present application is only a kind of association relationship describing the associated objects, indicating that there can be three relationships, for example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone, where A and B can be singular or plural. And, in the description of the present application, unless otherwise specified, "multiple" refers to two or more than two. "At least one of the following" or its similar expressions refers to any combination of these items, including any combination of single items or plural items. For example, at least one of a, b, or c can represent: a, b, c, ab, ac, bc, or abc, where a, b, c can be single or multiple. In addition, in order to clearly describe the technical solutions of the embodiments of the present application, in the embodiments of the present application, words such as "first" and "second" are used to distinguish the same or similar items with basically the same functions and effects.

[0057] Those skilled in the art will appreciate that words such as "first" and "second" do not limit the quantity and execution order, and words such as "first" and "second" do not necessarily limit the difference. At the same time, in some embodiments of the present application, words such as "exemplary" or "for example" are used to indicate examples, illustrations or descriptions. Any embodiment or design described as "exemplary" or "for example" in the embodiments of the present application should not be interpreted as being more preferred or more advantageous than other embodiments or designs. Specifically, the use of words such as "exemplary" or "for example" is intended to present related concepts in a concrete way for easy understanding.

[0058] In addition, the network architecture and business scenarios described in the embodiments of the present application are intended to more clearly illustrate the technical solutions of the embodiments of the present application, and do not constitute a limitation on the technical solutions provided in the embodiments of the present application. A person of ordinary skill in the art can appreciate that with the evolution of the network architecture and the emergence of new business scenarios, the technical solutions provided in the embodiments of the present application are equally applicable to similar technical problems.

[0059] When playing video resources, electronic devices usually obtain video data corresponding to the video from a cloud server, pre-process the video data in advance to improve the display effect of the video resources, and finally control the display screen to display the video screen.

[0060] At present, in order to balance the display effects of most video resources, each electronic device usually uses the same adjustment method to adjust the video data during the process of preprocessing the video data.

[0061] For example, the clarity of the video resource is increased by 20%. It is understandable that the video data corresponding to each video resource is different, some video data has a higher clarity, and some video data has a lower clarity. If a unified adjustment is made for most video resources, there will be problems of over-adjusting the video resources or failing to adjust the video resources to match the display hardware capabilities. As a result, when the electronic device plays the video resources, the display effect of the video resources is poor, reducing the user experience.

[0062] The related art provides a method for adjusting the image mode, see Figure 1 , the electronic device can capture the currently playing video screen, and use the classification model to recognize the video screen, obtain the recognition result and issue a recognition instruction. Then, the electronic device calls the scene local model according to the recognition instruction, loads the classification label for model matching, and obtains the matching result. Then, the sound mode and image mode are automatically adjusted according to the matching result.

[0063] It can be seen that the above scheme is based on the deep learning network classification model to identify the video screen in real time to determine the video category. By adjusting different image modes for videos of different categories. When an electronic device determines the category of the corresponding video based on a certain frame of an image in the video, such as sports-themed videos and animation-themed videos, the category may be misjudged, and the error rate is high. At the same time, different categories of videos correspond to different sound modes and image modes. However, fixed image parameters are still used for unified adjustment for videos of the same category. There will still be problems of too high or too low adjustment in the process of adjusting the video. As a result, the display effect of video resources is poor when the electronic device plays video resources.

[0064] The related art also provides an automatic image pattern matching method, see Figure 2 , the scheme is that the electronic device obtains the image sequence of the currently played video content, divides each frame image in the image sequence into multiple image areas, and calculates the average grayscale value corresponding to each image area. Then, according to the average grayscale value corresponding to each image area, it is determined that the video content is a movie video, and the electronic device switches the image mode of the video content to the preset movie image mode.

[0065] It can be seen that the above scheme only adjusts the image for movie-type videos, and the movie image mode corresponds to image parameters. At the same time, the fixed image parameters used by all movie-type videos are uniformly adjusted. There will still be problems of too high or too low adjustment in the process of adjusting the video. As a result, the display effect of video resources is poor when the electronic device plays video resources. At the same time, some current movie videos do not have the characteristics of upper and lower black borders. In this way, judging that the video content is a movie video based on the characteristics of upper and lower black borders in the video will result in wrong judgments and a high misjudgment rate.

[0066] As can be seen from the above content, the currently provided video processing methods all have the problem of over-adjusting the video resources or failing to adjust the video resources to a suitable display effect, which results in poor display effect of the video resources when the electronic device plays the video resources.

[0067] The embodiment of the present application provides a video processing method and an electronic device, which can be applied to an electronic device, and the method includes: the electronic device can send a video acquisition request of a target video to a server, and receive information for adjusting the video quality of the target video and video stream information of the target video from the server. The electronic device can also obtain video data corresponding to the video stream information according to the video stream information of the target video. And, according to the information for adjusting the video quality of the target video, image processing is performed on the video data corresponding to the video stream information and displayed.

[0068] That is, in the embodiment of the present application, before playing the target video, the electronic device can receive the information and video stream information for adjusting the video quality of the target video sent by the server. And according to the information for adjusting the video quality of the target video, the electronic device can also perform image processing on the video data corresponding to the video stream, and display the video data after image processing.

[0069] It is understandable that the electronic device can obtain the information sent by the server in advance for adjusting the video quality of the target video, and perform image processing and display on the video data based on the video quality of the target video. In this way, the video data will not be over-processed. Furthermore, the electronic device can improve the display effect corresponding to the target video in the process of displaying the video data. Thus, the user's experience is improved.

[0070] The video processing method provided in the embodiment of the present application can be applied to electronic devices. In some embodiments, the electronic device may include, for example, a smart screen, a mobile phone, a tablet computer, a personal computer (PC), a personal digital assistant (PDA), a smart watch, a netbook, a wearable device, an augmented reality (AR) device, a virtual reality (VR) device, a vehicle-mounted device, and a smart car, etc. The embodiment of the present application does not impose any special restrictions on the specific form of the electronic device.

[0071] The operating system installed on the electronic device includes but is not limited to Or other operating systems. This application does not limit the specific type of electronic equipment and the type of operating system when an operating system is installed.

[0072] For example, taking the electronic device as a smart screen as an example, Figure 3 (A) in the figure shows a schematic diagram of the structure of the smart screen 100.

[0073] The smart screen 100 may include a processor 110, an external memory interface 120, an internal memory 121, an antenna, a wireless communication module 130, a charging management module 140, a power management module 141, a battery 142, an audio module 150, a speaker 150A, a sensor module 160, a camera 170 and a display screen 180. Among them, the sensor module 160 includes an image sensor 160A.

[0074] It is understood that the structure illustrated in the embodiment of the present application does not constitute a specific limitation on the smart screen 100. In other embodiments of the present application, the smart screen 100 may include more or fewer components than shown in the figure, or combine certain components, or split certain components, or arrange the components differently. The components shown in the figure can be implemented in hardware, software, or a combination of software and hardware.

[0075] The processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.

[0076] Among them, the controller can be the nerve center and command center of the smart screen 100. The controller can generate an operation control signal according to the instruction operation code and the timing signal to complete the control of fetching and executing instructions.

[0077] The processor 110 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may store instructions or data that the processor 110 has just used or cyclically used. If the processor 110 needs to use the instruction or data again, it may be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0078] The wireless communication function of the smart screen 100 can be realized through an antenna, a wireless communication module 130, a modem processor, and a baseband processor.

[0079] The wireless communication module 130 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc., which can be applied to the smart screen 100. The wireless communication module 130 can be one or more devices integrating at least one communication processing module. The wireless communication module 130 receives electromagnetic waves via an antenna, modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110. The wireless communication module 130 can also receive the signal to be sent from the processor 110, modulate the frequency, amplify it, and convert it into electromagnetic waves for radiation through the antenna.

[0080] The smart screen 100 implements the display function through a GPU, a display screen 180, and an application processor. The GPU is a microprocessor for image processing, which connects the display screen 180 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs that execute program instructions to generate or change display information.

[0081] The display screen 180 is used to display images, video images corresponding to the target video, etc. The display screen 180 includes a display panel. In some embodiments, the smart screen 100 may include 1 or N display screens 180, where N is a positive integer greater than 1.

[0082] The smart screen 100 can realize the shooting function through ISP, camera 170, video codec, GPU, display screen 180 and application processor.

[0083] The ISP is used to process the data fed back by the camera 170. For example, when taking a photo, the shutter is opened, and the light is transmitted to the camera photosensitive element through the lens. The light signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to the ISP for processing and converts it into an image visible to the naked eye. The ISP can also perform algorithm optimization on the noise, brightness, and skin color of the image. The ISP can also optimize the exposure, color temperature and other parameters of the shooting scene. In some embodiments, the ISP can be set in the camera 170.

[0084] The camera 170 is used to capture still images or videos. The object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal oxide semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, and then transmits the electrical signal to the ISP for conversion into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV or other format.

[0085] In some embodiments, the smart screen 100 may include 1 or N cameras 170 , where N is a positive integer greater than 1.

[0086] Here, the camera 170 can be set in the smart screen 100. Of course, it can also be a part of the electronic device. In some implementations, the camera can also be set outside the electronic device and connected to the electronic device by wired or wireless means. For example, the camera and the electronic device can be connected to the electronic device via Bluetooth or a mobile hotspot. The electronic device can control the camera by sending or receiving instructions to the camera.

[0087] The camera 170 may also include a camera module, which may be disposed inside the camera. Of course, it may also be disposed at other locations inside the smart screen 100. The camera module includes a lens, a focus motor, a base, a circuit board, and a photosensitive element.

[0088] The base is fixedly connected to one side of the circuit board. The focus motor is located on the side of the base away from the circuit board and is fixedly connected to the periphery of the base. The lens is installed in the middle of the focus motor. The photosensitive element is fixed to the side of the circuit board facing the lens.

[0089] The lens is used to collect light signals reflected by the subject. The focus motor is used to drive the lens to move in a direction parallel to the optical axis. The optical axis refers to a line passing through the center of the lens. In some embodiments, the smart screen 100 can control the focus motor to move the lens to the focus position, thereby completing the focusing process.

[0090] In some embodiments, the focus motor may be a voice coil motor (VCM), a shape memory alloy (SMA) motor, a piezo motor (PM), a stepper motor (STM), etc.

[0091] In some embodiments of the present application, the camera 170 may be an artificial intelligence (AI) camera, and the AI ​​camera may further include an AI processor. In one conceivable embodiment, the AI ​​processor may be used for face and / or human figure recognition, image processing, video processing, posture detection, and the like.

[0092] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the smart screen 100. The external memory card communicates with the processor 110 through the external memory interface 120 to implement a data storage function. For example, music, video and other files are saved in the external memory card.

[0093] The internal memory 121 can be used to store computer executable program codes, which include instructions. The processor 110 executes various functional applications and data processing of the smart screen 100 by running the instructions stored in the internal memory 121. The internal memory 121 may include a program storage area and a data storage area.

[0094] The smart screen 100 can implement audio functions such as music playback and recording through the audio module 150, the speaker 150A, and the application processor.

[0095] In other embodiments, the image sensor 160A can be used to detect objects within the range captured by the camera, and each photosensitive unit corresponds to an image point in the image sensor. The image sensor 160A may include a first color (red green blue, RGB) image sensor, a second color (red yellow blue, RYB) image sensor, a black and white image sensor, and an infrared image sensor, etc., which is not limited in the embodiment of the present application. The image sensor 160A is used to collect images within the range captured by the camera 170, wherein the image may include an RGB image, a RYB image, a black and white image, and an infrared image, etc.

[0096] The image sensor 160A may also be disposed in one or more cameras 170. The embodiment of the present application does not specifically limit the arrangement of components.

[0097] Typically, the smart screen 100 may also be equipped with a remote controller. The remote controller is used to control the smart screen 100. Figure 3(B) in the figure shows a schematic diagram of the structure of a remote control 190. The remote control 190 may include a plurality of buttons, such as an up button 191, a down button 192, a left button 193, a right button 194, an OK button 195, a power button 196, etc. The buttons on the remote control 190 may be mechanical buttons or touch buttons. The remote control 190 may receive key inputs, generate key signal inputs related to user settings and function control of the smart screen 100, and send corresponding signals to the smart screen 100 to control the smart screen 100. For example, when a user presses the up button 191, the down button 192, the left button 193, the right button 194, the OK button 195 or the power button 196, the button may send a corresponding signal; and send a signal to the smart screen 100 via Bluetooth, infrared, etc. The smart screen 100 receives the signal corresponding to the button through the wireless communication module 130, and may perform corresponding operations according to the signal.

[0098] It is understandable that the remote controller 190 may also include other buttons and components, such as a volume button, a Bluetooth interface, an infrared interface, a battery storage cavity (for installing batteries to power the remote controller), etc. The embodiments of the present application will not be described in detail.

[0099] Figure 4 This is a software structure block diagram of the smart screen 100 of an embodiment of the present application.

[0100] The layered architecture divides the software into several layers, each with a clear role and division of labor. The layers communicate with each other through software interfaces. The system is divided into four layers, from top to bottom: application layer, application framework layer, Runtime (Android runtime) and system libraries and kernel layer.

[0101] The application layer can include a series of application packages.

[0102] like Figure 4 As shown, the application package may include applications such as camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, short message, etc. In some embodiments, the video application can play video resources.

[0103] The application framework layer provides an application programming interface (API) and a programming framework for the applications in the application layer. The application framework layer includes some predefined functions.

[0104] like Figure 4 As shown, the application framework layer may include a window manager, a content provider, a view system, a phone manager, a resource manager, a notification manager, and the like.

[0105] The window manager is used to manage window programs. The window manager can obtain the display screen size, determine whether there is a status bar, lock the screen, capture the screen, etc.

[0106] Content providers are used to store and retrieve data and make it accessible to applications. The data may include videos, images, audio, calls made and received, browsing history and bookmarks, phone books, etc.

[0107] The view system includes visual controls, such as controls for displaying text, controls for displaying images, etc. The view system can be used to build applications. A display interface can be composed of one or more views. For example, a display interface including a text notification icon can include a view for displaying text and a view for displaying images.

[0108] The phone manager is used to provide communication functions for smart watches, such as the management of call status (including answering, hanging up, etc.).

[0109] The resource manager provides various resources for applications, such as localized strings, icons, images, layout files, video files, and so on.

[0110] The notification manager allows applications to display notification information in the status bar. It can be used to convey notification-type messages and can disappear automatically after a short stay without user interaction. For example, the notification manager is used to notify download completion, message reminders, etc. The notification manager can also be a notification that appears in the system top status bar in the form of a chart or scroll bar text, such as notifications of applications running in the background, or a notification that appears on the screen in the form of a dialog window. For example, a text message is displayed in the status bar, a reminder sound is emitted, a smart watch vibrates, and an indicator light flashes.

[0111] Runtime includes core libraries and virtual machines. Runtime is responsible for the scheduling and management of the Android system.

[0112] The core library consists of two parts: one is the function that the Java language needs to call, and the other is The core library.

[0113] The application layer and the application framework layer run in a virtual machine. The virtual machine executes the Java files of the application layer and the application framework layer as binary files. The virtual machine is used to perform functions such as object life cycle management, stack management, thread management, security and exception management, and garbage collection.

[0114] The system library can include multiple functional modules, such as dynamic parameter adjustment module and image enhancement module.

[0115] In some embodiments of the present application, the dynamic parameter adjustment module is used to determine the target quality parameter information according to the information used to adjust the video quality of the target video, and the image enhancement module is used to perform image processing on the video data according to the target quality parameter information determined by the dynamic parameter adjustment module to improve the video quality corresponding to the video data. Wherein, the video data includes multiple frames of images, and the video quality corresponding to the video data can also be understood as the image quality corresponding to the video data.

[0116] The kernel layer is the layer between hardware and software. The kernel layer contains at least display driver, camera driver, audio driver, and sensor driver.

[0117] The posture detection method provided in the embodiment of the present application can be applied to the interactive system. Figure 5 An interactive system provided in an embodiment of the present application includes a first device 100 (such as a user's smart screen) and a second device 101 (such as a server).

[0118] In some embodiments, a communication connection may be established between the first device 100 and the second device 101. The communication connection may include a wireless connection.

[0119] Among them, the wireless communication technology for establishing a wireless communication connection includes but is not limited to at least one of the following: wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) network), Bluetooth (BT) (for example, traditional Bluetooth or low energy (BLE) Bluetooth), near field communication (NFC), Zigbee, frequency modulation (FM), infrared (IR), etc.

[0120] For ease of description, the first device 100 is taken as a smart screen as an example. The smart screen is different from traditional TV products because it has the function of wireless signal transmission and reception, and will assume more roles in the family. The smart screen is not only a home audio-visual entertainment center, but also an information sharing center, a control management center, and a multi-device interaction center. The smart screen can establish connections with a variety of devices to achieve information interaction.

[0121] In some embodiments of the present application, the smart screen can obtain video data corresponding to the target video from the server, and the server sends information for adjusting the video quality of the target video and the video stream information of the target video to the smart screen. The smart screen can determine the target quality parameter information based on the information for adjusting the video quality of the target video. And according to the target quality parameter information, image processing is performed on the video data corresponding to the video stream information to improve the video quality corresponding to the video data. In turn, the display effect of the target video during the display process is improved.

[0122] The interactive system provided in the embodiment of the present application may also include other electronic devices in addition to the first device 100 and the second device 101. The interactive system provided in the embodiment of the present application includes but is not limited to interaction between three devices, and may also be interaction between one device and multiple devices. Those skilled in the art can determine the type and quantity of electronic devices according to actual needs, and these designs do not exceed the protection scope of the embodiments of the present application.

[0123] The following embodiments will be combined with the accompanying drawings, taking the device as an example Figure 3 Taking the smart screen with the structure shown in the figure as an example, the video processing method provided by the embodiment of the present application is described. Figure 6 , the method may include:

[0124] S601. The smart screen receives information sent by the server for adjusting the video quality of the target video and the video stream information of the target video.

[0125] In some embodiments of the present application, the target video may be any type of video that can be played on the smart screen. For example, the target video may include one or more of a movie video, a TV series video, a variety show video, a sports video, a game video, a documentary video, a short video, a teaching video, or a live broadcast video.

[0126] The target application in the smart screen can support the selection and playback of the above target videos. Among them, the target application may include video applications, game applications, social applications, educational applications, conference applications, player applications and other applications with video playback functions. The target application can be a system application in the smart screen or a third-party application. Of course, the target application can be an application that is installed when the smart screen leaves the factory, or it can be an application that the user downloads from the Internet or obtains from other devices while using the smart screen.

[0127] Typically, a user can select a target video in a target application to watch or learn. For example, a user selects a first movie video in a video application. For another example, a user selects a game tutorial video in a game application. For another example, a user selects a recorded video shared by other users in a social application. For another example, a user selects a teaching video in a teaching type application. It can be seen that the core scenario involved in the embodiments of the present application includes a scenario in which a user selects and watches streaming media.

[0128] For ease of understanding, combined Figure 7 The application scenarios involved in the embodiments of the present application are preliminarily described.

[0129] In some embodiments of the present application, the user can select the video he wants to watch in the video application in the smart screen. For example: Movie A. After the smart screen detects the user's selection operation on Movie A, it sends a video acquisition request to the server. The server receives the video acquisition request, searches for the video stream information corresponding to Movie A according to the video acquisition request, and sends the video stream information corresponding to Movie A to the smart screen. The smart screen receives the video stream information corresponding to Movie A and decodes the video data corresponding to the video stream information. Then, the smart screen displays the decoded video data corresponding to Movie A. In this way, the user can watch Movie A through the smart screen.

[0130] It should be noted that the embodiment of the present application only takes the example that the user can select the video he wants to watch in the video application in the smart screen. The embodiment of the present application does not specifically limit the application type and video type.

[0131] The following will be combined Figure 8 (A) in the figure specifically explains the interaction process between the smart screen and the server in the embodiment of the present application.

[0132] In some embodiments of the present application, the smart screen can send a video acquisition request for the target video to the server.

[0133] In some examples, the smart screen can detect the user's trigger operation on the target video and send a video acquisition request for the target video to the server.

[0134] The server receives a video acquisition request for the target video, and acquires the video stream information of the target video and the information for adjusting the video quality of the target video according to the video acquisition request. The video stream information and the information for adjusting the video quality of the target video are sent to the smart screen. The video quality information of the target video is used to adjust the video quality of the target video displayed on the device. The smart screen can receive the video stream information of the target video and the information for adjusting the video quality of the target video sent by the server.

[0135] In some examples, the video acquisition request may include a video identifier of the target video; or, the video stream information of the target video includes a video stream address of the target video. Moreover, the video identifier is a mark that can indicate the unique identity of the target video. The video identifier may include a video name and a video ID, etc.

[0136] Specifically, the server may obtain information for adjusting the video quality of the target video and the video stream address of the target video according to the video identifier of the target video.

[0137] See also Figure 8 In (B), in some embodiments of the present application, the server includes a video generation system and a video operation platform. The video generation system includes a preprocessing module and an encoding module. The video operator can transcode and process the source data corresponding to the target video through the video generation system. In other words, the preprocessing module in the video generation system is used to perform image processing on the source data corresponding to the target video. The encoding module in the video generation system is used to encode the video data after image processing to generate video data.

[0138] Specifically, the preprocessing module can perform image processing on the source data corresponding to the target video. The source data after image processing includes information for adjusting the video quality of the target video. In addition, the preprocessing module can send the source data after image processing to the encoding module. Then, the encoding module can encode the source data after image processing to generate video data corresponding to the target video.

[0139] Among them, the information used to adjust the video quality of the target video may include one or more of clarity parameters, color parameters, contrast parameters, brightness parameters, noise parameters, smoothness parameters, grayscale parameters, saturation parameters, background blur parameters, dark corner parameters or color temperature parameters.

[0140] Exemplarily, the information used to adjust the video quality of the target video may include a clarity parameter of 50, a color parameter of 30, a contrast parameter of 30, a brightness parameter of 40, a noise parameter of 32, a smoothness parameter of 12, a grayscale parameter of 50, a saturation parameter of 43, a background blur parameter of 50, a vignetting parameter of 55, and a color temperature parameter of 68.

[0141] It should be noted that the embodiments of the present application only exemplify the information for adjusting the video quality of the target video, and do not specifically limit the type of parameters and each parameter in the information for adjusting the video quality of the target video.

[0142] In some embodiments of the present application, the information used to adjust the video quality of target videos included in the video data of different target videos may be different. The information used to adjust the video quality of target videos included in the video data of different types of target videos may also be different.

[0143] For example, a movie-type video needs to create a slightly darker and less saturated visual effect, while a sports-type video needs to create a clearer and more vivid visual effect. Thus, the grayscale parameter and saturation parameter of a movie-type video can be lower than that of a sports-type video, and the background blur degree parameter can be higher. The clarity parameter, color parameter, and brightness parameter of a sports-type video can be higher than that of a movie-type video.

[0144] In some embodiments of the present application, see Figure 8 In (B), the encoding module can send the video data of the target video to the video operation platform. The video operation personnel can configure the information of the video data through the video operation platform.

[0145] Exemplarily, the video operation platform may bind the video data with the video stream information, the video identifier, and the information for adjusting the video quality of the target video. That is, a corresponding relationship is established between the video data and the video stream information, the video identifier, and the information for adjusting the video quality of the target video; so that the video data is associated with the corresponding video stream information, the video identifier, and the information for adjusting the video quality of the target video.

[0146] As another example, the video operation platform may also establish a correspondence between the video data and the video stream information of the target video, the video information, and the information for adjusting the video quality of the target video; wherein the video information includes the video identifier and the video type corresponding to the target video.

[0147] In addition, the server may also include a video information database. After the video operation platform has established the corresponding relationship, it may store the corresponding relationship in the video information database of the server.

[0148] In some embodiments, the preprocessing module may also send the video data, information for adjusting the video quality of the target video, video information or video identification to the encoding module. After encoding the source data to generate the video data, the encoding module sends the video data, information for adjusting the video quality of the target video, video information or video identification to the video operation platform.

[0149] In this way, after receiving the video acquisition request of the target video sent by the smart screen, the server can obtain the video stream information of the target video and the information for adjusting the video quality of the target video according to the video identifier and the corresponding relationship. And send the video stream information and the information for adjusting the video quality of the target video to the smart screen.

[0150] In some embodiments, after receiving the video acquisition request for the target video sent by the smart screen, the server can also send the video information or video identifier of the target video to the smart screen.

[0151] In some embodiments, after receiving the video acquisition request for the target video sent by the smart screen, the server can also directly send the above-mentioned correspondence to the smart screen.

[0152] It can be seen that in the embodiment of the present application, the server can not only perform image processing on the source data of the target video in advance to obtain information for adjusting the video quality of the target video. The video data after image processing can also be configured with information. The video stream information of the target video, the information for adjusting the video quality of the target video, the video information or the video identifier are sent to the smart screen. In this way, the subsequent smart screen can perform image processing and display the video data according to the information for adjusting the video quality of the target video.

[0153] In some embodiments of the present application, see Fig. 9 , the server includes a video generation system, a quality detection module and a video operation platform. The video generation system includes a preprocessing module and an encoding module. Among them, the preprocessing module in the server can adjust the source data corresponding to the target video according to the preset resolution and / or frame rate. Then, the encoding module encodes the adjusted source data to obtain the video data corresponding to the target video. And send the video data to the quality detection module. The quality detection module can perform image quality detection on the video data, obtain the information corresponding to the target video for adjusting the video quality of the target video, and send the information for adjusting the video quality of the target video and the video stream information to the video operation platform.

[0154] Similarly, video operators can configure information on video data through the video operation platform. The video operation platform can establish a correspondence between the video data and the video stream information of the target video, information for adjusting the video quality of the target video, the video identifier, or the video information. Then, after the video operation platform has established the correspondence, it can store the correspondence in the video information database of the server.

[0155] In some embodiments, the server may perform image quality detection on video data corresponding to the target video to obtain information for adjusting the video quality of the target video.

[0156] Specifically, the preprocessing module may also send the adjusted source data, video information or video identification to the encoding module. After encoding the adjusted source data to generate video data, the encoding module sends the video data, video information or video identification to the quality detection module. After performing quality detection on the video data, the quality detection module obtains information for adjusting the video quality of the target video, and then sends the information for adjusting the video quality of the target video, the video data, video information or video identification to the video operation platform.

[0157] In some embodiments of the present application, the quality detection module in the server may include a quality detection algorithm or a quality detection model. The quality detection algorithm or the quality detection model is used to perform image quality detection on the video data to obtain information corresponding to the video data for adjusting the video quality of the target video.

[0158] Among them, the quality detection algorithm may include a noise detection algorithm, a motion image detection algorithm, a video jitter detection algorithm, and the like.

[0159] The quality detection model can use convolutional neural networks (CNN), region proposal network (RPN), regions with cnn features (RCNN), fast RCNN network and residual network, or a combination of multiple networks to extract the video quality information of the target video.

[0160] It should be noted that the quality detection model provided in the embodiment of the present application may include one or more of the YOLO algorithm, the SSD algorithm, and the DenseBox algorithm. These algorithms all have the advantages of fast speed and high precision. Of course, the embodiment of the present application will also train the quality detection model. When training the quality detection model, a large amount of video data and image quality parameters can be used as training samples for training so that the quality detection model can learn the ability to identify the information corresponding to the video data for adjusting the video quality of the target video. The embodiment of the present application does not limit the specific form of the quality detection algorithm and the quality detection model.

[0161] It can be seen that the server provided in the embodiment of the present application can generate video data corresponding to the target video by simply adjusting the resolution or frame rate of the source data of the target video. And by adding a quality detection module on the server side, information corresponding to the video data for adjusting the video quality of the target video can be obtained. Similarly, it is convenient for the subsequent smart screen to obtain the video quality corresponding to the video data based on the information for adjusting the video quality of the target video, and perform image processing and display on the video data.

[0162] S602. The smart screen performs image processing and displays the video data corresponding to the video stream information according to the information used to adjust the video quality of the target video.

[0163] In some embodiments of the present application, the smart screen can determine the target quality parameter information based on the information used to adjust the video quality of the target video. The target quality parameter information matches the display capability of the smart screen, and there is at least one parameter in the target quality parameter information that is different from the parameter in the information used to adjust the video quality of the target video. The display capability of the smart screen includes at least one of the display hardware capability and the display software capability of the smart screen. The smart screen can also perform image processing and display on the video data corresponding to the video stream information based on the target quality parameter information.

[0164] Specifically, after receiving the video stream information of the video data sent by the server, the information for adjusting the video quality of the target video, the video information or the video identifier, the smart screen can determine the target quality parameter information based on the information for adjusting the video quality of the target video.

[0165] In some examples, the target quality parameter information is determined based on information for adjusting the video quality of the target video, configuration information, video information, or video identification, wherein the configuration information includes at least one video identification or information corresponding to the video information for adjusting the video quality of the target video and target quality parameter information corresponding to the information for adjusting the video quality of the target video.

[0166] That is to say, the smart screen provided in the embodiment of the present application may be pre-stored with configuration information, and the configuration information includes one or more video identifiers or information corresponding to the video quality of the target video and target quality parameter information corresponding to the information for adjusting the video quality of the target video. The smart screen may interact with the server in advance, associate the information for adjusting the video quality of the target video on the server side with the target quality parameter information, establish a corresponding relationship between the two, and obtain the configuration information.

[0167] In some embodiments, the configuration information may be implemented in the form of a configuration table. The configuration information may also be implemented by a preset rule or a preset algorithm. Of course, the embodiment of the present application does not specifically limit the implementation method of the data structure corresponding to the configuration information.

[0168] In some embodiments of the present application, at least one parameter in the target quality parameter information is different from the information used to adjust the video quality of the target video. That is, all parameters in the target quality parameter information may be different from all parameters in the information used to adjust the video quality of the target video, and some parameters in the target quality parameter information may also be different from some parameters in the information used to adjust the video quality of the target video. In this way, in the subsequent process of performing image processing according to the target quality parameter information, the smart screen can perform image processing according to one or more parameters in the adjusted video parameters.

[0169] In some embodiments of the present application, the target quality parameter information may be dynamically configured based on the information for adjusting the video quality of the target video. The smart screen may configure different target quality parameter information corresponding to different information for adjusting the video quality of the target video based on its own display capabilities.

[0170] Exemplarily, each video may correspond to a piece of information for adjusting the video quality of the target video, and each piece of information for adjusting the video quality of the target video may also correspond to a piece of target quality parameter information.

[0171] In some embodiments of the present application, different information for adjusting the video quality of the target video may also refer to different information corresponding to different videos. The smart screen may configure the target quality parameter information corresponding to each information for adjusting the video quality of the target video according to its own display capability and video type.

[0172] For example, the information corresponding to the first video for adjusting the video quality of the target video is the first quality parameter, and the information corresponding to the second video for adjusting the video quality of the target video is the second quality parameter. The configuration table in the smart screen may include the correspondence between the first quality parameter and the third quality parameter. In addition, it may also include the correspondence between the second quality parameter and the fourth quality parameter. Then, when the smart screen receives the first quality parameter corresponding to the first video, the third quality parameter can be determined based on the first video, the first quality parameter and the configuration table. When the smart screen receives the second quality parameter corresponding to the second video, the fourth quality parameter can be determined based on the second video, the second quality parameter and the configuration table.

[0173] As another example, different information for adjusting the video quality of the target video may also refer to different information corresponding to different types of videos. In a scenario where the information for adjusting the video quality of the target video corresponding to the same type of video is the same, that is, each type of video may correspond to one information for adjusting the video quality of the target video. The smart screen can configure the target quality parameter information corresponding to each information for adjusting the video quality of the target video according to its own display capability and video type.

[0174] For example, Movie A and Movie B are both movie-type videos. The information corresponding to Movie A and Movie B for adjusting the video quality of the target video is the first quality parameter. The configuration table in the smart screen may include the correspondence between the first quality parameter and the second quality parameter. Then, when the smart screen receives the first quality parameter corresponding to Movie A or Movie B, the second quality parameter can be determined based on Movie A or Movie B, the first quality parameter and the configuration table.

[0175] In scenarios where the same type of video corresponds to different information for adjusting the video quality of the target video, that is, each type of video may correspond to multiple information for adjusting the video quality of the target video. The smart screen can also configure the target quality parameter information corresponding to each information for adjusting the video quality of the target video according to its own display capabilities and video type.

[0176] For example, movie A and movie B are both movie-type videos. The information corresponding to movie A for adjusting the video quality of the target video is the third quality parameter, and the information corresponding to movie B for adjusting the video quality of the target video is the fourth quality parameter. The configuration table in the smart screen may include the correspondence between the third quality parameter and the fifth quality parameter. In addition, it may also include the correspondence between the fourth quality parameter and the sixth quality parameter. Then, when the smart screen receives the third quality parameter corresponding to movie A, the fifth quality parameter can be determined based on movie A, the third quality parameter and the configuration table. When the smart screen receives the fourth quality parameter corresponding to movie B, the sixth quality parameter can be determined based on movie B, the fourth quality parameter and the configuration table.

[0177] In some embodiments of the present application, different smart screens may also configure corresponding different target quality parameter information for the same information for adjusting the video quality of the target video according to their own display capabilities.

[0178] Take the display hardware capabilities of smart screens as an example. The display corresponding to smart screen A is a 2K (2K resolution) display, that is, the resolution is 2560×1440. The display corresponding to smart screen B is a 4K display, that is, the resolution is 3840×2160. It can be seen that the display hardware capabilities corresponding to smart screen A are lower than the display hardware capabilities corresponding to smart screen B. In this way, since the display hardware capabilities of smart screens A and B are different, when smart screens A and B display the same video data, smart screen B needs to improve the video quality corresponding to the video data to a greater extent, so that the video quality of the video data matches its own display hardware capabilities. For example, one or some parameters in the target quality parameter information set by smart screen B are higher than one or some parameters in the target quality parameter information set by smart screen A.

[0179] It should be noted that the video quality corresponding to the video can directly reflect the user's experience quality. The configuration of the above target quality parameter information can be configured through subjective evaluation, which refers to evaluating the image quality according to the viewer's subjective perception. Of course, the configuration of the above target quality parameter information can also be configured through objective evaluation, which refers to calculating the quantitative value of the image quality corresponding to the video data.

[0180] The embodiments of the present application do not limit the specific implementation form of the target quality parameter information and the specific implementation manner of the corresponding relationship between the information configured to adjust the video quality of the target video and the target quality parameter information.

[0181] In some embodiments of the present application, the information used to adjust the video quality of the target video may include target quality parameter information. That is, the server may also determine the target quality parameter information according to the information used to adjust the video quality of the target video.

[0182] Specifically, the server can perform image quality detection on the video data corresponding to the target video to obtain information for adjusting the video quality of the target video. And according to the information for adjusting the video quality of the target video, the target quality parameter information is determined. Of course, the target quality parameter information matches the display capability of the electronic device. The server can directly send the target quality parameter information and the video stream information of the target video to the electronic device.

[0183] In this way, when the smart screen performs image processing and display on the video data corresponding to the video stream information according to the information used to adjust the video quality of the target video, it can directly perform image processing and display on the video data corresponding to the video stream information according to the target quality parameter information.

[0184] It can be seen that the smart screen can determine the target quality parameter information based on the information sent by the server for adjusting the video quality of the target video. The target quality parameter information matches its own display capability. It is understandable that the information used to adjust the video quality of the target video can characterize the video quality of the target video on the server side. In other words, the smart screen can determine the degree of optimization of the video quality corresponding to the video data within its own display capability based on the information used to adjust the video quality of the target video, that is, determine the target quality parameter information.

[0185] In this way, the smart screen can use the target quality parameter information to process and display the video data based on the video quality of the target video and its own display capability, without wasting its own display capability or over-processing the video data.

[0186] Moreover, in the embodiment of the present application, the server side can determine the target quality parameter information in advance based on the information used to adjust the video quality of the target video. Of course, the target quality parameter information matches the display capability of the smart screen. In this way, the smart screen can directly use the target quality parameter information to process and display the video data. It can not only reduce its own workload, but also improve the display effect corresponding to the target video in the process of displaying video data. In addition, it improves the user experience.

[0187] In some embodiments of the present application, the smart screen can obtain video data corresponding to the video stream information, and perform image processing and display on the video data corresponding to the video stream information according to the target quality parameter information.

[0188] In some embodiments, the information of the video quality of the target video includes original quality parameter information, and the target quality parameter information includes one or more specific parameters, i.e., specific values. In this way, the smart screen can directly adjust the original quality parameters of the video data corresponding to the video stream information to be consistent with the target quality parameter information based on the target quality parameter information.

[0189] Exemplarily, the target quality parameter information includes a clarity parameter of 50, a color parameter of 30, a contrast parameter of 30, and a brightness parameter of 40. After the smart screen performs image processing on the video data, the clarity parameter of the processed video data is 50, the color parameter is 30, the contrast parameter is 30, and the brightness parameter is 40.

[0190] In some embodiments, the target quality parameter information may also include an adjustment value corresponding to at least one parameter in the information for adjusting the video quality of the target video, that is, the target quality parameter information may characterize the degree to which one or more parameters need to be adjusted. In this way, the smart screen may also perform image processing and display on the video data corresponding to the video stream information according to the adjustment value corresponding to at least one parameter.

[0191] For another example, the information for adjusting the video quality of the target video includes a clarity parameter of 10, a color parameter of 20, a contrast parameter of 30, and a brightness parameter of 40. The target quality parameter information includes a clarity parameter of 5, a color parameter of 6, a contrast parameter of 7, and a brightness parameter of 10. After the smart screen performs image processing on the video data, the clarity parameter of the processed video data is 15, the color parameter is 26, the contrast parameter is 37, and the brightness parameter is 40.

[0192] In some embodiments of the present application, the smart screen can call the target application programming interface to perform image processing on the video data according to the target quality parameter information.

[0193] That is to say, the methods provided in the embodiments of the present application can call a target application programming interface to perform image processing on video data. It should be understood that the target application programming interface can be an interface provided by a framework layer or an application framework layer, and can provide a function of performing image processing on video data according to target quality parameter information. Moreover, different applications can correspond to different target application programming interfaces to perform image processing on video data.

[0194] In some embodiments of the present application, see Fig.10 , the smart screen may include a target application, a dynamic parameter adjustment module and an image enhancement module. After the target application in the smart screen receives the video stream information of the target video, the information for adjusting the video quality of the target video, the video information or the video identification sent by the server, the video stream information, the information for adjusting the video quality of the target video, the video information or the video identification are sent to the dynamic parameter adjustment module. The dynamic parameter adjustment module obtains the target quality parameter information based on the video information or the video identification, the information for adjusting the video quality of the target video and the configuration table. In addition, the dynamic parameter adjustment module can call the target application programming interface to send the video stream information, the target quality parameter information, the video information or the video identification to the image enhancement module. The image enhancement module can obtain the video data corresponding to the video stream information, and perform image processing on the video data corresponding to the video stream information according to the target quality parameter information.

[0195] In some embodiments of the present application, the image enhancement module may also configure different application programming interfaces for different target applications, so that different target applications can adjust the intensity of image processing corresponding to the video data according to their own needs.

[0196] Exemplarily, the first application and the second application are both video applications. The image enhancement module can configure a first interface for the first application and a second interface for the second application. When the first application wants to use the first processing intensity to perform image enhancement on the video data, the image enhancement module can be called through the first interface. Similarly, when the second application wants to use the second processing intensity to perform image enhancement on the video data, the image enhancement module can be called through the second interface. In this way, different applications can flexibly configure the intensity of image processing, thereby improving the flexibility of use.

[0197] In some embodiments of the present application, some or all of the parameters in the target quality parameter information may be different from the parameters in the information for adjusting the video quality of the target video. In this way, the smart screen can process and display the video data based on some or all of the parameters in the information of the video quality of the target video. In other words, the smart screen can adjust the parameters corresponding to the video data separately. Furthermore, the video data can be processed more finely, which improves the processing flexibility in the image processing process.

[0198] In some embodiments of the present application, the target video may include multiple frames of images. The information used to adjust the video quality of the target video includes information used to adjust the image quality of at least one frame of image in the target video.

[0199] The server side may also send information for adjusting the image quality of at least one frame of the target video and video stream information to the smart screen. The smart screen may perform image processing and display at least one frame of the video data corresponding to the video stream information based on the information for adjusting the image quality of at least one frame of the target video.

[0200] Among them, the information used to adjust the image quality of at least one frame of the target video may include one or more of clarity parameters, color parameters, contrast parameters, brightness parameters, noise parameters, smoothness parameters, grayscale parameters, saturation parameters, background blur degree parameters, dark corner parameters or color temperature parameters.

[0201] That is to say, the smart screen can receive information sent by the server for adjusting the image quality of at least one frame of the target video, and according to the information of the image quality of at least one frame of the target video, perform image processing and display on at least one frame of the video data. In this way, the smart screen can perform image processing and display on at least one frame of the video data based on the image quality corresponding to at least one frame of the image. It is possible to finely process at least one frame of the video data, thereby improving the flexibility and precision of the processing process.

[0202] In some embodiments of the present application, after the smart screen performs image processing on the video data according to the target quality parameter information, it can display the video picture corresponding to the target video, and the video picture is rendered based on the video data after the image processing.

[0203] That is to say, after the image enhancement module processes the video data according to the target quality parameter information, it can control the display screen to display the processed video data. In this way, the user can watch the target video with a better display effect through the smart screen.

[0204] In some embodiments of the present application, the smart screen can also output prompt information, which is used to prompt that the video quality of the target video has been improved.

[0205] For example, after the user selects movie A in the details page corresponding to the target application, the smart screen detects the user's selection operation on movie A, performs image processing on the video data corresponding to movie A, and displays the video screen corresponding to movie A after image processing. While displaying the video screen corresponding to movie A, the smart screen can also output prompt information.

[0206] The prompt information may include one or more of pop-up prompt information, text prompt information, voice prompt information or video prompt information.

[0207] See also Fig.11 In the example, the smart screen can display a prompt message on the playback interface of the current movie A, and the prompt message can be implemented as the text "The video quality of movie A has been improved." Of course, the smart screen can also control the speaker to play the prompt message, and the prompt message can be implemented as a prompt tone such as "The video quality of movie A has been improved."

[0208] It can be seen that after the smart screen processes the video data, it can output a prompt message to remind the user that the video quality of the target video has been improved. In turn, the interactivity between the user and the smart screen and the flexibility of the video display process are improved.

[0209] In some schemes, multiple embodiments of the present application may be combined, and the combined scheme may be implemented. Optionally, some operations in the process of each method embodiment may be optionally combined, and / or the order of some operations may be optionally changed. Furthermore, the execution order between the steps of each process is only exemplary and does not constitute a limitation on the execution order between the steps, and other execution orders may be used between the steps. It is not intended to indicate that the execution order is the only order in which these operations can be performed.

[0210] A person skilled in the art will be able to think of many ways to reorder the operations described in the embodiments of the present application. In addition, it should be noted that the process details involved in a certain embodiment of the present application are also applicable to other embodiments in a similar manner, or different embodiments can be used in combination.

[0211] In addition, some steps in the method embodiment may be equivalently replaced by other possible steps. Alternatively, some steps in the method embodiment may be optional and may be deleted in certain usage scenarios. Alternatively, other possible steps may be added to the method embodiment.

[0212] Furthermore, the various method embodiments may be implemented separately or in combination.

[0213] The present application also provides an electronic device, such as the above-mentioned smart screen. Fig.12As shown, the electronic device may include one or more processors 1910 , a memory 1920 , and a communication interface 1930 .

[0214] The memory 1920 , the communication interface 1930 , and the processor 1910 are coupled together. For example, the memory 1920 , the communication interface 1930 , and the processor 1910 may be coupled together via a bus 1940 .

[0215] The communication interface 1930 is used for data transmission with other devices. The memory 1920 stores computer program codes. The computer program codes include computer instructions. When the computer instructions are executed by the processor 1910, the electronic device executes the video processing method in the embodiment of the present application.

[0216] Among them, the processor 1910 can be a processor or a controller, for example, a central processing unit (CPU), a general processor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic devices, transistor logic devices, hardware components or any combination thereof. It can implement or execute various exemplary logic blocks, modules and circuits described in conjunction with the present disclosure. The processor can also be a combination that implements computing functions, such as a combination of one or more microprocessors, a combination of DSP and microprocessors, and the like.

[0217] The bus 1940 may be a Peripheral Component Interconnect (PCI) bus or an Extended Industry Standard Architecture (EISA) bus. The bus 1940 may be divided into an address bus, a data bus, a control bus, etc. For ease of representation, Fig.12 Only one thick line is used in the diagram, but this does not mean that there is only one bus or only one type of bus.

[0218] An embodiment of the present application provides an interactive system, which includes an electronic device and a server. The electronic device is configured to send a video acquisition request for a target video to the server. The server is configured to receive the video acquisition request sent by the electronic device, and obtain information for adjusting the video quality of the target video and the video stream information of the target video. The server is also configured to send information for adjusting the video quality of the target video and the video stream information of the target video to the electronic device. The electronic device is also configured to receive information for adjusting the video quality of the target video and the video stream information of the target video sent by the server, and obtain video data corresponding to the video stream information based on the video stream information of the target video. The electronic device is also configured to perform image processing and display on the video data corresponding to the video stream information based on the information for adjusting the video quality of the target video.

[0219] An embodiment of the present application provides a server, which includes: a memory and a processor, wherein program instructions are stored in the memory, and the processor executes the relevant method steps in the above method embodiment by running the program instructions.

[0220] An embodiment of the present application also provides an electronic device, which includes: a memory, a processor and a display screen. The memory and the display screen are coupled to the processor. The display screen is used to output video images, and the memory is used to store computer-readable instructions. When the processor reads the computer-readable instructions from the memory, the electronic device executes the relevant method steps in the above method embodiment.

[0221] An embodiment of the present application further provides a computer-readable storage medium, in which a computer program code is stored. When the processor executes the computer program code, the electronic device executes the relevant method steps in the method embodiment.

[0222] The embodiment of the present application also provides a computer program product. When the computer program product is run on a computer, it enables the computer to execute the relevant method steps in the above method embodiment.

[0223] An embodiment of the present application also provides a chip system, including: a processor, the processor is coupled to a memory, the memory is used to store programs or instructions, when the program or instructions are executed by the processor, the chip system implements the method in any of the above method embodiments.

[0224] Optionally, the processor in the chip system may be one or more. The processor may be implemented by hardware or by software. When implemented by hardware, the processor may be a logic circuit, an integrated circuit, etc. When implemented by software, the processor may be a general-purpose processor implemented by reading software code stored in a memory.

[0225] Optionally, the memory in the chip system may also be one or more. The memory may be integrated with the processor or may be separately arranged with the processor, which is not limited in the embodiments of the present application. Exemplarily, the memory may be a non-transient processor, such as a read-only memory ROM, which may be integrated with the processor on the same chip or may be arranged on different chips respectively. The embodiments of the present application do not specifically limit the type of memory and the arrangement of the memory and the processor.

[0226] Exemplarily, the chip system can be a field programmable gate array (FPGA), an application specific integrated circuit (ASIC), a system on chip (SoC), a central processor unit (CPU), a network processor (NP), a digital signal processor (DSP), a microcontroller unit (MCU), a programmable logic device (PLD) or other integrated chips.

[0227] Among them, the electronic device, computer storage medium or computer program product provided in this application is used to execute the corresponding method provided above. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding method provided above, and will not be repeated here.

[0228] Through the description of the above implementation methods, technical personnel in the relevant field can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional modules is used as an example. In actual applications, the above-mentioned functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.

[0229] In the several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of modules or units is only a logical function division. There may be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another device, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0230] The units described as separate components may or may not be physically separated, and the components shown as units may be one physical unit or multiple physical units, which may be located in one place or distributed in multiple different places. Some or all of the units may be selected according to actual needs to achieve the purpose of the present embodiment.

[0231] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0232] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application is essentially or the part that contributes or all or part of the technical solution can be embodied in the form of a software product, which is stored in a storage medium, including a number of instructions to enable a device (which can be a single-chip microcomputer, chip, etc.) or a processor (processor) to perform all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read only memory (ROM), random access memory (RAM), disk or optical disk and other media that can store program code.

[0233] The above contents are only specific implementation methods of the present application, but the protection scope of the present application is not limited thereto. Any changes or substitutions within the technical scope disclosed in the present application shall be included in the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims

1. A video processing method, characterized in that: Applied to electronic equipment, the method comprises: Send a video acquisition request for the target video to the server; receiving information for adjusting the video quality of the target video and video stream information of the target video from the server; According to the video stream information of the target video, obtaining video data corresponding to the video stream information; According to the information for adjusting the video quality of the target video, the video data corresponding to the video stream information is image processed and displayed.

2. The method according to claim 1, characterized in that The performing image processing and displaying of the video data corresponding to the video stream information according to the information for adjusting the video quality of the target video includes: Determining target quality parameter information according to the information used to adjust the video quality of the target video; the target quality parameter information matches the display capability of the electronic device, and at least one parameter in the target quality parameter information is different from a parameter in the information used to adjust the video quality of the target video; According to the target quality parameter information, image processing is performed on the video data corresponding to the video stream information and the image is displayed.

3. The method according to claim 1, characterized in that The information for adjusting the video quality of the target video includes target quality parameter information, and the target quality parameter information matches the display capability of the electronic device; and performing image processing and displaying the video data corresponding to the video stream information according to the information for adjusting the video quality of the target video includes: According to the target quality parameter information, image processing is performed on the video data corresponding to the video stream information and the image is displayed.

4. The method according to claim 2 or 3, characterized in that: The information of the video quality of the target video includes original quality parameter information, and performing image processing and displaying the video data corresponding to the video stream information according to the target quality parameter information includes: According to the target quality parameter information, the original quality parameter of the video data corresponding to the video stream is adjusted to be consistent with the target quality parameter information and displayed.

5. The method according to claim 2 or 3, characterized in that: The target quality parameter information includes an adjustment value corresponding to at least one parameter in the information for adjusting the video quality of the target video; and performing image processing and displaying the video data corresponding to the video stream information according to the target quality parameter information includes: According to the adjustment value corresponding to the at least one parameter, image processing is performed on the video data corresponding to the video stream information and the image is displayed.

6. The method according to any one of claims 1 to 5, characterized in that: The information used to adjust the video quality of the target video includes information used to adjust the image quality of at least one frame of image in the target video; The performing image processing and displaying of the video data corresponding to the video stream information according to the information for adjusting the video quality of the target video includes: According to the information for adjusting the image quality of at least one frame of the target video, image processing is performed on at least one frame of the video data corresponding to the video stream information and the image is displayed.

7. The method according to any one of claims 1 to 6, characterized in that: The method further comprises: Outputting prompt information, wherein the prompt information is used to prompt that the video quality of the target video has been improved.

8. The method according to any one of claims 1 to 7, characterized in that: The information used to adjust the video quality of the target video includes one or more of a clarity parameter, a color parameter, a contrast parameter, a brightness parameter, a noise parameter, a smoothness parameter, a grayscale parameter, a saturation parameter, a background blur degree parameter, a dark corner parameter or a color temperature parameter.

9. The method according to any one of claims 1 to 8, characterized in that: The video acquisition request includes the video identifier of the target video; or, The video stream information of the target video includes the video stream address of the target video.

10. The method according to any one of claims 2 to 5, characterized in that: The display capability of the electronic device includes at least one of a display hardware capability and a display software capability of the electronic device.

11. A video processing method, characterized in that: Applied to a server, the method comprises: Receiving a video acquisition request for a target video sent by an electronic device; Acquire, according to the video acquisition request, information for adjusting the video quality of the target video and video stream information of the target video; The information for adjusting the video quality of the target video and the video stream information of the target video are sent to the electronic device, wherein the information of the video quality of the target video is used to adjust the video quality of the target video displayed on the device.

12. The method according to claim 11, characterized in that Before receiving the video acquisition request of the target video sent by the electronic device, the method further includes: Image quality detection is performed on the video data corresponding to the target video to obtain information for adjusting the video quality of the target video.

13. The method according to claim 11, characterized in that Before receiving the video acquisition request of the target video sent by the electronic device, the method further includes: Performing image quality detection on video data corresponding to the target video to obtain information for adjusting the video quality of the target video; Determining target quality parameter information according to information used to adjust the video quality of the target video; the target quality parameter information matches the display capability of the electronic device; The sending the information for adjusting the video quality of the target video and the video stream information of the target video to the electronic device includes: The target quality parameter information and the video stream information of the target video are sent to the electronic device.

14. The method according to any one of claims 11 to 13, characterized in that: The video acquisition request includes the video identifier of the target video; or the video stream information of the target video includes the video stream address of the target video; The acquiring, according to the video acquisition request, information for adjusting the video quality of the target video and video stream information of the target video comprises: According to the video identifier of the target video, information for adjusting the video quality of the target video and the video stream address of the target video are acquired.

15. An interactive system, characterized in that: The interactive system includes an electronic device and a server; The electronic device is configured to send a video acquisition request for a target video to the server; The server is configured to receive the video acquisition request sent by the electronic device, and acquire information for adjusting the video quality of the target video and video stream information of the target video; The server is further configured to send the information for adjusting the video quality of the target video and the video stream information of the target video to the electronic device; The electronic device is further configured to receive the information for adjusting the video quality of the target video and the video stream information of the target video sent by the server, and acquire video data corresponding to the video stream information according to the video stream information of the target video; The electronic device is further configured to perform image processing and display on the video data corresponding to the video stream information according to the information used to adjust the video quality of the target video.

16. A server, characterized in that: The server comprises: a memory and a processor, wherein program instructions are stored in the memory, and the processor executes the video processing method according to any one of claims 11 to 14 by running the program instructions.

17. An electronic device, characterized in that: The electronic device includes: a memory, a processor and a display screen, wherein the memory and the display screen are coupled to the processor, the display screen is used to display a video screen corresponding to a target video, and the memory is used to store computer-readable instructions. When the processor reads the computer-readable instructions from the memory, the electronic device executes the video processing method as described in any one of claims 1 to 10.

18. A computer-readable storage medium, characterized in that: The computer-readable storage medium includes a computer program, and when the computer program is executed on an electronic device, the electronic device executes the video processing method according to any one of claims 1 to 10.

Images