Display device and video stream processing method of display device

Abstract

Embodiments of the present application provide a display device and a video stream processing method of the display device. The display device comprises a processor configured to acquire encoding capability of a SOC chip, decoding capability of the SOC chip and encoding capability of a camera device arranged in the display device when a video call function is started; determine a video call parameter of the display device according to the encoding capability of the SOC chip, the decoding capability of the SOC chip and the encoding capability of the camera device; and perform video call according to the encoding capability of the camera device when the video call parameter matches the encoding capability of the camera device, so that the decoding capability of the television chip SOC and the encoding capability of the camera device are maximally utilized, the resolution effect of the video call is improved, and the experience of the user on the video call is improved.

Description

TECHNICAL FIELD

[0001] Embodiments of the present application relate to the technical field of display, in particular to a display device and a video stream processing method of the display device. BACKGROUND

[0002] With the development of technology, digitalization is more and more deeply into people's life, and television is gradually moving towards intelligent, and the current video call function has become an essential function of the smart TV.

[0003] At present, when video calling is performed through the smart TV, the main processing process is: obtaining the video stream through the camera device set on the TV, encoding the obtained video stream, and transmitting the encoded video stream to the opposite end of the video call. As for the smart TV, the iteration speed of the encoding capability of the SOC chip is far less than the decoding capability of the TV chip. The current video call parameters depend on the encoding capability of the SOC chip. At present, the resolution of the camera device is high, and the 4K camera device has become the trend of the industry.

[0004] Therefore, even if the encoding capability of the camera device used on the TV is strong, the corresponding resolution effect cannot be experienced when video calling is performed, and the user experience is poor when video calling is performed. SUMMARY

[0005] Embodiments of the present application provide a display device and a video stream processing method of the display device to solve the problem that when the encoding capability of the camera device used on the TV is strong, the corresponding resolution effect cannot be experienced when video calling is performed in the prior art, and improve the user experience.

[0006] In a first aspect, embodiments of the present application provide a display device, comprising: a processor configured to:

[0007] When the video call function is started, the encoding capability of the SOC chip, the decoding capability of the SOC chip and the encoding capability of the camera device set in the display device are obtained;

[0008] According to the encoding capability of the SOC chip, the decoding capability of the SOC chip and the encoding capability of the camera device, the video call parameters of the display device are determined;

[0009] When the video call parameters match the encoding capability of the camera device, video calling is performed according to the encoding capability of the camera device; the encoding capability of the camera device is greater than or equal to the encoding capability of the SOC chip.

[0010] In some embodiments of the present application, when determining the video call parameter of the display device according to the encoding capability of the SOC chip, the decoding capability of the SOC chip and the encoding capability of the camera, the processor is specifically configured to:

[0011] determining the encoding capability set of the display device according to the encoding capability of the SOC chip and the encoding capability of the camera;

[0012] determining the video call parameter of the display device according to the encoding capability set of the display device and the decoding capability of the SOC chip.

[0013] In some embodiments of the present application, when determining the encoding capability set of the display device according to the encoding capability of the SOC chip and the encoding capability of the camera, the processor is specifically configured to:

[0014] performing a union operation on the encoding capability of the SOC chip and the encoding capability of the camera to obtain a union operation result, and taking the union operation result as the encoding capability set of the display device.

[0015] In some embodiments of the present application, when determining the video call parameter of the display device according to the encoding capability set of the display device and the decoding capability of the SOC chip, the processor is specifically configured to:

[0016] performing an intersection operation on the encoding capability set of the display device and the decoding capability of the SOC chip to obtain an intersection operation result;

[0017] obtaining a maximum value of the intersection operation result, and determining the maximum value as the video call parameter of the display device.

[0018] In some embodiments of the present application, when performing the video call according to the encoding capability of the camera, the processor is specifically configured to:

[0019] obtaining a first video stream corresponding to the encoding capability of the camera from the camera, and copying the first video stream, and transmitting the copied first video stream to a peer.

[0020] In some embodiments of the present application, the processor is further configured to:

[0021] when the video call parameter matches the encoding capability of the SOC chip, obtaining a second video stream corresponding to the encoding capability of the SOC chip from the camera, performing encoding processing on the second video stream, and transmitting the video stream after the encoding processing to the peer.

[0022] In some embodiments of the present application, the processor is further configured to, after acquiring the first video stream corresponding to the encoding capability of the camera from the camera:

[0023] decode the first video stream and locally preview the decoded video stream;

[0024] Alternatively, the processor is further configured to, after acquiring the second video stream corresponding to the encoding capability of the SOC chip from the camera:

[0025] decode the second video stream and locally preview the decoded video stream.

[0026] In some embodiments of the present application, the processor is further configured to:

[0027] acquire a third video stream from the opposite end corresponding to the video call parameter of the display device;

[0028] decode the acquired third video stream to obtain a decoded video stream and display the decoded video stream on the display device.

[0029] In some embodiments of the present application, the processor is further configured to:

[0030] when it is detected that the user initiates a video call request through the display device, or when a video call request sent by the opposite end is received, it is determined that the video call function is started.

[0031] In a second aspect, the embodiments of the present application provide a video stream processing method of a display device, the method being applied to a processor, and the method comprising:

[0032] when the video call function is started, acquiring the encoding capability of the SOC chip, the decoding capability of the SOC chip, and the encoding capability of the camera arranged in the display device;

[0033] determining the video call parameter of the display device according to the encoding capability of the SOC chip, the decoding capability of the SOC chip, and the encoding capability of the camera;

[0034] when the video call parameter matches the encoding capability of the camera, performing a video call according to the encoding capability of the camera; the encoding capability of the camera is greater than or equal to the encoding capability of the SOC chip.

[0035] The display device and the video stream processing method of the display device provided by the embodiment of the application, the display device comprises a processor configured to acquire the encoding capability of a SOC chip, the decoding capability of the SOC chip and the encoding capability of a camera arranged in the display device when a video call function is started; determine a video call parameter of the display device according to the encoding capability of the SOC chip, the decoding capability of the SOC chip and the encoding capability of the camera; and perform video call according to the encoding capability of the camera when the video call parameter matches the encoding capability of the camera, so that the decoding capability of the television chip SOC and the encoding capability of the camera are maximally utilized, the resolution effect of the video call is improved, and the experience of the user for the video call is improved. BRIEF DESCRIPTION OF DRAWINGS

[0036] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the following will briefly introduce the drawings needed to be used in the embodiments or the prior art description. Obviously, the drawings in the following description are some embodiments of the present application, and for those skilled in the art, other drawings can also be obtained without creative labor.

[0037] Figure 1 Fig. 1 exemplarily shows a schematic diagram of an operating scenario between a display device and a control device according to some embodiments;

[0038] Figure 2 Fig. 2 exemplarily shows a hardware configuration block diagram of a display device 200 according to some embodiments;

[0039] Figure 3 Fig. 3 exemplarily shows a software configuration schematic diagram in the display device 200 according to some embodiments;

[0040] Figure 4 Fig. 4 exemplarily shows a structural schematic diagram of a display device;

[0041] Figure 5 Fig. 5 exemplarily shows a schematic diagram of video stream processing of a display device;

[0042] Figure 6 Fig. 6 exemplarily shows a principle diagram of video call of a display device according to some embodiments;

[0043] Figure 7 Fig. 7 exemplarily shows a schematic diagram of video stream processing of a display device using an existing video stream processing mode according to some embodiments;

[0044] Figure 8 Fig. 8 exemplarily shows a schematic diagram of video stream processing of a display device using an optimized video stream processing mode according to some embodiments;

[0045] Figure 9 A flowchart of a video stream processing method of a display device according to some embodiments is shown in FIG. 1. DETAILED DESCRIPTION

[0046] For the purpose of clarity and enabling a person of ordinary skill in the art to better appreciate the application, the application will now be described in greater detail with reference to the accompanying drawings. It is to be understood that the following detailed description of the application is only exemplary and intended to provide further description basic ideas of the application.

[0047] It should be noted that the brief description of terms in the present application is only for the convenience of understanding the following described embodiments, and is not intended to limit the embodiments of the present application. Unless otherwise specified, these terms should be understood according to their ordinary and customary meanings.

[0048] The terms "first", "second", "third", and the like in the specification and claims of the present application and the above-described drawings are used to distinguish similar or like objects or entities, and do not necessarily mean a specific order or sequence, unless otherwise noted. It should be understood that the terms used in this way can be interchanged under appropriate circumstances.

[0049] The terms "include" and "have" and any variations thereof are intended to cover but not exclusively include, for example, a product or device containing a series of components, which does not necessarily limit to all the components clearly listed, but can include other components not clearly listed or inherent to such products or devices.

[0050] The display device provided by the embodiments of the present application can have various implementation forms, for example, can be a television, a smart television, a laser projection device, a monitor, an electronic bulletin board, an electronic table, etc. Figure 1 And Figure 2 A specific embodiment of the display device of the present application.

[0051] Figure 1 A schematic diagram of an operating scenario between a display device and a control device according to some embodiments is shown in FIG. 2. As shown in FIG. 2, a user can operate the display device 200 through the smart device 300 or the control device 100. Figure 1

[0052] ​In some embodiments, the control device 100 can be a remote controller, and the communication between the remote controller and the display device can include infrared protocol communication or Bluetooth protocol communication, and other short-distance communication methods, to control the display device 200 through wireless or wired means. The user can input user instructions through buttons on the remote controller, voice input, control panel input, etc., to control the display device 200.

[0053] In some embodiments, the smart device 300 (such as a mobile terminal, tablet, computer, notebook, etc.) can also be used to control the display device 200. For example, the display device 200 can be controlled using an application running on the smart device.

[0054] In some embodiments, the display device can not use the above-mentioned smart device or control device to receive instructions, but can receive user control through touch or gestures, etc.

[0055] In some embodiments, the display device 200 can also be controlled in ways other than the control device 100 and the smart device 300, for example, the display device 200 can directly receive user voice instructions through a voice instruction acquisition module configured inside the display device 200, or can receive user voice instructions through a voice control device set outside the display device 200.

[0056] In some embodiments, the display device 200 also communicates data with the server 400. The display device 200 can be allowed to communicate through a local area network (LAN), a wireless local area network (WLAN), and other networks. The server 400 can provide various content and interactions to the display device 200. The server 400 can be a cluster or multiple clusters, and can include one or more types of servers.

[0057] Figure 2 An exemplary hardware configuration block diagram of the display device 200 according to some embodiments is shown in FIG. 2. Figure 2 The display device 200 includes at least one of a tuner / demodulator 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, a memory, a power supply, and a user interface.

[0058] In some embodiments, the controller includes a processor, a video processor, an audio processor, a graphics processor, a RAM, a ROM, a first interface to an n-th interface for input / output.

[0059] The display 260 includes a display screen component for presenting a picture, and a driving component for driving image display, a component for receiving image signals originating from the controller output, and displaying video content, image content, and a menu control interface, and a user control UI interface.

[0060] The display 260 can be a liquid crystal display, an OLED display, and a projection display, and can also be a projection device and a projection screen.

[0061] The communicator 220 is a component for communicating with external devices or servers according to various communication protocol types. For example, the communicator can include at least one of a Wifi module, a Bluetooth module, a wired Ethernet module, and other network communication protocol chips or near field communication protocol chips, and an infrared receiver. The display device 200 can establish transmission and reception of control signals and data signals with the external control device 100 or the server 400 through the communicator 220.

[0062] The user interface can be used to receive control signals of the control device 100 (such as an infrared remote controller, etc.).

[0063] The detector 230 is used to collect signals of the external environment or interaction with the outside. For example, the detector 230 includes a light receiver for collecting ambient light intensity, or an image collector such as a camera for collecting external environment scenes, user attributes, or user interaction gestures, or a sound collector such as a microphone for receiving external sounds.

[0064] The external device interface 240 can include, but is not limited to, any one or more of the following: a high-definition multimedia interface (HDMI), an analog or digital high-definition component input interface (component), a composite video input interface (CVBS), a USB input interface (USB), an RGB port, etc. It can also be a composite input / output interface formed by the above multiple interfaces.

[0065] The tuner demodulator 210 receives broadcast television signals through wired or wireless reception, and demodulates audio and video signals and EPG data signals from multiple wireless or wired broadcast television signals.

[0066] In some embodiments, the controller 250 and the tuner demodulator 210 can be located in different split devices, i.e., the tuner demodulator 210 can also be in an external device of the main device where the controller 250 is located, such as an external set-top box, etc.

[0067] The controller 250 controls the operation of the display device and responds to user operations through various software control programs stored in the memory. The controller 250 controls the overall operation of the display device 200. For example, in response to receiving a user command for selecting a UI object displayed on the display 260, the controller 250 can perform an operation related to the object selected by the user command.

[0068] In some embodiments, the controller includes at least one of a Central Processing Unit (CPU), a video processor, an audio processor, a Graphics Processing Unit (GPU), a RAM (Random Access Memory), a ROM (Read-Only Memory), a first interface to an n-th interface for input / output, a communication bus, and the like.

[0069] The user can input a user command through a graphical user interface (GUI) displayed on the display 260, and the user input interface receives the user input command through the graphical user interface (GUI). Alternatively, the user can input a user command by inputting a specific sound or gesture, and the user input interface receives the user input command by recognizing the sound or gesture through a sensor.

[0070] A "user interface" is a medium interface for interaction and information exchange between an application program or an operating system and a user, which realizes conversion between an internal form of information and a form acceptable by the user. A commonly used form of a user interface is a graphical user interface (GUI), which refers to a user interface related to computer operation displayed in a graphical manner. It can be an icon, a window, a control element, and the like interface elements displayed in a display screen of an electronic device, wherein the control element can include an icon, a button, a menu, a tab, a text box, a dialog box, a status bar, a navigation bar, a widget, and the like visible interface elements.

[0071] Figure 3 An exemplary schematic diagram of a software configuration in the display device 200 according to some embodiments is shown in FIG. 2; see Figure 3 In some embodiments, the system is divided into four layers, from top to bottom, an Applications layer (referred to as "application layer" for short), an Application Framework layer (referred to as "framework layer" for short), an Android runtime and system library layer (referred to as "system runtime library layer" for short), and a kernel layer.

[0072] Figure 4 An exemplary schematic diagram of the structure of the display device is shown in FIG. 3, which shows a schematic diagram of the structure of the display device 200 according to some embodiments; see Figure 4As shown, the current display device such as a smart television can make a video call, by setting a camera and a microphone in the television, based on the camera to collect video information, based on the microphone to obtain audio information, then combine the video information and the audio information to obtain the fused video stream, and send to the opposite display device of the video call. Among them, the resolution of the video stream sent to the opposite end in the prior art depends on the coding ability of the SOC chip of the television. This is because the existing video stream processing flow is: obtaining the video stream from the camera, decoding the video stream for local preview, then encoding the decoded video stream, and sending the encoded video stream to the opposite end through the cloud. Since the encoding operation is required, the video call parameter is limited by the coding ability of the SOC chip of the television. Since the coding ability of the SOC chip is weaker than the decoding ability, and also weaker than the coding ability of the camera, when a higher resolution camera is installed on the television, the higher resolution effect cannot be experienced during the video call.

[0073] Based on this, in order to solve the above technical problems, the applicant considers that when determining the video call parameter, if the coding ability of the SOC chip, the decoding ability of the SOC chip and the coding ability of the camera are considered comprehensively, when the decoding ability of the SOC chip and the coding ability of the camera are matched, then a new video stream processing logic is used for video call, that is, the video call is made according to the coding ability of the camera, which can fully utilize the coding ability of the camera and the decoding ability of the SOC chip, improve the resolution of the video call, and improve the user experience.

[0074] The display device provided by the embodiment of the application comprises a processor configured to:

[0075] When the video call function is started, the coding ability of the SOC chip, the decoding ability of the SOC chip and the coding ability of the camera arranged in the display device are acquired;

[0076] According to the coding ability of the SOC chip, the decoding ability of the SOC chip and the coding ability of the camera, the video call parameter of the display device is determined;

[0077] When the video call parameter matches the coding ability of the camera, the video call is made according to the coding ability of the camera; the coding ability of the camera is greater than or equal to the coding ability of the SOC chip.

[0078] Figure 5 An exemplary schematic diagram of the display device for video stream processing is shown as Figure 5As shown, when the video call function is started, the processor needs to process the video stream, wherein the processor can be arranged on the SOC chip. Before processing the video stream, the encoding capability of the SOC chip, the decoding capability of the SOC chip and the encoding capability of the camera are acquired. The camera is arranged on the display device. When the display device is initialized, the processor can read the encoding capability of the SOC chip and the decoding capability of the SOC chip, and the processor can also read the encoding capability of the camera. The encoding capability or the decoding capability includes resolution and refresh rate, for example, the acquired encoding capability of the SOC chip is 1080P@30HZ, wherein the resolution is 1080P and the refresh rate is 30HZ.

[0079] After acquiring the encoding capability of the SOC chip, the decoding capability of the SOC chip and the encoding capability of the camera, the video call parameter of the display device is determined according to the acquired values. The determined video call parameter of the display device needs to meet the decoding capability of the SOC chip, and also meet the encoding capability of the SOC chip or the encoding capability of the camera.

[0080] In some embodiments, when the processor determines the video call parameter of the display device according to the encoding capability of the SOC chip, the decoding capability of the SOC chip and the encoding capability of the camera, the processor is specifically configured to:

[0081] determine a set of encoding capabilities of the display device according to the encoding capability of the SOC chip and the encoding capability of the camera; and determine the video call parameter of the display device according to the set of encoding capabilities of the display device and the decoding capability of the SOC chip.

[0082] Here, a specific implementation of determining the video call parameter is given. First, a set of encoding capabilities of the display device is determined according to the encoding capability of the SOC chip and the encoding capability of the camera, for example, the encoding capability of the SOC chip is 1080P@30HZ and the encoding capability of the camera is 4K@30HZ, and then the set of encoding capabilities of the display device is 1080P@30HZ and 4K@30HZ. Further, the video call parameter of the display device is determined according to the decoding capability of the SOC chip. The video call parameter needs to meet the decoding capability of the SOC chip. For example, the decoding capability of the SOC chip is 4K@30HZ, which can meet the decoding capability of the SOC chip and the encoding capability of the display device, and therefore the video call parameter of the display device is determined as 4K@30HZ.

[0083] After determining the video call parameter, it is necessary to judge the matching relationship between the video call parameter and the coding capability of the SOC chip and the coding capability of the camera. When the video call parameter matches the coding capability of the camera, video call is performed according to the coding capability of the camera. Wherein, the video call parameter matches the coding capability of the camera means that the video call parameter is less than or equal to the coding capability of the camera. When the video call parameter matches the coding capability of the camera, it means that the video call can be performed by using the parameter corresponding to the coding capability of the camera. Wherein, when the video call is performed by using the parameter corresponding to the coding capability of the camera, the first video stream corresponding to the coding capability of the camera is obtained from the camera and transmitted to the opposite end. For example, the first video stream corresponding to 4K@30HZ is obtained from the camera and transmitted to the opposite end, so that the resolution of the video stream transmitted in the process of video call is improved.

[0084] In the present application, the video call parameter of the display device is finally determined by simultaneously considering the coding capability of the SOC chip, the decoding capability of the SOC chip and the coding capability of the camera. If the video call parameter matches the coding capability of the camera, the video call can be performed according to the coding capability of the camera. Since the coding capability of the camera is greater than or equal to the coding capability of the SOC chip, by using the above processing process, the video call parameter can be improved, so that the decoding capability of the SOC chip and the coding capability of the camera are maximally utilized, and the user's experience is improved.

[0085] Figure 6 An exemplary schematic diagram of video call of a display device according to some embodiments is shown. As shown in the figure, the processor is configured to judge whether the video call function is started when performing video stream processing. Figure 6

[0086] In some embodiments, the processor is configured to:

[0087] When it is detected that the user initiates a video call request through the display device, or a video call request sent by the opposite end is received, it is determined that the video call function is started.

[0088] Wherein, when performing video call, it can be that the local end actively initiates a video call request, or passively receives a video call request sent by the opposite end.

[0089] When it is detected that the user initiates a video call request through the display device, it is determined that the local end actively sends a video call request, and the video call function is started. When a video call request sent by the opposite end is received, it is considered that a video call request is passively received, and the video call function is started.

[0090] ​In addition, the video call time and the video call object can be preset, and when it is detected that the current time is the video call time, the video call function is started.

[0091] When it is determined that the video call function is started, the coding capability TV-E of the SOC chip, the decoding capability TV-D of the SOC chip and the coding capability CA-E of the camera are obtained, and the coding capability set of the display device is determined according to TV-E and CA-E.

[0092] In some embodiments, when the processor determines the coding capability set of the display device according to the coding capability of the SOC chip and the coding capability of the camera, the processor is specifically configured to:

[0093] The coding capability of the SOC chip and the coding capability of the camera are subjected to a set operation to obtain a set operation result, and the set operation result is taken as the coding capability set of the display device.

[0094] Specifically, the set E of TV-E and CA-E can be calculated, and E is the set operation result, that is, the coding capability set of the display device. When TV-E is 1080P@30HZ and CA-E is 4K@30HZ, E is 1080P@30HZ and 4K@30HZ.

[0095] In some embodiments, when the processor determines the video call parameter of the display device according to the coding capability set of the display device and the decoding capability of the SOC chip, the processor is specifically configured to:

[0096] The coding capability set of the display device and the decoding capability of the SOC chip are subjected to an intersection operation to obtain an intersection operation result, and the maximum value of the intersection operation result is obtained, and the maximum value is determined as the video call parameter of the display device.

[0097] After the coding capability set of the display device is obtained, the coding capability set of the display device and the decoding capability of the SOC chip can be subjected to an intersection operation. For example, when TV-D is 4K@30HZ, the intersection with E is all parameters less than 4K@30HZ. The maximum value E' of the intersection operation result is calculated, and the value is the video call parameter of the display device. For example, the maximum value of the above intersection operation result is 4K@30HZ.

[0098] Wherein, after calculating E', it is also necessary to determine the matching relationship between E' and TV-E and CV-E. According to different matching relationships, different video stream processing methods are executed. Specifically, it can be first judged whether E' matches TV-E, that is, whether E' belongs to TV-E, such as when E' is 4K@30HZ and TV-E is 1080P@30HZ, then E' does not belong to TV-E, that is, E' does not match TV-E. Wherein, when E' does not match TV-E, it can be further judged whether E' matches CV-E, such as when E' is 4K@30HZ and CV-E is 4K@30HZ, then E' matches CV-E. Wherein, when E' does not match CV-E, it belongs to the case of calculation error, at this time the video call process can be ended.

[0099] According to the matching relationship between E' and TV-E and CV-E, the processing method of the video stream is determined. Wherein, when E' matches TV-E, the existing video stream processing method is adopted for video stream processing; when E' matches CV-E, the optimized video stream processing method is adopted for video stream processing, and after processing the video stream, the video call is started.

[0100] It should be noted that when TV-E, CA-E and TV-D are all 4K@30HZ, the calculated E' or video call parameter is 4K@30HZ, at this time it is first judged whether E' matches TV-E, and E' matches TV-E, at this time the existing video stream processing method is executed for video stream processing.

[0101] In some embodiments, the processor is specifically configured to:

[0102] Obtain a first video stream corresponding to the encoding capability of the camera from the camera, and copy the first video stream, and transmit the copied first video stream to the opposite end.

[0103] Figure 7 An exemplary schematic diagram of a display device adopting an optimized video stream processing method for video stream processing according to some embodiments is shown. As shown in Figure 7 When it is determined that the video call parameter of the display device matches the encoding capability of the camera, the video stream corresponding to the encoding capability of the camera is obtained from the camera through USB, and the video stream is determined as the first video stream. Such as when the video call parameter of the display device is determined to be 4K@30HZ, the 4K H.264@30HZ video stream is obtained through USB. H.264 is a digital video compression format.

[0104] After obtaining the 4K H.264@30HZ video stream, the video stream is copied, and at the same time, the PCM (Pulse Code Modulation) audio is obtained from the microphone through the USB, and the audio is encoded by AAC (Advanced Audio Coding). The encoded audio and the copied video stream are sent to the opposite end through the cloud by the video call SDK (Software Development Kit), so that the opposite end can receive a video stream with higher resolution.

[0105] The processor, after obtaining the first video stream corresponding to the encoding capability of the camera from the camera, is further configured to:

[0106] decode the first video stream and locally preview the decoded video stream.

[0107] In some embodiments, the processor is further configured to:

[0108] In some embodiments, the processor is further configured to:

[0109] When the video call parameter matches the encoding capability of the SOC chip, a second video stream corresponding to the encoding capability of the SOC chip is obtained from the camera, the second video stream is encoded, and the encoded video stream is transmitted to the opposite end.

[0110] Figure 8 An exemplary schematic diagram of a display device using an existing video stream processing method to process a video stream according to some embodiments is shown. As shown in Figure 8 When it is determined that the video call parameter of the display device matches the encoding capability of the SOC chip, a video stream corresponding to the encoding capability of the SOC chip is obtained from the camera through the USB, and the video stream is determined as a second video stream. When it is determined that the video call parameter of the display device is 1080P@30HZ, a 1080P H.264@30HZ video stream is obtained through the USB. After obtaining the second video stream, the second video stream is decoded, and the decoded video stream is encoded again to obtain an encoded video stream. The encoded audio and the encoded video stream are simultaneously sent to the opposite end through the cloud. In this process, the encoding capability of the display device is sufficient to process the obtained video stream, so that the video stream obtained from the camera can be encoded, and the quality of the obtained video stream can be improved by encoding, such as beauty operation.

[0111] The processor is further configured to, after acquiring the second video stream corresponding to the encoding capability of the SOC chip:

[0112] decode the second video stream and locally preview the decoded video stream.

[0113] Similar to the optimized video stream processing manner, the processor decodes the acquired video stream after acquiring the second video stream corresponding to the encoding capability of the SOC chip, and locally previews the decoded video stream.

[0114] In some embodiments, the processor is further configured to:

[0115] acquire a third video stream from the opposite end corresponding to the video call parameter of the display device, decode the acquired third video stream to obtain a decoded video stream, and display the decoded video stream on the display device.

[0116] Referring to Figure 7 and Figure 8 , whether it is the optimized video stream processing manner or the existing video stream processing manner, it is necessary to acquire the video stream from the opposite end, i.e., the third video stream. The format of the acquired third video stream corresponds to the video call parameter of the display device. Here, it is assumed that the video call parameter of the display device of the opposite end is the same as that of the display device of the local end. After acquiring the third video stream from the opposite end, the acquired third video stream is decoded and the decoded video stream is displayed on the local end.

[0117] Figure 9 The flowchart of the video stream processing method of the display device according to some embodiments is shown in an exemplary manner in Figure 9 As shown in

[0118] Step S901, when the video call function is started, the encoding capability of the SOC chip, the decoding capability of the SOC chip, and the encoding capability of the camera set in the display device are acquired.

[0119] Step S902, according to the encoding capability of the SOC chip, the decoding capability of the SOC chip, and the encoding capability of the camera, the video call parameter of the display device is determined.

[0120] Step S903, when the video call parameter matches the encoding capability of the camera, the video call is performed according to the encoding capability of the camera; the encoding capability of the camera is greater than or equal to the encoding capability of the SOC chip.

[0121] The video stream processing method of the display device provided by the embodiment comprises the following steps: when a video call function is started, the encoding capability of a SOC chip, the decoding capability of the SOC chip and the encoding capability of a camera device arranged in the display device are acquired; the video call parameter of the display device is determined according to the encoding capability of the SOC chip, the decoding capability of the SOC chip and the encoding capability of the camera device; when the video call parameter matches the encoding capability of the camera device, the video call is performed according to the encoding capability of the camera device; the encoding capability of the camera device is greater than or equal to the encoding capability of the SOC chip, so that the decoding capability of the television chip SOC and the encoding capability of the camera device are maximally utilized, the resolution effect of the video call is improved, and the experience of the user on the video call is improved.

[0122] In some embodiments, determining the video call parameter of the display device according to the encoding capability of the SOC chip, the decoding capability of the SOC chip and the encoding capability of the camera device comprises:

[0123] determining the encoding capability set of the display device according to the encoding capability of the SOC chip and the encoding capability of the camera device;

[0124] determining the video call parameter of the display device according to the encoding capability set of the display device and the decoding capability of the SOC chip.

[0125] In some embodiments, determining the encoding capability set of the display device according to the encoding capability of the SOC chip and the encoding capability of the camera device comprises:

[0126] performing a union operation on the encoding capability of the SOC chip and the encoding capability of the camera device to obtain a union operation result, and taking the union operation result as the encoding capability set of the display device.

[0127] In some embodiments, determining the video call parameter of the display device according to the encoding capability set of the display device and the decoding capability of the SOC chip comprises:

[0128] performing an intersection operation on the encoding capability set of the display device and the decoding capability of the SOC chip to obtain an intersection operation result;

[0129] acquiring the maximum value of the intersection operation result, and determining the maximum value as the video call parameter of the display device.

[0130] In some embodiments, performing the video call according to the encoding capability of the camera device comprises:

[0131] acquire a first video stream corresponding to the coding capability of the camera from the camera, and copy the first video stream, and transmit the copied first video stream to the opposite end.

[0132] In some embodiments, the method further comprises:

[0133] When the video call parameter matches the coding capability of the SOC chip, acquire a second video stream corresponding to the coding capability of the SOC chip from the camera, encode the second video stream, and transmit the encoded video stream to the opposite end.

[0134] In some embodiments, after acquiring the first video stream corresponding to the coding capability of the camera from the camera, the method further comprises:

[0135] decode the first video stream, and locally preview the decoded video stream;

[0136] Alternatively, after acquiring the second video stream corresponding to the coding capability of the SOC chip from the camera, the processor is further configured to:

[0137] decode the second video stream, and locally preview the decoded video stream.

[0138] In some embodiments, the method further comprises:

[0139] acquire a third video stream from the opposite end corresponding to the video call parameter of the display device;

[0140] decode the acquired third video stream to obtain a decoded video stream, and display the decoded video stream on the display device.

[0141] In some embodiments, the method further comprises: when it is detected that the user initiates a video call request through the display device, or when a video call request sent by the opposite end is received, it is determined that the video call function is started.

[0142] The video stream processing method of the display device provided by the above embodiments has the advantages of Figures 5 to 8 The functions implemented by the display device provided by the above embodiments correspond to the functions described above, and will not be described here.

[0143] The embodiments of the present application further provide a computer readable storage medium, and the computer readable storage medium stores computer execution instructions. When the processor executes the computer execution instructions, the video stream processing method of the display device in the above embodiments is implemented.

[0144] Meanwhile, the embodiment of the present application can also provide a computer product, which can implement the video stream processing method of the display device in the above embodiment.

[0145] Finally, it should be noted that: the above embodiments are only used to illustrate the technical solutions of the present application, but not to limit them. Although the present application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that they can still modify the technical solutions recorded in the foregoing embodiments, or make equivalent replacement for part or all of the technical features. These modifications or replacements do not make the essence of the corresponding technical solutions deviate from the scope of the technical solutions of the embodiments of the present application.

[0146] For the convenience of explanation, the above description has been made in combination with specific embodiments. However, the above exemplary discussion is not intended to exhaust or limit the embodiments to the specific forms disclosed above. Various modifications and variations can be derived according to the above teachings. The selection and description of the above embodiments are to better explain the principles and practical applications, so that those skilled in the art can better use the embodiments and various different modified embodiments suitable for specific use considerations.

Claims

1. A display device, characterized in that, Comprising: a processor configured to: when the video call function is started, obtain the encoding capability of the SOC chip, the decoding capability of the SOC chip and the encoding capability of the camera device arranged in the display device; perform a union operation on the encoding capability of the SOC chip and the encoding capability of the camera device to obtain a union operation result, take the union operation result as the encoding capability set of the display device, and perform an intersection operation on the encoding capability set of the display device and the decoding capability of the SOC chip to obtain an intersection operation result; obtain the maximum value of the intersection operation result, and determine the maximum value as the video call parameter of the display device; when the video call parameter matches the encoding capability of the camera device, perform a video call according to the encoding capability of the camera device; the encoding capability of the camera device is greater than or equal to the encoding capability of the SOC chip.

2. The display device of claim 1, wherein, The processor, when performing the video call according to the encoding capability of the camera device, is specifically configured to: obtain a first video stream corresponding to the encoding capability of the camera device from the camera device, and copy the first video stream, and transmit the copied first video stream to the opposite end.

3. The display device of claim 1, wherein, The processor is further configured to: determine whether the video call parameter matches the encoding capability of the SOC chip; when the video call parameter matches the encoding capability of the SOC chip, obtain a second video stream corresponding to the encoding capability of the SOC chip from the camera device, perform encoding processing on the second video stream, and transmit the video stream after the encoding processing to the opposite end; when the video call parameter does not match the encoding capability of the SOC chip, determine whether the video call parameter matches the encoding capability of the camera device.

4. The display device according to claim 2 or 3, characterized in that, The processor, after obtaining the first video stream corresponding to the encoding capability of the camera device from the camera device, is further configured to: perform decoding processing on the first video stream, and locally preview the video stream after the decoding processing; or, the processor, after obtaining the second video stream corresponding to the encoding capability of the SOC chip from the camera device, is further configured to: perform decoding processing on the second video stream, and locally preview the video stream after the decoding processing.

5. The display device of claim 1, wherein, The processor is further configured to: obtain a third video stream from the opposite end corresponding to the video call parameter of the display device; perform decoding operation on the obtained third video stream to obtain a video stream after decoding, and display the video stream after decoding on the display device.

6. The display device according to any of claims 1-5, characterized in that, The processor is further configured to: when it is detected that a user initiates a video call request through the display device, or when a video call request sent by the opposite end is received, it is determined that the video call function is started. 7.A method for processing a video stream of a display device, the method comprising: The method is applied to a processor, and the method comprises: when the video call function is started, obtaining the encoding capability of the SOC chip, the decoding capability of the SOC chip and the encoding capability of the camera device arranged in the display device; determining the video call parameter of the display device according to the encoding capability of the SOC chip, the decoding capability of the SOC chip and the encoding capability of the camera device; When the video call parameter matches the encoding capability of the camera, video calling is performed according to the encoding capability of the camera; the encoding capability of the camera is greater than or equal to the encoding capability of the SOC chip; The video call parameter of the display device is determined according to the encoding capability of the SOC chip, the decoding capability of the SOC chip and the encoding capability of the camera, and includes: The encoding capability of the SOC chip and the encoding capability of the camera are subjected to a set operation to obtain a set operation result, and the set operation result is taken as an encoding capability set of the display device; The encoding capability set of the display device and the decoding capability of the SOC chip are subjected to an intersection operation to obtain an intersection operation result; The maximum value of the intersection operation result is obtained, and the maximum value is determined as the video call parameter of the display device.

Images