Terminal equipment

Abstract

The utility model relates to terminal equipment. The terminal equipment comprises a processing chip which is provided with a first output interface, and the first output interface is used for outputting initial multimedia data; the display driving chip is provided with a first input interface and a second output interface; the first input interface is electrically connected with the first output interface, and the second output interface is used for outputting target multimedia data generated based on the initial multimedia data; and the peripheral connection interface is electrically connected with the second output interface and is used for outputting the target multimedia data to the outside. According to the multimedia data processing method and device, the display driving chip is arranged, the initial multimedia data can be processed to generate the target multimedia data, the power consumption of the terminal equipment is reduced, and the quality of the multimedia data output by the terminal equipment is improved.

Description

Technical Field

[0001] The present disclosure relates to the field of multimedia data screen projection, and in particular to a terminal device. Background Art

[0002] As the functions of electronic products continue to develop, multimedia data display technology is also pursuing greater progress; among them, multimedia data can be transmitted to external devices through terminal devices so that the external devices with display functions can display the screen.

[0003] At present, terminal devices process multimedia data transmitted to external devices through the central processing unit. Due to the limitations of computing power and resource allocation, the quality of multimedia data transmitted by terminal devices to external devices is generally very low, affecting the display effect of external devices. However, if the quality of multimedia data is pursued, it will lead to the resource occupation of the central processing unit, increase the power consumption of the terminal device as a whole, and affect the battery life of the terminal device. Utility Model Content

[0004] In order to overcome the problems existing in the related art, the present disclosure provides a terminal device. The present disclosure can process initial multimedia data to generate target multimedia data by setting a display driver chip, thereby reducing the power consumption of the terminal device and improving the quality of the multimedia data output by the terminal device.

[0005] According to an embodiment of the present disclosure, a terminal device is provided; the terminal device includes:

[0006] A processing chip having a first output interface, wherein the first output interface is used to output initial multimedia data;

[0007] A display driver chip having a first input interface and a second output interface; the first input interface is electrically connected to the first output interface, and the second output interface is used to output target multimedia data generated based on the initial multimedia data;

[0008] The peripheral connection interface is electrically connected to the second output interface and is used to output the target multimedia data externally.

[0009] In some embodiments, the terminal device further includes:

[0010] A signal conversion circuit, comprising a first connection interface, a second connection interface and a conversion element for data format conversion, wherein the conversion element is connected between the first connection interface and the second connection interface;

[0011] The first connection interface is electrically connected to the second output interface;

[0012] The second connection interface is electrically connected to the peripheral connection interface, and is used to output the target multimedia data converted by the conversion element to the peripheral connection interface.

[0013] In some embodiments, the second output interface includes a first sub-interface; the terminal device further includes a switch component;

[0014] The switch assembly includes a second input interface and a third output interface;

[0015] The second input interface is electrically connected to the first sub-interface;

[0016] The third output interface is electrically connected to the first connection interface;

[0017] Wherein, when the switch component is in the first switch state, the connection line between the second input interface and the third output interface is conductive.

[0018] In some embodiments, the processing chip further includes a control interface; the switch component further includes a third input interface;

[0019] The control interface is electrically connected to the third input interface, and is used to input a control signal to the third input interface;

[0020] The control signal is used to control the switch component to be in the first switch state.

[0021] In some embodiments, the processing chip further includes a detection interface electrically connected to the control interface; the terminal device further includes an insertion detection circuit;

[0022] The insertion detection circuit is connected to the connection line between the peripheral connection interface and the detection interface, and is used to input a detection signal to the detection interface through the output interface of the insertion detection circuit when the peripheral connection interface is electrically connected to an external device;

[0023] The detection signal is used to enable the control interface to output the control signal.

[0024] In some embodiments, the switch component further includes a fourth output interface; and the terminal device further includes:

[0025] A display screen, electrically connected to the fourth output interface, and configured to display a picture based on the target multimedia signal;

[0026] Wherein, when the switch component is in the second switch state, the connection line between the second input interface and the fourth output interface is conductive.

[0027] In some embodiments, the first input interface, the first output interface, the second output interface and the first connection interface are all mobile industry processor interfaces; and the second connection interface is a display interface.

[0028] In some embodiments, the processing chip further includes a third input interface and a fifth output interface; the second output interface includes a second sub-interface;

[0029] The second sub-interface is electrically connected to the third input interface;

[0030] The fifth output interface is connected to the peripheral connection interface, and is used to output the target multimedia data to the peripheral connection interface;

[0031] The signal conversion circuit is disposed on the processing chip, the first connection interface of the signal conversion circuit is electrically connected to the third input interface, and the second connection interface of the signal conversion circuit is electrically connected to the fifth output interface.

[0032] In some embodiments, the display driver chip further includes a sixth output interface;

[0033] The sixth output interface is electrically connected to the display screen of the terminal device, and is used to output the target multimedia data to the display screen.

[0034] In some embodiments, the first output interface, the third input interface, the first input interface, the second sub-interface and the first connection interface of the signal conversion circuit are all mobile industry processor interfaces;

[0035] The second connection interface and the fifth output interface of the signal conversion circuit are both display interfaces.

[0036] In some embodiments, the display driver chip further includes:

[0037] The multimedia data processing module is electrically connected to the first input interface and the second output interface of the display driver chip respectively, and is used to process the initial multimedia data to obtain the target multimedia data.

[0038] The technical solution provided by the embodiments of the present disclosure may have the following beneficial effects:

[0039] A display driver chip is provided in the terminal device proposed by the embodiment of the present disclosure, and a processing chip is connected based on a first input interface of the display driver chip, and a peripheral connection interface of the terminal device is connected based on a second output interface of the display driver chip; in this way, the initial multimedia data is processed into target multimedia data by the display driver chip, so that the quality of the multimedia data can be effectively improved, so that when the target multimedia data is projected to an external device, the projection display effect of the external device is improved; at the same time, the present disclosure can also effectively reduce the resource occupation of the processing chip while being compatible with the quality of the multimedia data, further reducing the overall power consumption of the terminal device and optimizing the battery life of the terminal device.

[0040] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0041] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the present disclosure.

[0042] Figure 1 is a schematic diagram of the structure of a terminal device according to an exemplary embodiment;

[0043] Figure 2 It is a schematic diagram of a process of wired screen projection shown in the related art;

[0044] Figure 3 A multimedia data transmission process diagram according to an exemplary embodiment is shown Figure 1 ;

[0045] Figure 4 A multimedia data transmission process diagram according to an exemplary embodiment is shown Figure 2 ;

[0046] Figure 5 A multimedia data transmission process diagram according to an exemplary embodiment is shown Figure 3 ;

[0047] Figure 6 A multimedia data transmission process diagram according to an exemplary embodiment is shown Figure 4 ;

[0048] Figure 7 The present invention is a block diagram of a terminal device according to an exemplary embodiment.

[0049] The Disclosure Figures 1 to 6 The reference numerals involved are as follows:

[0050] 1. Terminal device; 11. Processing chip; 111. First output interface; 112. Control interface; 113. Detection interface; 114. Third input interface; 115. Fifth output interface; 12. Display driver chip; 121. First input interface; 122. Second output interface; 1221. First sub-interface; 1222. Second sub-interface; 123. Sixth output interface; 13. Peripheral connection interface; 14. Signal conversion circuit; 141. First connection interface; 142. Second connection interface; 15. Switch component; 151. Second input interface; 152. Third output interface; 153. Third input interface; 154. Fourth output interface; 16. Insertion detection circuit; 17. Display screen; 2. External device. DETAILED DESCRIPTION

[0051] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present disclosure. Instead, they are merely examples of devices and methods consistent with some aspects of the present disclosure as detailed in the appended claims.

[0052] The present disclosure provides a terminal device. Figure 1 , Figure 1 is a schematic diagram of a terminal device according to an exemplary embodiment; wherein: Figure 1 The terminal device 1 shown comprises:

[0053] The processing chip 11 has a first output interface 111, and the first output interface 111 is used to output initial multimedia data;

[0054] The display driver chip 12 has a first input interface 121 and a second output interface 122; the first input interface 121 is electrically connected to the first output interface 111, and the second output interface 122 is used to output target multimedia data generated based on the initial multimedia data;

[0055] The peripheral connection interface 13 is electrically connected to the second output interface 122 and is used to output target multimedia data externally.

[0056] The terminal device proposed in the present disclosure is applied to multimedia data transmission scenarios, such as screen projection scenarios, data copy scenarios, etc., and the present disclosure does not limit this. Here, the terminal device connects to the external device through the peripheral connection interface, and transmits the above-mentioned target multimedia data to the external device through the peripheral connection interface, so that the external device displays the screen based on the above-mentioned target multimedia data. Among them, the terminal device in the embodiments of the present disclosure includes but is not limited to a camera, a mobile phone, a tablet computer, a personal computer device or a smart watch, etc.

[0057] In the disclosed embodiment, the processing chip is arranged on the mainboard of the terminal device, and includes a central processing unit (Central Processing Unit); wherein the CPU is responsible for executing programs, processing data and performing logical operations, and is the control center of the terminal device, responsible for managing and scheduling the resources of the terminal device such as memory, etc.; the graphics processing unit (Graphics Processing Unit) built into the CPU is used for image processing, screen rendering, etc.

[0058] In the related art, the GPU built into the CPU is usually used for multimedia data processing, that is, the GPU is used for image processing and picture rendering; Figure 2 , Figure 2 is a schematic diagram of a wired screen projection process shown in the related art; Figure 2 As shown, the processing chip 11 of the mobile phone, such as the CPU, converts the multimedia data a processed and rendered by the GPU into display interface (DisplayPort) data b, and transmits the DP data b to the peripheral connection interface 13 of the mobile phone through the DP interface of the CPU; wherein the peripheral connection interface 13 transmits the DP data to the external device 2 through a connecting line; here, the external device 2 is a device with a display function, such as a TV, a personal computer device or virtual reality glasses, etc.; the external device 2 can recognize the DP data and display the picture.

[0059] However, for Figure 2 The mobile phone shown performs wired screen projection processing to the external device 2. The resolution and frame rate of the multimedia data transmitted by the processing chip 11 of the mobile phone to the external device 2 are low, resulting in poor display effect of the external device 2. If the display effect of the external device 2 is to be improved, the CPU needs to allocate more resources for image processing, increasing the resource usage of the central processing unit, which will affect the overall power consumption of the mobile phone and reduce the battery life of the mobile phone.

[0060] Based on this, a display driver chip is proposed in an embodiment of the present disclosure. The display driver chip and the CPU are arranged in different chip slots of the motherboard at intervals and electrically connected; here, the display driver chip includes an independent display chip, which can further process the initial multimedia data transmitted in the CPU and obtain higher-quality target multimedia data, so that the higher-quality target multimedia data can be projected to an external device for display driving, thereby improving the screen display effect of the external device.

[0061] Here, the processing chip has a first output interface, and the display driver chip has a first input interface. The interface standards of the first output interface of the processing chip and the first input interface of the display driver chip are the same, and can support data transmission of the same protocol; and there is an electrical connection between the first input interface and the first output interface, and the first output interface can transmit initial multimedia data to the first input interface; wherein the electrical connection between the first output interface and the first input interface can be connected through wiring on the mainboard.

[0062] It should be noted that the initial multimedia data proposed in the present disclosure is data obtained by the GPU in the processing chip performing image processing and screen rendering according to the process currently running on the terminal device, including image data and video data; wherein the image data can be a frame of initial picture for screen display, and the video data can be formed by multiple frames of continuous initial pictures.

[0063] Here, the GPU can perform simple image processing and picture rendering in response to the process running in the terminal device to obtain multiple frames of initial pictures. In the embodiment of the present disclosure, the display driver chip can process multiple frames of initial pictures to obtain target multimedia data.

[0064] In some embodiments, the display driver chip further includes:

[0065] The multimedia data processing module is electrically connected to the first input interface and the second output interface of the display driver chip respectively, and is used for processing the initial multimedia data to obtain target multimedia data.

[0066] Here, the target multimedia data includes one or more target frames. In the disclosed embodiment, the multimedia data processing module in the display driver chip is provided with an image processing model, which is used to further process the multiple initial frames to obtain multiple target frames.

[0067] In some examples, the image processing model proposed in the embodiments of the present disclosure includes a super-resolution algorithm model; wherein the super-resolution algorithm model can reconstruct a high-resolution picture based on a low-resolution picture; for example, the present embodiment performs interpolation and filtering processing on the initial picture through the super-resolution algorithm model to obtain a target picture; for another example, based on the mapping relationship from low resolution to high resolution learned by the super-resolution algorithm model, determine the target picture corresponding to the initial picture.

[0068] Here, the resolution of the target picture processed based on the super-resolution algorithm model is higher than that of the initial picture. In actual implementation, the embodiment of the present disclosure adjusts the initial picture with a resolution of 720P to a target picture with a resolution of 1.5K based on the super-resolution algorithm model of the display driver chip.

[0069] In other examples, the image processing model proposed in the embodiments of the present disclosure includes a super-frame algorithm model; wherein the super-frame algorithm model can increase the number of frames displayed per second, that is, improve the frame rate, by interpolation processing or learning motion information between adjacent picture frames.

[0070] Here, the frame rate of the multi-frame target picture processed based on the super-frame algorithm model is higher than the frame rate of the multi-frame initial picture; in actual implementation, the embodiment of the present disclosure adjusts the multi-frame initial picture with a frame rate of 30FPS to a multi-frame target picture with a frame rate of 120FPS based on the super-frame algorithm model.

[0071] In some other examples, the image processing model proposed in the embodiments of the present disclosure may also include an image filling algorithm or a color enhancement algorithm, etc.; here, the image filling algorithm can compensate for the missing pixels in the initial picture and improve the content completeness of the target picture; the color enhancement algorithm can improve the color consistency of the initial picture and enhance the visual effect of the target picture.

[0072] Here, by setting up a multimedia data processing module in the display driver chip, it is possible to share the computing pressure of the built-in GPU in the CPU, reduce the resource usage of the CPU, and reduce the power consumption of the terminal device; it is also possible to improve the quality of the initial multimedia data and achieve the projection of higher quality target multimedia data to external devices for screen display.

[0073] In the embodiment of the present disclosure, there is an electrical connection between the second output interface of the display driver chip and the peripheral connection interface, and the electrical connection is achieved through the wiring in the terminal device, or the flexible circuit board in the terminal device. The present disclosure does not impose further restrictions on this. Here, the second output interface and the peripheral connection interface are both interfaces that support image / video data transmission protocols; therefore, the target multimedia data processed by the display driver chip can be transmitted to the external device through the second output interface and the peripheral interface.

[0074] In the disclosed embodiment, the peripheral connection interface may include a Universal Serial Bus (USB) interface; here, the USB interface includes but is not limited to a Type-B interface, a Type-C interface, and a Lightning interface, etc.; a connecting cable is arranged between the peripheral connection interface and the external device, one end of the connecting cable is a port adapted to the USB interface, and the other end of the connecting cable is a port adapted to the external device.

[0075] Taking the USB interface as an example, the connection cable may be a Type-C to Type-C cable; the Type-C to Type-C cable can support the transmission of image / video data.

[0076] It should be noted that the external devices proposed in the embodiments of the present disclosure include but are not limited to mobile terminals, personal computer devices or displays, etc.; here, mobile terminals include mobile phones, smart glasses, etc.; displays include televisions, projectors, etc.

[0077] A display driver chip is provided in the terminal device proposed by the embodiment of the present disclosure, and a processing chip is connected based on a first input interface of the display driver chip, and a peripheral connection interface of the terminal device is connected based on a second output interface of the display driver chip; in this way, the initial multimedia data is processed into target multimedia data by the display driver chip, so that the quality of the multimedia data can be effectively improved, so that when the target multimedia data is projected to an external device, the projection display effect of the external device is improved; at the same time, the present disclosure can also effectively reduce the resource occupation of the processing chip while being compatible with the quality of the multimedia data, further reducing the overall power consumption of the terminal device and optimizing the battery life of the terminal device.

[0078] In the embodiment of the present disclosure, the second output interface and the peripheral connection interface are both interfaces that support image / video data transmission protocols, and the specific image / video data transmission protocols supported by the second output interface and the peripheral connection interface may be the same or different.

[0079] Here, when the second output interface and the peripheral connection interface support the same transmission protocol, the target multimedia data can be directly transmitted to the peripheral connection interface via the second output interface, and then transmitted to the external device through the peripheral connection interface.

[0080] Exemplarily, the second output interface and the peripheral connection interface are both DP interfaces, and the target multimedia data in DP format can be output through the second output interface and transmitted to the peripheral connection interface.

[0081] When the transmission protocols supported by the second output interface and the peripheral connection interface are different, the target multimedia data needs to be format converted so that the target multimedia data can be transmitted externally through the peripheral connection interface.

[0082] In some embodiments, see Figure 3 , Figure 3 A multimedia data transmission process diagram according to an exemplary embodiment is shown Figure 1 ; Combine Figure 1 and Figure 3 As shown, the terminal device 1 also includes:

[0083] The signal conversion circuit 14 has a first connection interface 141, a second connection interface 142 and a conversion element for data format conversion, and the conversion element is connected between the first connection interface 141 and the second connection interface 142;

[0084] The first connection interface 141 is electrically connected to the second output interface 122;

[0085] The second connection interface 142 is electrically connected to the peripheral connection interface 13 , and is used to output the target multimedia data converted by the conversion element to the peripheral connection interface 13 .

[0086] Here, the first connection interface and the second output interface support the same transmission protocol, and can transmit target multimedia data generated based on the initial multimedia data; the second connection interface and the peripheral connection interface can support the same transmission protocol, and can be used to transmit the target multimedia data after format conversion.

[0087] In the embodiment of the present disclosure, the signal conversion circuit is arranged in a conversion chip, and the conversion element in the conversion chip includes an encoder, which can encode the initial multimedia data, thereby changing the format of the target multimedia data through encoding processing; in the embodiment of the present disclosure, the target multimedia data after format conversion is not only compatible with the transmission protocol supported by the second connection interface and the peripheral connection interface, but also can be received, recognized and played by the external device.

[0088] In the present disclosure, the conversion element can be electrically connected to the first connection interface and the second connection interface through a signal trace in the conversion chip.

[0089] The embodiment of the present disclosure converts the format of target multimedia data by setting a signal conversion circuit, so that the converted target multimedia data can be output externally through a peripheral connection interface, thereby improving the effectiveness and continuity of the screen projection process to an external device; and, the embodiment of the present disclosure can also adapt to peripheral connection interfaces that support different transmission protocols and adapt to external devices that recognize multimedia data in different formats by setting different signal conversion circuits, thereby improving the diversity of application scenarios of the terminal device proposed in the present disclosure.

[0090] In some embodiments, the first input interface, the first output interface, the second output interface and the first connection interface are all mobile industry processor interfaces; and the second connection interface is a display interface.

[0091] Here, the Mobile Industry Processor Interface (MIPI) interface is an open standard interface developed by the mobile application processor, which is suitable for video / image data transmission protocol; wherein, the MIPI interface has the characteristics of standardization, high speed, low power consumption, noise suppression and flexibility, etc., and the MIPI interface is an interface set inside the terminal device for display connection.

[0092] The DisplayPort (DP) interface is a digital video interface standard standardized by the Video Electronics Standards Association (VESA). It is suitable for video / image data transmission protocols and supports audio, USB and other forms of data transmission. The DP interface has a high data transmission rate and a small number of pins. The DP interface can be set inside the terminal device for display connection or for external display connection.

[0093] It should be noted that the first output interface, the first input interface, the second output interface and the first connection interface are all MIPI interfaces, and can support the transmission of MIPI signals; therefore, the initial multimedia data transmitted by the first output interface and the first input interface, and the target multimedia data transmitted by the second output interface and the first connection interface are all MIPI signal data. The second connection interface is a DP interface, so the target multimedia data after format conversion output by the second connection interface is DP signal data.

[0094] The signal conversion circuit includes a DP conversion circuit; the DP conversion circuit can convert the MIPI signal output by the MIPI interface into a DP signal to achieve high-resolution, high-refresh-rate multimedia data output. The DP conversion circuit can not only achieve data format conversion, but also clock synchronization, signal amplification and other functions to ensure the stability and reliability of the output signal.

[0095] Here, since the external device can recognize the DP signal data transmitted via the DP interface and the USB interface, but cannot recognize the MIPI signal data transmitted via the MIPI interface; therefore, the embodiment of the present disclosure can convert the MIPI format signal into a DP format signal through the DP conversion circuit, so that the USB interface that supports the DP data transmission protocol can receive the target multimedia data in the DP format, and transmit the target multimedia data in the DP format to the external device for the external device to receive, recognize and play.

[0096] In the disclosed embodiment, the first input interface, the first output interface, the second output interface and the first connection interface are all MIPI interfaces, and the second connection interface is set as a DP interface, which can meet the requirements for transmitting multimedia data to external devices and improve the effectiveness and continuity of the screen projection process to external devices.

[0097] In some embodiments, in combination Figure 1 and Figure 3 , the second output interface 122 includes a first sub-interface 1221; the terminal device also includes a switch component 15;

[0098] The switch assembly 15 includes a second input interface 151 and a third output interface 152;

[0099] The second input interface 151 is electrically connected to the first sub-interface 1221;

[0100] The third output interface 152 is electrically connected to the first connection interface 141;

[0101] When the switch assembly 15 is in the first switch state, the connection line between the second input interface 151 and the third output interface 152 is conductive.

[0102] In the embodiment of the present disclosure, the first sub-interface is an interface in the second output interface; in combination with the above example, the first sub-interface is a MIPI interface. Accordingly, the second input interface of the switch component and the third output interface of the switch component are also MIPI interfaces.

[0103] Here, the switch assembly proposed in the embodiment of the present disclosure includes a mechanical switch or an electronic switch.

[0104] Among them, when the switch component is a mechanical switch, the switch component can be adjusted to the first switch state by adjusting the position of the moving contact of the mechanical switch to the third output interface; when the switch component is an electronic switch, the electronic switch can be adjusted to the first switch state by applying a preset voltage signal or current signal to the electronic switch.

[0105] Here, the first switch state is a switch closed state. When the switch component is in the first switch state, the second input interface and the third output interface are short-circuited, and the connection line between the first sub-interface and the first connection interface of the signal conversion circuit is turned on; at this time, the target multimedia data processed by the display driver chip can be input to the first connection interface of the signal conversion circuit through the first sub-interface, the second input interface, and the third output interface, and the signal conversion circuit performs format conversion on the target multimedia data.

[0106] In the disclosed embodiment, the terminal device can respond to the electrical connection between the terminal device and the external device by controlling the switch component to be in a first switch state, so that the target multimedia data after format conversion can be smoothly output to the external device through the peripheral connection interface; and the terminal device can also respond to the electrical disconnection between the terminal device and the external device by controlling the switch component to be in a switch state different from the first switch state, so that the target multimedia data cannot be transmitted to the signal conversion circuit, thereby reducing the waste of resources and excess power consumption generated by starting the signal conversion circuit, thereby improving the overall usage effect of the terminal device.

[0107] In some embodiments, see Figure 4 , Figure 4 A multimedia data transmission process diagram according to an exemplary embodiment is shown Figure 2 ;like Figure 1 , Figure 3 and Figure 4 As shown, the processing chip 11 further includes a control interface 112; the switch component 15 further includes a third input interface 153;

[0108] The control interface 112 is electrically connected to the third input interface 153 and is used to input a control signal to the third input interface 153;

[0109] The control signal is used to control the switch component 15 to be in the first switch state.

[0110] Here, the switch component is an electronic switch, and there is an electrical connection between the third input interface of the electronic switch and the control interface of the processing chip. Through the electrical connection between the third input interface and the control interface, the processing chip can input a control signal into the electronic switch to short-circuit the second input interface and the third output interface of the electronic switch, thereby turning on the connection line between the first sub-interface and the first connection interface of the signal conversion circuit.

[0111] In the disclosed embodiment, the control signal is a digital signal, which is a high level signal or a low level signal; correspondingly, the electronic switch can be a triode switch, and the gate of the triode switch corresponds to the third input interface. Taking the triode switch as a P-channel Metal-Oxide-Semiconductor switch tube as an example, the control signal can be a low level signal, and by inputting the low level signal into the third input interface corresponding to the gate of the PMOS switch tube, the source and drain of the PMOS switch tube can be connected, that is, the second input interface and the third output interface can be connected.

[0112] It should be noted that, because the control signal is a digital signal, the third input interface and the control interface are both interfaces that can transmit digital signals; illustratively, the third input interface and the control interface of the present disclosure can both be general purpose input / output (GPIO) interfaces.

[0113] In the disclosed embodiment, a control module is further provided in the processing chip, and the output end of the control module is the above-mentioned control interface. When the control module responds to an electrical connection between the terminal device and the external device, the control module inputs a control signal to the third input interface through the control interface.

[0114] The disclosed embodiment can control the switch state of the switch component by inputting a control signal to the third input interface of the switch component through the control interface of the processing chip, and can effectively realize the transmission of target multimedia data in the terminal device.

[0115] In some embodiments, Figure 4As shown, the processing chip 11 further includes a detection interface 113 electrically connected to the control interface 112; the terminal device 1 further includes an insertion detection circuit 16;

[0116] An insertion detection circuit 16 is connected to the connection line between the peripheral connection interface 13 and the detection interface 113, and is used to input a detection signal to the detection interface 113 through an output interface of the insertion detection circuit 16 when the peripheral connection interface 13 is electrically connected to the external device 2;

[0117] The detection signal is used to enable the control interface 112 to output a control signal.

[0118] In combination with the above disclosure, the input end of the control module in the processing chip is the above detection interface, and the output end of the control module is the above control interface. After receiving the detection signal at the detection interface, the control element in the control module generates the above control signal and outputs the above control signal to the outside through the control interface.

[0119] In the disclosed embodiment, the input interface of the insertion detection circuit is connected to the peripheral connection interface such as a USB interface, and the output interface of the insertion detection circuit is connected to the detection interface of the processing chip; wherein, the working principle of the insertion detection circuit is: the signal generating element in the insertion detection circuit continuously sends a DC signal to the configuration pin of the peripheral connection interface; since the circuit impedance in the insertion detection circuit will be changed when the peripheral connection interface is connected to an external device, when the detection element in the insertion detection circuit detects that the current change value of the DC signal exceeds the current change threshold, it is determined that the current peripheral connection interface is electrically connected to the external device, based on which a detection signal is generated, and the detection signal is sent to the detection interface of the processing chip through the output interface of the insertion detection circuit.

[0120] The disclosed embodiment sets up an insertion detection circuit and detects the connection of an external device through the insertion detection circuit, so that the terminal device only starts the format conversion and external transmission of the target multimedia data when it senses that the external device is connected, thereby reducing unnecessary waste of resources and power consumption and improving the overall performance of the terminal device.

[0121] In some embodiments, see Figure 5 ; Figure 5 A multimedia data transmission process diagram according to an exemplary embodiment is shown Figure 3 ;like Figure 1 , Figure 3 , Figure 4 and Figure 5 As shown, the switch component 15 further includes a fourth output interface 154; the terminal device 1 further includes:

[0122] The display screen 17 is electrically connected to the fourth output interface 154 and is used for displaying a picture based on the target multimedia signal;

[0123] When the switch assembly 15 is in the second switch state, the connection line between the second input interface 151 and the fourth output interface 154 is conductive.

[0124] In the embodiment of the present disclosure, the fourth output interface of the switch component can be a MIPI interface; the input interface of the display screen is also a MIPI interface; in this way, when a short circuit is formed between the second input interface and the fourth input interface of the switch component, that is, when the connection line between the second input interface and the fourth input interface is turned on, the target multimedia data in the MIPI format output by the first sub-interface of the display driver chip can be input to the display screen through the first sub-interface, the second input interface and the fourth output interface of the switch component in sequence.

[0125] The disclosed embodiment controls the switch component to be in the second switch state, so that the display screen can receive the target multimedia data and display the picture based on the target multimedia data. In this way, the display screen of the terminal device can display the picture corresponding to the target multimedia data with higher resolution and higher frame rate, thereby effectively improving the display effect of the terminal device.

[0126] In an exemplary embodiment of the present disclosure, the switch component can switch between a first switch state and a second switch state, and control a transmission path of target multimedia data by switching the switch state.

[0127] Here, when the insertion detection circuit does not detect the insertion of an external device, a first signal is generated and the first signal is input into the detection interface of the processing chip; the processing chip generates a second signal based on the first signal, and inputs the second signal into the third input interface of the switch component through the control interface of the processing chip; wherein the first signal and the second signal are both used to indicate that the current terminal device is not connected to an external device, and the second signal is used to control the connection line between the second input interface and the fourth output interface of the switch component to be turned on, and to control the connection line between the second input interface and the third output interface to be turned off, that is, to control the switch component to switch from the first switch state to the second switch state; here, the target multimedia data is transmitted to the display screen for display; and when the insertion detection circuit detects the insertion of an external device, the above-mentioned detection signal is generated; accordingly, the processing chip generates a control signal based on the detection signal, and the control signal controls the switch component to switch from the second switch state to the first switch state, at which time the target multimedia data is format-converted by the signal conversion circuit and then output to the external device, and the display screen of the terminal device cannot receive the target multimedia data for screen display, so in this example, the display screen of the terminal device and the external device cannot achieve screen collaboration.

[0128] For example, Figure 4The solid line portion in shows the transmission path of the multimedia data when the switch assembly 15 is in the first switch state; Figure 5 The solid line portion in the figure shows the transmission path of multimedia data when the switch component 15 is in the second switch state. In actual implementation, taking the switch component as a mechanical switch as an example, the mechanical switch may be a single-pole double-throw switch; taking the switch component as an electronic switch as an example, the electronic switch may be a dual-gate transistor.

[0129] In another exemplary embodiment of the present disclosure, the switch component can always maintain the second switch state and switch between the first switch state and the third switch state, and through the switching of the switch state, control whether the target multimedia data is format converted and transmitted to the external device.

[0130] Here, the connection line between the second input interface and the fourth output interface of the switch component is always in a conducting state, that is, the target multimedia data output by the display driver chip can be transmitted to the display screen for real-time display of the screen. When the insertion detection circuit does not detect the insertion of the external device, a third signal can be generated and the third signal can be input into the detection interface of the processing chip; the processing chip generates a fourth signal based on the third signal, and inputs the fourth signal into the third input interface of the switch component through the control interface of the processing chip; wherein the third signal and the fourth signal are both used to indicate that the current terminal device is not connected to the external device, and the fourth signal is used to control the connection line between the second input interface and the third output interface of the switch component to be turned off, that is, to control the switch component to switch from the first switch state to the third switch state; and when the insertion detection circuit detects the insertion of the external device, the above detection signal is generated; accordingly, the processing chip generates a control signal based on the detection signal, and the control signal controls the switch component to switch from the third switch state to the first switch state, at which time the target multimedia data is format-converted by the signal conversion circuit and then output to the external device. Therefore, in this example, the display screen of the terminal device can perform screen display based on the target multimedia data, and the external device can perform screen display based on the target multimedia data after format conversion, so the terminal device and the external device can achieve screen collaboration.

[0131] In actual implementation, taking the switch component as a mechanical switch as an example, the mechanical switch may be a double-pole double-throw switch; taking the switch component as an electronic switch as an example, the electronic switch may be a dual-gate transistor, etc.

[0132] In some embodiments, see Figure 6 , Figure 6 A multimedia data transmission process diagram according to an exemplary embodiment is shown Figure 4 ; Combine Figure 1 and Figure 6As shown, the processing chip 11 further includes a third input interface 114 and a fifth output interface 115; the second output interface 122 includes a second sub-interface 1222;

[0133] The second sub-interface 1222 is electrically connected to the third input interface 114;

[0134] The fifth output interface 115 is connected to the peripheral connection interface 13 and is used to output target multimedia data to the peripheral connection interface 13;

[0135] Signal conversion circuit ( Figure 6 The first connection interface of the signal conversion circuit is electrically connected to the third input interface, and the second connection interface of the signal conversion circuit is electrically connected to the fifth output interface 115.

[0136] In the disclosed embodiment, the second sub-interface is an interface in the second output interface, wherein the second sub-interface is an interface different from the above-mentioned first sub-interface, but supports the video / image data transmission protocol and can be used to transmit video / image data; here, the third input interface of the processing chip is electrically connected to the second sub-interface and supports the same transmission protocol.

[0137] Exemplarily, the second sub-interface and the third input interface are both MIPI interfaces, and the display driver chip can transmit the target multimedia data back to the third input interface through the second sub-interface.

[0138] Based on this, because the display driver chip has an independent multimedia data processing module and a feedback function, the target multimedia data generated by the processing chip can be transmitted back to the processing chip and then output externally based on the processing chip; this can not only reduce the computing pressure and resource usage of the processing chip, but also improve the quality of the multimedia data projected to the outside.

[0139] Here, the signal conversion circuit provided in the processing chip can perform format conversion on the target multimedia data returned by the display driver chip, so as to output the target multimedia data after format conversion through the fifth output interface. The fifth output interface supports the same transmission protocol as the second connection interface, for example, the fifth output interface and the second connection interface are both DP interfaces; the target multimedia data after format conversion is multimedia data in DP format.

[0140] In some embodiments, Figure 6 As shown, the display driver chip 12 further includes a sixth output interface 123;

[0141] The sixth output interface 123 is electrically connected to the display screen 17 of the terminal device 1 , and is used to output target multimedia data to the display screen 17 .

[0142] In the embodiment of the present disclosure, the sixth output interface and the second output interface are different output interfaces of the display driver chip, both support video / image data transmission protocol, and can be used to transmit video / image data; exemplarily, the sixth output interface is a MIPI interface.

[0143] Here, the sixth output interface is electrically connected to the input interface of the display screen of the terminal device, and can transmit the target multimedia data generated by the display driver chip to the display screen for screen display. In this way, the display screen of the terminal device can display the corresponding screen of the target multimedia data with higher resolution and higher frame rate, thereby effectively improving the display effect of the terminal device. In addition, since the display driver chip has a second sub-interface and a sixth output interface, the target multimedia data generated on the display driver chip can be transmitted to the display screen of the terminal device and the external device at the same time. Therefore, screen collaboration can be achieved between the external device and the terminal device to improve the screen projection effect.

[0144] In some embodiments, the first output interface, the third input interface, the first input interface, the second sub-interface, and the first connection interface of the signal conversion circuit are all mobile industry processor interfaces;

[0145] The second connection interface and the fifth output interface of the signal conversion circuit are both display interfaces.

[0146] Here, the first output interface, the third input interface, the first input interface, the second sub-interface and the first connection interface of the signal conversion circuit are all MIPI interfaces, which can realize the effective transmission of multimedia signals in the terminal device; and the second connection interface and the fifth output interface of the signal conversion circuit are both DP interfaces, which can realize the smooth transmission of the converted target multimedia signals to the peripheral connection interface, so that the external device can recognize the target multimedia data after format conversion to ensure the effectiveness of screen projection.

[0147] In combination with the above embodiments of the present disclosure and Figure 1 , Figures 3 to 5 , illustrating an exemplary terminal device of the present disclosure.

[0148] With the continuous development of information sharing technology between electronic devices, screen projection as a method of content dissemination, sharing and display has been widely used in smart home, smart office, smart education and other fields. Taking mobile phones as terminal devices as an example, mobile phones are often used to project screens to external devices such as personal computers, TVs, and virtual reality (VR) glasses to achieve screen sharing between different electronic devices.

[0149] Here, when the mobile phone uses the GPU built into the CPU to generate image data and transmits it to an external TV or VR glasses, due to limited computing power, the resolution of the multimedia data projected by the mobile phone to the outside can reach 1080P, and the frame rate can reach 60FPS, so the resolution and frame rate are relatively low; and if high-quality and high-resolution multimedia data is required, the power consumption of the mobile phone will increase sharply, seriously affecting the battery life.

[0150] Thus, the embodiment of the present disclosure sets an independent display chip in the mobile phone, and uses the independent display chip to process the initial multimedia data with low resolution and low frame rate to obtain the target multimedia data with high resolution and high frame rate.

[0151] According to an exemplary embodiment of the present disclosure, Figure 6 The display driver chip 12 (i.e., the independent display chip) receives the initial multimedia data input by the first output interface 111 of the processing chip 11 (i.e., the CPU) through the first input interface 121; here, the resolution of the initial multimedia data is 1020P, and the frame rate is 30FPS; the independent display chip doubles and multiplies the resolution and frame rate of the initial multimedia data through the super-resolution super-frame algorithm to obtain the target multimedia data with enhanced effect; wherein, the resolution of the target multimedia data is 1.5K, and the frame rate is 120FPS.

[0152] After obtaining the target multimedia data, the independent display chip can output the target multimedia data to the display screen 17 based on the sixth output interface 123, and transmit the target multimedia data back to the third input interface 114 of the CPU based on the second sub-interface 1222. Here, the CPU can perform format conversion on the target multimedia data, and transmit the format-converted target multimedia data to the peripheral connection interface 13 through the fifth output interface 115, so as to be transmitted to the TV or VR glasses through the peripheral connection interface 13.

[0153] Among them, the target multimedia data and the initial multimedia data are video stream data; the second sub-interface, the third input interface, and the sixth output interface are all MIPI interfaces; the fifth output interface is the DP interface; the peripheral connection interface is the USB interface; the USB interface is connected to the TV through a Type-C to Type-C cable, or connected to the VR glasses.

[0154] Since the embodiments of the present disclosure propose an independent display chip with a feedback function, high-frame-rate and high-resolution multimedia data can be projected onto a TV or VR glasses, thereby improving the projection effect.

[0155] According to another exemplary embodiment of the present disclosure, in combination with Figure 4 and Figure 5, the independent display chip does not have a return function; here, a switch component 15 and a signal conversion circuit 14 are set on the connection line between the second sub-interface 1222 and the peripheral connection interface 13, and an insertion detection circuit 16 is set; wherein, the independent display chip receives the initial multimedia data and generates the target multimedia data with reference to the above example, and the present disclosure will not be repeated here. Figure 4 When the insertion detection circuit 16 detects that the TV or VR glasses are not electrically connected to the peripheral connection interface 13, the CPU of the mobile phone controls the switch component 15 to be in the second switch state, and the target multimedia data is transmitted to the display screen 17 through the switch component. Figure 5 When the insertion detection circuit 16 detects that the TV or VR glasses are electrically connected to the peripheral connection interface 13, the CPU of the mobile phone controls the switch component 15 to be in the first switch state, that is, the signal path is switched to the screen projection path, and the target multimedia data is transmitted to the signal conversion circuit 14 through the switch component. In this way, the signal conversion circuit 14 converts the target multimedia data from the MIPI format to the DP format and then projects it to the outside.

[0156] In this way, the present invention can achieve high frame rate and high resolution wired screen projection based on an independent display chip without a feedback function by setting a switch component and a signal conversion circuit, and reduce the power consumption of the target multimedia data feedback CPU to a certain extent, further improving the battery life of the terminal device.

[0157] Through the independent display chip proposed in the embodiment of the present disclosure, the material cost is reduced based on the mobile phone display enhancement technology, and wired screen projection with super resolution and super frame rate can be achieved while balancing power consumption.

[0158] Figure 7 700 is a block diagram of a terminal device according to an exemplary embodiment. For example, the terminal device 700 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, etc.

[0159] Reference Figure 7 The terminal device 700 may include one or more of the following components: a processing component 702, a memory 704, a power component 706, a multimedia component 708, an audio component 710, an input / output (I / O) interface 712, a sensor component 714, and a communication component 716.

[0160] The processing component 702 generally controls the overall operation of the terminal device 700, such as operations associated with at least one of display, phone call, data communication, camera operation, and recording operation. The processing component 702 may include one or more processors 720 to execute instructions to complete the above-mentioned multimedia data transmission steps. In addition, the processing component 702 may include one or more modules to facilitate the interaction between the processing component 702 and other components. For example, the processing component 702 may include a multimedia module to facilitate the interaction between the multimedia component 708 and the processing component 702. Here, the processing component 702 includes the processing chip and the display driver chip proposed in the above-mentioned embodiments of the present disclosure.

[0161] The memory 704 is configured to store various types of data to support operations on the terminal device 700. Examples of such data include at least one of the following: instructions for any application or method operating on the terminal device 700, contact data, phone book data, messages, pictures, and videos. The memory 704 may be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as a static random access memory (SRAM), an electrically erasable programmable read-only memory (EEPROM), an erasable programmable read-only memory (EPROM), a programmable read-only memory (PROM), a read-only memory (ROM), a magnetic memory, a flash memory, a magnetic disk, or an optical disk.

[0162] The power supply component 706 provides power to various components of the terminal device 700. The power supply component 706 may include at least one of the following: a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the terminal device 700.

[0163] The multimedia component 708 includes a screen that provides an output interface between the terminal device 700 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundaries of the touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 708 includes a front camera and / or a rear camera. When the terminal device 700 is in an operating mode, such as a shooting mode or a video mode, the front camera and / or the rear camera may receive external multimedia data. Each front camera and the rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.

[0164] The audio component 710 is configured to output and / or input audio signals. For example, the audio component 710 includes a microphone (MIC), and when the terminal device 700 is in an operation mode, such as a call mode, a recording mode, and a speech recognition mode, the microphone is configured to receive an external audio signal. The received audio signal can be further stored in the memory 704 or sent via the communication component 716. In some embodiments, the audio component 710 also includes a speaker for outputting audio signals.

[0165] I / O interface 712 provides an interface between processing component 702 and peripheral interface modules, such as keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to, a home button, a volume button, a start button, and a lock button.

[0166] The sensor assembly 714 includes one or more sensors for providing various aspects of status assessment for the terminal device 700. For example, the sensor assembly 714 can detect the open / closed state of the terminal device 700, the relative positioning of the components, such as the display and keypad of the terminal device 700, and the sensor assembly 714 can also detect the position change of the terminal device 700 or a component in the terminal device 700, the presence or absence of contact between the user and the terminal device 700, the orientation or acceleration / deceleration of the terminal device 700, and the temperature change of the terminal device 700. The sensor assembly 714 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. The sensor assembly 714 may also include an optical sensor, such as a complementary metal oxide semiconductor (CMOS) or a charge coupled device (CCD) image sensor, for use in imaging applications. In some embodiments, the sensor assembly 714 may also include, but is not limited to, at least one of the following: an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, and a temperature sensor.

[0167] The communication component 716 is configured to facilitate communication between the terminal device 700 and other devices in a wired or wireless manner. The terminal device 700 can access a wireless network based on a communication standard, such as Wi-Fi, 4G, 5G, or a combination thereof. In an exemplary embodiment, the communication component 716 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 716 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (Ultra Wide Band, UWB) technology, Bluetooth (BT) technology and other technologies to achieve.

[0168] In an exemplary embodiment, the terminal device 700 can be implemented by one or more application specific integrated circuits (ASIC), digital signal processors (DSP), digital signal processing devices (DSPD), programmable logic devices (PLD), field programmable gate arrays (FPGA), controllers, microcontrollers, microprocessors or other electronic components.

[0169] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 704 including executable instructions or a computer program, which can be executed by a processor 720 of a terminal device 700 to complete the steps of generating initial multimedia data, transmitting initial multimedia data, and transmitting target multimedia data in the embodiment of the present disclosure, etc. For example, the non-transitory computer-readable storage medium may be a ROM, a random access memory (RAM), a compact disc read-only memory (CD-ROM), a magnetic tape, a floppy disk, an optical data storage device, etc.

[0170] Those skilled in the art will readily appreciate other embodiments of the present disclosure after considering the specification and practicing the utility model disclosed herein. The present disclosure is intended to cover any variations, uses or adaptations of the present disclosure, which follow the general principles of the present disclosure and include common knowledge or customary technical means in the art that are not disclosed in the present disclosure. The specification and examples are to be regarded as exemplary only, and the true scope and spirit of the present disclosure are indicated by the claims.

[0171] It should be understood that the present disclosure is not limited to the exact structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims

1. A terminal device, characterized in that: include: A processing chip having a first output interface, wherein the first output interface is used to output initial multimedia data; A display driver chip having a first input interface and a second output interface; The first input interface is electrically connected to the first output interface, and the second output interface is used to output target multimedia data generated based on the initial multimedia data; The peripheral connection interface is electrically connected to the second output interface and is used to output the target multimedia data externally.

2. The terminal device according to claim 1, characterized in that: The terminal device further includes: A signal conversion circuit, comprising a first connection interface, a second connection interface and a conversion element for data format conversion, wherein the conversion element is connected between the first connection interface and the second connection interface; The first connection interface is electrically connected to the second output interface; The second connection interface is electrically connected to the peripheral connection interface, and is used to output the target multimedia data converted by the conversion element to the peripheral connection interface.

3. The terminal device according to claim 2, characterized in that: The second output interface includes a first sub-interface; the terminal device also includes a switch component; The switch assembly includes a second input interface and a third output interface; The second input interface is electrically connected to the first sub-interface; The third output interface is electrically connected to the first connection interface; Wherein, when the switch component is in the first switch state, the connection line between the second input interface and the third output interface is conductive.

4. The terminal device according to claim 3, characterized in that: The processing chip further includes a control interface; the switch component further includes a third input interface; The control interface is electrically connected to the third input interface, and is used to input a control signal to the third input interface; The control signal is used to control the switch component to be in the first switch state.

5. The terminal device according to claim 4, characterized in that: The processing chip further includes a detection interface electrically connected to the control interface; the terminal device further includes an insertion detection circuit; The insertion detection circuit is connected to the connection line between the peripheral connection interface and the detection interface, and is used to input a detection signal to the detection interface through the output interface of the insertion detection circuit when the peripheral connection interface is electrically connected to an external device; The detection signal is used to enable the control interface to output the control signal.

6. The terminal device according to any one of claims 3 to 5, characterized in that: The switch component further includes a fourth output interface; and the terminal device further includes: A display screen, electrically connected to the fourth output interface, and configured to display a picture based on the target multimedia data; Wherein, when the switch component is in the second switch state, the connection line between the second input interface and the fourth output interface is conductive.

7. The terminal device according to any one of claims 2 to 5, characterized in that: The first input interface, the first output interface, the second output interface and the first connection interface are all mobile industry processor interfaces; the second connection interface is a display interface.

8. The terminal device according to any one of claims 2 to 5, characterized in that: The processing chip further includes a third input interface and a fifth output interface; the second output interface includes a second sub-interface; The second sub-interface is electrically connected to the third input interface; The fifth output interface is connected to the peripheral connection interface, and is used to output the target multimedia data to the peripheral connection interface; The signal conversion circuit is disposed on the processing chip, the first connection interface of the signal conversion circuit is electrically connected to the third input interface, and the second connection interface of the signal conversion circuit is electrically connected to the fifth output interface.

9. The terminal device according to claim 8, characterized in that: The display driver chip also includes a sixth output interface; The sixth output interface is electrically connected to the display screen of the terminal device, and is used to output the target multimedia data to the display screen.

10. The terminal device according to claim 8, characterized in that: The first output interface, the third input interface, the first input interface, the second sub-interface and the first connection interface of the signal conversion circuit are all mobile industry processor interfaces; The second connection interface and the fifth output interface of the signal conversion circuit are both display interfaces.

11. The terminal device according to any one of claims 1 to 5, characterized in that: The display driver chip also includes: The multimedia data processing module is electrically connected to the first input interface and the second output interface of the display driver chip respectively, and is used to process the initial multimedia data to obtain the target multimedia data.

Images