System chip, electronic device and screen projection method of electronic device
By directly connecting the display processing module and the wireless communication module in the system chip, the problem of delay and excessive resource occupation during the screen projection process is solved, and the screen projection efficiency and user experience are improved.
Patent Information
- Application Number
- CN202110393953.9
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-04-13
- Publication Date
- 2025-01-07
- Estimated Expiration
- 2041-04-13
AI Technical Summary
Existing electronic devices have problems such as delay and excessive resource utilization during screen projection, resulting in poor screen projection effect and poor user experience.
A system chip is designed, including a direct transmission line between the display processing module and the wireless communication module, which directly connects the display processing module and the wireless communication module to avoid intermediate processing, improve data transmission efficiency and reduce delay.
By directly transmitting display data, the information transmission delay is reduced, the screen projection efficiency and user experience are improved, and resource overhead and power consumption are reduced.
Smart Images

Figure CN115209212B_ABST
Abstract
Description
Technical Field
[0001] The present disclosure relates to the field of electronic devices, and in particular to a system chip, an electronic device, and a screen projection method of the electronic device. Background Art
[0002] With the development of screen projection technology, the use of screen projection has brought great convenience to users. Screen projection can be understood as displaying the display content of one device A on the screen of another device B. The displayed content can include various media information and various operation screens displayed in one device A.
[0003] For example, the content displayed on the screen of a device such as a mobile phone or tablet is projected to a device with a larger screen such as a computer, TV or projector, and the content displayed on the screen of the mobile phone or tablet is displayed on the screen of the device such as the computer, TV or projector. Summary of the invention
[0004] The present disclosure provides a system chip, an electronic device, and a screen projection method of the electronic device.
[0005] According to a first aspect of an embodiment of the present disclosure, a system chip is provided, including: a display processing module for processing display data; a first transmission line is provided between the display processing module and the wireless communication module, and the first transmission line is a direct transmission line.
[0006] In one embodiment, the wireless communication module is located on the system chip; the first transmission line is located on the system chip and directly connects the display processing module and the wireless communication module.
[0007] In one embodiment, the system chip also includes: a bus, which is connected to the display processing module and the wireless communication module respectively, wherein there is a second transmission line between the display processing module and the bus, and between the bus and the wireless communication module; the second transmission line is used to transmit display data between the display processing module, the bus and the wireless communication module.
[0008] In one embodiment, the display processing module includes at least: a compression unit connected to the first transmission line and / or the bus, for performing visually lossless compression on the display data, and transmitting the visually lossless compressed display data through the first transmission line or the second transmission line.
[0009] In one embodiment, the display processing module is used to generate display data for screen projection; the first transmission line is used to transmit the display data generated by the display processing module to the wireless communication module; the wireless communication module is used to forward the display data to other electronic devices so that the display data can be displayed through other electronic devices.
[0010] In one embodiment, the wireless communication module is also used to receive the display data; the first transmission line is also used to transmit the display data received by the wireless communication module to the display processing module; the display processing module is also used to receive the display data transmitted by the first transmission line, and send the display data to the display corresponding to the system chip for display.
[0011] In one embodiment, the wireless communication module is located outside the system chip; the system chip has a connection interface, and the first transmission line is between the connection interface and the display processing module; the first transmission line is between the connection interface and the wireless communication module.
[0012] In one embodiment, the system chip also includes: a bus, which is respectively connected to the display processing module and the connection interface, wherein a second transmission line is provided between the display processing module and the bus, and between the bus and the connection interface; the second transmission line is used to transmit display data between the display processing module, the bus and the connection interface.
[0013] In one embodiment, the display processing module includes at least: a compression unit, connected to the first transmission line and / or the bus between the connection interface and the display processing module, for performing visually lossless compression on the display data, and transmitting the visually lossless compressed display data through the first transmission line or the second transmission line.
[0014] In one embodiment, the display processing module is used to generate display data for screen projection; the first transmission line is used to transmit the display data generated by the display processing module to the connection interface; the connection interface is used to forward the display data; the wireless communication module is used to receive the display data sent by the connection interface, and send the display data to other electronic devices so that the display data can be displayed by the other electronic devices.
[0015] In one embodiment, the wireless communication module is also used to receive display data of the projected screen and send the display data to the connection interface; the connection interface is also used to receive the display data; the first transmission line is also used to transmit the display data received by the connection interface to the display processing module; the display processing module is also used to receive the display data transmitted by the first transmission line, and send the display data to the display corresponding to the system chip for display.
[0016] In one embodiment, the wireless communication module includes: one or more wireless communication units, each of the wireless communication units corresponds to a connection interface in the system chip, and each of the wireless communication units is connected to the display processing module in the system chip through the connection interface to which it is connected.
[0017] In one embodiment, the system chip further includes: a memory connected to the bus and used to store the display data; and a codec connected to the bus and used to encode or decode the display data.
[0018] According to a second aspect of the embodiments of the present disclosure, an electronic device is provided, including: the system chip described in any one of the above embodiments.
[0019] A third aspect of an embodiment of the present disclosure provides a screen projection method, which is applied to a first electronic device, and includes: generating display data for projecting the screen to a second electronic device through a display processing module; determining a target transmission line for the display data; wherein the target transmission line is a first transmission line or a second transmission line, wherein the first transmission line is used to directly connect the display processing module and a connection interface, or directly connect the display processing module and a wireless communication module; if the target transmission line is the first transmission line, the display data is transmitted to the connection interface or the wireless communication module through the first transmission line; using the wireless communication module, the display data forwarded by the connection interface, or the display data received and transmitted via the first transmission route is sent to the second electronic device, so that the display data is displayed through the second electronic device.
[0020] In one embodiment, the second transmission line is: a transmission line formed between the display processing module and the bus, and between the bus and the connection interface; or, a transmission line formed between the display processing module and the bus, and between the bus and the wireless communication module; before using the wireless communication module to send the display data forwarded by the connection interface or the display data received via the first transmission route to the second electronic device, the method also includes: if the target transmission line is the second transmission line, transmitting the display data to the connection interface or the wireless communication module via the second transmission line.
[0021] In one embodiment, determining the target transmission line of the display data includes: determining whether the first electronic device is in a screen projection state; if it is determined that the first electronic device is in a screen projection state, determining that the target transmission line is the first transmission line; if it is determined that the first electronic device is not in a screen projection state, determining that the target transmission line is the second transmission line.
[0022] In one embodiment, after determining that the target transmission line is the second transmission line, the method further includes: transmitting the display data to a memory via the bus; encoding the display data via a codec; and transmitting the encoded display data to the bus.
[0023] In one embodiment, before transmitting the display data to the connection interface or the wireless communication module through the first transmission line, or before transmitting the display data to the connection interface or the wireless communication module through the second transmission line, the method further includes: performing visually lossless compression on the display data.
[0024] A fourth aspect of an embodiment of the present disclosure provides a screen projection method, which is applied to a second electronic device, including: receiving display data sent by a first electronic device through a wireless communication module; determining a target transmission line for the display data, wherein the target transmission line is a first transmission line or a second transmission line, and the first transmission line is used to directly connect a display processing module and a connection interface, or directly connect the display processing module and the wireless communication module; if the target transmission line is the first transmission line, then transmitting the display data received by the wireless communication module to the first transmission line through the connection interface; or directly transmitting the display data to the first transmission line through the wireless communication module; transmitting the display data to the display processing module through the first transmission line; and sending the display data to the display of the second electronic device through the display processing module, so as to display the display data through the display of the second electronic device.
[0025] In one embodiment, the second transmission line is: a transmission line formed between the display processing module and the bus, and between the bus and the connection interface; or, a transmission line formed between the display processing module and the bus, and between the bus and the wireless communication module; after determining the target transmission line of the display data, the method further includes: if the target transmission line is the second transmission line, transmitting the display data to the connection interface or the wireless communication module through the second transmission line.
[0026] In one embodiment, determining the target transmission line of the display data includes: determining whether the second electronic device is in a projected screen state; if it is determined that the second electronic device is in a projected screen state, determining that the target transmission line is the first transmission line; if it is determined that the second electronic device is not in a projected screen state, determining that the target transmission line is the second transmission line.
[0027] In one embodiment, after determining that the target transmission line is the second transmission line, the method further includes: transmitting the display data to a memory via a bus; decoding the display data via a codec; and transmitting the decoded display data to the bus.
[0028] In one embodiment, the display data is display data that has been subjected to visually lossless compression processing.
[0029] The technical solution provided by the embodiments of the present disclosure may have the following beneficial effects:
[0030] The system chip includes a display processing module for processing display data. There is a first transmission line between the display processing module and the wireless communication module. The first transmission line is a direct transmission line, that is, the first transmission line directly connects the display processing module and the wireless communication module. The first transmission line is used to transmit display data between the display processing module and the wireless communication module. The wireless communication module sends the information transmitted to the wireless communication module through the first transmission line. Since the first transmission line directly connects the display processing module and the wireless communication module, the information output by the display processing module can be directly transmitted to the wireless communication module through the first transmission line, and the information output by the display processing module does not need to be processed through other media in the middle. The time for reprocessing the information is saved, thereby saving the transmission time of the information, improving the transmission efficiency of the information, and reducing the delay of the information transmission, thereby achieving the purpose of reducing the delay of the screen projection when projecting the screen, improving the projection effect and the user experience.
[0031] On the other hand, the display processing module and the wireless communication module are directly connected through the first transmission line, and there is no need to occupy resources such as bus and memory when transmitting information in the display processing module. This also reduces resource overhead and occupancy, and further reduces the power consumption of the electronic device.
[0032] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS
[0033] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the invention and, together with the description, serve to explain the principles of the invention.
[0034] Figure 1 is a schematic structural diagram of a system chip according to an exemplary embodiment;
[0035] Figure 2 is a schematic structural diagram of another system chip according to an exemplary embodiment;
[0036] Figure 3 is a schematic structural diagram of another system chip according to an exemplary embodiment;
[0037] Figure 4 is a schematic structural diagram of another system chip according to an exemplary embodiment;
[0038] Figure 5 is a schematic structural diagram of another system chip according to an exemplary embodiment;
[0039] Figure 6 is a flowchart of a screen projection method according to an exemplary embodiment;
[0040] Figure 7 is a flow chart showing a method for determining a target transmission line for display data according to an exemplary embodiment;
[0041] Figure 8 is a flowchart of another screen projection method according to an exemplary embodiment;
[0042] Fig. 9 is a flowchart of another screen projection method according to an exemplary embodiment;
[0043] Fig.10 is a flow chart showing another method for determining a target transmission line of the display data according to an exemplary embodiment;
[0044] Fig.11is a flowchart of another screen projection method according to an exemplary embodiment;
[0045] Fig.12 The present invention is a block diagram of a terminal device according to an exemplary embodiment. DETAILED DESCRIPTION
[0046] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present invention. Instead, they are merely examples of devices and methods consistent with some aspects of the present invention as detailed in the appended claims.
[0047] Generally, due to the complex architecture used for screen projection in existing electronic devices and the large number of transmission nodes, there will be delays when existing electronic devices are projecting or being projected, and a large amount of bus resources and memory resources are required during data transmission, which increases the power consumption of the device. And all of the above factors will lead to poor screen projection effects, resulting in a poor user experience. For example, when playing games, the content displayed on a mobile phone or tablet is wirelessly projected to a TV or computer, and the mobile phone or tablet is used as a game controller. The experience of screen mirroring or projection using the usual WiFi wireless projection method is not very good, and there are long delays. For interactive scenarios with increasingly higher requirements such as video playback and game scenes, it is particularly important to reduce delays and improve screen projection effects.
[0048] In order to solve this problem, the present technical solution provides a system chip, which can be used for a projected device or a projecting device, wherein the projecting device can be understood as an electronic device corresponding to the system chip sending display data to be projected to other electronic devices, and displaying the display data through other electronic devices, for example: the display data is video data or image data; the projected device can be understood as an electronic device corresponding to the system chip receiving and displaying the display data sent by other electronic devices.
[0049] refer to Figure 1 , is a structural diagram of a system chip provided in an embodiment of the present technical solution, the system chip comprises: a display processing module 1, for processing display data.
[0050] A first transmission line 4 is provided between the display processing module 1 and the wireless communication module 3 , and the first transmission line 4 is a direct transmission line.
[0051] In this embodiment, the display processing module 1 may be a unit for processing display data, and may generate display data, etc. The display processing module 1 includes but is not limited to a display processor (DPU) or a display system chip. The present technical solution does not specifically limit the specific model of the display system chip, etc., and may be any system chip that can generate display data according to actual usage requirements. The display data generated by the display processing module 1 may be directly displayed by the display of the electronic device, such as image data, specifically RGB data, etc.
[0052] The wireless communication module 3 includes at least one wireless communication unit such as a WiFi module or a Bluetooth module. The wireless communication module 3 can be a wireless communication module located on the system chip, or a wireless communication module located outside the system chip, that is, a wireless communication module not on the system chip. The location of the wireless communication module 3 can be set according to actual needs.
[0053] The main idea of this solution is: the display data generated by the display processing module 1 is output from the system chip through the first transmission line 4. In this process, the display data output by the display processing module 1 does not need to be further processed by other nodes, but is directly transmitted to the wireless communication module 3, and then output from the electronic device where the system chip is located to other electronic devices.
[0054] There is a first transmission line 4 between the display processing module 1 and the wireless communication module 3, and the first transmission line 4 directly connects the display processing module 1 and the wireless communication module 3. Among them, the first transmission line 4 is used to transmit display data between the display processing module 1 and the wireless communication module 3, and the first transmission line 4 can be a transmission line printed on the mainboard of the electronic device, so as to transmit the display data between the display processing module 1 and the wireless communication module 3 through the first transmission line 4. It should be noted that when casting or being cast, the first transmission line 4 is used to transmit the display data of the cast or cast screen. Since the first transmission line 4 does not pass through other devices and is directly connected between the wireless communication module 3 and the display processing module 1, the delay, resource occupation and power consumption in the transmission process can be reduced.
[0055] In an embodiment of the present scheme, when the system chip is used in a screen projection device, the electronic device first generates display data for the projection, then sends the display data to the projected device, and displays the display data through the projected device. It should be noted that the projected device mentioned above is an electronic device other than the projection device that meets the preset requirements. For example, meeting the preset requirements can be understood as the communication distance with the projection device being within a preset range; or, meeting the preset requirements can also be understood as meeting the password requirements of the projection device or the projected device. Specifically, the data processing process when the system chip is used for the projection device is as follows:
[0056] The display processing module 1 is used to generate display data of the screen projection device, and the display data projected by the screen projection device to the projected device is the same as the display data of the screen projection device. That is, the display processing module 1 can be used to generate display data for projection, and the display data is transmitted to the display of the screen projection device through a serial interface applied to display technology, such as a MIPI-DSI interface, for display (refer to the transmission line corresponding to the display data of the display). The display processing module 1 is also used to send the generated display data to the first transmission line 4. The first transmission line 4 transmits the display data generated by the display processing module to the wireless communication module 3. The wireless communication module 3 receives the display data transmitted by the first transmission line, and sends the display data to other electronic devices so that the display data can be displayed by other electronic devices.
[0057] Based on the above analysis, this solution has the following advantages:
[0058] On the one hand, when the display data is transmitted through the first transmission line 4, there is no need to process the display data output by the display processing module through other media in the middle, and the display data is directly transmitted to the wireless communication module 3. The time for reprocessing the display data is saved, thereby saving the information transmission time, improving the information transmission efficiency, and reducing the information transmission delay, thereby achieving the purpose of reducing the screen projection delay during screen projection, improving the screen projection effect and the user experience.
[0059] On the other hand, since there is no need to perform lossy compression operations such as encoding by an encoder on the display data, damage to the display data is reduced, thereby ensuring the quality of the display data.
[0060] On the other hand, the display processing module 1 and the wireless communication module 3 are directly connected through the first transmission line, and there is no need to occupy resources such as the bus and memory when transmitting information in the display processing module 1. This reduces resource overhead and occupancy, and further reduces the power consumption of the system chip and the electronic device where the system chip is located.
[0061] In another embodiment, usually, for the projected device, the structure of the system chip in the projected device is the same as the structure of the system chip in the projection device, but the direction of information transmission is opposite. After receiving the information sent by the projection device, it is also necessary to occupy bus, memory and other resources for transmission, and also requires a video codec for decoding, and then the decoded information is sent to the display of the projected device for display through the display processor. In this process, decoding will also consume a certain amount of time, increasing the time delay. Therefore, it will also lead to poor projection effect and poor user experience.
[0062] In the embodiment of this solution, when the system chip is used in the projected screen device, the structure of the projected screen electronic device is the same as that of the projecting screen device, and the projected screen device receives and displays the display data sent by the projecting screen device. The data processing process of the system chip when used in the projected screen device is as follows:
[0063] In this embodiment, the wireless communication module 3 is also used to receive display data of the projection screen, and transmit the display data to the first transmission line 4. The display data may be sent by a device that generates the display data, for example, a projection screen device.
[0064] The first transmission line 4 transmits the display data to the display processing module 1. The display processing module 1 receives the display data transmitted by the first transmission line 4, and sends the display data to the display of the electronic device where the system chip is located for display.
[0065] It can be understood that the first transmission line 4 is directly connected to the display processing module 1 and the wireless communication module 3. After the wireless communication module 3 receives the display data, it will directly transmit the display data to the display processing module 1 through the first transmission line 4 to reduce the delay, resource occupation and power consumption of the device during the display data transmission process.
[0066] When the projected device receives the display data sent by the projection device, it receives the display data sent by the projection device through the wireless communication module 3, transmits the display data to the first transmission line 4 through the wireless communication module 3, and then transmits the display data to the display processing module 1 through the first transmission line 4. Finally, the display processing module 1 sends the display data to the display of the projected device, and the display data is displayed on the display of the projected device. The display can be an enlarged display or a reduced display, etc., which can be determined according to the size of the display screen.
[0067] Based on the above analysis, the embodiment of this scheme has the following advantages:
[0068] In the process of receiving display data and performing screen projection display by the projected device, the projected device also directly transmits the display data to the display processing module 1 through the first transmission line 4. In this transmission process, no processing, such as decoding, etc., is required for the display data. Therefore, the time for decoding the display data is saved, the time delay is reduced, the transmission efficiency of the display data is improved, and the effect and user experience of the screen projection are improved.
[0069] In addition, since the display data is transmitted between the wireless communication module 3 and the display processing module 1 through the first transmission line 4, there is no need to occupy resources such as bus and memory, thus saving resources, reducing resource occupation, and also reducing power consumption.
[0070] In another embodiment, reference Figure 2 , is a structural schematic diagram of a system chip provided in an embodiment of the present technical solution, the system chip comprising: a display processing module 1 and a connection interface 2.
[0071] In this embodiment, the wireless communication module 3 is located outside the system chip, that is, the system chip does not include the wireless communication module 3, and the wireless communication module 3 can be located on the electronic device where the system chip is located. There is a first transmission line between the wireless communication module 3 and the connection interface 2, and the wireless communication module 3 is connected to the connection interface 2 through the first transmission line.
[0072] There is a first transmission line 4 between the display processing module 1 and the connection interface 2, and the first transmission line 4 directly connects the display processing module 1 and the connection interface 2. Among them, the first transmission line 4 is used to transmit display data between the display processing module 1 and the connection interface 2, and the first transmission line 4 can be a transmission line printed on the mainboard of the electronic device, so that the display data can be transmitted between the display processing module 1 and the connection interface 2 through the first transmission line 4. There can also be a first transmission line 4 between the connection interface 2 and the wireless communication module 3. It should be noted that when casting or being cast, the first transmission line 4 is used to transmit the display data of the cast or cast screen. Since the first transmission line 4 does not pass through other devices and is directly connected between the connection interface 2 and the display processing module 1, the delay, resource occupation and power consumption during the transmission process can be reduced.
[0073] The connection interface 2 may be an interface unit connected to an external device, i.e., an external device connection interface. The connection interface 2 may include, but is not limited to, a peripheral device interconnect bus interface (PCIE), etc., through which the peripheral device interconnect bus interface may be connected to the external device, and of course, other connection interfaces that may be connected to the external device may also be used. The wireless communication module 3 is located on the electronic device where the system chip is located, and includes at least one wireless communication unit such as a WiFi module or a Bluetooth module.
[0074] In an embodiment of the present scheme, when the system chip is used in a screen projection device, the electronic device first generates display data for the projection, then sends the display data to the projected device, and displays the display data through the projected device. It should be noted that the projected device mentioned above is an electronic device other than the projection device that meets the preset requirements. For example, meeting the preset requirements can be understood as the communication distance with the projection device being within a preset range; or, meeting the preset requirements can also be understood as meeting the password requirements of the projection device or the projected device. Specifically, the data processing process when the system chip is used for the projection device is as follows:
[0075] The display processing module 1 is used to generate display data of the screen projection device, and the display data projected by the screen projection device to the projected device is the same as the display data of the screen projection device. That is, the display processing module 1 can be used to generate display data for projection, and the display data is transmitted to the display of the screen projection device through a serial interface applied to display technology, such as a MIPI-DSI interface, for display (refer to the transmission line corresponding to the display data of the display). The display processing module 1 is also used to send the generated display data to the first transmission line 4. The first transmission line 4 is used to transmit the display data generated by the display processing module to the connection interface 2. The connection interface 2 is used to receive the display data transmitted through the first transmission line 4, and send the display data to the wireless communication module 3 through the first transmission line 4. The wireless communication module 3 is used to receive the display data sent by the connection interface 2, and send the display data sent by the connection interface 2 to other electronic devices so that the display data can be displayed by other electronic devices.
[0076] It can be understood that since the first transmission line 4 is directly connected between the display processing module 1 and the connection interface 2 and is used to transmit display data between the display processing module 1 and the connection interface 2, the display data can be directly transmitted from the display processing module 1 to the peripheral connection interface through the first transmission line 4. The connection interface 2 is connected to the wireless communication module 3 through the first transmission line 4. After the display data is transmitted from the display processing module 1 to the connection interface 2 through the first transmission line 4, the display data is sent to other electronic devices through the wireless communication module 3 so that the display data is displayed through the other electronic devices, for example, to the projected screen device so that the display data is displayed through the projected screen device.
[0077] Based on the above analysis, this solution has the following advantages:
[0078] On the one hand, when the display data is transmitted through the first transmission line 4, there is no need to process the display data output by the display processing module through other media in the middle, and the display data is directly transmitted to the connection interface 2. The connection interface 2 serves as a connection bridge connecting the display processing module 1 and the wireless communication module 3. It transmits the display information between the display processing module 1 and the wireless communication module 3, and does not process the display information in any way, so it does not affect the transmission efficiency of the display information, nor does it affect the quality of the display information. The solution of this embodiment saves the time for reprocessing the display data, thereby saving the transmission time of the information, improving the transmission efficiency of the information, and reducing the delay of the information transmission, thereby achieving the purpose of reducing the delay of the screen projection when projecting the screen, and improving the screen projection effect and the user experience.
[0079] On the other hand, since no other processing, such as encoding or decoding, is required when the display data is transmitted through the first transmission line 4, time is saved and, since compression operations such as encoding are lossy compression operations, damage to the display data is reduced, thereby ensuring the quality of the display data. When screen projection is performed, the quality of the information sent by the electronic device can be guaranteed.
[0080] On the other hand, the display processing module and the peripheral connection interface are directly connected through the first transmission line, and there is no need to occupy resources such as bus and memory when transmitting information in the display processing module. This reduces resource overhead and occupancy, and further reduces the power consumption of the electronic device.
[0081] On the other hand, the display data generated by the display processing module in the projection device for projection to the projection device is the same as the display data displayed by the projection device itself, that is, the display data generated by the display processing module is the display data of the projection device, and is also the display data sent to the projection device through the first transmission line. And when the display data is transmitted through the first transmission line, there is no re-processing operation between the display processing module and the peripheral connection interface, so the projection device displays the display data and the information displayed by the projection device is the same. This also ensures the display quality of the content displayed by the two electronic devices and improves the effect of projection.
[0082] In another embodiment, usually, for the projected screen device, the structure of the projected screen device is the same as that of the projection device, but the direction of information transmission is opposite. After receiving the information sent by the projection device, it is also necessary to occupy bus, memory and other resources for transmission, and also requires a video codec for decoding, and then the decoded information is sent to the display of the projected screen device for display through the display processor. In this process, decoding will also consume a certain amount of time, increasing the time delay. Therefore, it will also lead to poor projection effect and poor user experience.
[0083] In the embodiment of this solution, when the system chip is used in the projected screen device, the structure of the projected screen electronic device is the same as that of the projecting device, and the projected screen device receives and displays the display data sent by the projecting device. The data processing process when the system chip is used in the projected screen device is as follows:
[0084] In this embodiment, the wireless communication module 3 is also used to receive display data of the projection screen and transmit the display data to the connection interface 2. The display data may be sent by the device that generates the display data, or may be sent by the projection device. The connection interface 2 is also used to receive display data sent by the projection device and received by the wireless communication module 3, that is, to receive display data sent by the wireless communication module 3, and then transmit the display data to the display processing module 1 through the first transmission line 4. The first transmission line 4 is also used to transmit the display data received by the connection interface 2 to the display processing module 1. The display processing module 1 is also used to receive the display data transmitted by the first transmission line 4, and send the display data to the display of the electronic device corresponding to the system chip for display.
[0085] It can be understood that the first transmission line 4 is directly connected to the display processing module 1 and the connection interface 2. After the connection interface 2 receives the display data, it will directly transmit the display data to the display processing module 1 to reduce the delay, resource occupation and power consumption of the device during the display data transmission process.
[0086] When the projected device receives the display data sent by the projection device, it receives the display data sent by the projection device through the wireless communication module 3, transmits the display data to the connection interface 2 through the wireless communication module 3, and then transmits the display data from the connection interface 2 to the display processing module 1 through the first transmission line 4. Finally, the display processing module 1 sends the display data to the display of the projected device, and the display data is displayed on the display of the projected device. The display can be an enlarged display or a reduced display, etc., which can be determined according to the size of the display screen.
[0087] Based on the above analysis, the embodiment of this scheme has the following advantages:
[0088] In the process of receiving display data and performing screen projection display, the screen projection device also directly transmits the display data from the connection interface 2 to the display processing module 1 through the first transmission line 4. In this transmission process, no processing of the display data, such as decoding, is required. Therefore, the time for decoding the display data is saved, the time delay is reduced, the transmission efficiency of the display data is improved, and the effect and user experience of screen projection are improved.
[0089] In addition, since the display data is transmitted between the connection interface 2 and the display processing module 1 through the first transmission line 4, there is no need to occupy resources such as bus and memory, thus saving resources, reducing resource occupation, and also reducing power consumption.
[0090] In another embodiment, the display data transmitted between the screen projection device and the screen projection device will be compressed or decompressed by the codec. The compression of the display data by the codec is generally lossy compression. After the lossy compression of the display data, the quality of the display data will be reduced, and the compressed display data cannot be completely restored after decompression. In addition, the process of compressing and decompressing the display data takes time, which will also cause a delay in the transmission time. Therefore, it will also lead to poor screen projection effect and poor user experience.
[0091] In order to solve the above problems, the display processing module 1 includes a compression unit. The compression unit may be a unit that performs visual lossless compression using a fixed bit rate display stream compression algorithm (VDC-M) and a display stream compression algorithm (DSC), etc., for visual lossless compression of display data. It may also include a visual lossless decompression unit, which may be a decompression unit corresponding to the lossless compression unit, which is not limited here.
[0092] In this embodiment, the compression unit can be connected to the first transmission line 4, and when the electronic device has the first transmission line 4, the compression unit can be connected to the first transmission line 4. When connected to the first transmission line 4, the display data after visual lossless compression can be directly transmitted to the connection interface 2 through the first transmission line 4, without the need for lossy compression through the codec.
[0093] The compression ratio of visual lossless compression is lower than the high compression ratio of video codecs. By performing visual lossless compression on the display data, the size of the display data is reduced, which is more conducive to data transmission, and there is no visual loss after the compressed display data is displayed. By performing visual lossless compression on the display data, the size of the display data is compressed, and the size of the resulting display data is smaller, which is conducive to data transmission, and the visual display effect of the display data after being displayed is guaranteed, which improves the efficiency and quality of screen projection, thereby improving the user experience.
[0094] refer to Figure 3 , a schematic diagram of the structure of a system chip provided in another embodiment, the system chip further includes:
[0095] The bus 5 is connected to the display processing module 1 and the connection interface 2, respectively, wherein a second transmission line 6 is provided between the display processing module 1 and the bus 5, and between the bus 5 and the connection interface 2. The second transmission line 6 is used to transmit display data between the display processing module 1, the bus 5 and the connection interface 2.
[0096] In this embodiment, the display data can also be transmitted through the bus 5, and the display data is transmitted between the display processing module 1 and the bus 5 through the second transmission line 6. In the projection device, the display processing module 1 transmits the display data to the bus 5 through the second transmission line 6, and the bus 5 then transmits the display data to the connection interface 2 through the second transmission line 6, and then sends the display data to the projected device through the wireless communication module 3. Or in the projected device, the display data sent by the projection device is received through the wireless communication module 3, and then the received display data is sent to the connection interface 2, and then the display data is transmitted to the bus 5 through the second transmission line 6, and the bus 5 then sends the display data to the display processing module 1 through the second transmission line 6.
[0097] The display data can be transmitted through the second transmission line 6 and the bus 5 when the screen is not in the projection state. The electronic device has two transmission lines. When the screen is projected, the display data is transmitted through the first transmission line 4, which reduces the time delay of the screen projection, improves the transmission efficiency of the display data, and thus improves the effect and user experience of the screen projection. When the screen is not in the projection state, the display data is transmitted through the second transmission line 6, which increases the data transmission mode of the electronic device.
[0098] In one embodiment, a screen projection protocol may be used for screen projection, such as WIFI Display (WFD) for wireless screen projection or screen mirroring.
[0099] refer to Figure 3 In another embodiment, the system chip further includes:
[0100] The memory 7 is connected to the bus 5 and is used for storing display data.
[0101] The codec 8 is connected to the bus 5 and is used to encode or decode the display data. The codec 8 can be an image codec, a video codec, an audio codec, etc.
[0102] There is a second transmission line 6 between the bus 5 and the memory 7, and there is also a second transmission line 6 between the bus 5 and the codec 8. When the display data is transmitted through the second transmission line 6, the memory 7 and the codec 8 can also be used to encode or decode the display data. For the projection device, when the display data is transmitted through the second transmission line 6, the display data is transmitted from the display processing module 1 to the bus 5 through the second transmission line 6, and the display data is transmitted to the memory 7 through the bus 5 through the second transmission line 6, and then the display data in the memory 7 is encoded through the codec 8, and the bus 5 transmits the encoded display data to the connection interface 2 through the second transmission line 6, and the display data is sent to the projection device through the wireless communication module 3.
[0103] After the display data is encoded by the codec 8, the size of the display data is compressed, which can be more conducive to the transmission of the display data.
[0104] For the projected screen device, when the received display data is transmitted through the second transmission line 6, the display data sent by the projected screen device is received through the wireless communication module 3, and then the wireless communication module 3 transmits the received display data to the connection interface 2, and the connection interface 2 transmits the display data to the bus 5 through the second transmission line 6, and the bus 5 then transmits the display data to the memory 7 through the second transmission line 6, and then transmits it to the codec 8 through the second transmission line 6, and uses the codec 8 to decode the display data stored in the memory 7, and finally transmits the decoded display data to the display processing module 1 through the bus 5 through the second transmission line 6.
[0105] In another embodiment, the connection interface 2 includes one or more peripheral connection interfaces, and the wireless communication module 3 includes one or more wireless communication units. Each wireless communication unit corresponds to a connection interface 2, and each wireless communication unit is connected to the display processing module 1 through the connection interface 2 connected to it. The connection interface 2 is connected to the wireless communication unit correspondingly, and each connection interface 2 is connected to a wireless communication unit corresponding to the connection interface 2, and data transmitted through each connection interface 2 can be sent through the wireless communication unit corresponding to the connection interface 2.
[0106] Through multiple connection interfaces and multiple wireless communication units, the transmission efficiency and speed of display data can be improved. For example, display data corresponding to content with higher resolution and higher frame rate can be supported, further reducing the delay time of display data during transmission, improving the stability of transmission rate, and reducing the occurrence of situations such as frame drops and screen freezes, thereby improving the screen projection effect and user experience.
[0107] In another embodiment, the compression unit may be connected to the first transmission line 4, may be connected to the bus 5, or may be connected to both the first transmission line 4 and the bus 5. That is, when the electronic device has the bus 5, it may be connected to the bus 5, when the electronic device has the first transmission line 4, it may be connected to the first transmission line 4, and when the electronic device has both the first transmission line 4 and the bus 5, it may be connected to both the first transmission line 4 and the bus 5. When connected to the first transmission line 4, the compressed display data may be transmitted through the first transmission line 4, and when connected to the bus 5, the compressed display data may be transmitted through the second transmission line 6.
[0108] refer to Figure 4 , is a structural schematic diagram of another system chip, the system chip includes: a display processing module 1 and a wireless communication module 3, the wireless communication module 3 is located on the system chip, there is a first transmission line 4 between the display processing module 1 and the wireless communication module 3, the first transmission line 4 is located on the system chip, and directly connects the display processing module 1 and the wireless communication module 3.
[0109] In this embodiment, the wireless communication module 3 is located on the system chip, that is, the system chip includes the wireless communication module 3, that is, the system chip is integrated with the wireless communication module 3, and the display data can be directly sent to other electronic devices through the wireless communication module 3.
[0110] When projecting or being projected, the first transmission line 4 is used to transmit the display data of the projected or projected screen. Since the first transmission line 4 does not pass through other devices and is directly connected between the wireless communication module 3 and the display processing module 1, the delay, resource occupation and power consumption in the transmission process can be reduced.
[0111] In an embodiment of the present scheme, when the system chip is used in a screen projection device, the screen projection device first generates display data for the projection, then sends the display data to the projected device, and displays the display data through the projected device. It should be noted that the projected device mentioned above is an electronic device other than the projection device that meets the preset requirements. For example, meeting the preset requirements can be understood as the communication distance with the projection device being within a preset range; or, meeting the preset requirements can also be understood as meeting the password requirements of the projection device or the projected device. Specifically, the data processing process when the electronic device is used as a projection device is as follows:
[0112] The display processing module 1 is used to generate display data for the screen projection device, and the display data projected by the screen projection device to the projected device is the same as the display data of the screen projection device. That is, the display processing module 1 can be used to generate display data for projection, and the display data is transmitted to the display of the screen projection device for display through a serial interface applied to display technology, such as a MIPI-DSI interface, etc. (refer to the transmission line corresponding to the display data of the display). The display processing module 1 is also used to send the generated display data to the first transmission line 4. The first transmission line 4 is used to transmit the display data generated by the display processing module to the wireless communication module 3. The wireless communication module 3 is used to receive the display data sent by the first transmission line 4, and send the display data to other electronic devices so that the display data can be displayed by other electronic devices.
[0113] It can be understood that since the first transmission line 4 is directly connected between the display processing module 1 and the wireless communication module 3 and is used to transmit display data between the display processing module 1 and the wireless communication module 3, the display data can be directly transmitted from the display processing module 1 to the wireless communication module 3 through the first transmission line 4, and the display data can be sent to other electronic devices through the wireless communication module 3 so that the display data can be displayed through the other electronic devices, for example, sent to the projected screen device so that the display data can be displayed through the projected screen device.
[0114] Based on the above analysis, this solution has the following advantages:
[0115] On the one hand, when the display data is transmitted through the first transmission line 4, there is no need to process the display data output by the display processing module through other media in the middle, and the display data is directly transmitted to the wireless communication module 3. The solution of this embodiment saves the time for reprocessing the display data during the transmission process, thereby saving the transmission time of information, improving the transmission efficiency of information, and reducing the delay of information transmission, thereby achieving the purpose of reducing the screen projection delay during screen projection, improving the screen projection effect and the user experience.
[0116] On the other hand, since no other processing, such as encoding or decoding, is required when the display data is transmitted through the first transmission line 4, time is saved and, since compression operations such as encoding are lossy compression operations, damage to the display data is reduced, thereby ensuring the quality of the display data. When screen projection is performed, the quality of the information sent by the electronic device can be guaranteed.
[0117] On the other hand, the display processing module and the wireless communication module are directly connected through the first transmission line, and there is no need to occupy resources such as bus and memory when transmitting information in the display processing module. This reduces resource overhead and occupancy, and further reduces the power consumption of the electronic device.
[0118] On the other hand, the display data generated by the display processing module in the projection device for projection to the projection device is the same as the display data displayed by the projection device itself, that is, the display data generated by the display processing module is the display data of the projection device, and is also the display data sent to the projection device through the first transmission line. And when the display data is transmitted through the first transmission line, there is no re-processing operation between the display processing module and the wireless communication module, so the projection device displays the display data and the information displayed by the projection device is the same. This also ensures the display quality of the content displayed by the two electronic devices and improves the effect of projection.
[0119] In another embodiment, usually, for the projected screen device, the structure of the projected screen device is the same as that of the projection device, but the direction of information transmission is opposite. After receiving the information sent by the projection device, it is also necessary to occupy bus, memory and other resources for transmission, and also requires a video codec for decoding, and then the decoded information is sent to the display of the projected screen device for display through the display processor. In this process, decoding will also consume a certain amount of time, increasing the time delay. Therefore, it will also lead to poor projection effect and poor user experience.
[0120] In the embodiment of this solution, when the system chip is used for the screen-projected device, the structure of the screen-projected electronic device is the same as that of the screen-projecting device, and the screen-projected device receives and displays the display data sent by the screen-projecting device. The data processing process of the screen-projected device is as follows:
[0121] In this embodiment, the wireless communication module 3 is also used to receive the display data of the projection screen, and then transmit the display data to the first transmission line 4. The first transmission line 4 is also used to transmit the display data received by the wireless communication module 3 to the display processing module 1. The display processing module 1 is also used to receive the display data transmitted by the first transmission line 4, and send the display data to the display of the electronic device corresponding to the system chip for display.
[0122] It can be understood that the first transmission line 4 is directly connected to the display processing module 1 and the wireless communication module 3. After the wireless communication module 3 receives the display data, it will directly transmit the display data to the display processing module 1 through the first transmission line 4 to reduce the delay, resource occupation and power consumption of the device during the display data transmission process.
[0123] When the projected device receives the display data sent by the projection device, it receives the display data sent by the projection device through the wireless communication module 3, and transmits the display data from the wireless communication module 3 to the display processing module 1 through the first transmission line 4. Finally, the display processing module 1 sends the display data to the display of the projected device, and the display data is displayed on the display of the projected device. The display can be enlarged display or reduced display, etc., which can be determined according to the size of the display screen.
[0124] Based on the above analysis, the embodiment of this scheme has the following advantages:
[0125] In the process of receiving display data and performing screen projection display, the screen projection device also directly transmits the display data from the wireless communication module 3 to the display processing module 1 through the first transmission line 4. In this transmission process, no processing of the display data, such as decoding, is required. Therefore, the time for decoding the display data is saved, the time delay is reduced, the transmission efficiency of the display data is improved, and the effect and user experience of screen projection are improved.
[0126] In addition, since the display data is transmitted between the wireless communication module 3 and the display processing module 1 through the first transmission line 4, there is no need to occupy resources such as bus and memory, thus saving resources, reducing resource occupation, and also reducing power consumption.
[0127] In another embodiment, the display data transmitted between the screen projection device and the screen projection device will be compressed or decompressed by the codec. The compression of the display data by the codec is generally lossy compression. After the lossy compression of the display data, the quality of the display data will be reduced, and the compressed display data cannot be completely restored after decompression. In addition, the process of compressing and decompressing the display data takes time, which will also cause a delay in the transmission time. Therefore, it will also lead to poor screen projection effect and poor user experience.
[0128] In order to solve the above problems, the display processing module 1 includes a compression unit. The compression unit may be a unit that performs visual lossless compression using a fixed bit rate display stream compression algorithm (VDC-M) and a display stream compression algorithm (DSC), etc., for visual lossless compression of display data. It may also include a visual lossless decompression unit, which may be a decompression unit corresponding to the lossless compression unit, which is not limited here.
[0129] In this embodiment, the compression unit can be connected to the first transmission line 4, and is connected to the first transmission line 4 when the electronic device has the first transmission line 4. When connected to the first transmission line 4, the display data after visual lossless compression can be directly transmitted to the wireless communication module 3 through the first transmission line 4, without the need for lossy compression through the codec.
[0130] The compression ratio of visual lossless compression is lower than the high compression ratio of video codecs. By performing visual lossless compression on the display data, the size of the display data is reduced, which is more conducive to data transmission, and there is no visual loss after the compressed display data is displayed. By performing visual lossless compression on the display data, the size of the display data is compressed, and the size of the resulting display data is smaller, which is conducive to data transmission, and the visual display effect of the display data after being displayed is guaranteed, which improves the efficiency and quality of screen projection, thereby improving the user experience.
[0131] refer to Figure 5 , a schematic diagram of the structure of a system chip provided in another embodiment, the system chip further includes:
[0132] The bus 5 is connected to the display processing module 1 and the wireless communication module 3, respectively, wherein a second transmission line 6 is provided between the display processing module 1 and the bus 5, and between the bus 5 and the wireless communication module 3. The second transmission line 6 is used to transmit display data between the display processing module 1, the bus 5 and the wireless communication module 3.
[0133] In this embodiment, the display data can also be transmitted through the bus 5, and the display data is transmitted between the display processing module 1 and the bus 5 through the second transmission line 6. In the projection device, the display processing module 1 transmits the display data to the bus 5 through the second transmission line 6, and the bus 5 then transmits the display data to the wireless communication module 3 through the second transmission line 6, and then sends the display data to the projected device through the wireless communication module 3. Or in the projected device, the display data sent by the projection device is received through the wireless communication module 3, and then the display data is transmitted to the bus 5 through the second transmission line 6, and the bus 5 then sends the display data to the display processing module 1 through the second transmission line 6.
[0134] The display data can be transmitted through the second transmission line 6 and the bus 5 when the screen is not in the projection state. The electronic device has two transmission lines. When the screen is projected, the display data is transmitted through the first transmission line 4, which reduces the time delay of the screen projection, improves the transmission efficiency of the display data, and thus improves the effect and user experience of the screen projection. When the screen is not in the projection state, the display data is transmitted through the second transmission line 6, which increases the data transmission mode of the electronic device.
[0135] refer to Figure 5 In another embodiment, the system chip further includes:
[0136] The memory 7 is connected to the bus 5 and is used for storing display data.
[0137] The codec 8 is connected to the bus 5 and is used to encode or decode the display data. The codec 8 can be an image codec, a video codec, an audio codec, etc.
[0138] There is a second transmission line 6 between the bus 5 and the memory 7, and there is also a second transmission line 6 between the bus 5 and the codec 8. When the display data is transmitted through the second transmission line 6, the memory 7 and the codec 8 can also be used to encode or decode the display data. For the screen projection device, when the display data is transmitted through the second transmission line 6, the display data is transmitted from the display processing module 1 to the bus 5 through the second transmission line 6, and the display data is transmitted to the memory 7 through the bus 5 through the second transmission line 6, and then the display data in the memory 7 is encoded through the codec 8, and the bus 5 then transmits the encoded display data to the wireless communication module 3 through the second transmission line 6, and the display data is sent to the projected device through the wireless communication module 3.
[0139] After the display data is encoded by the codec 8, the size of the display data is compressed, which can be more conducive to the transmission of the display data.
[0140] For the projected screen device, when the received display data is transmitted through the second transmission line 6, the display data sent by the projected screen device is received through the wireless communication module 3, and then the display data is transmitted to the bus 5 through the second transmission line 6. The bus 5 then transmits the display data to the memory 7 through the second transmission line 6, and then transmits it to the codec 8 through the second transmission line 6. The codec 8 is used to decode the display data stored in the memory 7, and finally the decoded display data is transmitted to the display processing module 1 through the bus 5 through the second transmission line 6.
[0141] In another embodiment, the wireless communication module 3 includes one or more wireless communication units, each of which is connected to the display processing module 1 respectively.
[0142] Through multiple wireless communication units, the transmission efficiency and speed of display data can be improved. For example, it can support display data corresponding to content with higher resolution and higher frame rate, further reduce the delay time of display data during transmission, improve the stability of transmission rate, and reduce the occurrence of situations such as frame drops and screen freezes, thereby improving the screen projection effect and user experience.
[0143] In another embodiment, the compression unit may be connected to the first transmission line 4, may be connected to the bus 5, or may be connected to both the first transmission line 4 and the bus 5. That is, when the electronic device has the bus 5, it may be connected to the bus 5, when the electronic device has the first transmission line 4, it may be connected to the first transmission line 4, and when the electronic device has both the first transmission line 4 and the bus 5, it may be connected to both the first transmission line 4 and the bus 5. When connected to the first transmission line 4, the compressed display data may be transmitted through the first transmission line 4. When connected to the bus 5, it may be connected to the second transmission line 6, the second transmission line 6 may be connected to the bus 5, and the compressed display data may be transmitted through the second transmission line 6.
[0144] In another embodiment, an electronic device is provided, including: the system chip described in any of the above embodiments. The electronic device can be used as a screen projection device or a screen projection device, the screen projection device and the screen projection device in the above embodiments.
[0145] In another embodiment, a screen projection method is also provided. The execution subject of the screen projection method is Figures 1 to 5 The corresponding electronic device, and the screen projection method is used to describe the data processing process on the screen projection device side. In order to facilitate the description of the transmission process of display data, the first electronic device is used as the screen projection device, and the second electronic device is used as the screen projection device. Figure 6 , is a flowchart of a screen projection method, the method comprising:
[0146] Step S100: generating display data for projecting the screen to a second electronic device through a display processing module.
[0147] The display processing module in the first electronic device is used to generate display data of the first electronic device, and the display data of the first electronic device projected to the second electronic device is the same as the display data of the first electronic device. The second electronic device may be the projected device. The display data may be transmitted to the display of the first electronic device for display via a serial interface applied to display technology, such as a MIPI-DSI interface.
[0148] Step S200, determining a target transmission line for display data; wherein the target transmission line is a first transmission line or a second transmission line, and the first transmission line is directly connected to the display processing module and the connection interface, or directly connected to the display processing module and the wireless communication module.
[0149] Before transmitting the display data, it is necessary to determine a transmission path for transmitting the display data, and the transmission path may be a first transmission path or a second transmission path. In this embodiment, the first transmission line directly connects the display processing module and the connection interface, and the first transmission line is used to transmit the display data generated by the display processing module to the connection interface, or directly connects the display processing module and the wireless communication module.
[0150] Step S300: if the target transmission line is the first transmission line, the display data is transmitted to the connection interface or the wireless communication module through the first transmission line.
[0151] Since the first transmission line directly connects the display processing module and the connection interface, the display data can be directly transmitted from the display processing module to the connection interface through the first transmission line. The connection interface receives the display data transmitted through the first transmission line. After the display processing module generates the display data and determines the target transmission line, the display processing module sends the display data to the first transmission line, transmits the display data to the connection interface through the first transmission line, and then transmits the display data to the wireless communication module through the connection interface.
[0152] Alternatively, since the first transmission line directly connects the display processing module and the wireless communication module, the display data can be directly transmitted from the display processing module to the wireless communication module through the first transmission line. After the display processing module generates the display data and determines the target transmission line, the display processing module sends the display data to the first transmission line, and transmits the display data to the wireless communication module through the first transmission line.
[0153] Since the display data generated by the display processing module in the first electronic device for projection to the second electronic device is the same as the display data displayed by the first electronic device itself, that is, the display data generated by the display processing module is the display data of the first electronic device, and is also the display data sent to the second electronic device through the first transmission line. And when the display data is transmitted through the first transmission line, there is no operation to process the display data again between the display processing module and the connection interface, or between the display processing module and the wireless communication module, so the second electronic device displays the display data and the information displayed is the same as that displayed by the first electronic device. This also ensures the display quality of the content displayed by the two electronic devices and improves the effect of screen projection.
[0154] In step S400, the display data transmitted to the connection interface or the display data received via the first transmission route is sent to the second electronic device by using the wireless communication module, so that the display data is displayed by the second electronic device.
[0155] The wireless communication module is connected to the connection interface, and the display data received by the connection interface is sent to the second electronic device, or the wireless communication module 1 directly receives the display data transmitted by the first transmission route 4 and sends it to the second electronic device, thereby completing the screen projection of the first electronic device to the second electronic device. The first electronic device and the second electronic device communicate with each other through the wireless communication module in the first electronic device and the wireless communication module in the second electronic device.
[0156] In one embodiment, before transmitting the display data to the connection interface through the first transmission line, or before transmitting the display data to the connection interface through the second transmission line, or before transmitting the display data to the connection interface or the wireless communication module through the second transmission line, it also includes:
[0157] The display data is compressed to obtain compressed display data. The display data is generated by the display processing module, the visual lossless compression unit in the display processing module performs visual lossless compression on the data to be displayed, and the compressed display data is transmitted through a transmission line.
[0158] In another embodiment, the second transmission line in the target transmission line is a transmission line formed between the display processing module and the bus, and between the bus and the connection interface. Different application scenarios and usage requirements can determine different transmission lines. For example, when the screen is projected, the transmission line for display data is determined to be the first transmission line, and when the screen is not projected, the transmission line for display data is determined to be the second transmission line.
[0159] After determining that the target transmission line is the second transmission line, the display data is transmitted to the connection interface through the second transmission line. The display processing module transmits the display data to the second transmission line between the display processing module and the bus, and the display data is transmitted to the bus through the second transmission line. The display data is then transmitted to the second transmission line between the bus and the connection interface through the bus, and the display data is transmitted to the connection interface through the second transmission line. The display data can be transmitted to the wireless communication module through the connection interface.
[0160] Alternatively, the second transmission line in the target transmission line is a transmission line formed between the display processing module and the bus, and between the bus and the wireless communication module. After determining that the target transmission line is the second transmission line, the display data is transmitted to the wireless communication module through the second transmission line. The display processing module transmits the display data to the second transmission line between the display processing module and the bus, and the display data is transmitted to the bus through the second transmission line. The display data is then transmitted to the second transmission line between the bus and the wireless communication module through the bus, and the display data is transmitted to the wireless communication module through the second transmission line.
[0161] In another embodiment, the first device and the second device can simultaneously transmit different display data through the first transmission line and the second transmission line.
[0162] In another embodiment, there is no order in which data is transmitted through the first transmission line or the second transmission line, and both can be interchanged.
[0163] In another embodiment, a method for determining a target transmission line for display data is provided, wherein the method comprises: determining the target transmission line according to a preset transmission rule.
[0164] The preset transmission rule is a matching relationship between a preset target transmission line and display data to be transmitted.
[0165] In another embodiment, the method for determining a target transmission line for display data further includes:
[0166] Determine the attribute information of the display data, where the attribute information includes the size, format type, etc. of the display data.
[0167] The target transmission line is determined based on the attribute information of the display data.
[0168] For example, when the size of the display data exceeds a preset threshold, the target transmission path is determined to be the first transmission path. For example, when the format is MPEG2 format, the encoding transmission path is determined to be the first transmission path.
[0169] In another embodiment, a method for determining a target transmission line for display data is also provided. Figure 7 , is a flow chart of the method, the method comprising:
[0170] Step S10, determining whether the first electronic device is in a screen projection state.
[0171] According to the usable status of the first electronic device, it can be determined whether the first electronic device is in the projection state. Since the delay time for transmitting display data in the projection state is lower than the delay time for transmitting display data in the non-projection state, the transmission line can be determined according to whether the first electronic device is in the projection state. Here, it is necessary to determine the status of the first electronic device first.
[0172] Step S20: If it is determined that the first electronic device is in a screen projection state, determine that the target transmission line is a first transmission line.
[0173] When it is determined that the first electronic device is in the screen projection state, the target transmission line is determined to be the first transmission line. Since a shorter delay time is required to transmit display data in the screen projection state, the first transmission line directly transmits the display data from the display processing module to the connection interface or the wireless communication module, and the second transmission line also needs to pass through the bus, so the delay time of the first transmission line to transmit the display data is less than the delay time of the second transmission line, so when the screen is projected, the target transmission line is determined to be the first transmission line. Transmitting display data through the first transmission line during screen projection reduces the delay time, improves the screen projection effect and the user experience.
[0174] Step S30: If it is determined that the first electronic device is not in the screen projection state, determine that the target transmission line is the second transmission line.
[0175] When it is determined that the first electronic device is in a non-screen projection state, the target transmission line is determined to be the second transmission line. Of course, the display data can also be transmitted through the first transmission line.
[0176] In another embodiment, another screen projection method is provided. Figure 8 After determining that the target transmission line is the second transmission line, the method further includes:
[0177] Step S31, transmitting the display data to a memory via the bus.
[0178] When the display data is transmitted through the second transmission line, the display data generated by the display processing module is transmitted to the memory through the bus, and the display data is stored in the memory to facilitate the processing in subsequent steps.
[0179] Step S32: Encode the display data using the codec.
[0180] After the display data is stored in the memory, the display data is encoded by a codec. The encoding process is the process of compressing the display data. The encoded display data is compressed, and the compressed display data is easier to transmit.
[0181] Step S33, transmitting the encoded display data to the bus.
[0182] The encoded display data is transmitted to the bus, and then the encoded display data is transmitted to the connection interface through the bus, and then sent to the second electronic device through the wireless communication module.
[0183] In another embodiment, another screen projection method is provided. The execution subject of the screen projection method is Figure 1 or Figure 5The corresponding electronic device, and the screen projection method is used to describe the data processing process on the screen projection device side. In order to facilitate the description of the transmission process of display data, the first electronic device is used as the screen projection device, and the second electronic device is used as the screen projection device. Fig. 9 , the method comprising:
[0184] Step S400: receiving display data sent by the first electronic device through the wireless communication module.
[0185] The second electronic device also includes a wireless communication module. After the first electronic device sends the display data, the display data sent by the first electronic device is received by the wireless communication module of the second electronic device, and then the display data is displayed. The first electronic device is a screen projection device. The wireless communication module can be a wireless communication module located on the system chip, or it can be a wireless communication module located outside the system chip and on the electronic device to which the screen is projected.
[0186] Step S500, determining a target transmission line for display data, the target transmission line is a first transmission line or a second transmission line, the first transmission line is directly connected to the display processing module and the connection interface, or directly connected to the display processing module and the wireless communication module.
[0187] After the second electronic device receives the display data through the wireless communication module, it is also necessary to determine the transmission line of the display data so as to transmit the display data from the wireless communication module to the display of the second electronic device for display. In this embodiment, the transmission line in this embodiment is the first transmission line.
[0188] Step S600: if the target transmission line is the first transmission line, the display data received by the wireless communication module is transmitted to the first transmission line through the connection interface.
[0189] When the system chip includes a connection interface and the wireless communication module is located outside the system chip, after receiving the display data through the wireless communication module, the display data received by the wireless communication module is transmitted to the first transmission line through the connection interface. Alternatively, when the system chip does not include a connection interface, that is, when the wireless communication module is located on the system chip, the display data is directly transmitted to the first transmission line through the wireless communication module.
[0190] Step S700: transmitting display data to a display processing module via a first transmission line.
[0191] The first transmission line is used to transmit display data between the display processing module and the connection interface, and the display data transmitted by the connection interface is transmitted to the display processing module through the first transmission line.
[0192] Step S800: sending the display data to the display of the second electronic device through the display processing module, so that the display data is displayed through the display of the second electronic device.
[0193] After the display processing module receives the display data transmitted by the first transmission line, the display data is sent to the display of the second electronic device, and the display data is displayed by the display of the second electronic device.
[0194] The process in which the second electronic device receives the display data sent by the first electronic device is the reverse process to the process in which the first electronic device sends the display data to the second electronic device.
[0195] The second electronic device receives the display data through the first transmission line, which also reduces the delay time of the display data during the transmission process, thereby improving the display effect of the projection screen.
[0196] In another embodiment, the second transmission line is a transmission line formed between the display processing module and the bus, and between the bus and the connection interface. After determining that the target transmission line is the second transmission line, the display data is transmitted to the connection interface through the second transmission line. The transmission direction of the display data of the second transmission line in the second electronic device is opposite to the direction in which the display data is transmitted by the first electronic device through the second transmission line.
[0197] In another embodiment, the second transmission line is a transmission line formed between the display processing module and the bus, and between the bus and the wireless communication module. After determining that the target transmission line is the second transmission line, the display data is transmitted to the wireless communication module through the second transmission line.
[0198] In another embodiment, a method for determining a target transmission line of the display data is also provided, referring to Fig.10 , is a flow chart of the method, the method comprising:
[0199] Step S40, determining whether the second electronic device is in a screen projection state.
[0200] Whether the second electronic device is in a projection state can be determined based on the usable status of the second electronic device. Since the delay time for transmitting display data in the projection state is lower than the delay time for transmitting display data in the non-projection state, the transmission line can be determined based on whether the first electronic device is in the projection state. Here, the status of the second electronic device needs to be determined first.
[0201] Step S50: If it is determined that the second electronic device is in a screen projection state, determine that the target transmission line is the first transmission line.
[0202] When it is determined that the second electronic device is in the screen projection state, the target transmission line is determined to be the first transmission line. Since a shorter delay time is required to transmit display data in the screen projection state, the first transmission line directly transmits the display data from the display processing module to the connection interface or the wireless communication module, and the second transmission line also needs to pass through the bus, so the delay time of the first transmission line to transmit the display data is less than the delay time of the second transmission line, so when the screen is projected, the target transmission line is determined to be the first transmission line. Transmitting display data through the first transmission line during screen projection reduces the delay time, improves the screen projection effect and the user experience.
[0203] Step S60: If it is determined that the second electronic device is not in the screen projection state, determine that the target transmission line is the second transmission line.
[0204] When it is determined that the second electronic device is in a non-screen projection state, the target transmission line is determined to be the second transmission line. Of course, the display data can also be transmitted through the first transmission line.
[0205] The steps in this embodiment have no sequential relationship with S10-S30.
[0206] In one embodiment, the target transmission line of the second electronic device is the same as that of the first electronic device, and the method for determining the encoding transmission line of the second electronic device may be the same as the method for determining the target transmission line of the first electronic device.
[0207] In another embodiment, another screen projection method is provided. Fig.11 After determining that the target transmission line is the second transmission line, the method further includes:
[0208] Step S61, transmitting the display data to a memory via the bus.
[0209] When the display data is transmitted through the second transmission line, the display data transmitted by the connection interface is transmitted to the memory through the bus, and the display data is stored in the memory to facilitate the processing of subsequent steps.
[0210] Step S62: decoding the display data by using the codec.
[0211] After the display data is stored in the memory, the display data is decoded by a codec. The encoding and decoding process is the process of decompressing the display data. The decoded display data is decompressed. The decompressed display data is used for display on the second electronic device.
[0212] Step S63, transmitting the decoded display data to the bus.
[0213] The decoded display data is transmitted to the bus, and then transmitted to the display processing module through the bus, and the decoded display data is sent to the display of the second electronic device for display through the display processing module.
[0214] In another embodiment, the display data received by the second electronic device through the wireless transmission module is display data that has undergone visually lossless compression processing. The second electronic device does not need to decompress the display data and can directly display the display data through the display without affecting the display effect.
[0215] It should be noted that the “first” and “second” in the embodiments of the present disclosure are only for the convenience of description and distinction and have no other specific meanings.
[0216] Fig.12 1 is a block diagram of a terminal device according to an exemplary embodiment. For example, the terminal device may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, etc.
[0217] Reference Fig.12 The terminal device may include one or more of the following components: a processing component 802 , a memory 804 , a power component 806 , a multimedia component 808 , an audio component 810 , an input / output (I / O) interface 812 , a sensor component 814 , and a communication component 816 .
[0218] The processing component 802 generally controls the overall operation of the terminal device, such as operations associated with display, phone calls, data communications, camera operations, and recording operations. The processing component 802 may include one or more processors 820 to execute instructions to complete all or part of the steps of the above method. In addition, the processing component 802 may include one or more modules to facilitate the interaction between the processing component 802 and other components. For example, the processing component 802 may include a multimedia module to facilitate the interaction between the multimedia component 808 and the processing component 802.
[0219] The memory 804 is configured to store various types of data to support operations on the terminal device. Examples of such data include instructions for any application or method operating on the terminal device, contact data, phone book data, messages, pictures, videos, etc. The memory 804 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk.
[0220] The power component 806 provides power to various components of the terminal device. The power component 806 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to the terminal device.
[0221] The multimedia component 808 includes a screen that provides an output interface between the terminal device and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundaries of the touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 808 includes a front camera and / or a rear camera. When the terminal device is in an operating mode, such as a shooting mode or a video mode, the front camera and / or the rear camera may receive external multimedia data. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.
[0222] The audio component 810 is configured to output and / or input audio signals. For example, the audio component 810 includes a microphone (MIC), and when the terminal device is in an operation mode, such as a call mode, a recording mode, and a speech recognition mode, the microphone is configured to receive an external audio signal. The received audio signal can be further stored in the memory 804 or sent via the communication component 816. In some embodiments, the audio component 810 also includes a speaker for outputting audio signals.
[0223] I / O interface 812 provides an interface between processing component 802 and peripheral interface modules, such as keyboards, click wheels, buttons, etc. These buttons may include but are not limited to: a home button, a volume button, a start button, and a lock button.
[0224] The sensor assembly 814 includes one or more sensors for providing various aspects of status assessment for the terminal device. For example, the sensor assembly 814 can detect the open / closed state of the terminal device, the relative positioning of components, such as the display and keypad of the terminal device, and the sensor assembly 814 can also detect the position change of the terminal device or a component of the terminal device, the presence or absence of user contact with the terminal device, the orientation or acceleration / deceleration of the terminal device, and the temperature change of the terminal device. The sensor assembly 814 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. The sensor assembly 814 may also include an optical sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 814 may also include an accelerometer, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.
[0225] The communication component 816 is configured to facilitate wired or wireless communication between the terminal device and other devices. The terminal device can access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component 816 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 816 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.
[0226] In an exemplary embodiment, the terminal device may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components to perform the above method.
[0227] Those skilled in the art will readily appreciate other embodiments of the present invention after considering the specification and practicing the invention disclosed herein. This application is intended to cover any variations, uses or adaptations of the present invention that follow the general principles of the present invention and include common knowledge or customary techniques in the art that are not disclosed in this disclosure. The specification and examples are to be considered exemplary only, and the true scope and spirit of the present invention are indicated by the following claims.
[0228] It should be understood that the present invention is not limited to the exact construction that has been described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the present invention is limited only by the appended claims.
Claims
1. A system chip, characterized in that: include: Display processing module, used for processing display data; The display processing module has a first transmission line between it and the wireless communication module, and the first transmission line is a direct transmission line; The wireless communication module is located on the system chip; The first transmission line is located on the system chip and directly connects the display processing module and the wireless communication module; A bus is connected to the display processing module and the wireless communication module respectively, wherein a second transmission line is provided between the display processing module and the bus, and between the bus and the wireless communication module; the second transmission line is used to transmit display data between the display processing module, the bus and the wireless communication module; or, The wireless communication module is located outside the system chip; the system chip has a connection interface, and the first transmission line is between the connection interface and the display processing module; the first transmission line is between the connection interface and the wireless communication module; the bus is connected to the display processing module and the connection interface, respectively, wherein a second transmission line is provided between the display processing module and the bus, and between the bus and the connection interface; the second transmission line is used to transmit display data between the display processing module, the bus and the connection interface.
2. The system chip according to claim 1, characterized in that: When the wireless communication module is located on the system chip, the display processing module at least includes: A compression unit is connected to the first transmission line and / or the bus, and is used to perform visual lossless compression on the display data, and transmit the visual lossless compressed display data through the first transmission line or the second transmission line.
3. The system chip according to claim 1, characterized in that: When the wireless communication module is located on the system chip, the display processing module is used to generate display data for screen projection; The first transmission line is used to transmit the display data generated by the display processing module to the wireless communication module; The wireless communication module is used to forward the display data to other electronic devices so that the display data can be displayed by other electronic devices.
4. The system chip according to claim 1, characterized in that: When the wireless communication module is located on the system chip, the wireless communication module is further used to receive the display data; The first transmission line is further used to transmit the display data received by the wireless communication module to the display processing module; The display processing module is further used to receive the display data transmitted by the first transmission line, and send the display data to a display corresponding to the system chip for display.
5. The system chip according to claim 1, characterized in that: When the wireless communication module is located outside the system chip, the display processing module at least includes: A compression unit is connected to the first transmission line and / or the bus between the connection interface and the display processing module, and is used to perform visual lossless compression on the display data, and transmit the visually lossless compressed display data through the first transmission line or the second transmission line.
6. The system chip according to claim 1, characterized in that: When the wireless communication module is located outside the system chip, the display processing module is used to generate display data for screen projection; The first transmission line is used to transmit the display data generated by the display processing module to the connection interface; The connection interface is used to forward the display data; The wireless communication module is used to receive the display data sent by the connection interface, and send the display data to other electronic devices so that the display data can be displayed by other electronic devices.
7. The system chip according to claim 1, characterized in that: When the wireless communication module is located outside the system chip, the wireless communication module is also used to receive display data of the projection screen and send the display data to the connection interface; The connection interface is further used to receive the display data; The first transmission line is further used to transmit the display data received by the connection interface to the display processing module; The display processing module is further used to receive the display data transmitted by the first transmission line, and send the display data to a display corresponding to the system chip for display.
8. The system chip according to claim 1, characterized in that: When the wireless communication module is located outside the system chip, the wireless communication module includes: One or more wireless communication units, each of which corresponds to a connection interface in the system chip, and each of which is connected to the display processing module in the system chip through the connection interface connected to it.
9. The system chip according to claim 1, characterized in that: The system chip also includes: A memory, connected to the bus, and used to store the display data; A codec is connected to the bus and is used to encode or decode the display data.
10. An electronic device, characterized in that: include: A system chip as claimed in any one of claims 1 to 9.
11. A screen projection method, characterized in that: Applicable to a first electronic device, comprising: Generate display data for projecting the screen to the second electronic device through the display processing module; Determine a target transmission line of the display data; wherein the target transmission line is a first transmission line or a second transmission line, wherein the first transmission line is used to directly connect the display processing module and the connection interface, or directly connect the display processing module and the wireless communication module; When it is determined that the first electronic device is in a screen projection state, and the target transmission line is determined to be a first transmission line, the display data is transmitted to the connection interface or the wireless communication module through the first transmission line; Using the wireless communication module, the display data forwarded by the connection interface or the display data received and transmitted by the first transmission line is sent to a second electronic device, so that the display data is displayed by the second electronic device; The second transmission line is: a transmission line formed between the display processing module and the bus, and between the bus and the connection interface; or a transmission line formed between the display processing module and the bus, and between the bus and the wireless communication module; Before using the wireless communication module to send the display data forwarded by the connection interface or the display data received and transmitted by the first transmission line to the second electronic device, the method further includes: When it is determined that the first electronic device is not in the screen projection state, and the target transmission line is determined to be the second transmission line, the display data is transmitted to the connection interface or the wireless communication module through the second transmission line.
12. The screen projection method according to claim 11, characterized in that: After determining that the target transmission line is the second transmission line, the method further includes: transmitting the display data to a memory via the bus; encoding the display data by a codec; The encoded display data is transmitted to the bus.
13. The screen projection method according to claim 11, characterized in that: Before transmitting the display data to the connection interface or the wireless communication module through the first transmission line, or before transmitting the display data to the connection interface or the wireless communication module through the second transmission line, the method further includes: Visually lossless compression is performed on the display data.
14. A screen projection method, characterized in that: Applicable to a second electronic device, comprising: receiving display data sent by the first electronic device through the wireless communication module; Determine a target transmission line of the display data, the target transmission line is a first transmission line or a second transmission line, the first transmission line is used to directly connect the display processing module and the connection interface, or directly connect the display processing module and the wireless communication module; When it is determined that the second electronic device is in a screen projection state, and the target transmission line is determined to be the first transmission line, the display data received by the wireless communication module is transmitted to the first transmission line through the connection interface; or the display data is directly transmitted to the first transmission line through the wireless communication module; Transmitting the display data to the display processing module via a first transmission line; Sending the display data to a display of a second electronic device through the display processing module, so that the display data is displayed through the display of the second electronic device; The second transmission line is: a transmission line formed between the display processing module and the bus, and between the bus and the connection interface; or a transmission line formed between the display processing module and the bus, and between the bus and the wireless communication module; After determining the target transmission line of the display data, the method further includes: When it is determined that the second electronic device is not in the screen projection state, and the target transmission line is determined to be the second transmission line, the display data is transmitted to the connection interface or the wireless communication module through the second transmission line.
15. The screen projection method according to claim 14, characterized in that: After determining that the target transmission line is the second transmission line, the method further includes: Transmitting the display data to a memory via a bus; Decoding the display data by a codec; The decoded display data is transmitted to the bus.
16. The screen projection method according to claim 14, characterized in that: The display data is display data that has been subjected to visual lossless compression processing.
Citation Information
Patent Citations
Data transmission method, device and equipment
CN110392047A
Wireless screen projection transfer device and wireless screen projection system
WO2020233722A1