Realization system and method for transmitting end of wireless screen projector

Abstract

The invention provides a system and a method for realizing a transmitting end of a wireless screen projector. The system comprises an audio and video acquisition module and wireless screen projection equipment, the conversion chip CHIP is used for transmitting the audio and video signals to the conversion chip CHIP through the type-c interface, and the conversion chip is used for converting the audio and video signals, converting the video signals into mipi signals and converting the audio signals into I2S signals; the video processing module and the audio processing module are integrated on the main control chip to receive audio and video signals, and respectively convert, encode, package and send formats of audio and video data; the network module and the transmitting end of the wireless screen projector are integrated with a 5G Wifi module and are matched with the receiving end to automatically form a local area network, and the transmission protocol of the 5G frequency band ensures efficient transmission of data transmission and ensures low delay and stable screen projection. According to the system and the method, wiring is not needed, and operation is convenient; the key projection screen is easy to control; high-definition videos are realized; and time delay is short.

Description

Technical Field

[0001] The present invention belongs to the technical field of multimedia display, and in particular relates to a system and method for realizing a transmitting end of a wireless screen projector. Background Art

[0002] In current office meetings, sharing PPT or information on a large screen usually requires cumbersome HDMI wiring, which makes the meeting room look messy and inconvenient to use. In home entertainment, online course learning, or travel entertainment, mobile phones, tablets, and laptops have become the choice of most people, but due to the limitation of screen size, there are some shortcomings in the experience.

[0003] Multimedia display interfaces have gone through 1). VGA (Video Graphics Array), which transmits analog signals, is susceptible to interference, supports low resolution, does not support audio transmission, and does not support hot-plug technology; 2). DVI (Digital Visual Interface), which transmits digital signals, cannot support high resolution, does not support audio transmission, and does not support hot-plug technology; 3). HDMI (High-Definition Multimedia Interface), which transmits digital signals, video signals and audio signals at the same time, and has strong anti-interference ability; 4). DP (DisplayPort), which transmits digital signals, can transmit video signals and audio signals at the same time, and can also transmit some other signals, has better scalability and strong anti-interference ability.

[0004] DP interface is DisplayPort interface, which is a display interface released by the Video Electronics Standards Association (VESA). As the successor of DVI, DisplayPort will support high-definition audio signal transmission while transmitting video signals, and support higher resolution and refresh rate. DP1.2 has reached 21.6Gbit / s, surpassing HDMI2.0, and supports 1080P@240fps, 2K@165fps, 4K@75fps, and 5K@30fps. DP1.3 supports 2K@240fps, 4K@120fps, and 8K@30. DP interfaces include standard DP interface, mini DP interface, and Thunderbolt port. The transmission distance of DP cable is generally about 10 meters for stable transmission.

[0005] However, in the existing technology, the sharing of information in current meetings mostly adopts the wiring method, which is cumbersome to operate; in terms of entertainment, mobile phones, tablets or computers pursue a large-screen experience, and the existing screen projection solutions are heavily dependent on the Wifi environment, and the fluency and image quality are also unsatisfactory.

[0006] In addition, common terms in the prior art include:

[0007] 1. Wireless screen projector: The content displayed on the small screen is projected to the device with a large screen via wireless means (such as Wifi, etc.).

[0008] 2. Transmitter: Data transmission end implemented by Beijing Ingenic Integrated Circuit Co., Ltd. (hereinafter referred to as Ingenic) T31X chip.

[0009] 3. Receiving end: data receiving end implemented by other chips.

[0010] 4. Adapter chip: a chip that acts as an intermediate bridge. Summary of the invention

[0011] In order to solve the above problems, the purpose of this application is to solve the limitation of wiring in large-screen sharing through the wireless screen projection transmitter of this system and method, and realize large-screen display through wireless transmission. At the same time, the transmitter is compatible with all devices with type-c ports of mobile phones, tablets, and notebooks with DP signal output (regardless of operating system). In addition, the wireless screen projection transmitter has its own Wifi and automatically connects to the corresponding receiving end, which is completely independent of the external Wifi environment. At the same time, it is also perfect in terms of audio and video fluency and sound and picture quality.

[0012] Specifically, the present invention provides a system for implementing a wireless screen projection device transmitting end, the system comprising:

[0013] Audio and video acquisition module, including:

[0014] Wireless screen projection devices, including mobile phones, tablets, and computers that support type-c interface devices with DP signal output, regardless of the device's operating system;

[0015] The conversion chip CHIP transmits the audio and video signals to the conversion chip CHIP through the type-c interface. The function of this conversion chip is to realize the conversion of audio and video signals, converting the video signal into mipi signal and converting the audio signal into I2S signal;

[0016] The video processing module and the audio processing module are integrated in the main control chip to receive audio and video signals, and convert, encode, package and send the formats of audio and video data respectively;

[0017] The main control chip uses the T31X model chip. The reasons for choosing the T31X model chip are:

[0018] The T31X chip can meet the basic functional requirements of the wireless screen projector transmitter, including

[0019] (1) Hardware design supports corresponding peripherals;

[0020] (2) Able to receive the data format output by the conversion chip;

[0021] (3) Video hard encoding can meet 1080p@30fps specification requirements, etc.

[0022] Of course, you can also choose other types of chips to meet the 1080p@30fps specification requirements. Under this specification requirement, the T31X model chip has a higher cost performance. In addition, the T40 model chip can also meet the 1080P@30fps specification requirements and can also achieve the 4k@30fps specification requirements. In terms of performance parameters such as CPU frequency and DDR size, the T40 performance parameters are better;

[0023] Network module: The transmitter of the wireless screen projector integrates a 5G Wifi module, which automatically forms a local area network with the receiver. The transmission protocol of the 5G frequency band ensures efficient data transmission, low latency and stable screen projection.

[0024] The audio and video acquisition module acquires audio and video data, and then sends it to the audio / video processing module for processing, and finally sends it to the network module for data transmission;

[0025] The audio and video acquisition module is implemented by the conversion chip, which is used to obtain the audio and video data of the projection device. The video information is transmitted to the main control chip through the mipi signal, and the audio signal is transmitted to the main control chip through the I2S signal. The audio / video processing module is completed by the main control chip T31X chip. In the flow chart, there are actually only two modules, the video processing module and the audio processing module. These two modules respectively include data reception processing, data encoding, data subpackaging, and packaging processing;

[0026] The network module sends the packaged data packets one by one through network transmission, and the receiving end will receive them.

[0027] The transmitting end of the wireless screen projector integrates the conversion chip CHIP, the main control chip, and the network module into a development board with a diameter of 5 cm. At the same time, the data transmission and pause, that is, the play and pause of the screen projection, are controlled by operating buttons. According to the product aesthetic design and usage habits, the control buttons are placed in the center of the development board.

[0028] The performance parameters of the wireless screen projection transmitter are as follows:

[0029] Main chip T31X Model Wifi Module 5G Wifi bandwidth 100Mbps Startup time <15S How to operate Plug and play, one-click screen projection Transmission resolution 1920x 1080 Transmission frame rate 30fps Access interface Type-c Access signal DP signal Power supply interface Type-c .

[0030] The encoding: the video data is encoded into the h264 format by the hardware encoding module, and the audio data is encoded into the AAC format by the software encoding library; the data volume of the encoded audio and video data is reduced, and the audio and video quality is not affected;

[0031] The packaging: the audio and video data are divided into data packets of only 2kB in size, and encapsulated according to the format of the RTP protocol. This method ensures that the data is transmitted efficiently and safely through the network.

[0032] The video processing module converts the format of the acquired video data, and then implements the video h264 encoding through the hardware encoding module, and finally divides it into small data packets for packaging, so as to facilitate the transmission of data;

[0033] The audio processing module converts the format of the acquired audio data, and then implements audio AAC encoding through a software encoding library, and finally packages the data into small data packets to facilitate data transmission.

[0034] The wireless screen projection transmitter is equipped with Ingenic T31X chip, T31X main frequency is 1.5GHZ, memory is 128MByte, chip size is 9*9, chip package is QFN88, QFN88 is the chip packaging form, packaging refers to the shell used to install semiconductor integrated circuit chips, with image hardware encoding unit and high-performance CPU to realize fast and high-quality image encoding and efficient data transmission.

[0035] The present application also includes a method for implementing a wireless screen projection device transmitting end, the method comprising the following steps:

[0036] S1, processes the application logic layer, is responsible for initializing modules at all levels, and organizes and coordinates, that is, implements the initialization preparation work of each module, coordinates the processes of each module, including the main function and basic parameter configuration;

[0037] S2, processing the application protocol layer, is responsible for handshake negotiation with the receiving end according to the screen projection protocol, that is, the wireless screen projection device requires the cooperation of the transmitter and the receiver. This layer realizes the negotiation between the transmitter and the receiver, and prepares for data sending and receiving, involving the screen projection protocol-control protocol;

[0038] S3, the data processing layer, is responsible for obtaining data from the projection device and encoding it. This layer includes separate processing of audio and video. The two modules are parallel and do not interfere with each other. They perform format conversion and encoding of audio and video data.

[0039] S4, performs the processing of the transmission protocol layer, which implements the subpacketization and packaging operations of the encoded audio and video data, and adds header information to the data packet in the form of RTP protocol, involving the screen projection protocol-transmission protocol;

[0040] S5 performs network transport layer processing, pays TCP / UDP protocol, supports independent audio and video channel transmission, that is, establishes independent audio and video transmission channels, and sends the packaged audio and video data through TCP / UDP protocol transmission respectively, involving connecting hotspots / distribution networks, and creating channels / data transmission.

[0041] Therefore, the advantages of the wireless screen projection transmitter of the present application are:

[0042] No wiring required, easy to operate: The wireless screen projector transmitter transmits audio and video data to the receiving end via Wifi, eliminating the tediousness and restrictions of wiring.

[0043] Button screen projection, easy control: configure buttons to control data transmission.

[0044] High-definition video with low latency: Image hardware encoding achieves high-quality and efficient image encoding. BRIEF DESCRIPTION OF THE DRAWINGS

[0045] The drawings described herein are used to provide a further understanding of the present invention, constitute a part of this application, and do not constitute a limitation of the present invention.

[0046] Figure 1 It is a schematic diagram of the composition of the wireless screen projector transmitting end of the present application.

[0047] Figure 2 It is a schematic diagram of the principle block diagram of the system of the wireless screen projector transmitting end of the present application.

[0048] Figure 3 It is a flow chart of the implementation method of the wireless screen projector transmitting end of the present application. DETAILED DESCRIPTION

[0049] In order to more clearly understand the technical content and advantages of the present invention, the present invention is now further described in detail in conjunction with the accompanying drawings.

[0050] The embodiment of the present application relates to an implementation system of a wireless screen projection transmitter. The wireless screen projection transmitter is equipped with an Ingenic T31X chip. The T31X has a main frequency of 1.5GHZ, a memory of 128MByte, a chip size of 9*9, and a chip package of QFN88. It has a professional image hardware encoding unit and a high-performance CPU, which can realize fast and high-quality image encoding and efficient data transmission.

[0051] The schematic diagram of the wireless screen projection device transmitter is as follows: Figure 1 shown.

[0052] The left side of the diagram shows wireless screen projection devices, including mobile phones, tablets, and computers that support type-c interface devices with DP signal output. The device's operating system is not restricted, and the audio and video signals are transmitted to the conversion chip CHIP through the type-c interface. The function of this conversion chip is to realize audio and video signal conversion, converting video signals into mipi signals and audio signals into I2S signals. The main control chip uses Ingenic T31X chip. The reasons for choosing T31X chip are:

[0053] First, the T31X chip can meet the basic functional requirements of the wireless screen projection transmitter, including (1) hardware design support for corresponding peripherals;

[0054] (2) Able to receive the data format output by the conversion chip;

[0055] (3) Video hard encoding can meet 1080p@30fps specification requirements;

[0056] Secondly, other chip models can also meet the 1080p@30fps specification requirements. Under this specification requirement, the T31X chip model has a higher cost performance. For example, the Ingenic T40 chip model can also meet the 1080P@30fps specification requirements and can also achieve the 4k@30fps specification requirements. In terms of performance parameters such as CPU frequency and DDR size, the T40 performance parameters are better; the T31X chip model is used here for illustration.

[0057] The main control chip T31X receives audio and video signals and then processes them further. The T31X chip mainly completes the format conversion, encoding, packaging, and sending of audio and video data. The video data of the encoding part is encoded into h264 format through the hardware encoding module, and the audio data is encoded into AAC format through the software encoding library. The amount of audio and video data after encoding is reduced, and the audio and video quality is not affected. The packaging part divides the audio and video data into data packets of only 2kB in size, and encapsulates them according to the format of the RTP protocol. This method can ensure that the data is transmitted efficiently and securely through the network. The transmitter of the wireless screen projector integrates a 5G Wifi module, which can automatically form a local area network with the receiving end, getting rid of the constraints of the external Wifi environment. The transmission protocol of the 5G frequency band ensures efficient transmission of data transmission, and ensures low latency and stable screen projection without jamming.

[0058] like Figure 2 As shown, the system includes:

[0059] Audio and video acquisition module, including:

[0060] Wireless screen projection devices, including mobile phones, tablets, and computers that support type-c interface devices with DP signal output, regardless of the device's operating system;

[0061] The conversion chip CHIP transmits the audio and video signals to the conversion chip CHIP through the type-c interface. The function of this conversion chip is to realize the conversion of audio and video signals, converting the video signal into mipi signal and converting the audio signal into I2S signal;

[0062] The video processing module and the audio processing module are integrated in the main control chip to receive audio and video signals, and convert, encode, package and send the formats of audio and video data respectively; the main control chip adopts the T31X model chip;

[0063] The encoding: the video data is encoded into the h264 format by the hardware encoding module, and the audio data is encoded into the AAC format by the software encoding library; the data volume of the encoded audio and video data is reduced, and the audio and video quality is not affected;

[0064] The packaging: the audio and video data are divided into data packets of only 2kB in size, and encapsulated according to the format of the RTP protocol. This method ensures that the data is transmitted efficiently and safely through the network; that is, the video processing module converts the format of the obtained video data, and then implements the video h264 encoding through the hardware encoding module, and finally divides it into small data packets for packaging, which is convenient for data transmission;

[0065] The audio processing module converts the format of the acquired audio data, and then implements audio AAC encoding through the software encoding library, and finally divides it into small data packets for packaging, so as to facilitate data transmission;

[0066] Network module: The transmitter of the wireless screen projector integrates a 5G Wifi module, which automatically forms a local area network with the receiver. The transmission protocol of the 5G frequency band ensures efficient data transmission, low latency and stable screen projection.

[0067] The audio and video acquisition module acquires audio and video data, and then sends it to the audio / video processing module for processing, and finally sends it to the network module for data transmission;

[0068] The audio and video acquisition module is implemented by the conversion chip, which is used to obtain the audio and video data of the projection device. The video information is transmitted to the main control chip T31X through the mipi signal, and the audio signal is transmitted to the main control chip T31X through the I2S signal. The audio / video processing module is completed by the main control chip T31X. Figure 2 The block diagram in the figure contains two modules, the video processing module and the audio processing module, which respectively include data receiving processing, data encoding, data subpackaging and packaging processing;

[0069] The network module sends the packaged data packets one by one through network transmission, and the receiving end will receive them.

[0070] The transmitter of the wireless screen projector integrates the conversion chip, the main control chip T31X, and the 5G Wifi module into a development board with a diameter of about 5cm. It is compact and easy to carry. At the same time, the data transmission and pause, that is, the playback and pause of the screen projection, can be controlled conveniently and quickly by operating the buttons. Considering the aesthetic design of the product and the usage habits, the control buttons are placed in the center of the development board.

[0071] The performance parameters of the wireless screen projection transmitter are as follows:

[0072] Main chip T31X Wifi Module 5G Wifi bandwidth 100Mbps Startup time <15S How to operate Plug and play, one-click screen projection Transmission resolution 1920x 1080 Transmission frame rate 30fps Access interface Type-c Access signal DP signal Power supply interface Type-c .

[0073] like Figure 3 As shown, the embodiment of the present application also relates to a method for implementing a wireless screen projection device transmitting end, and the method comprises the following steps:

[0074] S1, processes the application logic layer, is responsible for initializing modules at all levels, and organizes and coordinates, that is, implements the initialization preparation work of each module, coordinates the processes of each module, including the main function and basic parameter configuration;

[0075] S2, processing the application protocol layer, is responsible for handshake negotiation with the receiving end according to the screen projection protocol, that is, the wireless screen projection device requires the cooperation of the transmitter and the receiver. This layer realizes the negotiation between the transmitter and the receiver, and prepares for data sending and receiving, involving the screen projection protocol-control protocol;

[0076] S3, the data processing layer, is responsible for obtaining data from the projection device and encoding it. This layer includes separate processing of audio and video. The two modules are parallel and do not interfere with each other. They perform format conversion and encoding of audio and video data.

[0077] S4, performs the processing of the transmission protocol layer, which implements the subpacketization and packaging operations of the encoded audio and video data, and adds header information to the data packet in the form of RTP protocol, involving the screen projection protocol-transmission protocol;

[0078] S5 performs network transport layer processing, pays TCP / UDP protocol, supports independent audio and video channel transmission, that is, establishes independent audio and video transmission channels, and sends the packaged audio and video data through TCP / UDP protocol transmission respectively, involving connecting hotspots / distribution networks, and creating channels / data transmission.

[0079] The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. For those skilled in the art, the embodiments of the present invention may have various modifications and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention shall be included in the protection scope of the present invention.

Claims

1. A wireless screen projection device transmitting end implementation system, characterized in that: The system comprises: Audio and video acquisition module, including: Wireless screen projection devices, including mobile phones, tablets, and computers that support type-c interface devices with DP signal output, regardless of the device's operating system; The conversion chip CHIP transmits the audio and video signals to the conversion chip CHIP through the type-c interface. The function of this conversion chip is to realize the conversion of audio and video signals, converting the video signal into mipi signal and converting the audio signal into I2S signal; The video processing module and the audio processing module are integrated in the main control chip to receive audio and video signals, and convert, encode, package and send the formats of audio and video data respectively; Network module: The transmitter of the wireless screen projector integrates a 5G Wifi module, which automatically forms a local area network with the receiver. The transmission protocol of the 5G frequency band ensures efficient data transmission, low latency and stable screen projection. The audio and video acquisition module acquires audio and video data, and then sends it to the audio / video processing module for processing, and finally sends it to the network module for data transmission; The audio and video acquisition module is implemented by a conversion chip, which is used to obtain audio and video data from the screen projection device. The video information is transmitted to the main control chip via a mipi signal, and the audio signal is transmitted to the main control chip via an I2S signal. The audio / video processing module is completed by the main control chip, and the video processing module and the audio processing module respectively include data reception processing, data encoding, data subpackaging, and packaging processing; The network module sends the packaged data packets one by one through network transmission, and the receiving end will receive them.

2. A wireless screen projection device transmitting end implementation system according to claim 1, characterized in that: The main control chip needs to meet the basic functional requirements of the wireless screen projection transmitter, including: (1) Hardware design supports corresponding peripherals; (2) Able to receive the data format output by the conversion chip; (3) Video hard encoding must at least meet 1080p@30fps specification requirements.

3. The implementation system of a wireless screen projection device transmitting end according to claim 1, characterized in that: The transmitting end of the wireless screen projector integrates the conversion chip CHIP, the main control chip, and the network module into a development board with a diameter of 5 cm. At the same time, the data transmission and pause, that is, the play and pause of the screen projection, are controlled by operating buttons. According to the product aesthetic design and usage habits, the control buttons can be placed in the center of the development board.

4. The implementation system of a wireless screen projection device transmitting end according to claim 1, characterized in that: The performance parameters of the wireless screen projection transmitter are as follows: 。 5. The implementation system of a wireless screen projection device transmitting end according to claim 1, characterized in that: The encoding: the video data is encoded into the h264 format by the hardware encoding module, and the audio data is encoded into the AAC format by the software encoding library; the data volume of the encoded audio and video data is reduced, and the audio and video quality is not affected; The packaging: the audio and video data are divided into data packets of only 2kB in size, and encapsulated according to the format of the RTP protocol. This method ensures that the data is transmitted efficiently and safely through the network.

6. A wireless screen projection device transmitting end implementation system according to claim 1, characterized in that: The video processing module converts the format of the acquired video data, and then implements the video h264 encoding through the hardware encoding module, and finally divides it into small data packets for packaging, so as to facilitate the transmission of data; The audio processing module converts the format of the acquired audio data, and then implements audio AAC encoding through a software encoding library, and finally packages the data into small data packets to facilitate data transmission.

7. The implementation system of a wireless screen projection device transmitting end according to claim 1, characterized in that: The main control chip carried by the wireless projection transmitter has a main frequency of 1.5GHZ, a memory of 128MByte, a chip size of 9*9, and a chip package of QFN88. The QFN88 is the packaging form of the chip. The package refers to the shell used to install the semiconductor integrated circuit chip. It has an image hardware encoding unit and a high-performance CPU that can realize fast and high-quality image encoding and efficient data transmission.

8. A method for implementing a wireless screen projection device transmitting end, characterized in that: The method comprises the following steps: S1, processes the application logic layer, is responsible for initializing modules at all levels, and organizes and coordinates, that is, implements the initialization preparation work of each module, coordinates the processes of each module, including the main function and basic parameter configuration; S2, processing the application protocol layer, is responsible for handshake negotiation with the receiving end according to the screen projection protocol, that is, the wireless screen projection device requires the cooperation of the transmitter and the receiver. This layer realizes the negotiation between the transmitter and the receiver, and prepares for data sending and receiving, involving the screen projection protocol-control protocol; S3, the data processing layer, is responsible for obtaining data from the projection device and encoding it. This layer includes separate processing of audio and video. The two modules are parallel and do not interfere with each other. They perform format conversion and encoding of audio and video data. S4, performs the processing of the transmission protocol layer, which implements the subpacketization and packaging operations of the encoded audio and video data, and adds header information to the data packet in the form of RTP protocol, involving the screen projection protocol-transmission protocol; S5 performs network transport layer processing, pays TCP / UDP protocol, supports independent audio and video channel transmission, that is, establishes independent audio and video transmission channels, and sends the packaged audio and video data through TCP / UDP protocol transmission respectively, involving connecting hotspots / distribution networks, and creating channels / data transmission.

Images