Vehicle-mounted wireless screen projection method, system and device, electronic equipment and storage medium
The method stabilizes wireless screen projection in vehicles by using multiple network interfaces, dynamic data packet allocation, and adaptive video quality, addressing interference issues for enhanced user experience.
Patent Information
- Application Number
- CN202411096581.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-08-09
- Publication Date
- 2024-12-13
AI Technical Summary
The challenge of ensuring stable wireless screen projection in vehicles, particularly taxis, is exacerbated by frequent network interference due to their varied locations, leading to poor user experience.
A vehicle-mounted wireless screen projection method that utilizes multiple wireless network interfaces, dynamically determines the target interface based on network status, creates MPTCP subflows, and adjusts data packet allocation and video quality parameters to ensure stable data transmission.
This approach enhances the stability and efficiency of wireless screen projection by reducing network load and improving data transmission, thereby ensuring reliable screen projection in vehicles.
Smart Images
Figure CN119136169A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of vehicle-mounted terminal technology, and in particular to a vehicle-mounted wireless screen projection method, system, device, electronic device and storage medium. Background Art
[0002] At present, after taxi companies purchase taxis from car factories, taxi industry equipment suppliers need to install taxi industry supervision equipment and taximeters and other industry equipment on the taxis. In the past, the functions of the taxi onboard central control screen were relatively simple, so most taxi industry equipment suppliers would use industry equipment with taxi industry supervision requirements and pricing functions to replace the original car's onboard central control screen.
[0003] As the level of vehicle intelligence increases, more and more functions are integrated into the on-board central control screen. Therefore, taxi industry equipment suppliers have begun to use screen projection to project the display screen of industry equipment onto the taxi's on-board central control screen. This solution solves the screen display problem of taxi industry equipment, but it also raises another problem: the connection problem between devices. Many vehicles do not have extra network interfaces or USB interfaces reserved when they leave the factory. It is difficult to use wired connections between industry equipment and the on-board central control screen. Using wireless connection methods such as WiFi and Bluetooth can solve the connection problem between devices, and wireless connection methods are more convenient and faster. However, since taxis need to frequently travel between various places, wireless networks are easily interfered with, resulting in abnormal screen projection and poor user experience.
[0004] In view of this, how to ensure the stability of wireless screen projection in taxis and enhance user experience is an issue that needs to be considered at present. Summary of the invention
[0005] The embodiments of the present application provide a vehicle-mounted wireless screen projection method, system, device, electronic device and storage medium, which can ensure the stability of wireless screen projection in taxis and enhance user experience.
[0006] In a first aspect, an embodiment of the present application provides a vehicle-mounted wireless screen projection method, which is applied to a transmitting end, and the transmitting end is provided with more than one wireless network interface. The method includes:
[0007] Determine the network status of each wireless network interface, and determine the target wireless network interface based on the network status;
[0008] Obtain a target screen projection data stream, and perform packet processing on the target screen projection data stream to obtain a number of target data packets;
[0009] Distributing the target data packet to the target wireless network interface;
[0010] The allocated target data packet is transmitted to the receiving end through the target wireless network interface, and the receiving end is instructed to collect and reassemble the target data packets sent by each target wireless network interface to obtain the target screen projection data stream, and screen projection is realized based on the target screen projection data stream.
[0011] In a possible implementation manner of the first aspect, the step of allocating the target data packet to the target wireless network interface includes:
[0012] Based on the network status of the target wireless network interface, dynamically determine the allocation ratio of the target data packets allocated to the target wireless network interface;
[0013] The target data packet is allocated to the target wireless network interface according to the allocation ratio.
[0014] In a possible implementation manner of the first aspect, the target screen projection data stream is a video stream, and the step of transmitting the allocated target data packet to the receiving end through the target wireless network interface includes:
[0015] When the network status of any target wireless network interface meets the preset conditions, adjusting the video quality parameters of the target data packet or all target data packets allocated by the target wireless network interface according to the network status of the target wireless network interface meeting the preset conditions;
[0016] The target data packet after adjusting the video quality parameter is transmitted to the receiving end through the target wireless network interface.
[0017] In a possible implementation manner of the first aspect, after the step of determining the target wireless network interface based on the network status, the method includes:
[0018] An MPTCP subflow is created for each of the target wireless network interfaces, where the MPTCP subflow is a path for transmitting data packets between the sender and the receiver through the target wireless network interface.
[0019] In a possible implementation manner of the first aspect, the step of creating an MPTCP sub-flow for each of the target wireless network interfaces includes:
[0020] Initiate a TCP connection request to each wireless network interface of the receiving end, wherein the TCP connection request carries a specified MPTCP option;
[0021] Based on the specified MPTCP option, exchanging initial parameter information between the sending end and the receiving end;
[0022] Based on the initial parameter information, an MPTCP subflow corresponding to the target wireless network interface is created.
[0023] In a possible implementation manner of the first aspect, the step of transmitting the allocated target data packet to the receiving end through the target wireless network interface includes:
[0024] During the transmission of the target data packet, if packet loss or data error is detected, a retransmission mechanism is started.
[0025] In a second aspect, an embodiment of the present application provides a vehicle-mounted wireless screen projection system, the vehicle-mounted wireless screen projection system comprising a transmitting end and a receiving end, the transmitting end being provided with more than one wireless network interface, wherein:
[0026] The transmitting end is used to determine the network status of each wireless network interface, and based on the network status, determine the target wireless network interface; obtain the target screen projection data stream, and perform packet processing on the target screen projection data stream to obtain a number of target data packets; allocate the target data packets to the target wireless network interface; and transmit the allocated target data packets to the receiving end through the target wireless network interface;
[0027] The receiving end is used to collect and reorganize the target data packets sent by each of the target wireless network interfaces to obtain the target screen projection data stream, and realize screen projection based on the target screen projection data stream.
[0028] In a third aspect, an embodiment of the present application provides a vehicle-mounted wireless screen projection device, which is applied to a transmitting end, and the transmitting end is provided with more than one wireless network interface, and the device includes:
[0029] a target interface determination unit, configured to determine a network status of each wireless network interface, and determine a target wireless network interface based on the network status;
[0030] A data packet acquisition unit, used to acquire a target screen projection data stream, and perform packet processing on the target screen projection data stream to obtain a plurality of target data packets;
[0031] A data packet distribution unit, configured to distribute the target data packet to the target wireless network interface;
[0032] The wireless screen projection unit is used to transmit the allocated target data packets to the receiving end through the target wireless network interface, instruct the receiving end to collect and reassemble the target data packets sent by each target wireless network interface, obtain the target screen projection data stream, and realize screen projection based on the target screen projection data stream.
[0033] In a fourth aspect, an embodiment of the present application provides an electronic device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the computer program, the in-vehicle wireless screen projection method as described in the first aspect above is implemented.
[0034] In a fifth aspect, an embodiment of the present application provides a computer-readable storage medium, which stores a computer program. When the computer program is executed by a processor, it implements the in-vehicle wireless screen projection method as described in the first aspect above.
[0035] In a sixth aspect, an embodiment of the present application provides a computer program product. When the computer program product is run on an electronic device, the electronic device executes the in-vehicle wireless screen projection method as described in the first aspect above.
[0036] In an embodiment of the present application, the transmitting end includes more than one wireless network interface. The transmitting end first determines the network status of each wireless network interface, and based on the network status, determines the target wireless network interface, then obtains the target screen projection data stream, and performs packet processing on the target screen projection data stream to obtain a number of target data packets, and then distributes the target data packets to the target wireless network interface, and transmits the distributed target data packets to the receiving end through the target wireless network interface. The receiving end collects and reorganizes the target data packets sent by each of the target wireless network interfaces to obtain the target screen projection data stream, and implements screen projection based on the target screen projection data stream. In the scheme of the present application, selecting the target wireless network interface for transmitting data packets based on the network status can effectively ensure the stability of data transmission. At the same time, packet transmission of the target screen projection data stream is conducive to reducing the wireless network load and improving data transmission efficiency, thereby ensuring the screen projection effect of the receiving end. BRIEF DESCRIPTION OF THE DRAWINGS
[0037] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative labor.
[0038] Figure 1 This is a schematic diagram of a vehicle-mounted wireless screen projection system provided in an embodiment of the present application;
[0039] Figure 2 It is a flow chart of the implementation of the vehicle-mounted wireless screen projection method provided in the embodiment of the present application;
[0040] Figure 3 This is a specific implementation flowchart of creating an MPTCP substream in the vehicle-mounted wireless screen projection method provided in an embodiment of the present application;
[0041] Figure 4 This is a specific implementation flow chart of step S203 in the vehicle-mounted wireless screen projection method provided in an embodiment of the present application;
[0042] Figure 5 It is a specific implementation flow chart of transmitting a target data packet in the vehicle-mounted wireless screen projection method provided in an embodiment of the present application;
[0043] Figure 6 It is a structural block diagram of the vehicle-mounted wireless screen projection device provided in an embodiment of the present application;
[0044] Figure 7 It is a schematic diagram of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION
[0045] In the following description, specific details such as specific system structures, technologies, etc. are provided for the purpose of illustration rather than limitation, so as to provide a thorough understanding of the embodiments of the present application. However, it should be clear to those skilled in the art that the present application may also be implemented in other embodiments without these specific details. In other cases, detailed descriptions of well-known systems, devices, circuits, and methods are omitted to prevent unnecessary details from obstructing the description of the present application.
[0046] It should be understood that when used in the present specification and the appended claims, the term "comprising" indicates the presence of described features, wholes, steps, operations, elements and / or components, but does not exclude the presence or addition of one or more other features, wholes, steps, operations, elements, components and / or combinations thereof.
[0047] It should also be understood that the term “and / or” used in the specification and appended claims refers to any and all possible combinations of one or more of the associated listed items, and includes these combinations.
[0048] As used in the specification and appended claims of this application, the term "if" can be interpreted as "when" or "uponce" or "in response to determining" or "in response to detecting", depending on the context. Similarly, the phrase "if it is determined" or "if [described condition or event] is detected" can be interpreted as meaning "uponce it is determined" or "in response to determining" or "uponce [described condition or event] is detected" or "in response to detecting [described condition or event]", depending on the context.
[0049] In addition, in the description of the present application specification and the appended claims, the terms "first", "second", "third", etc. are only used to distinguish the descriptions and cannot be understood as indicating or implying relative importance.
[0050] References to "one embodiment" or "some embodiments" etc. described in the specification of this application mean that one or more embodiments of the present application include specific features, structures or characteristics described in conjunction with the embodiment. Therefore, the statements "in one embodiment", "in some embodiments", "in some other embodiments", "in some other embodiments", etc. that appear in different places in this specification do not necessarily refer to the same embodiment, but mean "one or more but not all embodiments", unless otherwise specifically emphasized in other ways. The terms "including", "comprising", "having" and their variations all mean "including but not limited to", unless otherwise specifically emphasized in other ways.
[0051] The in-vehicle wireless screen projection method provided in the embodiment of the present application can be applied to various types of electronic devices that need to perform wireless screen projection, specifically including taxi industry equipment, in-vehicle central control equipment, mobile phones, tablet computers, wearable devices, laptop computers, etc.
[0052] Figure 1 A system architecture diagram of a vehicle-mounted wireless screen projection system provided by the first embodiment of the present application is shown, and is described in detail as follows: For ease of explanation, only the parts related to the embodiment of the present invention are shown.
[0053] Reference Figure 1 The vehicle-mounted wireless screen projection system includes a transmitting end 10 and a receiving end 11. The transmitting end 10 includes more than one wireless network interface, and the receiving end includes a wireless network interface matching the transmitting end.
[0054] The transmitting end 10 is used to determine the network status of each wireless network interface, and based on the network status, determine the target wireless network interface; obtain the target screen projection data stream, and packetize the target screen projection data stream to obtain a number of target data packets; allocate the target data packets to the target wireless network interface; and transmit the allocated target data packets to the receiving end 11 through the target wireless network interface.
[0055] The sending end 10 can be an industrial device, a vehicle-mounted central control device, a mobile device, etc.
[0056] The receiving end 11 is used to collect and reorganize the target data packets sent by each of the target wireless network interfaces, obtain the target screen projection data stream, and realize screen projection based on the target screen projection data stream.
[0057] The receiving end 11 may be a vehicle-mounted central control device, a mobile device, etc.
[0058] For example, the industry equipment with taxi industry regulatory requirements and pricing functions on a taxi serves as the sending end 10, while the on-board central control device can serve as the receiving end 11.
[0059] In this embodiment, the transmitting end and the receiving end can achieve communication connection through more than one wireless network interface. The wireless network interface includes but is not limited to a WiFi interface, a Bluetooth interface, and a StarFlash interface.
[0060] In some embodiments, the receiving end 11 may include a smart device of a display screen, and the receiving end 11 directly implements screen projection based on the target screen projection data stream. In other embodiments, the receiving end 11 is also connected to the display device by wire, and after collecting and reorganizing the target data packets sent by each target wireless network interface and obtaining the target screen projection data stream, the receiving end 11 sends the target screen projection data stream to the display device to implement screen projection display.
[0061] The wireless network interface is an activated wireless network interface. When the electronic device as the transmitter is installed on the vehicle for the first time, the operator manually pairs the transmitter with the receiver to connect to the corresponding wireless network interface, such as WiFi connection and Bluetooth or StarFlash pairing connection, to activate the wireless network interface.
[0062] The in-vehicle wireless screen projection method provided by the present application is exemplarily described below in conjunction with specific embodiments.
[0063] Figure 2 The implementation process of the vehicle-mounted wireless screen projection method provided in the embodiment of the present application is shown. In this embodiment, the execution subject of the implementation process is Figure 1 The sending end 10 shown in the figure, the method flow includes step S201 to step S204. The specific implementation principle of each step is as follows:
[0064] Step S201: Determine the network status of each wireless network interface, and determine a target wireless network interface based on the network status.
[0065] The transmitting end includes more than one wireless network interface, and the transmitting end can communicate wirelessly with the receiving end through more than one wireless network interface at the same time. Wireless network interfaces include but are not limited to WiFi interfaces, Bluetooth interfaces, and StarFlash interfaces. When the screen projection task is triggered, the transmitting end determines the network status of each wireless network interface, and determines the target wireless network interface based on the network status. The target wireless network interface can be one or more than one.
[0066] In a possible implementation, the current network status of each wireless network interface is determined, the wireless network interfaces are screened based on the network status, and the wireless network interfaces that meet the preset network conditions are determined as target wireless network interfaces. Wherein, each wireless network interface is an activated wireless network interface.
[0067] For example, based on the network status, the wireless network interfaces activated by the sender are screened, and only the WiFi interface meets the preset network condition, and the WiFi interface is determined as the target wireless network interface.
[0068] For example, based on the network status, the wireless network interfaces activated by the sender are screened, and if the WiFi interface, the Bluetooth interface, and the StarFlash interface all meet the preset network conditions, then the three interfaces are all determined as target wireless network interfaces.
[0069] In one possible implementation, when there are three or more wireless network interfaces that meet the preset network conditions, the network stability of each type of wireless network interface that meets the preset network conditions can be further determined based on the environmental information of the location of the taxi. Based on the network stability, one or two wireless network interfaces are selected from the wireless network interfaces that meet the preset network conditions as the target wireless network interfaces.
[0070] In some implementations, big data statistical analysis is performed in advance to establish a mapping relationship between environmental information and the network stability of each type of wireless network interface. Based on this mapping relationship, the network stability of each type of wireless network interface that meets the preset network conditions can be determined according to the environmental information of the location of the taxi.
[0071] The transmitting end is provided with various types of wireless network interfaces, and different types of wireless network interfaces operate in different frequency bands. When the taxi travels between places and the wireless signal is interfered with, generally not all types of wireless signals are interfered with at the same time. In this embodiment, the transmitting end determines the network status of each wireless network interface and selects the wireless network interface with relatively better network status as the target wireless network interface, which can effectively reduce the impact of wireless signal interference on the transmission of the target projection data stream, which is conducive to ensuring the stable transmission of the target projection data stream, and thus ensuring the reliability of the projection.
[0072] When data is packetized and transmitted through different types of wireless networks, it is necessary to ensure that all data packets can arrive at the receiving end synchronously. In this embodiment, the sending end and the receiving end need to use a specific synchronization mechanism or protocol to ensure the order and integrity of the data packets.
[0073] In a possible implementation, the sender and the receiver support the MPTCP protocol at the same time. The sender creates an MPTCP subflow for each target wireless network interface. The MPTCP subflow is a path for transmitting data packets between the sender and the receiver through the target wireless network interface. The sender can transmit the allocated target data packets to the receiver through the MPTCP subflow of the target wireless network interface.
[0074] As a possible implementation of the present application, Figure 3As shown, the above step of creating an MPTCP sub-flow for each of the target wireless network interfaces includes:
[0075] A1: Initiate a TCP connection request to each wireless network interface of the receiving end, and the TCP connection request carries a specified MPTCP option. The TCP connection request is a standard TCP connection request. The specified MPTCP option is specifically the "MP_CAPABLE" option. In this process, the initial TCP handshake carries the "MP_CAPABLE" option of MPTCP, which is a special TCP option used to negotiate and confirm between two communication endpoints that both parties support the MPTCP protocol.
[0076] A2: Based on the specified MPTCP option, the initial parameter information of the sender and the receiver is exchanged. This step is the handshake phase, and the MPTCP compatibility and initial parameter information of the sender and the receiver are exchanged through the "MP_CAPABLE" option, such as the supported MPTCP version number and key information for subsequent connection security.
[0077] A3: Based on the initial parameter information, create an MPTCP sub-flow corresponding to the target wireless network interface.
[0078] In this embodiment, the sending end and the receiving end synchronously support the MPTCP protocol, allowing the Transmission Control Protocol (TCP) connection to use multiple paths to maximize the use of channel resources. The sending end sends the projection data based on the MPTCP substream, and the receiving end receives the projection data based on the MPTCP substream.
[0079] Step S202: Obtain a target screen projection data stream, and perform packet processing on the target screen projection data stream to obtain a number of target data packets.
[0080] The target screen projection data stream is the screen projection data to be projected corresponding to the screen projection task.
[0081] In a possible implementation, before the target projection data stream is packetized to obtain a plurality of target data packets, the target projection data stream is preprocessed according to a preset format requirement and a preset encoding standard. For example, the video is encoded into data in H.264 or H.265 format.
[0082] The sender encapsulates the original target projection data stream into a data packet, and further divides the data packet into several smaller target data packets. Additional header information is added to each target data packet, including the subpacket number, total number of packets, subpacket size, etc., so that the target data packet can be correctly reassembled at the receiving end to obtain the original target projection data stream.
[0083] It should be noted that for the packet processing of the target projection data stream, too large a packet may lead to transmission failure or increased packet loss rate, while too small a packet may increase network overhead and transmission delay. Therefore, in this embodiment, the selection of the packet size needs to consider the network status of the target wireless network interface, that is, to balance the transmission efficiency and network limitations of the target wireless network interface.
[0084] In this embodiment, the target screen projection data stream is obtained, and the target screen projection data stream is packetized to obtain several target data packets. Smaller data packets are obtained through data segmentation, which is beneficial to reducing the demand on the wireless network load. The transmission of smaller data packets over the wireless network can improve transmission efficiency and reduce packet loss rate, thereby ensuring stable transmission of the data to be projected when the network conditions are relatively poor.
[0085] Step S203: Allocate the target data packet to the target wireless network interface.
[0086] In this embodiment, when there is more than one target wireless network interface, the target data packet needs to be distributed to each target wireless network interface, for example, the target data packet is evenly distributed to each target wireless network interface.
[0087] As a possible implementation of this application, Figure 4 A specific implementation process of allocating the target data packet to the target wireless network interface in the vehicle-mounted wireless screen projection method provided by an embodiment of the present application is shown, and is described in detail as follows:
[0088] B1: Based on the network status of the target wireless network interface, dynamically determine the allocation ratio of the target data packets allocated to the target wireless network interface.
[0089] B2: Allocate the target data packet to the target wireless network interface according to the allocation ratio.
[0090] In this embodiment, the network status of the target wireless network interface is monitored in real time, and the allocation ratio of the target data packets allocated to each target wireless network interface is dynamically determined. The so-called dynamic determination of the allocation ratio means that the allocation ratio changes dynamically based on the network status, rather than being fixed.
[0091] In some implementation methods, the network condition includes sub-flow performance, and the above-mentioned allocation ratio is dynamically determined based on the sub-flow performance. The dynamic determination strategy specifically includes: when the sub-flow performance of the target wireless network interface decreases, reducing the allocation ratio of the target data packets of the target wireless network interface, and correspondingly increasing the allocation ratio of the target data packets of other target wireless network interfaces; when the sub-flow performance of the target wireless network interface increases, increasing the allocation ratio of the target data packets of the target wireless network interface, and correspondingly reducing the allocation ratio of the target data packets of other target wireless network interfaces.
[0092] Exemplarily, there are four target wireless network interfaces, corresponding to substream 1, the second substream 2, substream 3, and substream 4. By evaluating the performance of each substream, it is determined that substream 1 and substream 2 have better performance, while substream 3 and substream 4 have worse performance. At this time, it can be determined that substream 1 and substream 2 each bear 30% of the target data packets, and substream 3 and substream 4 each bear 20% of the target data packets. The substream performance of each target wireless network interface is monitored in real time. When it is monitored that the performance of substream 1 decreases, the allocation ratio of the target data packets borne by substream 1 is adjusted, and the reduced allocation ratio of substream 1 is allocated to other substreams. For example, substream 1 is adjusted to bear 25% of the target data packets, substream 2 bears 35% of the target data packets, and substream 3 and substream 4 still bear 20% of the target data packets each.
[0093] In this embodiment, the substream performance can be evaluated based on performance parameters such as real-time bandwidth, RTT (Round-Trip Time), and packet loss rate. When the performance parameter of the substream corresponding to the target wireless network interface meets the first preset performance parameter standard, the substream performance is determined to be good; when the performance parameter of the substream corresponding to the target wireless network interface meets the second preset performance parameter standard, the substream performance is determined to be poor.
[0094] When the network environment changes, such as adding a new target wireless network interface, the target wireless network interface is dynamically and automatically added, target data packets are allocated to it, and the allocation ratio of target data packets of other existing target wireless network interfaces is adjusted; or, when the original target wireless network interface is unavailable, the target wireless network interface is dynamically deleted, and the allocation ratio of target data packets of other existing target wireless network interfaces is adjusted.
[0095] In an embodiment of the present application, by creating an MPTCP sub-stream for each of the target wireless network interfaces and performing data transmission based on the MPTCP sub-stream, the transmission efficiency can be improved and the stability of data transmission can be ensured.
[0096] Step S204: Transmit the allocated target data packet to the receiving end through the target wireless network interface, instruct the receiving end to collect and reorganize the target data packets sent by each target wireless network interface to obtain the target screen projection data stream, and realize screen projection based on the target screen projection data stream.
[0097] Each target wireless network interface at the sending end transmits the allocated target data packet to the receiving end. The receiving end collects the target data packets sent by each target wireless network interface, and parses the target data packets to obtain the subpacket number and the total number of packets in the header information of the target data packet, and sorts the collected target data packets according to the subpacket number to ensure that they are reorganized in the correct order, and then merges the sorted target data packets into a complete data packet, thereby obtaining the target screen projection data stream, and then realizing screen projection based on the target screen projection data stream.
[0098] In this embodiment, the "DSS" option of MPTCP may be used to mark the target data packets with sequence numbers to ensure that the receiving end can reassemble the data stream in the correct order.
[0099] In some implementations, after the sorted target data packets are merged and reassembled into a complete data packet, the reassembled data packet is checked to ensure its integrity and correctness.
[0100] As a possible implementation manner of the present application, the target screen projection data stream is a video stream. Figure 5 A specific implementation process of transmitting the allocated target data packet to the receiving end through the target wireless network interface in the vehicle-mounted wireless screen projection method provided by an embodiment of the present application is shown, and the details are as follows:
[0101] C1: When the network status of any target wireless network interface meets the preset conditions, adjust the video quality parameters of the target data packet or all target data packets allocated by the target wireless network interface according to the network status of the target wireless network interface that meets the preset conditions. Video quality parameters include resolution, frame rate, bit rate, color format and color depth, and compression format, etc.
[0102] C2: Transmitting the target data packet after adjusting the video quality parameter to the receiving end through the target wireless network interface.
[0103] In an embodiment of the present application, the transmitting end directly transmits the target data packet to the receiving end. In some implementations, when the network condition of the target wireless network interface meets the preset conditions, for example, when the network condition deteriorates, the video quality parameters of the target data packet allocated to the target wireless network interface are dynamically adjusted according to the network condition of the target wireless network interface, that is, the video quality of part of the video data in the target projection data stream is adjusted.
[0104] In other implementations, when the network condition of the target wireless network interface deteriorates, the video quality parameters of all target data packets are dynamically adjusted according to the network condition of the target wireless network interface, that is, the overall video quality of the target projection data stream is adjusted.
[0105] In this embodiment, the quality of the video stream is dynamically adjusted according to the network conditions of each substream. For example, when all substreams have good performance conditions, high-definition video is provided. If the performance conditions of some substreams deteriorate, the video quality is automatically reduced to maintain smooth playback, which can effectively ensure the stable transmission of screen projection data and improve the reliability of screen projection.
[0106] In a possible implementation, before data transmission begins, the sender negotiates basic parameters of the target projection data stream through a control protocol, such as resolution, encoding format, frame rate, etc. The control protocol can be sent through any substream.
[0107] In a possible implementation, during the transmission of the target data packet, if packet loss or data error is detected, a retransmission mechanism is started. The retransmission mechanism may adopt the retransmission mechanism of MPTCP. The integrity and consistency of the projection data are ensured by data retransmission. In the event of network disconnection or substream failure, the substream is reconstructed or switched to other available substreams to maintain the continuity of data transmission.
[0108] As can be seen from the above, in the embodiment of the present application, the sending end includes more than one wireless network interface. The sending end first determines the network status of each wireless network interface, and based on the network status, determines the target wireless network interface, then obtains the target screen projection data stream, and performs packet processing on the target screen projection data stream to obtain a number of target data packets, and then distributes the target data packets to the target wireless network interface, and transmits the distributed target data packets to the receiving end through the target wireless network interface. The receiving end collects and reorganizes the target data packets sent by each of the target wireless network interfaces to obtain the target screen projection data stream, and realizes screen projection based on the target screen projection data stream. This scheme selects the target wireless network interface for transmitting data packets based on the network status, which can effectively ensure the stability of data transmission. At the same time, packet transmission of the target screen projection data stream is conducive to reducing the wireless network load and improving data transmission efficiency, thereby ensuring the screen projection effect of the receiving end.
[0109] It should be understood that the size of the serial numbers of the steps in the above embodiments does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.
[0110] Corresponding to the vehicle-mounted wireless screen projection method described in the above embodiment, Figure 6 A structural block diagram of the vehicle-mounted wireless screen projection device provided in an embodiment of the present application is shown. For the sake of ease of explanation, only the parts related to the embodiment of the present application are shown.
[0111] Reference Figure 6The vehicle-mounted wireless screen projection device is applied to a transmitting end, and the transmitting end is provided with more than one wireless network interface. The device comprises: a target interface determination unit 61, a data packet acquisition unit 62, a data packet allocation unit 63, and a wireless screen projection unit 64, wherein:
[0112] A target interface determination unit 61, configured to determine a network status of each wireless network interface, and determine a target wireless network interface based on the network status;
[0113] The data packet acquisition unit 62 is used to acquire a target screen projection data stream and perform packet processing on the target screen projection data stream to obtain a plurality of target data packets;
[0114] The data packet distribution unit 63 is used to distribute the target data packet to the target wireless network interface;
[0115] The wireless screen projection unit 64 is used to transmit the allocated target data packets to the receiving end through the target wireless network interface, instruct the receiving end to collect and reassemble the target data packets sent by each target wireless network interface, obtain the target screen projection data stream, and realize screen projection based on the target screen projection data stream.
[0116] As a possible implementation of the present application, the data packet allocation unit 63 includes:
[0117] Based on the network status of the target wireless network interface, dynamically determine the allocation ratio of the target data packets allocated to the target wireless network interface;
[0118] The target data packet is allocated to the target wireless network interface according to the allocation ratio.
[0119] As a possible implementation of the present application, the target screen projection data stream is a video stream, and the wireless screen projection unit 64 includes:
[0120] A parameter adjustment module, configured to adjust the video quality parameters of the target data packet or all target data packets allocated by the target wireless network interface according to the network status of the target wireless network interface that meets the preset conditions when the network status of any target wireless network interface meets the preset conditions;
[0121] The first transmission module is used to transmit the target data packet after adjusting the video quality parameter to the receiving end through the target wireless network interface.
[0122] As a possible implementation of the present application, the above-mentioned vehicle-mounted wireless screen projection device further includes:
[0123] The sub-flow creation unit is used to create an MPTCP sub-flow for each of the target wireless network interfaces, and the MPTCP sub-flow is a path for transmitting data packets between the sending end and the receiving end through the target wireless network interface.
[0124] As a possible implementation manner of the present application, the sub-flow creation unit is specifically used for:
[0125] Initiate a TCP connection request to each wireless network interface of the receiving end, wherein the TCP connection request carries a specified MPTCP option;
[0126] Based on the specified MPTCP option, exchanging initial parameter information between the sending end and the receiving end;
[0127] Based on the initial parameter information, an MPTCP subflow corresponding to the target wireless network interface is created.
[0128] As a possible implementation of the present application, the wireless screen projection unit 64 further includes:
[0129] The retransmission unit is used to start a retransmission mechanism if packet loss or data error is detected during the transmission of the target data packet.
[0130] As can be seen from the above, in the embodiment of the present application, the sending end includes more than one wireless network interface. The sending end first determines the network status of each wireless network interface, and based on the network status, determines the target wireless network interface, then obtains the target screen projection data stream, and performs packet processing on the target screen projection data stream to obtain a number of target data packets, and then distributes the target data packets to the target wireless network interface, and transmits the distributed target data packets to the receiving end through the target wireless network interface. The receiving end collects and reorganizes the target data packets sent by each of the target wireless network interfaces to obtain the target screen projection data stream, and realizes screen projection based on the target screen projection data stream. This scheme selects the target wireless network interface for transmitting data packets based on the network status, which can effectively ensure the stability of data transmission. At the same time, packet transmission of the target screen projection data stream is conducive to reducing the wireless network load and improving data transmission efficiency, thereby ensuring the screen projection effect of the receiving end.
[0131] It should be noted that the information interaction, execution process, etc. between the above-mentioned devices / units are based on the same concept as the method embodiment of the present application. Their specific functions and technical effects can be found in the method embodiment part and will not be repeated here.
[0132] The present application also provides a computer-readable storage medium storing a computer program, wherein when the computer program is executed by a processor, Figures 2 to 5The steps of any in-vehicle wireless screen projection method are shown.
[0133] The embodiment of the present application also provides an electronic device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the computer program, Figures 2 to 5 The steps of any in-vehicle wireless screen projection method are shown.
[0134] The embodiment of the present application also provides a computer program product, when the computer program product is run on an electronic device, the electronic device executes the following Figures 2 to 5 The steps of any in-vehicle wireless screen projection method are shown.
[0135] Figure 7 is a schematic diagram of an electronic device provided by an embodiment of the present application. Figure 7 As shown, the electronic device 7 of this embodiment includes: a processor 70, a memory 71, and a computer program 72 stored in the memory 71 and executable on the processor 70. When the processor 70 executes the computer program 72, the steps in the above-mentioned embodiments of the vehicle-mounted wireless screen projection method are implemented, for example Figure 2 Alternatively, when the processor 70 executes the computer program 72, the functions of each module / unit in the above-mentioned device embodiments are realized, for example Figure 6 The functions of units 61 to 64 are shown.
[0136] Exemplarily, the computer program 72 may be divided into one or more modules / units, which are stored in the memory 71 and executed by the processor 70 to complete the present application. The one or more modules / units may be a series of computer-readable instruction segments capable of completing specific functions, which are used to describe the execution process of the computer program 72 in the electronic device 7.
[0137] The electronic device 7 may include, but is not limited to, a processor 70 and a memory 71. Those skilled in the art will appreciate that Figure 7 It is only an example of the electronic device 7 and does not constitute a limitation of the electronic device 7. It may include more or fewer components than shown in the figure, or a combination of certain components, or different components. For example, the electronic device 7 may also include input and output devices, network access devices, buses, etc.
[0138] The processor 70 may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor or any conventional processor, etc.
[0139] The memory 71 may be an internal storage unit of the electronic device 7, such as a hard disk or memory of the electronic device 7. The memory 71 may also be an external storage device of the electronic device 7, such as a plug-in hard disk, a smart media card (SMC), a secure digital (SD) card, a flash card, etc. equipped on the electronic device 7. Further, the memory 71 may also include both an internal storage unit and an external storage device of the electronic device 7. The memory 71 is used to store the computer program and other programs and data required by the electronic device. The memory 71 may also be used to temporarily store data that has been output or is to be output.
[0140] It should be noted that the information interaction, execution process, etc. between the above-mentioned devices / units are based on the same concept as the method embodiment of the present application. Their specific functions and technical effects can be found in the method embodiment part and will not be repeated here.
[0141] The technicians in the relevant field can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional units and modules is used as an example for illustration. In practical applications, the above-mentioned function allocation can be completed by different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the embodiment can be integrated in a processing unit, or each unit can exist physically separately, or two or more units can be integrated in one unit. The above-mentioned integrated unit can be implemented in the form of hardware or in the form of software functional units. In addition, the specific names of the functional units and modules are only for the convenience of distinguishing each other, and are not used to limit the scope of protection of this application. The specific working process of the units and modules in the above-mentioned system can refer to the corresponding process in the aforementioned method embodiment, which will not be repeated here.
[0142] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the present application implements all or part of the processes in the above-mentioned embodiment method, which can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a computer-readable storage medium, and the computer program can implement the steps of the above-mentioned various method embodiments when executed by the processor. Among them, the computer program includes computer program code, and the computer program code can be in source code form, object code form, executable file or some intermediate form. The computer-readable medium may at least include: any entity or device that can carry the computer program code to the device / electronic device, a recording medium, a computer memory, a read-only memory (ROM, Read-Only Memory), a random access memory (RAM, Random Access Memory), an electric carrier signal, a telecommunication signal, and a software distribution medium. For example, a USB flash drive, a mobile hard disk, a magnetic disk or an optical disk. In some jurisdictions, according to legislation and patent practice, computer-readable media cannot be electric carrier signals and telecommunication signals.
[0143] In the above embodiments, the description of each embodiment has its own emphasis. For parts that are not described or recorded in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.
[0144] The embodiments described above are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, a person skilled in the art should understand that the technical solutions described in the aforementioned embodiments may still be modified, or some of the technical features may be replaced by equivalents. Such modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present application, and should all be included in the protection scope of the present application.
Claims
1. A vehicle-mounted wireless screen projection method, characterized in that: Applied to a transmitting end, the transmitting end is provided with more than one wireless network interface, the method comprising: Determine the network status of each wireless network interface, and determine the target wireless network interface based on the network status; Obtain a target screen projection data stream, and perform packet processing on the target screen projection data stream to obtain a number of target data packets; Distributing the target data packet to the target wireless network interface; The allocated target data packet is transmitted to the receiving end through the target wireless network interface, and the receiving end is instructed to collect and reassemble the target data packets sent by each target wireless network interface to obtain the target screen projection data stream, and screen projection is realized based on the target screen projection data stream.
2. The method according to claim 1, characterized in that: The step of allocating the target data packet to the target wireless network interface comprises: Based on the network status of the target wireless network interface, dynamically determine the allocation ratio of the target data packets allocated to the target wireless network interface; The target data packet is allocated to the target wireless network interface according to the allocation ratio.
3. The method according to claim 1, characterized in that The target screen projection data stream is a video stream, and the step of transmitting the allocated target data packet to the receiving end through the target wireless network interface includes: When the network status of any target wireless network interface meets the preset conditions, adjusting the video quality parameters of the target data packet or all target data packets allocated by the target wireless network interface according to the network status of the target wireless network interface meeting the preset conditions; The target data packet after adjusting the video quality parameter is transmitted to the receiving end through the target wireless network interface.
4. The method according to claim 1, characterized in that: After the step of determining the target wireless network interface based on the network status, the method further comprises: An MPTCP subflow is created for each of the target wireless network interfaces, where the MPTCP subflow is a path for transmitting data packets between the sender and the receiver through the target wireless network interface.
5. The method according to claim 4, characterized in that The step of creating an MPTCP sub-flow for each of the target wireless network interfaces comprises: Initiate a TCP connection request to each wireless network interface of the receiving end, wherein the TCP connection request carries a specified MPTCP option; Based on the specified MPTCP option, exchanging initial parameter information between the sending end and the receiving end; Based on the initial parameter information, an MPTCP subflow corresponding to the target wireless network interface is created.
6. The method according to any one of claims 1 to 5, characterized in that: The step of transmitting the allocated target data packet to the receiving end through the target wireless network interface also includes: During the transmission of the target data packet, if packet loss or data error is detected, a retransmission mechanism is started.
7. A vehicle-mounted wireless screen projection system, characterized in that: The vehicle-mounted wireless screen projection system includes a transmitting end and a receiving end, and the transmitting end is provided with more than one wireless network interface, wherein: The transmitting end is used to determine the network status of each wireless network interface, and based on the network status, determine the target wireless network interface; obtain the target screen projection data stream, and perform packet processing on the target screen projection data stream to obtain a number of target data packets; allocate the target data packets to the target wireless network interface; and transmit the allocated target data packets to the receiving end through the target wireless network interface; The receiving end is used to collect and reorganize the target data packets sent by each of the target wireless network interfaces to obtain the target screen projection data stream, and realize screen projection based on the target screen projection data stream.
8. A vehicle-mounted wireless screen projection device, characterized in that: Applied to a transmitting end, the transmitting end is provided with more than one wireless network interface, and the device comprises: a target interface determination unit, configured to determine a network status of each wireless network interface, and determine a target wireless network interface based on the network status; A data packet acquisition unit, used to acquire a target screen projection data stream, and perform packet processing on the target screen projection data stream to obtain a plurality of target data packets; A data packet distribution unit, configured to distribute the target data packet to the target wireless network interface; The wireless screen projection unit is used to transmit the allocated target data packets to the receiving end through the target wireless network interface, instruct the receiving end to collect and reassemble the target data packets sent by each target wireless network interface, obtain the target screen projection data stream, and realize screen projection based on the target screen projection data stream.
9. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the computer program, the in-vehicle wireless screen projection method as described in any one of claims 1 to 6 is implemented.
10. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by the processor, the in-vehicle wireless screen projection method as described in any one of claims 1 to 6 is implemented.