Handcart interconnection method, system and device, electronic equipment and storage medium

Abstract

The invention relates to a handcart interconnection method, system and device, electronic equipment and a storage medium, and the method comprises the steps: obtaining interconnection data, and carrying out the coding and packaging of the interconnection data; the distance between the vehicle terminal and the vehicle terminal is obtained; according to the distance, a first connection or a second connection is selected to send the interconnection data subjected to coding and packaging processing to the vehicle-mounted terminal, interconnection with the vehicle-mounted terminal is completed, and the connection path of the first connection is different from that of the second connection. According to the embodiment of the invention, the mobile terminal and the vehicle-mounted terminal can realize interconnection through the first connection and the second connection, the connection paths of the first connection and the second connection are different, and interconnection at different distances is supported, so that the vehicle-mounted terminal and the mobile terminal can adaptively select the interconnection mode based on the distance to adapt to different scenes or different requirements, and the user experience is improved. And the use effect of handcart interconnection is improved.

Description

Technical Field

[0001] The present invention relates to the technical field of handcart interconnection, and in particular to a handcart interconnection method, system, device, electronic equipment and storage medium. Background Art

[0002] As consumers' demand for automotive technology continues to increase, the market share of smart connected cars is also expanding rapidly. As an important criterion for measuring the intelligence, comfort and convenience of cars, smart cockpits not only provide a highly personalized driving experience, but also enhance the interactive experience between drivers and vehicles through technological innovation and integration. In the design of smart cockpits, the application of car-to-car interconnection technology is particularly important. Through seamless connection with mobile terminals, consumers can achieve real-time synchronization and exchange of information inside and outside the car. This connectivity not only improves the convenience of driving, but also promotes the development of smart driving technology and vehicle automation. Overall, with the continuous advancement of smart connected technology and the growth of consumer demand, car-to-car interconnection, as a core component of the smart cockpit, will continue to play a key role in future car design.

[0003] Related car-to-vehicle interconnection technologies are usually based on proprietary car-to-vehicle interconnection solutions provided by various mobile terminal manufacturers, which achieve connection and interaction with the vehicle-mounted system through specific applications or interfaces. Alternatively, mobile terminals and vehicle-mounted systems can be interconnected through technologies such as DLNA and Miracast.

[0004] The above-mentioned interconnection technology achieves connection based on the mobile terminal and the vehicle terminal being in the same local area network or in a close range. When the mobile terminal and the vehicle terminal exceed a certain distance or the wireless signal is weak, the interconnection transmission performance decreases or is disconnected. This limitation affects the use of handcar interconnection in different scenarios or under different needs. Summary of the invention

[0005] One of the purposes of the present invention is to provide a trolley interconnection method to solve the problem in the prior art that the mobile terminal and the vehicle terminal need to be connected in a local area network or within a short distance to achieve interconnection; the second purpose is to provide a trolley interconnection system; the third purpose is to provide a trolley interconnection device; the fourth purpose is to provide an electronic device.

[0006] In order to achieve the above object, the technical solution adopted by the present invention is as follows:

[0007] In a first aspect, a handcart interconnection method is applied to a mobile terminal, comprising:

[0008] Acquire interconnected data, and encode and encapsulate the interconnected data;

[0009] Get the distance to the vehicle terminal;

[0010] According to the distance, the first connection or the second connection is selected to send the interconnection data after encoding and packaging to the vehicle terminal to complete the interconnection with the vehicle terminal, wherein the connection paths of the first connection and the second connection are different.

[0011] According to the above technical means, the vehicle-machine end and the mobile terminal are interconnected. On the one hand, it is based on the short-distance communication between the vehicle-machine end and the mobile terminal. On the other hand, the vehicle-machine end and the mobile terminal are interconnected based on the server, and the server supports long-distance communication. The vehicle-machine end and the mobile terminal can adaptively select the corresponding interconnection method based on the distance. For example, when the distance between the vehicle-machine end and the mobile terminal is far or over the distance, the handcar interconnection can still be stably performed based on the server, overcoming the limitation in the related technology that the vehicle-machine end and the mobile terminal must be in the same local area network or in a very close distance to be interconnected. And the vehicle-machine end and the mobile terminal can adaptively select the first connection for interconnected data transmission when the distance is greater than the preset distance, and adaptively select the second connection for interconnected data transmission when the distance is less than or equal to the preset distance, to ensure the interconnection effect between the vehicle-machine end and the mobile terminal, and increase the use scenarios of the interconnection between the vehicle-machine end and the mobile terminal, and improve the interconnection effect.

[0012] Further, selecting the first connection or the second connection according to the distance to send the interconnection data after encoding and encapsulation to the vehicle terminal to complete the interconnection with the vehicle terminal includes:

[0013] When the distance is greater than the preset distance, the interconnection data after the encoding and encapsulation processing is sent to the vehicle terminal based on the first connection, and the interconnection with the vehicle terminal is completed;

[0014] When the distance is less than or equal to the preset distance, the interconnection data after the encoding and encapsulation processing is sent to the vehicle terminal based on the second connection, and the interconnection with the vehicle terminal is completed;

[0015] Among them, the first connection is a connection with the vehicle terminal based on a server; the second connection is a connection with the vehicle terminal based on short-range communication.

[0016] According to the above technical means, short-range communication is point-to-point communication, which has the advantage of high transmission efficiency. When the distance between the mobile terminal and the vehicle terminal is relatively short, the second connection mode is adaptively selected to interconnect, thereby improving the interconnection efficiency.

[0017] Further, when the distance is less than or equal to the preset distance, the interconnected data after the encoding and encapsulation processing is sent to the vehicle terminal based on the second connection, including:

[0018] When the distance is less than or equal to a preset distance, obtaining a signal strength of the second connection;

[0019] If the signal strength is greater than or equal to a preset threshold, sending the encoded and encapsulated interconnection data to the vehicle terminal based on the second connection;

[0020] If the signal strength is less than the preset threshold, the interconnected data that has been encoded and packaged is sent to the vehicle terminal based on the first connection.

[0021] According to the above technical means, the mobile terminal and the vehicle terminal adaptively select a stable and efficient way to interconnect, thereby ensuring the interconnection effect between the mobile terminal and the vehicle terminal, and the interconnection based on the second connection method can also ensure the interconnection between the mobile terminal and the vehicle terminal in harsh environments, thereby improving the user experience.

[0022] Further, the interconnected data includes screen data, and the obtaining of the interconnected data includes:

[0023] Based on the recording function, the audio and video images displayed on the screen are recorded in real time to obtain the screen data;

[0024] Alternatively, in the screen-off state, based on the off-screen rendering function, the screen desktop application and / or the running application interface are rendered to obtain the screen data.

[0025] According to the above-mentioned technical means, the interconnected data is obtained by screen recording or off-screen rendering, and the interconnected data can be encoded in combination with the public protocol of audio and video. Since the encoding protocol is a public protocol, the interconnected data does not need to be transmitted based on a specific protocol. Therefore, in this embodiment, the interconnection between the vehicle terminal and the mobile terminal has no specific limitation on the system brand (not limited to the model) of the mobile terminal, and can be applied to all types of mobile terminals, and has universal applicability.

[0026] Further, the interconnected data includes screen projection application data, and the obtaining of the interconnected data includes:

[0027] In response to the screen projection operation of some applications on the vehicle machine, determine the application to be projected;

[0028] Based on the application information corresponding to the application to be projected, the projection application data is obtained;

[0029] After the projection application data is sent to the vehicle terminal, it also includes:

[0030] Receive the target application opening operation sent by the vehicle terminal, open the target application, and obtain screen data after the target application is opened.

[0031] According to the above-mentioned technical means, some applications to be projected can be projected to the car computer separately, and then the car computer can control the opening or operation of some applications to be projected. On the one hand, the projection of some applications that can be returned can be realized, and on the other hand, based on the fact that users can choose to project some applications, personal data privacy and security can be guaranteed.

[0032] Furthermore, before obtaining the interconnected data, the method further includes:

[0033] Sending first connection data to the server, wherein the first connection data includes identity information of the mobile terminal, display information of the mobile terminal, and a connection code of the vehicle terminal to be connected;

[0034] Receive interconnection success information after the server successfully verifies the first connection data, and complete the connection between the server and the vehicle terminal.

[0035] According to the above technical means, the interconnection between the mobile terminal and the vehicle terminal is established based on the server.

[0036] In the second aspect, a handcar interconnection method is applied to a vehicle computer end, comprising:

[0037] Sending second connection data to the server, wherein the second connection data includes network status information of the vehicle terminal and an identification code of the vehicle terminal;

[0038] A connection code generated by the server based on the second connection data is received, and the connection code is output, so that the mobile terminal requests interconnection and verification from the server after obtaining the connection code.

[0039] According to the above technical means, the interconnection between the mobile terminal and the vehicle terminal is achieved based on the server.

[0040] Further, after displaying the connection code on the display screen, the method further includes:

[0041] Receiving the interconnection review request sent by the server and checking the current network status;

[0042] If the current network status meets the interconnection requirements, a confirmation message is sent to the server, and the second connection mode is established.

[0043] According to the above technical means, ensure successful interconnection with the mobile terminal based on the server.

[0044] Furthermore, the method further comprises:

[0045] Receiving interconnected data from a mobile terminal, and displaying the interconnected data on a display screen, wherein the interconnected data includes screen projection application data and screen data;

[0046] In response to a touch operation corresponding to the interconnected data displayed on the display screen, obtaining touch data;

[0047] According to the distance between the touch terminal and the mobile terminal, the first connection or the second connection is selected to send the touch data to the mobile terminal.

[0048] According to the above technical means, the vehicle computer adaptively selects the interconnection mode based on the distance between it and the mobile terminal, so as to ensure the stability and timeliness of the interconnected data transmission between it and the mobile terminal.

[0049] In a third aspect, a handcart interconnection method is applied to a server side, comprising:

[0050] Receiving data to be processed, and determining a data type of the data to be processed, wherein the data type of the data to be processed includes connection data and interconnection data;

[0051] If the data type of the data to be processed is connection data, establishing a first connection between the mobile terminal and the vehicle terminal according to the data to be processed;

[0052] If the data type of the data to be processed is interconnected data, the interconnected data sent by the mobile terminal is sent to the vehicle terminal, and / or the interconnected data of the vehicle terminal is sent to the mobile terminal.

[0053] According to the above technical means, a second connection between the vehicle terminal and the mobile terminal is established through the server, and the vehicle terminal and the mobile terminal are interconnected based on the second connection. This interconnection method supports long-distance interconnection between the vehicle terminal and the mobile terminal, and realizes interconnection when the distance between the vehicle terminal and the mobile terminal is far.

[0054] Further, if the data type of the data to be processed is connection data, establishing a first connection between the mobile terminal and the vehicle terminal according to the data to be processed includes:

[0055] If the data to be processed is the second connection data sent by the vehicle terminal, generating a connection code according to the second connection data;

[0056] Sending the connection code to the vehicle terminal;

[0057] receiving first connection data sent by the mobile terminal, and verifying the mobile terminal according to the first connection data, wherein the first connection data includes the connection code;

[0058] If the verification is successful, sending an interconnection verification request to the vehicle terminal, and upon receiving confirmation information fed back by the vehicle terminal based on the interconnection verification request, establishing a first connection between the mobile terminal and the vehicle terminal;

[0059] If the verification fails, or the confirmation information fed back by the vehicle machine based on the interconnection review request is not received within the first preset time period, a connection failure information is sent to the mobile terminal.

[0060] According to the above-mentioned technical means, during the process of establishing the interconnection between the mobile terminal and the vehicle terminal, the server authenticates the legitimacy of the mobile terminal based on the security authentication mechanism, thereby ensuring the security and accuracy of the interconnection between the vehicle terminal and the mobile terminal, thereby effectively preventing unauthorized access and data leakage risks.

[0061] Further, the server establishes a first connection between the vehicle terminal and at least two of the mobile terminals, and the interconnection data sent by the mobile terminal is sent to the vehicle terminal, including:

[0062] Comparing the identity information of the mobile terminal included in the interconnection data with the identity information of the mobile terminal currently interconnected with the vehicle terminal, wherein the interconnection data includes the identity information of the corresponding mobile terminal;

[0063] If the identity information is consistent, the interconnection data is sent to the vehicle terminal;

[0064] If the identity information is inconsistent, a request to change the projection terminal is sent to the vehicle terminal;

[0065] After receiving the confirmation replacement information fed back by the vehicle terminal based on the request to replace the projection terminal, the interconnection data is sent to the vehicle terminal.

[0066] According to the above-mentioned technical means, the server supports multiple mobile terminals to be interconnected to the vehicle side at the same time, rather than a one-to-one interconnection mode; and when the user switches the current projection mobile terminal A to mobile terminal B, the server can identify the identity information of the mobile terminal sending the interconnection data to determine whether the projection terminal has been switched. If it has been switched, the vehicle side can be notified to change the projection terminal, and then the interconnection data of the replaced mobile terminal B will be displayed on the vehicle side. This can ensure that in the scenario where multiple mobile terminals are interconnected at the same time, when the projection mobile terminal is switched, the vehicle side can accurately receive the projection data of the switched mobile terminal, and multiple mobile terminals can be switched at any time. During the switching process, there is no need to re-establish the connection with the vehicle side, and seamless switching is achieved.

[0067] Furthermore, if the identity information is inconsistent, after sending a request to change the projection terminal to the vehicle terminal, the method further includes:

[0068] If no confirmation change information is received from the vehicle terminal based on the request to change the projection terminal within the second preset time period, or if no rejection information is received from the vehicle terminal, the interconnected data sent by the currently connected mobile terminal will be sent to the vehicle terminal.

[0069] Based on the above technical means, users can choose to refuse to change the projection terminal through the car terminal, increase human-computer interaction functions, and improve user experience.

[0070] Further, the sending of the interconnected data sent by the mobile terminal to the vehicle terminal includes:

[0071] Determining display information corresponding to the interconnected data according to the identity information of the mobile terminal contained in the interconnected data;

[0072] The interconnection data is processed according to the display information, and the processed interconnection data is sent to the vehicle machine end.

[0073] According to the above technical means, since the server processes the interconnected data according to the display information of the mobile terminal, the display information of the processed interconnected data is consistent with the display information of the mobile terminal. When the vehicle terminal displays the interconnected data, it is consistent with the display effect of the mobile terminal, avoiding excessive display differences affecting the user's viewing experience.

[0074] In a fourth aspect, a handcart interconnection system includes: a car terminal, a mobile terminal and a server;

[0075] The mobile terminal is used to execute the method described in the first aspect above;

[0076] The vehicle terminal is used to execute the method described in the second aspect above;

[0077] The server is used to execute the method described in the third aspect above.

[0078] A fifth aspect is a trolley interconnection device, the device comprising:

[0079] A data acquisition unit, used for acquiring screen data;

[0080] A first data processing unit, used for encoding and packaging the screen data;

[0081] The first data processing unit is also used to determine the distance to the vehicle terminal;

[0082] The first data transmission unit is used to select the first connection or the second connection according to the distance to send the interconnection data after encoding and packaging to the vehicle end, so as to complete the interconnection with the vehicle end, wherein the connection paths of the first connection and the second connection are different.

[0083] A sixth aspect is a trolley interconnection device, the device comprising:

[0084] A second data transmission unit, used to send second connection data to the server, wherein the second connection data includes vehicle terminal network status information and a vehicle terminal identification code;

[0085] The output module is used to receive the connection code generated by the server based on the second connection data, and output the connection code, so that the mobile terminal requests the server for interconnection and verification after obtaining the connection code.

[0086] A seventh aspect is a trolley interconnection device, the device comprising:

[0087] A third data sending module is used to receive the data to be processed and determine the data type of the data to be processed, where the data type of the data to be processed includes connection data and interconnection data;

[0088] A connection building module, configured to establish a first connection between the mobile terminal and the vehicle terminal according to the data to be processed if the data type of the data to be processed is connection data;

[0089] The third data receiving module is further used to send the interconnected data sent by the mobile terminal to the vehicle terminal if the data type of the data to be processed is interconnected data, and / or send the interconnected data of the vehicle terminal to the mobile terminal.

[0090] In an eighth aspect, an electronic device includes: a memory, a processor;

[0091] The memory is used to store a computer program; the processor is used to execute the method described in the first aspect, the second aspect or the third aspect according to the computer program stored in the memory.

[0092] Furthermore, the electronic device may be a vehicle, a mobile terminal or a server.

[0093] In a ninth aspect, a computer-readable storage medium is provided, characterized in that a computer program is stored in the computer-readable storage medium, and the computer program is used to implement the method described above when executed by a processor.

[0094] In a tenth aspect, a computer program product is provided, wherein the computer program product comprises a computer program, and the computer program is used to implement the method as described above when executed by a processor.

[0095] Beneficial effects of the present invention:

[0096] (1) In the embodiment of the present application, the vehicle-side and the mobile terminal are interconnected. On the one hand, it is based on the short-distance communication between the vehicle-side and the mobile terminal. On the other hand, the vehicle-side and the mobile terminal are interconnected based on the server. The server supports long-distance communication. The vehicle-side and the mobile terminal can adaptively select the corresponding interconnection method based on the distance. For example, when the distance between the vehicle-side and the mobile terminal is far, the vehicle-side interconnection can still be stably performed based on the server, which overcomes the limitation in the related technology that the vehicle-side and the mobile terminal must be in the same local area network or in a very short distance to be interconnected. Increase the use scenarios of the interconnection between the vehicle-side and the mobile terminal and improve the interconnection effect.

[0097] (2) In the embodiment of the present application, the mobile terminal obtains screen data by recording the screen, then encodes the screen data through a public audio and video coding protocol, and then sends the screen data to the vehicle terminal based on the first connection or the second connection. Compared with the proprietary interconnection protocol, the present application is applicable to all mobile terminal systems and all vehicle terminal systems, is not limited by device, hardware or software compatibility, and is not limited by cross-platform interconnection, and is universal.

[0098] (3) The interconnection solution of the embodiment of the present application supports full mirroring screen projection and partial application screen projection of mobile terminals, and partial application screen projection ensures the privacy and security of personal data.

[0099] (4) The embodiment of the present application is based on a server to achieve simultaneous establishment of interconnection between the vehicle terminal and multiple mobile terminals. The user can select any mobile terminal to project the screen based on the multiple mobile terminals that have established connections, and other mobile terminals will not exit the interconnection. When the user switches the mobile terminal for projecting the screen, the corresponding mobile terminal is directly selected for projecting the screen. The server sends the switched interconnection data to the vehicle terminal to achieve seamless switching of the projected screen terminal. In addition, multiple mobile terminals are interconnected at the same time, making the use of multiple users or in specific scenarios more flexible and practical.

[0100] (5) In this embodiment, a strict security authentication mechanism is implemented during the server establishment process to ensure the security and accuracy of the connection between the vehicle terminal and the mobile terminal, thereby effectively preventing unauthorized access and data leakage risks. BRIEF DESCRIPTION OF THE DRAWINGS

[0101] Figure 1 A schematic diagram of a trolley interconnection system provided in an embodiment of the present application after a first connection is established;

[0102] Figure 2 A schematic diagram of a trolley interconnection system provided in an embodiment of the present application after a second connection is established;

[0103] Figure 3 A schematic diagram of data transmission based on a first connection of a handcart interconnection system provided in an embodiment of the present application;

[0104] Figure 4 A schematic diagram of a flow chart of establishing a first connection in a handcart interconnection method provided in an embodiment of the present application;

[0105] Figure 5 A schematic diagram of a process flow of a handcart interconnection method provided in one embodiment of the present application;

[0106] Figure 6 A schematic diagram of a flowchart of a handcart interconnection method provided in another embodiment of the present application;

[0107] Figure 7 A flowchart of a handcart interconnection method provided in yet another embodiment of the present application;

[0108] Figure 8 A schematic diagram of the structure of the electronic device provided in this application. DETAILED DESCRIPTION

[0109] The following will describe the embodiments of the present invention with reference to the accompanying drawings and preferred embodiments. Those skilled in the art can easily understand other advantages and effects of the present invention from the contents disclosed in this specification. The present invention can also be implemented or applied through other different specific embodiments, and the details in this specification can also be modified or changed in various ways based on different viewpoints and applications without departing from the spirit of the present invention. It should be understood that the preferred embodiments are only for illustrating the present invention, not for limiting the scope of protection of the present invention.

[0110] It should be noted that the illustrations provided in the following embodiments are only schematic illustrations of the basic concept of the present invention, and thus the drawings only show components related to the present invention rather than being drawn according to the number, shape and size of components in actual implementation. In actual implementation, the type, quantity and proportion of each component may be changed arbitrarily, and the component layout may also be more complicated.

[0111] As consumers' demand for automotive technology continues to increase, the market share of smart connected cars is also expanding rapidly. As an important criterion for measuring the intelligence, comfort and convenience of cars, smart cockpits not only provide a highly personalized driving experience, but also enhance the interactive experience between drivers and vehicles through technological innovation and integration. In the design of smart cockpits, the application of car-to-car interconnection technology is particularly important. Through seamless connection with mobile terminals, consumers can achieve real-time synchronization and exchange of information inside and outside the car. This connectivity not only improves the convenience of driving, but also promotes the development of smart driving technology and vehicle automation. Overall, with the continuous advancement of smart connected technology and the growth of consumer demand, car-to-car interconnection, as a core component of the smart cockpit, will continue to play a key role in future car design.

[0112] Related car-to-vehicle interconnection technologies are usually based on proprietary car-to-vehicle interconnection solutions provided by various mobile terminal manufacturers, which achieve connection and interaction with the vehicle-mounted system through specific applications or interfaces. Alternatively, mobile terminals and vehicle-mounted systems can be interconnected through technologies such as DLNA and Miracast.

[0113] The above-mentioned interconnection technology achieves connection based on the mobile terminal and the vehicle terminal being in the same local area network or in a close range. When the mobile terminal and the vehicle terminal exceed a certain distance or the wireless signal is weak, the interconnection transmission performance decreases or is disconnected. This limitation affects the use of handcar interconnection in different scenarios or under different needs.

[0114] Based on this, the embodiment of the present application provides a handcart interconnection solution, which is different from the traditional WiFi / Bluetooth+DLNA, Miracast interconnection technology. The mobile terminal and the vehicle end include a first connection based on the server and a second connection based on the WiFi / Bluetooth+audio and video transmission protocol, wherein the server supports long-distance and short-distance connections between the mobile terminal and the vehicle end. Therefore, the handcart interconnection solution provided by the embodiment of the present application can select the corresponding connection method for interconnection based on the distance between the adaptive mobile terminal and the vehicle end, so that the mobile terminal and the vehicle end can adapt to the long-distance interconnection scenario, and can also adapt to the interconnection scenario with weak short-distance connection signal within a short range, and the handcart interconnection effect is better.

[0115] The technical solution of the present application is described in detail with specific embodiments below. The following specific embodiments can be combined with each other, and the same or similar concepts or processes may not be described in detail in some embodiments.

[0116] Figure 1 A schematic diagram of a trolley interconnection system provided in an embodiment of the present application is shown in FIG. Figure 1 As shown, the handcar interconnection system includes: a vehicle terminal, a mobile terminal and a server. The interconnection between the vehicle terminal and the mobile terminal can be achieved at least through a first connection and a second connection, wherein the connection paths of the first connection and the second connection are different, supporting interconnection at different distances. Therefore, the mobile terminal and the vehicle terminal can adaptively select the first connection or the second connection to send interconnection data according to the distance between the two, so that the mobile terminal and the vehicle terminal can be applied to a wider range of interconnection scenarios.

[0117] As an example, the vehicle machine end and the mobile terminal establish a first connection based on the server, and the vehicle machine end and the mobile terminal establish a second connection based on the short-range communication module.

[0118] Optionally, the short-range communication includes Bluetooth, WiFi, NFC, etc. The server supports long-range connection and short-range connection between the mobile terminal and the vehicle terminal. When both the first connection and the second connection can stably transmit interconnected data, the second connection is preferentially used to transmit interconnected data.

[0119] As an example, when the distance between the vehicle terminal and the mobile terminal is greater than or equal to the preset distance, the vehicle terminal and the mobile terminal transmit interconnected data based on the first connection; when the distance between the vehicle terminal and the mobile terminal is less than or equal to the preset distance, the vehicle terminal and the mobile terminal transmit interconnected data based on the second connection.

[0120] In actual application, after the mobile terminal and the vehicle machine end establish interconnection, the mobile terminal and the vehicle machine end adaptively choose to transmit interconnection data through the first connection or the second connection.

[0121] As an example, when the distance between the vehicle terminal and the mobile terminal is less than or equal to the preset distance, it is also necessary to determine the signal strength of the second connection. When the signal strength of the second connection is greater than or equal to the preset threshold, the interconnection data is transmitted based on the second connection, otherwise, the interconnection data is transmitted based on the first connection. That is to say, in this example, the connection with better connection performance in the current scenario is used to transmit the interconnection data. For example, in the current scenario, the distance between the mobile terminal and the vehicle terminal is greater than or equal to the preset distance, resulting in poor connection performance of the second connection, and better connection performance of the first connection, so the first connection is used to transmit the interconnection data. Alternatively, in the current scenario, the distance between the mobile terminal and the vehicle terminal is less than or equal to the preset distance, the signal strength of the second connection is large, the second connection is a point-to-point direct connection, and the connection performance is better, so the second connection is used to transmit the interconnection data. Alternatively, in the current scenario, the distance between the mobile terminal and the vehicle terminal is less than or equal to the preset distance, but the signal strength of the second connection is weak (for example, when the network state is unstable), which may affect the efficiency of interconnection data transmission, so the first connection is used to transmit the interconnection data.

[0122] Through the above method, the interconnection effect between the mobile terminal and the vehicle terminal is guaranteed (the interconnection data transmission speed is fast and stable).

[0123] As an example, the handcar interconnection system establishes a first connection and a second connection between the mobile terminal and the vehicle terminal in the following manner, and realizes interconnection based on the first connection and the second connection:

[0124] The mobile terminal includes a first data processing unit and a first data transmission unit. The first data processing unit is used to encapsulate the mobile terminal's identity information, display information and a connection code entered by the user (displayed on the vehicle terminal, manually entered by the user, similar to a password) into first connection data. The first data transmission unit is used to send the first connection data to the server.

[0125] The vehicle terminal includes a network status acquisition module, an identification code acquisition module, a second data processing unit and a second data transmission unit. Among them, the network status acquisition module is used to obtain the current network status information of the vehicle terminal, and the identification code acquisition module is used to obtain the identification code of the vehicle terminal; the second data processing unit is used to determine whether the current network status information meets the interconnection requirements, such as network stability and excellent performance. When the current network status information meets the interconnection requirements, the current network status information and the identification code of the vehicle terminal are encapsulated into the second connection data, and the second data transmission unit is used to transmit the second connection data to the server.

[0126] The server includes a connection building module, an arbitration module and a data path building module; the connection building module is used to generate a connection code according to the second type of connection data, and the arbitration module is used to verify the identity of the mobile terminal according to the first connection data sent by the mobile terminal (specifically, the verification connection code, and the second connection data includes the connection code). The data path building module is used to establish the first data queue and the second data queue after the mobile terminal passes the verification, such as Figure 2 As shown, the first data queue is used to receive the interconnected data sent by the mobile terminal and send the interconnected data to the vehicle terminal, and the second data queue is used to receive the interconnected data sent by the vehicle terminal and send the interconnected data to the mobile terminal.

[0127] For example, the mobile terminal includes the car-vehicle interconnection application 1, and the vehicle-machine terminal includes the car-vehicle interconnection application 2.

[0128] The car-to-vehicle interconnection application 2 provides a background service that can be started automatically when the computer is turned on. After the service is started, the network status of the vehicle-to-vehicle terminal can be obtained through the network status acquisition module. When the vehicle-to-vehicle terminal has the ability to connect to the Internet, the requirements of the car-to-vehicle interconnection are met. Then, the unique identification code (VIN) of the vehicle-to-vehicle terminal is obtained through the identification code acquisition module. The identification code corresponds to the vehicle-to-vehicle terminal one by one and can be used as the unique identity code of the vehicle-to-vehicle terminal.

[0129] When the user opens the car-vehicle interconnection application 2, the second data transmission unit will send the second connection data encapsulated based on the current network status information and the identification code of the vehicle-side to the server, notifying the server of the vehicle-side upper limit and enabling car-vehicle interconnection. At this time, the vehicle-side enters the car-vehicle interconnection waiting stage.

[0130] After the server receives the second connection data sent by the vehicle computer, it generates a connection code based on the VIN code (identification code) through the connection module, and then sends the connection code to the vehicle computer. After the vehicle computer receives the connection code, it outputs the connection code (it can be displayed on the display screen, output through voice, or sent to the mobile terminal through text messages, etc.).

[0131] When the user opens the car-car interconnection application 1 and triggers the car-car interconnection function, the first data processing unit obtains the identity information and display information of the mobile terminal, and outputs a connection code input window on the display interface of the mobile terminal. The user inputs the connection code output by the car-machine end based on the connection code input window. The first data processing module encapsulates the first connection data based on the identity information, display information (such as the resolution of the mobile terminal, etc.) of the mobile terminal and the connection code input by the user (displayed on the car-machine end, manually input by the user, similar to a password), and the first data transmission unit sends the first connection data to the server.

[0132] After the server receives the first connection data sent by the mobile terminal, it verifies the identity of the mobile terminal based on the first connection data through the arbitration module to determine the interconnected mobile terminal. Specifically, by verifying whether the connection code is consistent with the previously generated connection code, if they are consistent, it is determined that the mobile terminal verification is successful. In some examples, after the mobile terminal is verified, the first data queue of the mobile terminal-server-vehicle end and the second data queue of the vehicle end-server-mobile terminal are established based on the data path module. In other examples, after the mobile terminal is verified, the server also sends an interconnection review request to the vehicle end, requesting verification of whether the current network status of the vehicle end is normal and whether it meets the interconnection conditions. If so, the first data queue of the mobile terminal-server-vehicle end and the second data queue of the vehicle end-server-mobile terminal are established. Since the time when the vehicle computer requests to establish a connection with the server is different from the time when the mobile terminal requests to establish a connection with the server, when the mobile terminal requests to establish a connection, the current network status of the vehicle computer may not be stable or may not meet the conditions for interconnection. Therefore, the server, based on the connection request of the mobile terminal and after performing a security authentication on the mobile terminal, verifies with the vehicle computer whether the connection can be established, and then establishes the first connection. This can avoid the situation where the established first connection cannot transmit interconnection data.

[0133] Based on the above process, the first connection between the mobile terminal, the server and the vehicle terminal is completed, and data can be transmitted between the mobile terminal and the vehicle terminal through the first connection.

[0134] It should be noted that after the above-mentioned first connection is established, if the user also manually exits the interconnection (or the vehicle-side is powered off), the first connection always maintains communication. For example, in some scenarios, an adult projects the video content played by the mobile terminal onto the display screen of the vehicle-side. When the adult takes the mobile terminal and temporarily leaves the vehicle, if there is no manual trigger to exit the interconnection, the mobile terminal and the vehicle-side can continue to transmit interconnection data based on the first connection. Children or other members in the vehicle can continue to watch the video content played on the display screen of the vehicle-side, increasing the applicable scenarios of hand-car interconnection and improving user experience.

[0135] Alternatively, if Figure 3 As shown, the second connection between the mobile terminal and the vehicle terminal is realized based on short-distance communication. The establishment process of the second connection is described by taking Bluetooth and WiFi as examples of short-distance communication:

[0136] The mobile terminal also includes a first Bluetooth monitoring module and a first network direct connection module. The first Bluetooth monitoring module integrates the system-side Bluetooth interface, which can effectively scan and manage the connectable devices within the Bluetooth range, and supports the automatic operation of Bluetooth connection, thereby improving the user's convenience and interconnection efficiency. The first network direct connection module uses WIFI-DIRECT technology to enable two WIFI devices to be directly connected, which is suitable for handcart interconnection scenarios within a short distance or within the same local area network, thereby achieving efficient data transmission and interactive experience.

[0137] The vehicle terminal also includes a second Bluetooth monitoring module and a second Bluetooth monitoring module, whose functions and usage effects are similar to those of the mobile terminal.

[0138] When the first Bluetooth monitoring module of the mobile terminal monitors the Bluetooth of the vehicle computer, or the second Bluetooth monitoring module of the vehicle computer monitors the Bluetooth of the mobile terminal, a Bluetooth connection is established, and then based on the WIFI-DIRECT technology of the mobile terminal and the vehicle computer, a direct connection (short-range wireless connection) between the mobile terminal and the vehicle computer is realized, that is, a second connection is established.

[0139] When the vehicle-mounted terminal and the mobile terminal are interconnected, a second connection is automatically established based on the distance between the vehicle-mounted terminal and the mobile terminal. The vehicle-mounted terminal and the mobile terminal adaptively select the first connection and the second connection to transmit interconnected data, adapt to interconnection in different scenarios, and improve the interconnection effect.

[0140] As an example, the handcart interconnection system realizes interconnection data transmission in the following ways:

[0141] The mobile terminal also includes a data acquisition unit, wherein the data acquisition unit is used to acquire screen data. As an example, the data acquisition unit is used to acquire audio and video data displayed on the screen.

[0142] It should be noted that the screen data includes the screen image and / or the video data and audio data played on the screen. For example, when a user projects a desktop application of a mobile terminal to a mobile terminal, the screen data is the screen image. When a mobile terminal opens a video application and plays a video, the screen data includes the screen image, the played video data and the audio data, which are projected together to the vehicle terminal, and the effect presented on the vehicle terminal is consistent with the effect presented on the mobile terminal.

[0143] In this example, the data acquisition unit includes a screen recording module and an audio and video capture module. The screen recording module is used to record the screen of the mobile terminal, and the audio and video capture module is used to obtain the video data and audio data displayed by the mobile terminal to realize screen projection of the picture and audio.

[0144] Furthermore, the audio and video unit also includes an off-screen rendering module for obtaining screen data of the mobile terminal in an off-screen state. When the mobile device screen is turned off or the application is in the background, the off-screen rendering can continue to capture and process the image output of the application without being affected by the mobile phone screen state.

[0145] In this embodiment, the first data processing unit is also used to encode and encapsulate the screen data, and the first data transmission unit is also used for the first connection or the second connection to transmit the encoded and encapsulated screen data to the vehicle terminal.

[0146] Among them, encoding refers to encoding screen data based on a preset protocol to ensure stable data transmission and information security, and encapsulation refers to encapsulating screen data according to a set format to ensure the standardization and consistency of the data.

[0147] That is, in this example, the first data processing unit includes a first encoding module and a first data encapsulation module, the first encoding module is used to encode the screen data based on a preset protocol, and the first data encapsulation module is used to encapsulate the encoded screen data according to a set format.

[0148] Optionally, the preset protocol is a common protocol that is supported by mobile terminals of various brands. For example, the preset protocol includes video encoding protocols H.264 / H.265 and audio encoding protocols: AAC / Opus.

[0149] The car interconnection solutions provided by related technologies and the interconnection solutions provided by mobile terminal manufacturers are proprietary protocols, which are usually only applicable to the manufacturer's own brand of mobile terminals. This solution realizes the connection and interaction with the vehicle system through specific applications or interfaces. Although these solutions can provide users with certain connectivity and functions, their limitations lie in the restrictions on specific brands or models and cannot be widely applied to all consumers.

[0150] Some related technical solutions also use DLNA, Miracast and other interconnection technologies to achieve car-handling interconnection, but these protocols require that both mobile devices and vehicle-mounted systems support relevant standards to achieve some functions of car-handling interconnection. This method uses standardized screen projection protocols to allow mobile devices of different brands and types to transmit audio and video content or the interface of specific applications to the vehicle-mounted display screen, but it still relies on hardware and software support, limiting its popularization and application on all models and devices.

[0151] This embodiment obtains screen data based on video recording, encodes it based on a preset protocol, packages it based on a set format, and then sends the screen data to the vehicle terminal through the first connection or the second connection. On the one hand, the interconnection between the mobile terminal and the vehicle terminal is not restricted by proprietary protocols, and is not limited to a special brand system to be able to interconnect with the vehicle terminal; on the other hand, it can realize the projection of the mobile terminal screen to the vehicle terminal and complete the data sharing after interconnection.

[0152] Furthermore, the second data transmission unit of the vehicle terminal receives the screen data of the mobile terminal based on the first connection or the second connection, and the second data processing unit is used to parse the screen data and then display the parsed screen data through the display module.

[0153] Parsing refers to decoding the screen data. Since the screen data is encoded when the mobile terminal sends it, the vehicle terminal obtains the original data of the screen data through decoding. Therefore, the second data processing unit includes a second decoding module, which decodes the screen data based on a preset protocol.

[0154] As an example, the user can also perform touch control based on the projection content displayed on the vehicle side, so that the vehicle side can return control to the mobile terminal. In this example, the second data processing unit on the vehicle side also includes a second encoding module and a second data encapsulation module; the second encoding module is used to encode the touch data triggered by the display screen, and the second data encapsulation module is used to encapsulate the encoded touch data. Correspondingly, the first data processing module of the mobile terminal also includes a first decoding module. After the first data transmission unit receives the touch data, the first decoding module decodes the touch data to obtain the original touch data, and then responds to the touch data.

[0155] Optionally, the first data transmission unit of the mobile terminal includes a first data sending module and a first data receiving module, and correspondingly, the second data transmission unit of the vehicle terminal includes a second data sending module and a second data receiving module.

[0156] When the mobile terminal and the vehicle terminal transmit interconnected data based on the second connection, the first data sending module or the second data sending module can quickly and securely send the processed and packaged data to the designated server through the network to achieve timely data transmission and sharing. The first data receiving module and the second data receiving module receive data information sent from the server through the network, ensuring the integrity and accuracy of the data and providing timely feedback and information updates for users.

[0157] Optionally, the server further includes a third data sending module and a third data receiving module. The third data sending module is used to quickly and securely send the processed and encapsulated interconnected data to a designated client (including a mobile terminal and a vehicle terminal) through the network to achieve timely data transmission and sharing. The third data receiving module is used to receive data information sent from the client through the network, thereby ensuring the integrity and accuracy of the data and providing timely feedback and information updates to users.

[0158] As an example, the mobile terminal further includes a scanning module and a storage module, wherein the scanning module is used to scan all pages of the screen desktop of the mobile terminal to obtain application information of all applications on the screen desktop; and the storage module is used to associate and save the application and the corresponding application information. The application information includes the application name, application icon, and the location coordinates corresponding to the page where the application is located.

[0159] Based on the scanning module, the screen desktop of the mobile terminal can be scanned to obtain the page where each application is located and its position on the page. Then, when the mobile terminal is projected to the car computer, if the user touches an application based on the display screen of the car computer, the corresponding application name or location on the mobile terminal can be determined based on the application name triggered by the car computer, or the location of the application, and then the touch operation can be accurately responded to (for example, the corresponding application can be accurately opened).

[0160] The handcar interconnection system provided by the embodiment of the present application can realize full mirroring screen projection and partial application screen projection, wherein full mirroring screen projection refers to mirroring all contents displayed on the mobile terminal to the vehicle terminal; partial application screen projection refers to: projecting some applications on the mobile terminal to the vehicle terminal, such as icons and names of some applications. Compared with full mirroring screen projection, partial application screen projection can select privacy-related applications to prohibit screen projection to the vehicle terminal, protect user privacy, and improve the use effect of handcar interconnection.

[0161] In the example of implementing partial application screen projection, the application information of the application to be projected (partial application) can be obtained based on the association between the application and the corresponding application information, and the application to be projected is encoded and packaged separately, and transmitted to the vehicle end as projection application data for display. Among them, the data acquisition unit is also used to obtain the projection application data.

[0162] Based on the above-described handcart interconnection system, the following describes the interaction process of handcart interconnection with specific embodiments. The following specific embodiments can be combined with each other, and the same or similar concepts or processes may not be repeated in some embodiments.

[0163] Figure 4 The schematic diagram of establishing the interconnection between the mobile terminal, the server and the vehicle terminal in the handcart interconnection method provided in the embodiment of the present application is based on all the above embodiments, such as Figure 4 As shown, the handcart interconnection method includes:

[0164] S401: Send second connection data to the server.

[0165] It should be noted that this step is applied to the vehicle side, which includes the hand-car interconnection application 2. When the user opens the hand-car interconnection application 2 and enters the hand-car interconnection application 2, the vehicle side sends the second connection data to the server, notifies the server that the vehicle side is online, and requests the server to interconnect the mobile terminal and the vehicle side.

[0166] The data type of the second connection data is connection data, and the second connection data includes the vehicle-side network status information and the vehicle-side identification code.

[0167] The car interconnection application 2 provides a background service that can be automatically started when the computer is turned on. After the service is started, the network status of the vehicle terminal can be obtained through the network status acquisition module. When the vehicle terminal has the ability to connect to the Internet, the car interconnection can be used. Then the unique identification code (VIN) of the vehicle terminal is obtained through the identification code acquisition module. The identification code corresponds to the vehicle terminal one by one and can be used as the unique identity code of the vehicle terminal. The identification code is used when the server receives the connection request from the mobile terminal to accurately and quickly find the corresponding vehicle terminal to be connected, so as to avoid connecting the mobile terminal to other vehicle terminals.

[0168] S402, receiving second connection data, and generating a connection code according to the second connection data;

[0169] This step is applied to the server. The server receives the second connection data (data to be processed). Since the second connection data is connection data and is sent by the vehicle terminal, a connection code is generated by the connection module based on the VIN code sent by the vehicle terminal. The connection code is used to perform security authentication on the mobile terminal when receiving an interconnection request from the mobile terminal. For example, the mobile terminal can provide an accurate connection code to verify the interconnection relationship between the mobile terminal and the vehicle terminal.

[0170] S403, sending the connection code to the vehicle terminal;

[0171] After the server generates the verification code, it sends the verification code to the vehicle computer, through which the user can obtain it.

[0172] S404, the vehicle terminal outputs a connection code;

[0173] When the vehicle receives the connection code fed back by the server, it can output the connection code in the following ways:

[0174] For example, the connection code is displayed on a display screen; or the connection code is played by a voice broadcast system; or the connection code is sent to a mobile terminal via a text message or the like.

[0175] Based on the above steps, the interconnection between the vehicle terminal and the server is realized.

[0176] S405, sending first connection data to the server;

[0177] This step is applied to the mobile terminal, which includes the car interconnection application 1. When the user opens the car interconnection application 1 and enters the car interconnection application 1, the mobile terminal displays an input box to prompt the user to enter the connection code of the car terminal. The user obtains the connection code through the information output by the car terminal.

[0178] After the user enters the connection code, the mobile terminal encapsulates the first connection data based on the connection code, the identity information of the mobile terminal and the display information, and sends the first connection data to the server, sending a connection request with the vehicle terminal to the server.

[0179] Optionally, the identity representation information of the mobile terminal is the ID of the mobile terminal; the display information of the mobile terminal includes the resolution of the mobile terminal and the like.

[0180] Among them, the display information reflects the display effect of the mobile terminal. The first connection data includes the display information of the mobile terminal, and the server can obtain the relevant display parameters of the mobile terminal. After the connection is established, if the interconnection data is transmitted through the server, the server can determine the display information corresponding to the interconnection data according to the identity information of the mobile terminal; then process the interconnection data according to the display information, and send the processed interconnection data to the vehicle terminal, so that the display effect of the interconnection data sent to the vehicle terminal can be similar to the display effect on the mobile terminal, avoiding too large a difference in display effect after projection (such as too much distortion, etc.), and improving the use effect of projection.

[0181] S406: Receive first connection data, and verify the mobile terminal according to the first type of connection data.

[0182] This step is applied to the server. After receiving the interconnection request (first connection data) sent by the mobile terminal, the server verifies whether the connection code is correct through the arbitration module.

[0183] Optionally, the correctness can be determined by comparing the connection codes to see if they are consistent; or, the connection code can be paired to determine whether the connection code is correct. For example, the server sends the car computer connection code 1, the car computer generates a paired connection code 2 based on connection code 1, and then outputs connection code 2. The server determines whether the connection code is correct by judging whether connection code 1 and connection code 2 are paired.

[0184] S407, verification is successful, and an interconnection verification request is sent to the vehicle terminal;

[0185] If the server determines that the connection code is correct, it determines that the mobile terminal security verification is successful. The server further sends an interconnection review request to the vehicle terminal, which is used to verify whether the vehicle terminal network is normal and whether the conditions for interconnection are met.

[0186] S408, the vehicle terminal receives the interconnection verification request and detects the current network status.

[0187] After receiving the interconnection verification request, the vehicle side detects the current network status to determine whether the current network status is normal. If the network of the vehicle side is normal, it will confirm to the server that it has the interconnection capability and feedback the confirmation information.

[0188] If the vehicle-side network is abnormal and does not meet the interconnection conditions, the vehicle-side will not feedback confirmation information. If the server does not receive the confirmation information within the specified event (such as the first preset time), it jumps to step S411.

[0189] S409, the current network status meets the interconnection conditions, and a confirmation message is sent to the server;

[0190] S410, establishing data queue 1 and data queue 2;

[0191] After receiving the confirmation information sent by the vehicle terminal, the server determines that both the mobile terminal and the vehicle terminal meet the interconnection conditions. Then, through the data path module, two data queues for data exchange transmission are opened for the mobile terminal and the vehicle terminal, namely the first data queue: the queue in the direction of mobile terminal-server-vehicle terminal, and the second data queue: the queue in the direction of vehicle terminal-server-mobile terminal.

[0192] S411, verification fails, and a connection failure message is sent to the mobile terminal;

[0193] If the server determines that the connection code is wrong, it determines that the security verification of the mobile terminal is unsuccessful, and feeds back relevant information of the connection failure to the mobile terminal.

[0194] Alternatively, in step S408, if the verification request to the vehicle terminal is not passed, and the server does not receive a confirmation feedback from the vehicle terminal within the first preset time period, relevant information of the connection failure is fed back to the mobile terminal.

[0195] In this embodiment, a second connection between the vehicle terminal and the mobile terminal is established through the server, and the vehicle terminal and the mobile terminal are interconnected based on the second connection. This interconnection method supports long-distance interconnection between the vehicle terminal and the mobile terminal, and realizes interconnection when the distance between the vehicle terminal and the mobile terminal is far; and in the process of establishing the interconnection, the server ensures the security and accuracy of the interconnection between the vehicle terminal and the mobile terminal based on the security authentication mechanism, thereby effectively preventing unauthorized access and data leakage risks.

[0196] Figure 5 This is a flow chart of a handcart interconnection method provided by an embodiment of the present application. This embodiment is based on all the above embodiments and takes full mirror projection as an example to explain the interconnection process of the handcart interconnection method in detail. Figure 5 As shown, the handcart interconnection method includes:

[0197] S501, obtaining interconnected data, and performing encoding and packaging processing on the interconnected data;

[0198] This step is applied to mobile terminals. After the mobile terminal and the vehicle terminal are interconnected, the interconnected data can be transmitted between the mobile terminal and the vehicle terminal. For mobile terminals, the interconnected data includes screen data and screen projection application data. In the example of full mirroring screen projection, the screen data includes screen projection application data, that is, when the mobile terminal screen displays the application, the screen data is the screen projection application data, and when the mobile terminal displays the interface of the target application, the screen data is the interface data of the target application.

[0199] In this step, the interconnected data is obtained by recording the audio and video images displayed on the screen in real time based on the recording function of the handcar interconnected application 1. For example, when the mobile terminal displays a desktop application, the recorded desktop application video is the interconnected data. When the mobile terminal displays a video of a video player, the recorded screen image, video, and audio and video are the interconnected data (screen data).

[0200] That is to say, the mobile terminal of this embodiment captures the image of the current page in real time through the screen recording module, and obtains the audio stream data of the mobile phone through the audio and video capture module.

[0201] As an example, the interconnected data can also be obtained by rendering the screen desktop application and / or the running application interface based on the off-screen rendering function when the mobile terminal is in the screen-off state. That is, the handcar interconnection application 1 of the mobile terminal has an off-screen rendering module, which can obtain the current real-time audio and video data in the screen-off state.

[0202] For example, if the mobile terminal is not currently running an application, the desktop application of the mobile terminal is rendered off-screen in the screen-off state, and video data is obtained as the interconnected data based on the desktop application. If the mobile terminal is currently running a video player, the mobile terminal is in the screen-off state, and the playback interface of the video player is rendered off-screen to obtain real-time audio and video data as the interconnected data.

[0203] After the interconnected data is acquired, the interconnected data is coded and encoded according to a set format, for example, the interconnected data is encoded using a public protocol for audio and video data.

[0204] After encoding the interconnected data, the encoded interconnected data is encapsulated into audio and video data types to facilitate the transmission and screen projection of the interconnected data.

[0205] S502, sending the encoded and packaged interconnection data to the vehicle terminal;

[0206] In this step, the interconnected data of the mobile terminal can be transmitted to the vehicle side based on the first connection, or based on the second connection. The mobile terminal can adaptively select a better connection to transmit the interconnected data to the vehicle side to ensure the interconnected transmission performance.

[0207] Optionally, the mobile terminal adaptively selects the first connection or the second connection in a manner as follows:

[0208] Get the distance to the vehicle terminal;

[0209] If the distance to the vehicle terminal is greater than the preset distance, the interconnected data after encoding and packaging is sent to the vehicle terminal based on the first connection.

[0210] If the distance to the vehicle terminal is less than or equal to the preset distance, the interconnected data after the encoding and encapsulation processing is sent to the vehicle terminal based on the second connection.

[0211] Based on the above-mentioned handcart interconnection system, it can be known that the first connection is a connection with the vehicle terminal based on the server, and the second connection is a connection with the vehicle terminal based on short-distance communication. Among them, the server supports short-distance connection and long-distance connection between the vehicle terminal and the mobile terminal, while the second connection supports short-distance connection between the vehicle terminal and the mobile terminal. Therefore, the preset distance is set as the farthest distance that the second connection can support. When the distance between the mobile terminal and the vehicle terminal is greater than the preset distance, the second connection cannot realize the interconnection between the mobile terminal and the vehicle terminal. At this time, the first connection is adaptively used to complete the interconnection between the vehicle terminal and the mobile terminal. When the distance between the mobile terminal and the vehicle terminal is less than or equal to the preset distance, the second connection can realize the interconnection between the mobile terminal and the vehicle terminal. At this time, the second connection can be selected to complete the interconnection. Since the server also supports short-distance connection, the first connection can also be selected to complete the interconnection.

[0212] Furthermore, the first connection or the second connection is selected to complete the interconnection according to the signal strength of the second connection. For example, when the distance is less than or equal to the preset distance, the signal strength of the second connection is obtained; if the signal strength is greater than or equal to the preset threshold, the interconnection data processed by encoding and encapsulation is sent to the vehicle terminal based on the second connection; if the signal strength is less than the preset threshold, the interconnection data processed by encoding and encapsulation is sent to the vehicle terminal based on the first connection.

[0213] The signal strength of the second connection is affected by the current environment and may be weak. For example, in tunnels and remote areas with poor network signals, even if the distance between the mobile terminal and the vehicle is close, the connection performance of the second connection may be poor. In this case, the mobile terminal adaptively selects the first connection to complete the interconnection to ensure data transmission efficiency and improve the hand-car interconnection experience. When the second connection signal is strong, the mobile terminal gives priority to the second connection to transmit interconnection data. Based on point-to-point transmission, the output transmission speed is faster and more stable.

[0214] Therefore, the mobile terminal adaptively selects one of the interconnection modes to interconnect with the vehicle terminal, so that the interconnection between the vehicle terminal and the mobile terminal can achieve better interconnection effect in various scenarios and improve the interconnection experience.

[0215] If the interconnected data after encoding and encapsulation is sent to the vehicle terminal based on the first connection, the interconnected data is sent to the server through the mobile terminal, and the third data receiving module of the server injects the data into the first data queue after receiving the data. The third data sending module of the server takes out the interconnected data from the first data queue according to the requirements of the queue (data structure), and then sends the interconnected data to the vehicle terminal.

[0216] If the interconnected data after encoding and packaging is transmitted to the vehicle terminal based on the second connection, the interconnected data after encoding and packaging is directly transmitted to the vehicle terminal through the mobile terminal via the first network direct connection module.

[0217] S503, receiving the interconnection data, and displaying the interconnection data on a display screen;

[0218] This step is applied to the vehicle computer end. After the vehicle computer end receives the interconnection data, the second decoding module decodes the interconnection data and presents the interconnection data on the screen through the display module.

[0219] Optionally, after the car machine displays the projection screen, it can support reverse control, and the specific implementation method is as follows:

[0220] S504, in response to the touch operation corresponding to the interconnected data displayed on the display screen, obtaining touch data, and performing encoding and packaging processing on the touch data;

[0221] This step is applied to the vehicle terminal, and the touch operation includes controlling the opening of the target application or manipulating the target application on the display screen. Manipulating the target application on the display screen includes: touching the target function of the target application, or sliding the interface of the target application.

[0222] As an example, if the vehicle computer receives a touch operation based on the display screen, it generates corresponding touch data (opens the target application or controls the target application) according to the coordinates of the touch operation on the page displayed on the vehicle computer, and the coordinate mapping relationship between the page displayed on the vehicle computer and the page of the mobile terminal, and encodes and encapsulates the touch data.

[0223] S505: Send the encoded and packaged touch data to the mobile terminal.

[0224] The vehicle computer sends the encoded and packaged touch data to the mobile terminal, and the mobile terminal responds based on the touch data, thereby enabling the vehicle computer to return control to the mobile terminal.

[0225] The manner in which the vehicle terminal sends touch data to the mobile terminal is similar to that in the above step S502 , and the details may be referred to the above description, which will not be repeated here.

[0226] S506, receiving touch data, and responding to the touch data.

[0227] This step is run on the mobile terminal. After receiving the touch data, the mobile terminal responds to the touch data. For example, if the touch data is to open the target application, the target application is opened on the mobile terminal, or the target application is run in the background. Alternatively, if the touch data is to manipulate the target application, the target application on the mobile terminal is manipulated according to the operation instruction. For example, if the target application is a video player, and the manipulation of the target application is to switch the video, the video player on the mobile terminal is controlled to switch to the target video.

[0228] In this embodiment, the vehicle-machine end and the mobile terminal are interconnected. On the one hand, it is based on the short-distance communication between the vehicle-machine end and the mobile terminal. On the other hand, the vehicle-machine end and the mobile terminal are interconnected based on the server, and the server supports long-distance communication. The vehicle-machine end and the mobile terminal can adaptively select the corresponding interconnection method based on the distance. For example, when the distance between the vehicle-machine end and the mobile terminal is far or over the distance, the handcar interconnection can still be stably performed based on the server, overcoming the limitation in the related technology that the vehicle-machine end and the mobile terminal must be in the same local area network or in a very close distance to be interconnected. And the vehicle-machine end and the mobile terminal can adaptively select the first connection for interconnected data transmission when the distance is greater than the preset distance, and adaptively select the second connection for interconnected data transmission when the distance is less than or equal to the preset distance, so as to ensure the interconnection effect between the vehicle-machine end and the mobile terminal, and increase the use scenarios of the interconnection between the vehicle-machine end and the mobile terminal, and improve the interconnection effect.

[0229] Figure 6This is a flowchart of a handcart interconnection method provided by another embodiment of the present application. This embodiment is based on all the above embodiments. In this embodiment, the handcart interconnection method supports partial application screen projection on mobile terminals. Compared with full mirror screen projection, this embodiment can protect the privacy of mobile terminal users and prevent the screen from being projected to the vehicle terminal. This embodiment is described in detail with the specific implementation process of partial application screen projection. The handcart interconnection method includes:

[0230] S601, scanning all pages of the screen desktop, obtaining application information of all applications on the screen desktop, and associating and saving the applications and corresponding application information;

[0231] This step is run on the mobile terminal. The handcar interconnection application 1 of the mobile terminal has a scanning module for scanning application data. The mobile terminal scanning module scans all pages on the mobile terminal desktop and obtains application information of all applications on the desktop. The application information includes application icons, application names, and page coordinates where the applications are located.

[0232] After the application information is obtained by scanning, the application and the corresponding application information are associated and stored in the memory.

[0233] This step is to obtain all applications on the desktop of the mobile terminal and the location (distribution information) of the applications, etc. When the user selects some applications to be projected, some application information can be retrieved through the storage area, and then the application information can be projected to the car terminal to achieve partial application projection.

[0234] It is understandable that this step can be performed after the mobile terminal and the vehicle terminal are interconnected, or the scan can be started when entering the vehicle interconnection application 1. Alternatively, a screen projection type selection function can be set in the vehicle interconnection application 1, and the screen projection types include full mirror projection and partial application projection. When the user triggers the screen projection type selection function and selects partial application projection, this step is started to scan and obtain application information. This embodiment is not limited.

[0235] S602, in response to the screen projection operation of some applications on the vehicle machine, determining an application to be projected;

[0236] This step is performed on the mobile terminal. The hand-car interconnection application 1 of the mobile terminal provides an application selection interface for the user to select some applications. The user can select one or more applications based on the application selection interface, and the selected application is the application to be projected, which will be projected to the car terminal.

[0237] For example, the application selection interface provides all the applications on the desktop (including WeChat, navigation, video playback, phone, text messages, etc.). If the user selects "√" on the navigation and / or video playback icons, or selects the navigation or video playback application icon, WeChat and video playback will be the applications to be projected.

[0238] S603, obtaining screen projection application data based on application information corresponding to the screen projection application;

[0239] After the mobile terminal obtains the application to be projected selected by the user, it encapsulates the application information corresponding to the application to be projected into projection application data based on the data transmission method, so as to facilitate identification by the server or the vehicle terminal.

[0240] S604, sending screen projection application data to the vehicle terminal;

[0241] In this step, the interconnected data sent by the mobile terminal to the vehicle terminal is screen projection application data. The specific sending method is the same as above. Figure 5 The implementation of S502 in the embodiment is similar and will not be described in detail in this embodiment.

[0242] S605, receiving screen projection application data, and displaying the corresponding screen projection application according to the screen projection application data;

[0243] This step is applied to the vehicle side. After the vehicle side obtains the application that needs to be projected, it first decodes the data packet to obtain the accurate projection application icon and application name, and displays the icon and name on the vehicle desktop. In this way, part of the application is projected on the vehicle side.

[0244] S606, obtaining touch data according to the target application opening operation based on the display screen, and performing encoding and packaging processing on the touch data;

[0245] In this step, click the screen projection application icon on the vehicle terminal to open the screen projection application. The vehicle terminal encapsulates the application to be opened into control application data for easy recognition by the mobile terminal.

[0246] S607: Send the encoded and packaged touch data to the mobile terminal.

[0247] The specific implementation method of this step is the same as above. Figure 5 The implementation of S505 in the embodiment is similar and will not be described in detail in this embodiment.

[0248] S608, receiving the target application opening operation sent by the vehicle terminal, opening the target application to obtain the interconnected data after the target application is opened.

[0249] In this step, the interconnected data after the target application is opened is the screen data.

[0250] This step is executed on the mobile terminal. The mobile terminal receives the target application opening operation sent by the vehicle terminal, searches for the target application on the screen desktop based on the application information corresponding to the target application, and opens the target application. That is, the target application is found by the coordinates of the target application on the mobile phone page, and the operation of simulating clicking to open is performed to run the target application (it can be running in the background or not in the background).

[0251] After the target application is opened, the mobile terminal continues to obtain the screen data of the target application and continues to transmit the corresponding screen data to the vehicle terminal (the specific process can be referred to above). Figure 5 Embodiment shown).

[0252] In this embodiment, screen projection of some applications is supported, and users can selectively project specific applications or files to ensure the privacy and security of personal data.

[0253] Figure 7 This is a flowchart of a handcart interconnection method provided for another embodiment of the present application. This embodiment is based on all the above embodiments. In this embodiment, the handcart interconnection method supports multiple mobile terminals to be interconnected to a car terminal at the same time, and users can realize seamless switching of screen projection between different mobile terminals on the car terminal. The following takes mobile terminal A and mobile terminal B to be interconnected to a car terminal at the same time as an example to illustrate the implementation method of seamless switching of screen projection between mobile terminal A and mobile terminal B, such as Figure 7 As shown, the handcart interconnection method includes:

[0254] S701, mobile terminal A obtains interconnected data and encodes and encapsulates the interconnected data;

[0255] In this embodiment, the vehicle terminal has established interconnection with the mobile terminal A and the mobile terminal B through the server. The method of establishing interconnection can refer to the above Figure 4 In the illustrated embodiment, the server records the identity information of mobile terminal A and mobile terminal B during the process of establishing the interconnection between the vehicle terminal and mobile terminal A and mobile terminal B.

[0256] It should be noted that the interconnection solutions provided by related technologies usually only support one-to-one connection, that is, the vehicle terminal and the mobile terminal establish an independent connection. After the vehicle terminal and the mobile terminal establish a connection, other mobile terminals cannot connect to the vehicle terminal at the same time (for example, the vehicle terminal cannot be scanned). The established mobile terminal needs to be exited before other mobile terminals can establish a connection with the vehicle terminal, and the multi-mobile terminal preemption function cannot be realized. When switching between different mobile terminals, each time you need to exit the previous mobile terminal first, and then establish the mobile terminal to be connected later. The operation process is cumbersome and the user experience is poor.

[0257] In this embodiment, supporting multiple mobile terminals to be interconnected with a vehicle terminal at the same time means that: multiple mobile terminals can establish interconnection with the vehicle terminal at the same time. For example, after the vehicle terminal establishes interconnection with mobile terminal A, when it establishes interconnection with mobile terminal B, mobile terminal A does not need to exit the current interconnection, but maintains the interconnection between mobile terminal A and the vehicle terminal. When the user uses mobile terminal A to project the screen, the server stops sending the interconnection data of mobile terminal B to the mobile terminal. When the user uses mobile terminal B to project the screen, there is no need to re-establish the connection between mobile terminal B and the vehicle terminal. Instead, the server sends the interconnection data of mobile terminal B to the mobile terminal, and the server stops sending the interconnection data of mobile terminal A to the mobile terminal. In this way, it is possible to maintain the simultaneous interconnection of multiple mobile terminals with a vehicle terminal (without exiting the mobile terminal currently interconnected with the vehicle terminal first, and then establishing the interconnection between the vehicle terminal and other mobile terminals), and the server implements when switching the mobile terminal for projecting the screen, forwarding the interconnection data of the switched mobile terminal, so as to realize the seamless switching of the mobile terminal for projecting the screen.

[0258] In this step, assuming that the mobile terminal A is currently transmitting interconnected data with the vehicle terminal (that is, before this, the vehicle terminal and mobile terminal A are transmitting interconnected data), or after mobile terminal A and mobile terminal B are interconnected with the vehicle terminal, mobile terminal A is the terminal that sends interconnected data for the first time, then mobile terminal A is assumed to be the mobile terminal currently connected to the vehicle terminal. That is, in this step, the user selects mobile terminal A as the terminal for projecting the screen to the vehicle terminal. At this time, mobile terminal A obtains the interconnected data, encodes and encapsulates the interconnected data, and sends it to the vehicle terminal.

[0259] In this step, the mobile terminal obtains the interconnected data and processes the interconnected data in a manner similar to the above Figure 5 Example.

[0260] S702, mobile terminal A sends the encoded and encapsulated Internet data to the server;

[0261] Among them, step S702 and Figure 5 The implementation of step S502 in the embodiment is similar and will not be described in detail in this embodiment.

[0262] S703, the server compares the identity information of the mobile terminal A with the identity information of the mobile terminal currently connected to the vehicle terminal;

[0263] This step is run on the server. If the server receives multiple mobile terminal requests to establish interconnection with the same vehicle terminal, and the vehicle terminal is interconnected with multiple mobile terminals, then when the server receives the interconnection data of the mobile terminal corresponding to the vehicle terminal, it needs to compare the identity information of the mobile terminal with the identity information of the currently connected mobile terminal to confirm whether the user has switched the projection terminal.

[0264] S704, determining whether the identity information is consistent;

[0265] For example, if the currently connected mobile terminal is mobile terminal A, and if the mobile terminal sending the connected data is also mobile terminal A, it is determined that the projection terminal has not been changed; if the mobile terminal sending the connected data is mobile terminal B, it is determined that the projection terminal has been changed.

[0266] Optionally, the identity identification information is ID information of the mobile terminal.

[0267] S704, if the identity information is consistent, the interconnection data of mobile terminal A is sent to the vehicle terminal;

[0268] If the identity information is consistent, the projection terminal has not been changed. At this time, the interconnection data of mobile terminal A is directly sent to the vehicle terminal.

[0269] S706, the vehicle computer displays the interconnection data on the display screen;

[0270] While mobile terminal A continues to project the screen, steps S701 to S706 are executed in a loop.

[0271] 707, mobile terminal B obtains the interconnected data, and encodes and encapsulates the interconnected data;

[0272] If the user selects mobile terminal B for screen projection, mobile terminal B obtains and processes the interconnected data. The specific method of obtaining and processing the interconnected data is the same as that of the above-mentioned mobile terminal A, which will not be repeated here.

[0273] S708, mobile terminal B sends the encoded and encapsulated interconnected data to the server;

[0274] S709, the server compares the identity information of the mobile terminal B with the identity information of the mobile terminal currently connected to the vehicle terminal;

[0275] S710, determining whether the identity information is consistent;

[0276] S711, if the identity information is inconsistent, a request to change the projection terminal is sent to the vehicle terminal;

[0277] Since the projection terminal that sends the interconnected data is mobile terminal B, and the mobile terminal currently connected to the vehicle terminal is mobile terminal B, when the server determines the identity information, the determination result obtained is that the identity information is inconsistent. At this time, it can be determined that the projection terminal has been changed.

[0278] In some embodiments, the server can directly send the interconnection data of mobile terminal B to the vehicle terminal to directly implement the switching.

[0279] In some embodiments, since the vehicle terminal and the mobile terminal are interconnected through two connections, such as the first interconnection and the second interconnection, if the server directly sends the interconnection data of the mobile terminal B to the vehicle terminal, and the vehicle terminal is unaware that the user has changed the projection terminal, then the vehicle terminal can also receive the interconnection data of the mobile terminal A based on WiFi, resulting in the failure of the user to change the projection terminal.

[0280] Based on this, in this embodiment, when the server determines that the mobile terminal sending the interconnected data is inconsistent with the mobile terminal currently connected to the vehicle end, the server suspends receiving the interconnected data and suspends injecting the interconnected data into the first data queue, and at the same time sends a request to replace the projection terminal to the vehicle end, requesting the vehicle end to receive the interconnected data of the replaced projection terminal.

[0281] S712, sending a replacement confirmation message;

[0282] This step is applied to the vehicle side. After receiving the request to replace the projection terminal sent by the server, the vehicle side will feedback the replacement confirmation information to the server, informing the server that the vehicle side has been replaced synchronously and can send the interconnection data of the replaced projection terminal.

[0283] Optionally, the vehicle terminal can also output confirmation information based on the request to change the projection terminal, prompting to confirm the change request. When receiving the user's confirmation instruction, the change confirmation information is sent to the server.

[0284] Optionally, the confirmation information output by the vehicle terminal includes the projection terminal to be replaced, such as switching the projection of mobile terminal B, etc. The user can confirm whether the replaced projection terminal is correct based on the confirmation information. If it is correct, it will be replaced, and if it is incorrect, it will be corrected. In this way, the error of switching the projection terminal can be avoided.

[0285] S713, sending the interconnection data of mobile terminal B to the vehicle terminal.

[0286] This step runs on the server. After receiving the replacement confirmation information, the server sends the interconnection data of the switched mobile terminal B to the vehicle terminal and discards the interconnection data of the mobile terminal A, thus realizing seamless switching of the projection terminal.

[0287] For example, the interconnection data of mobile terminal B is input into the first data queue and sent to the vehicle terminal based on the first data queue. After the vehicle terminal receives the interconnection data, it displays the interconnection data on the display screen to complete the screen projection switching.

[0288] Optionally, in some examples, when the identity information is inconsistent, after the server sends a request to change the projection terminal to the vehicle terminal, the vehicle terminal may not respond to the request to change the projection terminal (for example, the user has not confirmed the change, etc.). In this scenario, in order to avoid the vehicle terminal not receiving the interconnected data for a long time and reducing the user experience, if the server does not receive the confirmation replacement information fed back by the vehicle terminal based on the request to change the projection terminal within the second preset time period, or receives the rejection information fed back by the vehicle terminal, the interconnected data sent by the currently connected mobile terminal (that is, mobile terminal A) will be sent to the vehicle terminal to ensure that the vehicle terminal can continue to receive the interconnected data, and send prompt information such as failure to switch the projection terminal to the mobile terminal to prompt the user.

[0289] S714, the server updates the identity information of the mobile terminal currently connected to the vehicle terminal to B.

[0290] That is to say, after switching to mobile terminal B for screen projection, the server records the currently connected mobile terminal on the vehicle side as B. Then, the next frame of interconnected data received is based on the identity information of mobile terminal B as the identity information of the currently connected mobile terminal, and is compared with the identity information of the mobile terminal sending the interconnected data, instead of being compared based on the identity information of mobile terminal A.

[0291] In this embodiment, the server supports multiple mobile terminals to be interconnected to the vehicle side at the same time, rather than a one-to-one interconnection mode; and when the user switches the currently projected mobile terminal A to mobile terminal B, the server can identify the identity information of the mobile terminal sending the interconnection data to determine whether the projection terminal has been switched. If switched, the vehicle side can be notified to change the projection terminal, and then the interconnection data of the replaced mobile terminal B is displayed on the vehicle side. This can ensure that in a scenario where multiple mobile terminals are interconnected at the same time, when the mobile terminal for projection is switched, the vehicle side can accurately receive the projection data of the switched mobile terminal, and multiple mobile terminals can be switched at any time. During the switching process, there is no need to re-establish the connection with the vehicle side, thereby achieving seamless switching, increasing the flexibility and practicality of use under multiple users or specific scenarios, and improving the user experience.

[0292] The present application also provides a handcart interconnection device, the device comprising:

[0293] A data acquisition unit, used for acquiring screen data;

[0294] A first data processing unit, used for encoding and packaging screen data;

[0295] The first data processing unit is also used to determine whether the distance between the vehicle and the vehicle terminal is greater than a preset distance;

[0296] The first data transmission unit is used to send the screen data after encoding and packaging to the vehicle terminal based on the first connection when the distance is greater than the preset distance. The first connection is a connection with the vehicle terminal based on the server.

[0297] Optionally, the trolley interconnection device in this embodiment is applied to a mobile terminal.

[0298] The trolley interconnection device provided in the embodiment of the present application can execute the above method embodiment. Its specific implementation principle and technical effects can be found in the above method embodiment, and this embodiment will not be repeated here.

[0299] The present application also provides a handcart interconnection device, the device comprising:

[0300] A second data transmission unit, used to send second connection data to the server, the second connection data including vehicle terminal network status information and vehicle terminal identification code;

[0301] The output module is used to receive a connection code generated by the server based on the second connection data, and output the connection code.

[0302] Optionally, the output module is a display module or a display screen.

[0303] Optionally, in this embodiment, the handcart interconnection device is applied to the vehicle computer end.

[0304] The trolley interconnection device provided in the embodiment of the present application can execute the above method embodiment. Its specific implementation principle and technical effects can be found in the above method embodiment, and this embodiment will not be repeated here.

[0305] The present application also provides a handcart interconnection device, the device comprising:

[0306] A third data sending module is used to receive the data to be processed and determine the data type of the data to be processed, where the data type of the data to be processed includes connection data and interconnection data;

[0307] A connection building module, used for establishing a first connection between the mobile terminal and the vehicle terminal according to the data to be processed if the data type of the data to be processed is connection data;

[0308] The third data receiving module is further used to send the interconnected data sent by the mobile terminal to the vehicle terminal if the data type of the data to be processed is interconnected data, and / or send the interconnected data of the vehicle terminal to the mobile terminal.

[0309] Optionally, in this embodiment, the trolley interconnection device is applied to the server.

[0310] The trolley interconnection device provided in the embodiment of the present application can execute the above method embodiment. Its specific implementation principle and technical effects can be found in the above method embodiment, and this embodiment will not be repeated here.

[0311] like Figure 8 As shown, the embodiment of the present application further provides an electronic device, including: a processor 801, a memory 802; optionally, the electronic device 800 further includes a communication component 803. The processor 801, the memory 802 and the communication component 803 are connected via a CAN bus.

[0312] The memory 802 is used to store computer programs / instructions; the processor 801 is used to execute the computer programs / instructions stored in the memory to implement the methods involved in the above embodiments.

[0313] The electronic device 800 also includes a communication interface, wherein the processor is used to provide computing power and control capabilities, and can be a GPU, CPU, NPU, MCU, FPGA, etc. The storage device includes an internal memory and a non-volatile memory. The non-volatile memory stores a computer program that implements the above method. The internal memory provides an environment for program startup and operation. The communication interface is used to communicate with an external terminal by wire or wireless.

[0314] In this embodiment, the electronic device may be an electronic component in a car, or may be a car. Alternatively, the electronic device may be a mobile terminal.

[0315] The present invention also provides a computer-readable storage medium / computer program product, in which computer control instructions are stored / the computer program product includes computer control instructions, and when the computer control instructions are executed by a processor, they are used to implement the methods involved in the above-mentioned embodiments.

[0316] The above embodiments are only preferred embodiments for fully illustrating the present invention, and the protection scope of the present invention is not limited thereto. Any equivalent substitution or change made by a person skilled in the art based on the present invention is within the protection scope of the present invention.

Claims

1. A trolley interconnection method, characterized in that: Applied to mobile terminals, including: Acquire interconnected data, and encode and encapsulate the interconnected data; Get the distance to the vehicle terminal; According to the distance, the first connection or the second connection is selected to send the interconnection data after encoding and encapsulation to the vehicle terminal to complete the interconnection with the vehicle terminal, wherein the connection paths of the first connection and the second connection are different.

2. The method according to claim 1, characterized in that The method of selecting the first connection or the second connection according to the distance to send the interconnection data processed by encoding and encapsulation to the vehicle terminal to complete the interconnection with the vehicle terminal includes: When the distance is greater than the preset distance, the interconnection data after the encoding and encapsulation processing is sent to the vehicle terminal based on the first connection, and the interconnection with the vehicle terminal is completed; When the distance is less than or equal to the preset distance, the interconnection data after the encoding and encapsulation processing is sent to the vehicle terminal based on the second connection, and the interconnection with the vehicle terminal is completed; Among them, the first connection is a connection with the vehicle terminal based on a server; the second connection is a connection with the vehicle terminal based on short-range communication.

3. The method according to claim 2, characterized in that When the distance is less than or equal to the preset distance, sending the encoded and packaged interconnected data to the vehicle terminal based on the second connection, including: When the distance is less than or equal to a preset distance, obtaining a signal strength of the second connection; If the signal strength is greater than or equal to a preset threshold, sending the encoded and encapsulated interconnection data to the vehicle terminal based on the second connection; If the signal strength is less than the preset threshold, the interconnected data that has been encoded and packaged is sent to the vehicle terminal based on the first connection.

4. The method according to claim 1, characterized in that: The interconnected data includes screen data, and the acquiring of the interconnected data includes: Based on the recording function, the audio and video images displayed on the screen are recorded in real time to obtain the screen data; Alternatively, in the screen-off state, based on the off-screen rendering function, the screen desktop application and / or the running application interface are rendered to obtain the screen data.

5. The method according to claim 1, characterized in that The interconnected data includes screen projection application data, and the obtaining of the interconnected data includes: In response to the screen projection operation of some applications on the vehicle machine, determine the application to be projected; Based on the application information corresponding to the application to be projected, the projection application data is obtained; After the projection application data is sent to the vehicle terminal, it also includes: Receive the target application opening operation sent by the vehicle terminal, open the target application, and obtain screen data after the target application is opened.

6. The method according to any one of claims 1 to 5, characterized in that: Before obtaining the interconnected data, the method further includes: Sending first connection data to the server, wherein the first connection data includes identity information of the mobile terminal, display information of the mobile terminal, and a connection code of the vehicle terminal to be connected; Receive interconnection success information after the server successfully verifies the first connection data, and complete the connection between the server and the vehicle terminal.

7. A trolley interconnection method, characterized in that: Applied to the vehicle side, including: Sending second connection data to the server, wherein the second connection data includes network status information of the vehicle terminal and an identification code of the vehicle terminal; A connection code generated by the server based on the second connection data is received, and the connection code is output, so that the mobile terminal requests interconnection and verification from the server after obtaining the connection code.

8. The method according to claim 7, characterized in that After the connection code is displayed on the display screen, the method further includes: Receiving the interconnection review request sent by the server and checking the current network status; If the current network status meets the interconnection requirements, a confirmation message is sent to the server, and the second connection mode is established.

9. The method according to claim 7 or 8, characterized in that: The method further comprises: Receiving interconnected data from a mobile terminal, and displaying the interconnected data on a display screen, wherein the interconnected data includes screen projection application data and screen data; In response to a touch operation corresponding to the interconnected data displayed on the display screen, obtaining touch data; According to the distance between the touch terminal and the mobile terminal, the first connection or the second connection is selected to send the touch data to the mobile terminal.

10. A trolley interconnection method, characterized in that: Applied to the server side, including: Receiving data to be processed, and determining a data type of the data to be processed, wherein the data type of the data to be processed includes connection data and interconnection data; If the data type of the data to be processed is connection data, establishing a first connection between the mobile terminal and the vehicle terminal according to the data to be processed; If the data type of the data to be processed is interconnected data, the interconnected data sent by the mobile terminal is sent to the vehicle terminal, and / or the interconnected data of the vehicle terminal is sent to the mobile terminal.

11. The method according to claim 10, characterized in that If the data type of the data to be processed is connection data, establishing a first connection between the mobile terminal and the vehicle terminal according to the data to be processed includes: If the data to be processed is the second connection data sent by the vehicle terminal, generating a connection code according to the second connection data; Sending the connection code to the vehicle terminal; receiving first connection data sent by the mobile terminal, and verifying the mobile terminal according to the first connection data, wherein the first connection data includes the connection code; If the verification is successful, sending an interconnection verification request to the vehicle terminal, and upon receiving confirmation information fed back by the vehicle terminal based on the interconnection verification request, establishing a first connection between the mobile terminal and the vehicle terminal; If the verification fails, or the confirmation information fed back by the vehicle machine based on the interconnection review request is not received within the first preset time period, a connection failure information is sent to the mobile terminal.

12. The method according to claim 10, characterized in that The server establishes a first connection between the vehicle terminal and at least two of the mobile terminals, and the interconnection data sent by the mobile terminal is sent to the vehicle terminal, including: Comparing the identity information of the mobile terminal included in the interconnection data with the identity information of the mobile terminal currently interconnected with the vehicle terminal, wherein the interconnection data includes the identity information of the corresponding mobile terminal; If the identity information is consistent, the interconnection data is sent to the vehicle terminal; If the identity information is inconsistent, a request to change the projection terminal is sent to the vehicle terminal; After receiving the confirmation replacement information fed back by the vehicle terminal based on the request to replace the projection terminal, the interconnection data is sent to the vehicle terminal.

13. The method according to claim 12, characterized in that If the identity information is inconsistent, after sending a request to change the projection terminal to the vehicle terminal, the method further includes: If no confirmation change information is received from the vehicle terminal based on the request to change the projection terminal within the second preset time period, or if no rejection information is received from the vehicle terminal, the interconnected data sent by the currently connected mobile terminal will be sent to the vehicle terminal.

14. The method according to any one of claims 10 to 13, characterized in that The step of sending the interconnected data sent by the mobile terminal to the vehicle terminal includes: Determining display information corresponding to the interconnected data according to the identity information of the mobile terminal contained in the interconnected data; The interconnection data is processed according to the display information, and the processed interconnection data is sent to the vehicle machine end.

15. A trolley interconnection system, characterized in that: include: Car terminal, mobile terminal and server; The mobile terminal is used to execute the method described in any one of claims 1 to 6 above; The vehicle terminal is used to execute the method described in any one of claims 7 to 9 above; The server is used to execute the method described in any one of claims 10 to 14 above.

16. A trolley interconnection device, characterized in that: The device comprises: A data acquisition unit, used for acquiring screen data; A first data processing unit, used for encoding and packaging the screen data; The first data processing unit is also used to determine the distance to the vehicle terminal; The first data transmission unit is used to select the first connection or the second connection according to the distance to send the interconnection data after encoding and packaging to the vehicle end, so as to complete the interconnection with the vehicle end, wherein the connection paths of the first connection and the second connection are different.

17. A trolley interconnection device, characterized in that: The device comprises: A second data transmission unit, used to send second connection data to the server, wherein the second connection data includes vehicle terminal network status information and a vehicle terminal identification code; The output module is used to receive the connection code generated by the server based on the second connection data, and output the connection code, so that the mobile terminal requests the server for interconnection and verification after obtaining the connection code.

18. A trolley interconnection device, characterized in that: The device comprises: A third data sending module is used to receive the data to be processed and determine the data type of the data to be processed, where the data type of the data to be processed includes connection data and interconnection data; A connection building module, configured to establish a first connection between the mobile terminal and the vehicle terminal according to the data to be processed if the data type of the data to be processed is connection data; The third data receiving module is further used to send the interconnected data sent by the mobile terminal to the vehicle terminal if the data type of the data to be processed is interconnected data, and / or send the interconnected data of the vehicle terminal to the mobile terminal.

19. An electronic device, characterized in that: include: Memory, processor; The memory is used to store computer programs; The processor is used to execute the method of any one of claims 1 to 6, or the method of any one of claims 7 to 9, or the method of any one of claims 10 to 14 according to the computer program stored in the memory.

20. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, it is used to perform the method according to any one of claims 1 to 14.

Images