Screen projection method and device based on virtual screen

Abstract

The present application provides a screen projection method and device based on a virtual screen. After the terminal establishes a connection with the vehicle-side, a first virtual layer corresponding to the identifier of the application supporting screen projection in the terminal and a second virtual layer corresponding to the application information are generated on the virtual screen interface, and the first data corresponding to the first virtual layer is sent to the vehicle-side to display the identifier corresponding to the first virtual layer on the vehicle-side. Then, a data request sent by the vehicle-side is received, and the second data of the second virtual layer of the application corresponding to the identifier in the data request is sent to the vehicle-side to display the application information on the vehicle-side. In this way, the terminal simulates the identifier and information of the application supporting screen projection on the virtual screen interface, and sends the simulated data to the vehicle-side, so as to quickly display the rich application information in the terminal on the vehicle-side through the virtual screen technology, thereby improving the capabilities of the infotainment host on the vehicle-side.

Description

Technical Field

[0001] The present application relates to the field of vehicle technology, and in particular to a screen projection method and device based on a virtual screen. Background Art

[0002] With the development of society, terminals play an increasingly important role in people's lives. Terminals have a large amount of user data and user usage habits information, such as audio and video files that users like stored in mobile phones.

[0003] How to use the advantages of the terminal to expand the capabilities of the IHU (Infotainment Head Unit) on the vehicle side is becoming increasingly important. Summary of the invention

[0004] The present application provides a screen projection method and device based on a virtual screen to improve the capabilities of an infotainment host on a vehicle side.

[0005] In a first aspect, the present application provides a screen projection method based on a virtual screen, the method being used in a terminal, comprising:

[0006] After establishing a connection with the vehicle terminal, a first virtual layer corresponding to the identifier of the application supporting screen projection in the terminal and a second virtual layer corresponding to the information of the application are generated on the virtual screen interface;

[0007] Sending first data corresponding to the first virtual layer to the vehicle computer end, so as to display a logo corresponding to the first virtual layer on the vehicle computer end;

[0008] A data request sent by the vehicle terminal is received, and second data of a second virtual layer of an application corresponding to the identifier in the data request is sent to the vehicle terminal, so as to display information of the application on the vehicle terminal.

[0009] Optionally, the receiving a data request sent by the vehicle terminal, and sending the second data of the second virtual layer of the application corresponding to the identifier in the data request to the vehicle terminal specifically includes:

[0010] Detect changes in the second virtual layer of each application in the virtual screen interface, and after receiving a data request sent by the vehicle computer, send the change data of the second virtual layer of the application corresponding to the identifier in the data request to the vehicle computer.

[0011] Optionally, the receiving a data request sent by the vehicle terminal, and sending the second data of the second virtual layer of the application corresponding to the identifier in the data request to the vehicle terminal, so as to display the information of the application on the vehicle terminal, specifically includes:

[0012] Receiving a video data request sent by the vehicle terminal, and sending video data of a video virtual layer of a video application corresponding to an identifier in the video data request to the vehicle terminal, so as to display a video of the video application on the vehicle terminal;

[0013] Or, receive an audio data request sent by the vehicle terminal, and send the audio data of the audio virtual layer of the audio application corresponding to the identifier in the audio data request to the vehicle terminal, so as to display the audio of the audio application on the vehicle terminal.

[0014] Optionally, the method further includes:

[0015] Receiving a connection request sent by the vehicle terminal and establishing a connection with the vehicle terminal;

[0016] Or, send a connection request to the vehicle terminal to establish a connection with the vehicle terminal.

[0017] Optionally, sending the second data of the second virtual layer of the application corresponding to the identifier in the data request to the vehicle machine side specifically includes:

[0018] Obtaining the first coordinate of the display interface of the vehicle terminal identified in the data request;

[0019] Acquire a second coordinate corresponding to the first coordinate and an application corresponding to the second coordinate according to a correspondence between the first coordinate of the identifier and the second coordinate of the first virtual layer;

[0020] The second data of the second virtual layer of the application corresponding to the second coordinate is sent to the vehicle machine end.

[0021] Optionally, sending the second data of the second virtual layer of the application corresponding to the identifier in the data request to the vehicle machine side specifically includes:

[0022] A volume request in the data request is obtained, the volume of the second data of the second virtual layer of the application corresponding to the identifier in the data request is adjusted according to the volume request, and the adjusted second data is sent to the vehicle terminal.

[0023] In a second aspect, the present application provides a screen projection method based on a virtual screen, the method being used on a vehicle terminal, comprising:

[0024] After establishing a connection with a terminal, receiving first data corresponding to a first virtual layer sent by the terminal, and displaying an identifier corresponding to the first virtual layer, where the first virtual layer is a virtual layer corresponding to an identifier of an application supporting screen projection generated by the terminal on a virtual screen interface;

[0025] Send a data request to the terminal, receive second data of a second virtual layer of an application corresponding to the identifier in the data request sent by the terminal, and display the information of the application, wherein the second virtual layer is a virtual layer corresponding to the information of the application generated by the terminal on the virtual screen interface.

[0026] Optionally, the sending a data request to the terminal specifically includes:

[0027] In response to a touch screen operation, an identifier corresponding to the touch screen operation is added to a data request, and the data request is sent to the terminal.

[0028] Optionally, adding an identifier corresponding to the touch screen operation to the data request specifically includes:

[0029] The first coordinate of the mark corresponding to the touch screen operation on the display interface of the vehicle terminal is added to the data request.

[0030] In a third aspect, the present application provides a screen projection device based on a virtual screen, comprising:

[0031] A generation module, used for generating, on a virtual screen interface, a first virtual layer corresponding to an identifier of an application supporting screen projection in the terminal and a second virtual layer corresponding to information of the application after establishing a connection with the vehicle terminal;

[0032] A first sending module, used for sending first data corresponding to the first virtual layer to the vehicle terminal, so as to display a logo corresponding to the first virtual layer on the vehicle terminal;

[0033] The second sending module is used to receive the data request sent by the vehicle terminal, and send the second data of the second virtual layer of the application corresponding to the identifier in the data request to the vehicle terminal, so as to display the information of the application on the vehicle terminal.

[0034] In a fourth aspect, the present application provides a screen projection device based on a virtual screen, comprising:

[0035] A first display module is used to receive first data corresponding to a first virtual layer sent by the terminal after establishing a connection with the terminal, and display an identifier corresponding to the first virtual layer, where the first virtual layer is a virtual layer corresponding to an identifier of an application supporting screen projection generated by the terminal on a virtual screen interface;

[0036] A second display module is used to send a data request to the terminal, receive second data of a second virtual layer of an application corresponding to the identifier in the data request sent by the terminal, and display information of the application, where the second virtual layer is a virtual layer corresponding to the information of the application generated by the terminal on the virtual screen interface.

[0037] In a fifth aspect, the present application provides an electronic device, including: a memory and a processor;

[0038] The memory is used to store instructions; the processor is used to call the instructions in the memory to execute the first aspect and the virtual screen projection method in any possible design of the first aspect or the second aspect and the virtual screen projection method in any possible design of the second aspect.

[0039] In a sixth aspect, the present application provides a computer-readable storage medium, which stores computer instructions. When at least one processor of an electronic device executes the computer instructions, the electronic device executes the virtual screen-based screen projection method in the first aspect and any possible design of the first aspect, or the virtual screen-based screen projection method in the second aspect and any possible design of the second aspect.

[0040] In the seventh aspect, the present application provides a computer program product, which includes computer instructions. When at least one processor of an electronic device executes the computer instructions, the electronic device executes the virtual screen-based screen projection method in the first aspect and any possible design of the first aspect, or the virtual screen-based screen projection method in the second aspect and any possible design of the second aspect.

[0041] The screen projection method based on a virtual screen provided in the present application, after the terminal establishes a connection with the vehicle-side, generates a first virtual layer corresponding to the identifier of the application that supports screen projection in the terminal and a second virtual layer corresponding to the application information on the virtual screen interface, and sends the first data corresponding to the first virtual layer to the vehicle-side to display the identifier corresponding to the first virtual layer on the vehicle-side. Then, a data request sent by the vehicle-side is received, and the second data of the second virtual layer of the application corresponding to the identifier in the data request is sent to the vehicle-side to display the application information on the vehicle-side. In this way, the terminal simulates the identifier and information of the application that supports screen projection on the virtual screen interface, and sends the simulated data to the vehicle-side, so as to quickly display the rich application information in the terminal on the vehicle-side through the virtual screen technology, thereby improving the capabilities of the infotainment host on the vehicle-side. BRIEF DESCRIPTION OF THE DRAWINGS

[0042] In order to more clearly illustrate the technical solutions in the present application or the prior art, a brief introduction will be given below to the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0043] Figure 1 A schematic diagram of a scenario of a screen projection method based on a virtual screen provided in an embodiment of the present application;

[0044] Figure 2 A flowchart of a screen projection method based on a virtual screen provided in one embodiment of the present application;

[0045] Figure 3 A signaling interaction diagram of a screen projection method based on a virtual screen provided in one embodiment of the present application;

[0046] Figure 4 A flowchart of another screen projection method based on a virtual screen provided in an embodiment of the present application;

[0047] Figure 5 A schematic diagram of the structure of a screen projection device based on a virtual screen provided in one embodiment of the present application;

[0048] Figure 6 A schematic diagram of the structure of another screen projection device based on a virtual screen provided in an embodiment of the present application;

[0049] Figure 7 A schematic diagram of the hardware structure of an electronic device provided in one embodiment of the present application. DETAILED DESCRIPTION

[0050] In order to make the purpose, technical solutions and advantages of this application clearer, the technical solutions in this application will be clearly and completely described below in conjunction with the drawings in this application. Obviously, the described embodiments are part of the embodiments of this application, not all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0051] With the development of society, terminals play an increasingly important role in people's lives. Terminals have a large amount of user data and information about user usage habits. For example, mobile phones store users' favorite audio and video. How to use the advantages of terminals to expand the capabilities of the car's infotainment host is becoming increasingly important.

[0052] In response to the above problems, the present application proposes a screen projection method based on a virtual screen. After the terminal establishes a connection with the vehicle-side, a first virtual layer corresponding to the identifier of the application that supports screen projection in the terminal and a second virtual layer corresponding to the information of the application that supports screen projection are generated on the virtual screen interface, and the first data corresponding to the first virtual layer is sent to the vehicle-side, so that the identifier corresponding to the first virtual layer is displayed on the vehicle-side, that is, the identifier of the application that supports screen projection is displayed. After the vehicle-side displays the identifier of the application that supports screen projection, it can respond to the touch screen operation of the identifier, and send a data request to the terminal after receiving the touch screen operation. The terminal sends the second data of the second virtual layer of the application corresponding to the identifier in the data request to the vehicle-side, and the vehicle-side can display the information of the application corresponding to the second virtual layer, thereby displaying rich information in the application and improving the capabilities of the infotainment host on the vehicle-side.

[0053] The technical solution of the present application is described in detail with specific embodiments below. The following specific embodiments can be combined with each other, and the same or similar concepts or processes may not be described in detail in some embodiments.

[0054] Figure 1 A scene schematic diagram of a screen projection method based on a virtual screen provided by an embodiment of the present application is shown. After receiving a connection request from the vehicle terminal 102, the terminal 101 establishes a connection with the vehicle terminal 102. Then, the terminal 101 generates a first virtual layer corresponding to the identifier of the application supporting screen projection in the terminal 101 and a second virtual layer corresponding to the application information on the virtual screen interface. After generating the first virtual layer corresponding to the identifier of the application, the terminal 101 sends the first data corresponding to the first virtual layer to the vehicle terminal 102. After receiving the first data corresponding to the first virtual layer, the vehicle terminal 102 displays the identifier corresponding to the first virtual layer. After receiving a touch screen operation on the identifier, the vehicle terminal 102 sends a data request to the terminal 101. After receiving the data request, the terminal 101 sends the second data of the second virtual layer of the application corresponding to the identifier in the data request to the vehicle terminal 102. After receiving the second data corresponding to the second virtual layer, the vehicle terminal 102 displays the application information.

[0055] Figure 2 A flowchart of a screen projection method based on a virtual screen provided by an embodiment of the present application is shown. Figure 1 Based on the embodiment shown, Figure 2 As shown, with the terminal as the execution subject, the method of this embodiment may include the following steps:

[0056] S101. After establishing a connection with the vehicle terminal, a first virtual layer corresponding to the identifier of the application supporting screen projection in the terminal and a second virtual layer corresponding to the application information are generated on the virtual screen interface.

[0057] The terminal can receive a connection request from the vehicle terminal, and establish a connection with the vehicle terminal according to the connection request. The terminal can also send a connection request to the vehicle terminal, so that the vehicle terminal establishes a connection with the terminal after receiving the connection request. For example, the terminal receives a connection request sent by the vehicle terminal via Bluetooth or wifi, or sends a connection request to the vehicle terminal via Bluetooth, wifi or QR code scanning. Therefore, when it is necessary to establish a connection between the terminal and the vehicle terminal, a connection request can be sent to the vehicle terminal through the terminal, or a connection can be sent to the terminal through the vehicle terminal, thereby quickly establishing a connection between the terminal and the vehicle terminal. The terminal is, for example, a mobile phone, a tablet computer, etc.

[0058] In a specific application, after receiving the connection request from the vehicle, the terminal can first verify the authentication information carried in the connection request, and after the verification is passed, a distributed network (socket) is established through wifi p2p and connected to the vehicle. The distributed network includes multiple transmission channels, such as video channels, audio channels, etc. After receiving the connection request from the terminal, the vehicle can first verify the authentication information carried in the connection request, and after the verification is passed, a connection with the terminal is established. The authentication information includes, for example, a login name and a password.

[0059] Since the terminal includes applications that support screen projection and applications that do not support screen projection, applications that support screen projection include video applications, audio applications, etc., and applications that do not support screen projection include game applications, office applications, etc. The information of applications that support screen projection can be displayed on the vehicle side, and the information of applications that do not support screen projection cannot be displayed on the vehicle side, so it is necessary to obtain applications that support screen projection in the terminal. The terminal can use the PackageManagerService service of the query system to find all applications that support screen projection. In some embodiments, after the terminal establishes a connection with the vehicle side, it can search for applications that support screen projection before creating a virtual screen interface, or it can search for applications that support screen projection after creating the virtual screen interface.

[0060] Generate a first virtual layer corresponding to the identifier of the application that supports screen projection in the terminal and a second virtual layer corresponding to the information of the application on the virtual screen interface. Simulate the layer of the identifier of the application that supports screen projection on the virtual screen interface to generate the first virtual layer, and also simulate the layer of the information of the application that supports screen projection to generate the second virtual layer. For example, if the application is a video application, simulate the layer of the video image in the video application to generate a video virtual layer. For example, if the application is an audio application, simulate the layer of the audio image in the audio application to generate an audio virtual layer.

[0061] S102: Send first data corresponding to the first virtual layer to the vehicle computer end, so as to display a logo corresponding to the first virtual layer on the vehicle computer end.

[0062] The terminal generates a first virtual layer corresponding to the application identifier that supports screen projection on the virtual screen interface, but the identifier corresponding to the first virtual layer cannot be displayed on the terminal. The terminal displays the identifiers of all applications, that is, the identifiers of applications that support screen projection and the identifiers of applications that do not support screen projection. If the identifier corresponding to the first virtual layer can be displayed on the terminal, duplicate identifiers will appear on the terminal, causing confusion. Therefore, the first data corresponding to the first virtual layer generated on the virtual screen interface is sent to the vehicle end, so that the identifier corresponding to the first virtual layer is displayed on the vehicle end, that is, the identifier of the application that supports screen projection is displayed on the vehicle end.

[0063] S103, receiving a data request sent by the vehicle computer, and sending the second data of the second virtual layer of the application corresponding to the identifier in the data request to the vehicle computer, so as to display information corresponding to the application on the vehicle computer.

[0064] The vehicle terminal displays the logo of the application that can be projected and can receive touch screen operations on the logo. The touch screen operation is a click operation on the logo displayed on the vehicle terminal, which can be understood as an operation to obtain information of the application corresponding to the logo. After receiving the touch screen operation on the logo, the vehicle terminal can respond to the touch screen operation, send a data request to the vehicle terminal, and place the logo corresponding to the touch screen operation in the data request.

[0065] After receiving the data request sent by the vehicle terminal, the terminal obtains the identifier in the data request and sends the second data of the second virtual layer of the application corresponding to the identifier to the vehicle terminal. Since the application information includes multiple layers, the second virtual layer is a layer of information simulated on the virtual screen interface, and thus the second data corresponding to the second virtual layer is sent to the vehicle terminal, the information of the application corresponding to the second virtual layer can be displayed on the vehicle terminal, that is, the information of the application that supports screen projection can be displayed on the vehicle terminal.

[0066] In some embodiments, the application that supports screen projection may include multiple information, and the second virtual layer corresponding to each information can be continuously generated on the virtual screen interface. Each time a second virtual layer of information is generated on the virtual screen interface, the second virtual layer of the application on the virtual screen interface increases. Therefore, the second virtual layer of the application on the virtual screen interface can be variable. The change of the second virtual layer can continuously increase the information displayed on the vehicle side, thereby improving the capabilities of the infotainment host and meeting user needs. The terminal can periodically detect the changes in the second virtual layer of each application in the virtual interface, and after receiving the data request sent by the vehicle side, send the change data of the second virtual layer of the application corresponding to the identifier in the data request to the vehicle side, so that more information can be displayed on the vehicle side, improving the capabilities of the infotainment host.

[0067] As an implementation method, the data request may include a video data request. After receiving the touch screen operation for the identification of the video application, the vehicle terminal sends the video data request to the vehicle terminal. After receiving the video data request, the vehicle terminal obtains the identification carried in the video data request, and sends the video data of the video virtual layer of the video application corresponding to the identification to the vehicle terminal through the video channel in the distributed network. After receiving the video data corresponding to the video virtual layer, the vehicle terminal displays the video corresponding to the video virtual layer, that is, displays the video in the video application.

[0068] As another implementation method, the data request may include an audio data request. After receiving the touch screen operation for the identifier of the audio application, the vehicle terminal sends the audio data request to the vehicle terminal. After receiving the audio data request, the vehicle terminal obtains the identifier carried in the audio data request, and sends the audio data of the audio virtual layer of the audio application corresponding to the identifier to the vehicle terminal through the audio channel in the distributed network. After receiving the audio data corresponding to the audio virtual layer, the vehicle terminal displays the audio corresponding to the audio virtual layer, that is, displays the audio in the audio application, such as playing music and songs in the audio application.

[0069] It should be noted that when the vehicle terminal displays the information corresponding to the second virtual layer, that is, the information in the application, the vehicle terminal cannot display the information of the application, but can display the information of other applications to avoid repeatedly displaying the same information and save resources.

[0070] The virtual screen interface cannot display the logo of the application, and a first virtual layer corresponding to the logo can be generated. Since multiple logos of applications that support screen projection can be generated on the virtual screen interface, a coordinate system can be established on the virtual screen interface, and each first virtual layer can be assigned a corresponding coordinate, so as to distinguish the first virtual layers corresponding to each logo on the virtual screen interface. At the same time, a coordinate system can be established on the display interface of the vehicle terminal. The logo of the application displayed on the display interface has corresponding coordinates. The coordinate system on the virtual screen interface corresponds to the coordinate system on the display interface of the vehicle terminal. Then, the coordinates corresponding to the first virtual layer corresponding to a logo on the virtual screen interface correspond to the coordinates of the logo on the display interface.

[0071] Therefore, the correspondence between the first coordinate of the identifier on the display interface of the vehicle terminal and the second coordinate of the first virtual layer corresponding to the identifier on the virtual screen interface can be established in advance, that is, the correspondence between the first coordinate of the identifier and the second coordinate of the first virtual layer is established. Therefore, after receiving the data request, the identifier carried in the data request and the first coordinate of the identifier on the display interface of the vehicle terminal can be obtained, and the second coordinate corresponding to the first coordinate is obtained according to the correspondence between the first coordinate of the identifier and the second coordinate of the first virtual layer. Since the second coordinate is the coordinate of the first virtual layer on the virtual screen interface, and the first virtual layer is the virtual layer of the identifier of the application, the corresponding application can be obtained according to the second coordinate. Therefore, after receiving the data request, the first coordinate of the identifier carried in the data request on the display interface of the vehicle terminal is obtained, the corresponding second coordinate is obtained according to the first coordinate, and the first virtual layer corresponding to the second coordinate is obtained, and the second data of the second virtual layer of the application corresponding to the first virtual layer is sent to the vehicle terminal. Therefore, it is possible to accurately know which application information needs to be obtained according to the coordinates of the identifier in the data request, and send the data corresponding to the second virtual layer of the application to the vehicle terminal to display the information of the application on the vehicle terminal.

[0072] In some embodiments, since the application can be a video application or an audio application, the video in the video application and the audio in the audio application have volume requirements. Therefore, after receiving the key request sent by the user, the vehicle terminal can respond to the key request, and the data request sent to the terminal carries the volume request corresponding to the key request. When the key request indicates to lower the volume, the volume request indicates to lower the volume. When the key request indicates to increase the volume, the volume request indicates to increase the volume. After receiving the data request, the terminal obtains the volume request and the identifier in the data request, and adjusts the volume of the second data of the second virtual layer of the application corresponding to the identifier in the data request according to the volume request. The volume of the second data is related to the volume of the information of the application displayed on the vehicle terminal. For example, the larger the volume of the second data, the larger the volume of the information of the application displayed on the vehicle terminal. Then, the terminal sends the adjusted second data to the vehicle terminal, so that the vehicle terminal displays the information of the application according to the adjusted second data, thereby improving the user experience.

[0073] The virtual screen-based screen projection method provided in the present application enables the terminal to simulate the logo and information of applications that support screen projection on the virtual screen interface, and quickly display the rich application information in the terminal on the vehicle side through the virtual screen technology, thereby improving the capabilities of the infotainment host on the vehicle side.

[0074] Figure 3 FIG. 1 is a flowchart of a screen projection method based on a virtual screen provided by an embodiment of the present application. Figure 3 As shown, the method of this embodiment may include the following steps:

[0075] S201, the vehicle terminal sends a connection request.

[0076] The vehicle computer sends a connection request to the terminal via Bluetooth, WiFi, etc. The connection request is used to request to establish a connection with the terminal.

[0077] S202: The terminal responds to the connection request and establishes a connection with the vehicle computer.

[0078] After receiving the connection request sent by the vehicle computer, the terminal responds to the connection request and establishes a connection with the vehicle computer.

[0079] S203: The terminal generates, on the virtual screen interface, a first virtual layer corresponding to the identifier of the application supporting screen projection in the terminal and a second virtual layer corresponding to the application information.

[0080] After the terminal establishes a connection with the vehicle terminal, a virtual screen interface is created and the identification of the application that supports screen projection in the terminal is obtained, and a first virtual layer corresponding to the identification of the application that supports screen projection and a second virtual layer corresponding to the identification of the application that supports screen projection are generated on the virtual screen interface.

[0081] S204. The terminal sends the first data corresponding to the first virtual layer to the vehicle computer.

[0082] After generating the first virtual layer of the identification of the application supporting screen projection, the terminal sends the first data corresponding to the first virtual highlight to the vehicle terminal.

[0083] S205: The vehicle computer displays a logo corresponding to the first virtual layer.

[0084] After receiving the first data corresponding to the first virtual layer, the vehicle computer displays the logo corresponding to the first virtual layer on the display interface.

[0085] S206: The vehicle computer responds to the touch screen operation of the logo and sends a data request to the terminal.

[0086] After receiving the touch screen operation on the identifier, the vehicle computer responds to the touch screen operation on the identifier, adds the identifier corresponding to the touch screen operation to the data request, and sends the data request to the terminal.

[0087] S207. The terminal sends the second data of the second virtual layer of the application corresponding to the identifier in the data request to the vehicle terminal.

[0088] After receiving the data request, the terminal obtains the identifier in the data request, and sends the second data of the second virtual layer of the application corresponding to the identifier to the vehicle computer.

[0089] S208. The vehicle terminal displays application information.

[0090] After receiving the second data corresponding to the second virtual layer, the vehicle computer displays information of the application corresponding to the second virtual layer.

[0091] The virtual screen-based projection method provided in the present application sends the identification and information of the application supporting projection simulated in the terminal to the vehicle-side through the interaction between the terminal and the vehicle-side, thereby quickly displaying the rich application information in the terminal on the vehicle-side, thereby improving the capabilities of the infotainment host on the vehicle-side.

[0092] Figure 4 FIG. 1 is a flowchart of a screen projection method based on a virtual screen provided by an embodiment of the present application. Figure 4 As shown, with the vehicle terminal as the execution subject, the method of this embodiment may include the following steps:

[0093] S301. After establishing a connection with a terminal, receiving first data corresponding to a first virtual layer sent by the terminal, and displaying an identifier corresponding to the first virtual layer.

[0094] The vehicle terminal can receive a connection request sent by the terminal and establish a connection with the terminal. After the vehicle terminal establishes a connection with the terminal, it receives the first data corresponding to the first virtual layer sent by the terminal. The first virtual layer is a virtual layer corresponding to the logo of the application that supports screen projection generated by the terminal on the virtual screen interface. After the vehicle terminal receives the first data corresponding to the first virtual layer, it displays the logo corresponding to the first virtual layer, that is, displays the logo of the application that supports screen projection.

[0095] S302: Send a data request to the terminal, receive second data of a second virtual layer of an application corresponding to the identifier in the data request sent by the terminal, and display information of the application.

[0096] The vehicle computer can send a data request to the terminal to request the application information. After the vehicle computer sends the data request to the terminal, the terminal sends the second data of the second virtual layer of the application corresponding to the identifier in the data request to the vehicle computer, and the second virtual layer is the virtual layer corresponding to the application information generated by the terminal on the virtual screen interface. After receiving the second data corresponding to the second virtual layer, the vehicle computer displays the application information corresponding to the second virtual layer.

[0097] In some embodiments, the vehicle terminal can respond to the user's touch screen operation on the identifier, and add the identifier corresponding to the touch screen operation to the data request, and then send the data request to the terminal. The terminal can obtain the identifier in the data request, and send the second data of the second virtual layer of the application corresponding to the identifier to the vehicle terminal, and the vehicle terminal displays the information of the application corresponding to the second virtual layer. Specifically, after receiving the user's touch screen operation on the identifier, the vehicle terminal can add the first coordinate of the identifier corresponding to the touch screen operation on the display interface of the vehicle terminal to the data request, and send the data request including the first coordinate of the identifier to the terminal, the terminal obtains the first coordinate of the identifier in the data request, obtains the second coordinate corresponding to the first coordinate according to the correspondence between the first coordinate of the identifier and the second coordinate of the first virtual layer, and the first virtual layer corresponding to the second coordinate, and sends the second data of the second virtual layer of the application corresponding to the first virtual layer to the vehicle terminal, and the vehicle terminal displays the information of the application corresponding to the second virtual layer.

[0098] In some embodiments, the vehicle terminal can also respond to the user's volume request, such as responding to a click operation on a volume button, where the click operation includes increasing the volume or decreasing the volume. The vehicle terminal adds the volume request to the data request, and sends the data request including the volume request to the terminal. The terminal obtains the volume request and the identifier in the data request, and adjusts the volume of the second data of the second virtual layer of the application corresponding to the identifier according to the volume request. After receiving the adjusted second data, the vehicle terminal displays the information of the application corresponding to the identifier according to the volume of the adjusted second data to meet the user's needs.

[0099] The virtual screen-based screen projection method provided in the present application receives the first data of the first virtual layer corresponding to the application identifier and the second data of the second virtual layer corresponding to the application information on the vehicle side, and displays the application identifier corresponding to the first virtual layer and the application information corresponding to the second virtual layer, thereby displaying the identifier and information of the application supporting screen projection simulated in the terminal, thereby improving the capabilities of the infotainment host on the vehicle side.

[0100] Figure 5 A schematic diagram of the structure of a screen projection device based on a virtual screen provided in an embodiment of the present application is shown. Figure 5 As shown, the screen projection device 10 based on the virtual screen of this embodiment is used to implement the operation corresponding to the terminal in any of the above method embodiments. The screen projection device 10 based on the virtual screen of this embodiment includes:

[0101] A generating module 11 is used to generate, on the virtual screen interface, a first virtual layer corresponding to the identifier of the application supporting screen projection in the terminal and a second virtual layer corresponding to the information of the application after establishing a connection with the vehicle terminal;

[0102] A first sending module 12, used for sending first data corresponding to the first virtual layer to the vehicle terminal, so as to display a logo corresponding to the first virtual layer on the vehicle terminal;

[0103] The second sending module 13 is used to receive a data request sent by the vehicle terminal, and send the second data of the second virtual layer of the application corresponding to the identifier in the data request to the vehicle terminal, so as to display the application information on the vehicle terminal.

[0104] The virtual screen projection device 10 provided in the embodiment of the present application can execute the above-mentioned method embodiment with the terminal as the execution subject. Its specific implementation principles and technical effects can be found in the above-mentioned method embodiment with the terminal as the execution subject, and this embodiment will not be repeated here.

[0105] Figure 6 A schematic diagram of the structure of a screen projection device based on a virtual screen provided in an embodiment of the present application is shown. Figure 6 As shown, the projection device 20 based on the virtual screen of this embodiment is used to implement the operation corresponding to the vehicle terminal in any of the above method embodiments. The projection device 20 based on the virtual screen of this embodiment includes:

[0106] The first display module 21 is used to receive first data corresponding to a first virtual highlight sent by the terminal after establishing a connection with the terminal, and display an identifier corresponding to a first virtual layer, where the first virtual layer is a virtual layer corresponding to an identifier of an application supporting screen projection generated by the terminal on a virtual screen interface;

[0107] The second display module 22 is used to send a data request to the terminal, receive the second data of the second virtual layer of the application corresponding to the identifier in the data request sent by the terminal, and display the application information. The second virtual layer is a virtual layer corresponding to the application information generated by the terminal on the virtual screen interface.

[0108] The virtual screen-based projection device 20 provided in the embodiment of the present application can execute the above-mentioned method embodiment with the vehicle-side as the execution body. Its specific implementation principles and technical effects can be found in the above-mentioned method embodiment with the vehicle-side as the execution body, and this embodiment will not be repeated here.

[0109] Figure 7 FIG. 1 shows a hardware structure diagram of an electronic device provided in an embodiment of the present application. Figure 7 As shown, the electronic device 30 is used to implement the operations corresponding to the terminal or the vehicle terminal in any of the above method embodiments. The electronic device 30 of this embodiment may include: a memory 31, a processor 32 and a communication interface 33.

[0110] The memory 31 is used to store computer instructions. The memory 31 may include a high-speed random access memory (RAM), and may also include a non-volatile memory (NVM), such as at least one disk memory, and may also be a USB flash drive, a mobile hard disk, a read-only memory, a disk or an optical disk.

[0111] The processor 32 is used to execute computer instructions stored in the memory to implement the screen projection method based on the virtual screen with the terminal as the execution subject or the screen projection method based on the virtual screen with the vehicle terminal as the execution subject in the above-mentioned embodiment. The processor 32 can be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application specific integrated circuits (ASIC), etc. The general-purpose processor can be a microprocessor or the processor can also be any conventional processor, etc. The steps of the method disclosed in the invention can be directly reflected as being executed by a hardware processor, or can be executed by a combination of hardware and software modules in the processor.

[0112] Optionally, the memory 31 may be independent or integrated with the processor 32 .

[0113] The communication interface 33 may be connected to the processor 32. The processor 32 may control the communication interface 33 to implement the functions of receiving and sending information signals.

[0114] The electronic device provided in this embodiment can be used to execute the above-mentioned screen projection method based on the virtual screen. Its implementation method and technical effect are similar, and this embodiment will not be repeated here.

[0115] The present application also provides a computer-readable storage medium, in which computer instructions are stored. When the computer instructions are executed by a processor, they are used to implement the methods provided in the various embodiments described above.

[0116] The present application also provides a computer program product, which includes computer instructions stored in a computer-readable storage medium. At least one processor of a device can read the computer instructions from the computer-readable storage medium, and at least one processor executes the computer instructions so that the device implements the methods provided in the various embodiments described above.

[0117] An embodiment of the present application also provides a chip, which includes a memory and a processor, wherein the memory is used to store computer instructions, and the processor is used to call and execute the computer instructions from the memory, so that a device equipped with the chip executes the methods described in the various possible implementation modes above.

[0118] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the above embodiments, a person of ordinary skill in the art should understand that the technical solutions described in the above embodiments can still be modified, or some or all of the technical features can be replaced by equivalents. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the scope of the technical solutions of the embodiments of the present application.

Claims

1. A screen projection method based on a virtual screen, characterized in that: The method is used in a terminal, comprising: After establishing a connection with the vehicle terminal, a first virtual layer corresponding to the identifier of the application supporting screen projection in the terminal and a second virtual layer corresponding to the information of the application are generated on the virtual screen interface; Sending first data corresponding to the first virtual layer to the vehicle computer end, so as to display a logo corresponding to the first virtual layer on the vehicle computer end; Receiving a data request sent by the vehicle terminal, and sending second data of a second virtual layer of an application corresponding to the identifier in the data request to the vehicle terminal, so as to display information of the application on the vehicle terminal; The receiving the data request sent by the vehicle terminal, and sending the second data of the second virtual layer of the application corresponding to the identifier in the data request to the vehicle terminal specifically includes: Detecting changes in the second virtual layer of each application in the virtual screen interface, and after receiving a data request sent by the vehicle computer, sending the change data of the second virtual layer of the application corresponding to the identifier in the data request to the vehicle computer; The receiving the data request sent by the vehicle terminal, and sending the second data of the second virtual layer of the application corresponding to the identifier in the data request to the vehicle terminal, so as to display the information of the application on the vehicle terminal, specifically includes: A video data request sent by the vehicle terminal is received, and video data of a video virtual layer of a video application corresponding to an identifier in the video data request is sent to the vehicle terminal, so as to display the video of the video application on the vehicle terminal.

2. The method according to claim 1, characterized in that The method further comprises: Receiving a connection request sent by the vehicle terminal and establishing a connection with the vehicle terminal; Or, send a connection request to the vehicle terminal to establish a connection with the vehicle terminal.

3. The method according to claim 1, characterized in that The sending the second data of the second virtual layer of the application corresponding to the identifier in the data request to the vehicle machine end specifically includes: Obtaining the first coordinate of the display interface of the vehicle terminal identified in the data request; Acquire a second coordinate corresponding to the first coordinate and an application corresponding to the second coordinate according to a correspondence between the first coordinate of the identifier and the second coordinate of the first virtual layer; The second data of the second virtual layer of the application corresponding to the second coordinate is sent to the vehicle machine end.

4. The method according to claim 1, characterized in that The sending the second data of the second virtual layer of the application corresponding to the identifier in the data request to the vehicle machine end specifically includes: A volume request in the data request is obtained, the volume of the second data of the second virtual layer of the application corresponding to the identifier in the data request is adjusted according to the volume request, and the adjusted second data is sent to the vehicle terminal.

5. A screen projection method based on a virtual screen, characterized in that: The method is used on a vehicle machine side, and includes: After establishing a connection with a terminal, receiving first data corresponding to a first virtual layer sent by the terminal, and displaying an identifier corresponding to the first virtual layer, where the first virtual layer is a virtual layer corresponding to an identifier of an application supporting screen projection generated by the terminal on a virtual screen interface; Sending a data request to the terminal, receiving second data of a second virtual layer of an application corresponding to the identification in the data request sent by the terminal, and displaying information of the application, wherein the second virtual layer is a virtual layer corresponding to the information of the application generated by the terminal on the virtual screen interface; the first virtual layer and the second virtual layer are generated on the virtual screen interface by the terminal after establishing a connection with the vehicle machine end; The sending of the data request to the terminal and receiving second data of the second virtual layer of the corresponding application identified in the data request sent by the terminal includes: After sending the data request to the terminal, receiving the change data of the second virtual layer of the application corresponding to the identifier in the data request sent by the terminal; A video data request is sent to a terminal, video data of a video virtual layer of a video application corresponding to an identifier in the video data request sent by the terminal is received, and a video of the video application is displayed.

6. The method according to claim 5, characterized in that The sending of the data request to the terminal specifically includes: In response to a touch screen operation, an identifier corresponding to the touch screen operation is added to a data request, and the data request is sent to the terminal.

7. The method according to claim 6, characterized in that The adding the identifier corresponding to the touch screen operation to the data request specifically includes: The first coordinate of the mark corresponding to the touch screen operation on the display interface of the vehicle terminal is added to the data request.

8. An electronic device, characterized in that: include: A processor, and a memory communicatively connected to the processor; The memory stores computer-executable instructions; The processor executes the computer-executable instructions stored in the memory to implement the virtual screen-based screen projection method as described in any one of claims 1-4 or the virtual screen-based screen projection method as described in any one of claims 5-7.

Images