Data processing method and device, electronic equipment and storage medium

Abstract

The invention discloses a data processing method and device, electronic equipment and a storage medium, and the method comprises the steps: starting a target application in response to a received application starting instruction which is sent by a user terminal and aims at the target application on a mobile terminal under the condition of communication connection with the user terminal, the coded data corresponding to the application content of the started target application is sent to the user terminal, so that the user terminal plays the application content of the target application, the application content comprises at least one of audio data and video data, and the target application is a preset application capable of being displayed on the user terminal. By adopting the embodiment of the invention, the control operation aiming at the target application in the mobile terminal can be carried out on the user terminal to generate the control instruction aiming at the target application in the mobile terminal, so that the purpose of controlling any application in the mobile terminal on the user terminal is realized, the use of a user is facilitated, and the user experience is improved.

Description

Technical Field

[0001] The present invention relates to the field of data processing technology, and in particular to a data processing method, device, electronic equipment and storage medium. Background Art

[0002] With the development of electronic equipment and vehicle computer interconnection technology, users can project the screen of electronic devices onto the screen of the vehicle computer for display, making it convenient for drivers and passengers to operate electronic devices while driving.

[0003] However, the current mainstream car-computer screen projection method is that when projecting the applications of electronic devices to the car computer for display, some applications cannot be operated on the car computer. The driver or passengers are required to operate on the electronic device so that the application display screen in the electronic device can be projected to the car computer. The purpose of controlling any application on the electronic device on the car computer cannot be achieved. Summary of the invention

[0004] The purpose of the embodiments of the present invention is to provide a data processing method, device, electronic device and storage medium to solve the technical problem that the existing screen projection method cannot be applied arbitrarily on the vehicle-side control electronic device.

[0005] In a first aspect, an embodiment of the present invention provides a data processing method, which is applied to a mobile terminal, and the method includes:

[0006] In a case of being in communication connection with a user terminal, in response to receiving an application start instruction for a target application on the mobile terminal sent by the user terminal, start the target application;

[0007] The encoded data corresponding to the application content of the started target application is sent to the user terminal so that the user terminal can play the application content of the target application, the application content includes at least one of audio data and video data, and the target application is a preset application displayed on the user terminal.

[0008] In a second aspect, an embodiment of the present invention further provides a data processing method, which is applied to a user terminal, and the method includes:

[0009] In the case of communication connection with a mobile terminal, in response to a user starting operation on a target application on the user terminal, generating an application start instruction, and sending the application start instruction to the mobile terminal, the target application being an application on the mobile terminal;

[0010] Receiving first audio and video stream data sent by the mobile terminal, where the first audio and video stream data is data obtained by encoding the display content of the started target application by the mobile terminal;

[0011] The first audio and video stream data is decoded and played.

[0012] In a third aspect, in order to solve the same technical problem, an embodiment of the present invention provides a data processing device, applied to a mobile terminal, the device comprising:

[0013] a starting module, configured to start the target application on the mobile terminal in response to receiving an application starting instruction for the target application sent by the user terminal when the mobile terminal is in communication connection with the user terminal;

[0014] The first sending module is used to send the encoded data corresponding to the application content of the started target application to the user terminal so that the user terminal can play the application content of the target application, the application content includes at least one of audio data and video data, and the target application is a preset application displayed on the user terminal.

[0015] In a fourth aspect, in order to solve the same technical problem, an embodiment of the present invention further provides a data processing device, which is applied to a user terminal, and the device includes:

[0016] A first instruction generation module is used to generate an application startup instruction in response to a user's startup operation on a target application on the user terminal when the mobile terminal is in communication connection with the mobile terminal, and send the application startup instruction to the mobile terminal, wherein the target application is an application on the mobile terminal;

[0017] A first receiving module, configured to receive first audio and video stream data sent by the mobile terminal, wherein the first audio and video stream data is data obtained by encoding the display content of the started target application by the mobile terminal;

[0018] The playing module is used to decode the first audio and video stream data and play the decoded first audio and video stream data.

[0019] In a fifth aspect, an embodiment of the present invention provides an electronic device, comprising a processor, a memory, and a computer program stored in the memory and executable on the processor, wherein the processor implements the steps of any of the above-mentioned data processing methods when executing the computer program.

[0020] In a sixth aspect, an embodiment of the present invention provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps in any one of the above-mentioned data processing methods are implemented.

[0021] An embodiment of the present invention provides a data processing method, device, electronic device and storage medium. The method receives an application startup instruction for a target application on a mobile terminal sent by a user terminal when in communication connection with the user terminal, and starts the target application in response to the application startup instruction, thereby achieving the purpose of controlling the startup of the corresponding application in the mobile terminal by performing a startup operation on the user terminal. Then, when displaying the application content of the target application on the mobile terminal, the encoded data corresponding to the application content of the target application is sent to the user terminal, so that the user terminal can achieve the purpose of playing the application content of the target application on the user terminal according to the encoded data, thereby solving the technical problem that the existing screen projection method cannot realize the control of any application on the electronic device on the vehicle side, making it convenient for users to use and improving the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] Figure 1 This is a schematic diagram of a multi-screen collaborative screen projection method provided by an embodiment of the present invention;

[0023] Figure 2 is another schematic diagram of a multi-screen collaborative screen projection method provided by an embodiment of the present invention;

[0024] Figure 3 It is a flow chart of a data processing method provided by an embodiment of the present invention;

[0025] Figure 4 is another flow chart of data processing provided by an embodiment of the present invention;

[0026] Figure 5 It is a schematic diagram of the relationship between the mobile phone end and the vehicle end before and after the communication connection is established provided by an embodiment of the present invention;

[0027] Figure 6 This is a schematic diagram of a process for data interaction between a mobile phone terminal and a vehicle terminal provided by an embodiment of the present invention;

[0028] Figure 7 This is a schematic diagram of starting a mobile phone application on a vehicle terminal provided by an embodiment of the present invention;

[0029] Figure 8 yes Figure 7 A flowchart of the corresponding data interaction;

[0030] Fig. 9 This is a flow chart of data interaction between a vehicle terminal and a mobile phone terminal when performing mode switching provided by an embodiment of the present invention;

[0031] Fig.10 This is a flow chart of data interaction between a vehicle terminal and a mobile phone terminal when performing an application closing operation provided by an embodiment of the present invention;

[0032] Fig.11 is a structural schematic diagram of a data processing device applied to a mobile terminal provided by an embodiment of the present invention;

[0033] Fig.12 is another structural schematic diagram of a data processing device applied to a mobile terminal provided by an embodiment of the present invention;

[0034] Fig.13 is a structural schematic diagram of a data processing device applied to a display terminal provided by an embodiment of the present invention;

[0035] Fig.14 is another structural schematic diagram of a data processing device applied to a display terminal provided by an embodiment of the present invention;

[0036] Fig.15 is a structural schematic diagram of an electronic device provided by an embodiment of the present invention;

[0037] Fig.16 This is another structural schematic diagram of an electronic device provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0038] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0039] It should be understood that the various steps described in the method embodiments of the present disclosure may be performed in different orders and / or in parallel. In addition, the method embodiments may include additional steps and / or omit the steps shown. The scope of the present disclosure is not limited in this respect.

[0040] The term "including" and its variations used herein are open inclusions, i.e., "including but not limited to". The term "based on" means "based at least in part on". The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; the term "some embodiments" means "at least some embodiments". The relevant definitions of other terms will be given in the following description.

[0041] In this example, see Figure 1 and Figure 2 , Figure 1 is a schematic diagram of a multi-screen collaborative screen projection method provided by an embodiment of the present invention. Figure 2 FIG. 1 is another schematic diagram of a multi-screen collaborative screen projection method provided by an embodiment of the present invention. Figure 1 As shown, one of the screen projection methods of multi-screen collaboration provided by this embodiment is to mirror the main screen of the mobile phone to the large-screen device. Because the mobile phone is generally in portrait mode, the display on the large-screen device also adopts a small window in portrait mode, and the display size of the mobile phone screen can be proportionally scaled to the large screen of these large-screen devices. In this way, all applications on the mobile phone can be displayed and used on large-screen devices such as PC, PAD, and TV. Because it is a mirrored screen projection, the use method on the large-screen device is the same as that on the mobile phone. Therefore, Figure 1 As shown, you only need to operate the mobile phone mirroring window displayed on the large-screen device, such as clicking an application on the mobile phone mirroring screen projection interface, such as application C, and the mobile phone will open application C on the mobile phone according to the instructions generated by the click operation, and the content page of application C will also be displayed on the large-screen device at the same time. In addition, the large-screen device also displays a return key and a HOME key, which can be operated by the user to control the mobile phone to return or return to the main interface of the mobile phone.

[0042] like Figure 2 As shown, another screen projection method for multi-screen collaboration provided by this embodiment is to open an application in a mobile phone on a large-screen device using a separate window. Specifically, you can long press or right-click an application such as application C on the mobile phone mirroring screen projection interface, or try to start application C separately in a new window in other ways. Then, the content page of application C will be displayed in a separate window, and the mobile phone mirroring window will not disappear, and it will remain on the display interface of the large-screen device. Among them, the separate window also displays a return button. Clicking the return button can realize the function of exiting the application, and after exiting the application, the currently displayed separate window will be closed.

[0043] However, the multi-screen collaborative projection method provided in the related art has the following defects:

[0044] (1) During the screen projection process, the phone's main screen cannot be locked. If the screen is locked, the screen projection function will be unavailable.

[0045] (2) In order to support opening the application in a new window, the mobile phone's desktop engine (Launcher) application needs to be modified synchronously, and function tags are added to increase the entry point to achieve the purpose of supporting the application to be opened in a new window, thereby increasing the workload of screen projection;

[0046] (3) The operation methods of mobile phone applications and large-screen devices are separated. For example, to launch a local application on a large-screen device, you can directly click the icon in the local application list to launch it, while launching a mobile phone application on a large-screen device in a separate window requires special operations or entering a special management interface to launch it, such as in Figure 1 and Figure 2If you want to start a mobile application, you need to start it in a separate window that displays the mirror image of the mobile phone screen on the large-screen device, rather than starting it in the local application list of the large-screen device, which increases the user's learning cost and reduces the user experience.

[0047] Therefore, in order to solve the technical problem that the existing screen projection method cannot realize any application on the vehicle-side control electronic device, and the technical defects of the screen projection method provided by the related technology, the embodiment of the present invention provides a data processing method applied to the mobile terminal, see Figure 3 , Figure 3 is a flow chart of a data processing method provided by an embodiment of the present invention, the method comprising steps 31 to 32;

[0048] Step 31 : in the case of communication connection with the user terminal, in response to receiving an application start instruction for a target application on the mobile terminal sent by the user terminal, start the target application.

[0049] In this embodiment, the user terminal provided in this embodiment can be a terminal device with a display screen such as a PC terminal, a PAD terminal, a TV terminal or a car terminal. Specifically, this embodiment is mainly described by taking the car terminal as the user terminal as an example.

[0050] Among them, the target application provided in this embodiment is an application preset to be displayed on the user terminal. The manner in which the mobile terminal provided in this embodiment establishes a communication connection with the user terminal may be a communication connection through a connection method such as WIFI, USB or Bluetooth, thereby realizing data interaction between the mobile terminal and the user terminal. Since the user terminal provided in this embodiment takes the vehicle terminal as an example, after the mobile terminal and the user terminal are communicated and connected, this embodiment may adopt the Carlink data transmission protocol to realize data transmission between the mobile terminal and the vehicle terminal. Among them, the data transmission protocol adopted in this embodiment is not limited to the Carlink protocol. Specifically, the data transmission protocol provided in this embodiment may be determined according to the user terminal, and different user terminals may adopt different data transmission protocols, as long as data transmission between the mobile terminal and the user terminal can be realized.

[0051] In this embodiment, before the step of starting the target application in response to receiving the application start instruction for the target application on the mobile terminal sent by the user terminal, the data processing method provided by this embodiment may also include: sending the target application information of the target application on the mobile terminal to the user terminal to support the user terminal to display the target application information. Among them, by sending the target application information of the target application to the user terminal through the mobile terminal, the user terminal can display the target application information of the target application in the application list of the user terminal, thereby achieving the purpose of displaying any application in the mobile terminal in the application list of the user terminal.

[0052] In some embodiments, this embodiment can not only display any application in the mobile terminal in the application list of the user terminal, but also display a target application list composed of target application information in the mobile terminal on the user terminal. Specifically, the step of sending the target application information of the target application on the mobile terminal to the user terminal to support the user terminal to display the target application information provided in this embodiment can be: in response to receiving the request information for obtaining the target application list sent by the user terminal, sending the target application information of the target application on the mobile terminal to the user terminal to support the user terminal to display the target application list composed of the target application information.

[0053] As an optional embodiment, the request information provided in this embodiment includes first request information for obtaining application list information, and second request information for obtaining target application information of the target application. Specifically, the step provided in this embodiment for sending the target application information of the target application on the mobile terminal to the user terminal in response to receiving the request information for obtaining the target application list sent by the user terminal to support the user terminal in displaying the target application list composed of the target application information can be: in response to the first request information sent by the user terminal, sending the application list information of the mobile terminal to the user terminal so that the user terminal can determine the target application according to the application list information; in response to the second request information sent by the user terminal, sending the target application information of the target application to the user terminal so as to support the user terminal in displaying the target application list composed of the target application information.

[0054] Among them, the application list information includes identification information of at least one application in the mobile terminal, and the identification information may be information such as the ID information of the application, the application name, etc., which is used to identify the specific application in the mobile terminal. By first sending the application list information to the user terminal, the user terminal can select the target application that needs to be displayed in the application list of the user terminal from the application list information, so that according to the second request information sent by the user terminal to obtain the target application information of the target application, the target application information of the target application selected by the user terminal can be sent to the user terminal, so that the user terminal can display the target application information in the application list of the user terminal. Specifically, the target application information provided in this embodiment includes the application name and application icon information of the target application.

[0055] It should be noted that the target application provided in this embodiment is any application in the mobile terminal, and the number of the target application may be one or more.

[0056] In this embodiment, after the target application information of the target application is displayed in the application list of the user terminal, the user can operate the target application on the user terminal in the same manner as the operation on the local application. Specifically, the target application can be started. After the user completes the start-up operation on the target application on the user terminal, the user terminal sends an application start-up instruction for the target application to the mobile terminal to control the mobile terminal to start the corresponding application according to the application start-up instruction.

[0057] In this embodiment, in one case, after starting the target application, the application content of the target application can be directly played on the display interface of the mobile terminal. In another case, after starting the target application, a virtual display screen can be created on the mobile terminal as a mirror screen, and then the application content of the started target application can be played on the virtual display screen.

[0058] The application content provided in this embodiment includes at least one of audio data and video data. When the application content provided in this embodiment is audio data, the audio data is played through the sound playing unit of the user terminal, such as a speaker; when the application content provided in this embodiment is video data, the video data is played on the display interface of the user terminal or on a virtual display screen; when the application content provided in this embodiment is audio and video data, the audio data is played through the sound playing unit of the user terminal, and the video data is played on the display interface of the user terminal or on a virtual display screen.

[0059] In some embodiments, the step of starting the target application in response to receiving an application start instruction for the target application on the mobile terminal sent by the user terminal provided in this embodiment may be: drawing a virtual display screen on the mobile terminal in response to receiving an application start instruction for the target application on the mobile terminal sent by the user terminal; starting the target application and playing the application content of the target application on the virtual display screen.

[0060] By displaying the display content of the started target application on the virtual display screen instead of displaying the content on the main display screen of the mobile terminal, the main display screen of the mobile terminal can also display other content for the user to perform other operations on the mobile terminal, thereby effectively improving the user experience.

[0061] Step 32: sending the encoded data corresponding to the application content of the started target application to the user terminal, so that the user terminal can play the application content of the target application.

[0062] In some embodiments, the step provided in this embodiment of sending the encoded data corresponding to the application content of the launched target application to the user terminal so that the user terminal can play the application content of the target application can be: encoding the application content of the launched target application to obtain first audio and video stream data; sending the first audio and video stream data to the user terminal so that the user terminal can play the decoded first audio and video stream data on the display interface of the user terminal.

[0063] Among them, since the mobile terminal provided in this embodiment mainly uses the Carlink protocol to transmit data to the user terminal, after obtaining the first audio and video stream data, this embodiment needs to package the first audio and video stream data according to a preset format, and then send it to the user terminal through the Carlink protocol. Specifically, the preset packaging format provided in this embodiment can be an RTP message format, or other message formats that can be transmitted through the Carlink protocol.

[0064] In this embodiment, after the first audio and video stream data is sent to the user terminal, the user terminal can decode the received first audio and video data, and then play the decoded first audio and video data on the user terminal, thereby realizing the control operation on the user terminal to project the application content of the target application on the mobile terminal on the user terminal for playback.

[0065] In one embodiment, when the application content of the target application is played in the user terminal, the data processing method provided in this embodiment may also include: in response to a display mode switching instruction sent by the user terminal, switching the first display mode of the display screen playing the application content to the second display mode; sending the encoded data corresponding to the application content of the target application in the second display mode to the user terminal, so that the user terminal can play the application content in the second display mode.

[0066] In this embodiment, since the application content of the target application will change after the display mode is switched, it is necessary to re-encode the application content of the target application in the new display mode. Specifically, the step provided in this embodiment of sending the encoded data corresponding to the application content of the target application in the second display mode to the user terminal so that the user terminal can play the application content in the second display mode can be: encoding the application content in the second display mode to obtain the second audio and video stream data; sending the second audio and video stream data to the user terminal so that the user terminal can play the decoded second audio and video stream data on the display interface of the user terminal.

[0067] The second display mode provided in this embodiment is the display mode specified by the display mode switching instruction. Specifically, the display modes provided in this embodiment can be portrait mode, landscape mode and full screen mode, wherein the display ratio of the portrait mode and landscape mode can be a user-defined display ratio, such as 4:3 or 16:9.

[0068] In another implementation, when the application content of the target application is played in the user terminal, the data processing method provided in this embodiment may further include: closing the started target application in response to an application closing instruction.

[0069] The application closing instruction includes an application closing instruction for a target application sent by a user terminal and an application closing instruction generated by a user closing a started target application on a mobile terminal. In this embodiment, the screen projection between the mobile terminal and the user terminal can be interrupted by an application closing instruction. Specifically, in this embodiment, not only can an application closing instruction be generated by operating on the mobile terminal to interrupt the screen projection with the user terminal, but also an application closing instruction sent by the user terminal can be received to interrupt the screen projection with the user terminal.

[0070] As an optional embodiment, the user's closing operation on the mobile terminal may be an operation of closing the target application in the application list in the mobile terminal, an operation of clicking a close button on the target application, or a closing operation performed by voice control.

[0071] It should be noted that the operation instructions provided in this embodiment are not limited to the start instructions, display mode switching instructions and application closing instructions, that is, this embodiment is not limited to only responding to the start instructions, display mode switching instructions and application closing instructions to perform corresponding operations on the target application, and can also respond to stop instructions, pause instructions and resume instructions to perform corresponding operations on the target application. As long as the mobile terminal can respond to and perform operations on the target application, the operation instructions are not specifically limited here. In addition, the operation instructions provided in this embodiment can be instructions for controlling the target application in the mobile terminal to perform corresponding operations, and can also be operation requests for requesting the target application in the mobile terminal to perform corresponding operations.

[0072] So far, the description of the data processing method in the mobile terminal is completed.

[0073] The above embodiments mainly describe the data processing method in the mobile terminal, so as to realize the screen projection between the mobile terminal and the user terminal. The following embodiments will mainly describe the data processing method in the user terminal.

[0074] See also Figure 4 , Figure 4 is another flow chart of data processing provided by an embodiment of the present invention, such as Figure 4 As shown, the embodiment of the present invention provides a data processing method applied to a user terminal, comprising steps 41 to 43;

[0075] Step 41 : in the case of communication connection with the mobile terminal, in response to the user's start operation on the target application on the user terminal, generate an application start instruction, and send the application start instruction to the mobile terminal.

[0076] The target application provided in this embodiment is an application on a mobile terminal.

[0077] As an optional embodiment, in order to control the application on the mobile terminal on the user terminal, this embodiment can pre-display the target application in the mobile terminal in the application list of the user terminal, so that the user can control the target application in the application list of the user terminal. Specifically, before the step of generating an application startup instruction in response to the user's startup operation on the target application on the user terminal, and sending the application startup instruction to the mobile terminal, the data processing method provided by this embodiment also includes: sending a first request message to obtain application list information to the mobile terminal; determining the target application displayed in the application list according to the application list information returned by the mobile terminal; sending a second request message to obtain the target application information of the target application to the mobile terminal; receiving the target application information returned by the mobile terminal, and displaying the target application information in the application list.

[0078] Among them, the application list information provided in this embodiment includes identification information of at least one application in the mobile terminal. The identification information can be the application ID information, application name, etc. used to determine the specific application in the mobile terminal. The target application information includes the application name and application icon information of the target application.

[0079] In this embodiment, this embodiment can effectively reduce the amount of data required for data transmission and improve the efficiency of screen projection by selecting target application information of the target application that needs to be displayed in the application list of the user terminal from the application list information instead of the application information of all applications in the mobile terminal.

[0080] As an optional embodiment, the steps provided in this embodiment for determining the target application displayed in the application list based on the application list information returned by the mobile terminal may be: obtaining the identification information of the local application on the user terminal; deleting the identification information of the local application from the application list information returned by the mobile terminal to obtain the target application list information; and determining the application in the target application list information as the target application.

[0081] By deleting the identification information of the application that is the same as the local application of the user terminal in the application list information returned by the mobile terminal, the amount of data that needs to be transmitted can be further reduced and the screen projection efficiency can be improved.

[0082] In this embodiment, after receiving the target application information of the target application sent by the mobile terminal, the user terminal provided by this embodiment can display the application name and application icon of the target application in the application list on the display interface of the user terminal. Among them, the application list of the user terminal contains local applications, that is, this embodiment displays the target application of the mobile terminal in the application list containing local applications, so that it is convenient for the user to control the target application provided by the mobile terminal by using the operation mode of controlling the local application on the user terminal, thereby achieving the purpose of controlling the target application in the mobile terminal at the user terminal.

[0083] As an optional embodiment, after the step of displaying the target application information in the application list, the data processing method provided by the embodiment of the present invention may further include: marking the target application in the application list.

[0084] Among them, the marking processing provided in this embodiment can be to add a specific pattern to the application icon of the target application, such as the pattern of the mobile terminal, or to change the color of the application name of the target application. Specifically, as long as the target application can be distinguished from the local application in the application list of the user terminal, no specific limitation is made here.

[0085] Step 42: Receive the first audio and video stream data sent by the mobile terminal.

[0086] The first audio and video stream data is data obtained by encoding the display content of the started target application by the mobile terminal.

[0087] In this embodiment, the first audio and video stream data includes at least one of audio data and video data. When the first audio and video stream data provided in this embodiment is audio stream data, the audio data corresponding to the audio stream data is played through the sound playback unit of the user terminal, such as a speaker; when the first audio and video stream data provided in this embodiment is video stream data, the video data corresponding to the video stream data is played on the display interface of the user terminal or on the virtual display screen; when the first audio and video stream data provided in this embodiment is audio stream data and video stream data, the audio data corresponding to the audio stream data is played through the sound playback unit of the user terminal, and the video data corresponding to the video stream data is played on the display interface of the user terminal or on the virtual display screen.

[0088] Step 43: decode the first audio and video stream data, and play the decoded first audio and video stream data.

[0089] In this embodiment, in one case, this embodiment can directly play the first audio and video stream data after decoding on the display interface of the user terminal. In another case, this embodiment can also play the first audio and video stream data after decoding on an independent display area of ​​the display interface of the user terminal, so that the first audio and video stream data after decoding can be played in different ways, thereby improving the user experience.

[0090] As an optional embodiment, before the step of decoding the first audio and video stream data, the data processing method provided by the embodiment of the present invention may further include: generating a display window in a preset area on the display interface of the user terminal.

[0091] The preset area may be an independent display area on the display interface of the user terminal selected by the user, so that by generating a display window on an independent display area on the display interface of the user terminal, the first video stream data after decoding can be played on the display window. Specifically, after generating a display window in an independent display area on the display interface of the user terminal, the step of playing the first audio and video stream data after decoding can be: playing the first audio and video stream data after decoding in the display window.

[0092] By playing the decoded first audio and video stream data in the display window, the applications that the mobile terminal can project to the user terminal can be expanded to the maximum extent, and the adaptation work of the mobile terminal application across terminals can be greatly reduced.

[0093] In one embodiment, when the application content of the target application is played in the user terminal, the data processing method provided by the embodiment of the present invention also includes: generating a display mode switching instruction in response to the display mode switching operation performed by the user on the target application; sending the display mode switching instruction to the mobile terminal; receiving the second audio and video stream data returned by the mobile terminal; decoding the second audio and video stream data, and playing the decoded second audio and video stream data in the target display mode.

[0094] The target display mode provided in this embodiment is the display mode specified by the display mode switching instruction. Specifically, the display modes provided in this embodiment can be portrait mode, landscape mode and full screen mode, wherein the display ratio of the portrait mode and landscape mode can be a user-defined display ratio, such as 4:3 or 16:9.

[0095] In this embodiment, when this embodiment plays the first audio and video stream data after decoding in an independent display window and receives the second audio and video stream data sent by the mobile terminal, the user terminal will hide or close the display window for playing the first audio and video stream data after decoding, and then regenerate a display window of the target display mode corresponding to the display mode switching operation, such as a horizontal screen window, and finally play the second audio and video stream data after decoding on the regenerated display window, so as to realize the playback of the second audio and video stream data after decoding in the target display mode on the user terminal, and achieve the purpose of switching the display mode of the display content of the target application on the user terminal.

[0096] In another implementation, when the application content of the target application is played in the user terminal, the data processing method provided by the embodiment of the present invention further includes: closing the display screen in response to the application closing instruction.

[0097] Among them, the application closing instruction includes the application closing instruction for the target application sent by the mobile terminal, and the application closing instruction generated by the user closing the target application on the user terminal. In this embodiment, the screen projection between the user terminal and the mobile terminal can be interrupted by the application closing instruction. Specifically, in this embodiment, not only can the application closing instruction be generated by operating on the user terminal and sending the application closing instruction to the mobile terminal to interrupt the screen projection with the mobile terminal, but also the screen projection with the mobile terminal can be interrupted by receiving the application closing instruction sent by the mobile terminal.

[0098] In this embodiment, when the user terminal receives an application closing instruction sent by the mobile terminal and interrupts the screen projection with the mobile terminal, this embodiment also needs to hide or close the display window generated on the display interface to avoid affecting the normal display of the user terminal.

[0099] It should be noted that the operation instructions provided in this embodiment are not limited to the start instructions, display mode switching instructions and application closing instructions, and may also include stop instructions, pause instructions and resume instructions, etc., as long as the mobile terminal can respond to and perform operations on the target application, no specific limitation is made here. In addition, the operation instructions provided in this embodiment may be instructions for controlling the target application in the mobile terminal to perform corresponding operations, or may be operation requests for requesting the target application in the mobile terminal to perform corresponding operations.

[0100] So far, the description of the data processing method in the user terminal is completed.

[0101] The above embodiments mainly provide a unilateral description of the mobile terminal or user terminal. In order to better understand the embodiments of the present invention, the mobile phone terminal will be used as the mobile terminal, the vehicle terminal will be used as the user terminal, and some embodiments will be used to provide a bilateral description of the interaction between the mobile terminal and the user terminal.

[0102] See also Figure 5 , Figure 5 It is a schematic diagram of the relationship between the mobile phone end and the vehicle end before and after the communication connection is established provided by an embodiment of the present invention. In this embodiment, since this embodiment mainly realizes the screen projection between the mobile phone end and the vehicle end by data transmission rather than mirror mapping, before the mobile phone end and the vehicle end establish a communication connection, the mobile phone end can be in any state, such as a locked screen state, a black screen state or an unlocked state. After the mobile phone end and the vehicle end establish a communication connection, the mobile phone end sends the target application information of the target application that needs to be displayed in the application list of the vehicle end to the vehicle end. When the vehicle end obtains the target application information, it displays this information in its application list, and can add special marks to the application icons of the target applications on the mobile phone end according to user needs to remind the user that the application with the special mark comes from the mobile phone end.

[0103] in, Figure 5 The dotted line in the figure is for illustration only, indicating that one side of the dotted line is the application on the mobile phone. The actual display method can be a mixed display, and there is no need to separate the local application on the vehicle side from the target application on the mobile phone.

[0104] In some embodiments, in order to reduce the amount of data transmission between the mobile phone and the vehicle, when the vehicle obtains the target application information of the target application, the present embodiment can filter the applications in the mobile phone according to the needs of the user and filter out the applications with the same name that already exist in the vehicle, so as to determine the target application information of the target application that the vehicle needs to obtain. Figure 6 , Figure 6 is a flow chart of data interaction between a mobile terminal and a vehicle terminal provided by an embodiment of the present invention, wherein the execution subject of the data processing method applied to the mobile terminal provided by this embodiment is Figure 6The mobile phone interconnection management program in the embodiment of the present invention is implemented by the data processing method applied to the user terminal. Figure 6 Carlink HMI (Human Machine Interface) in.

[0105] like Figure 6 As shown, when the mobile phone establishes a communication connection with the vehicle, the Carlink HMI on the vehicle will send a request to the mobile phone to obtain the application list information. Specifically, the Carlink HMI on the vehicle sends the request to obtain the application list information to the Carlink vehicle SDK (Software Development Kit), and the Carlink vehicle SDK sends the request to obtain the application list information to the Carlink mobile SDK through the Carlink protocol. After receiving the request, the Carlink mobile SDK forwards the request to the mobile phone interconnection management program. After receiving the request, the mobile phone interconnection management program will return the application list information, and then return it to the CarlinkHMI via the Carlink mobile SDK and the Carlink vehicle SDK. After receiving the application list information, the Carlink HMI will delete unnecessary applications and obtain the target application list information.

[0106] Please continue to see Figure 6 After obtaining the target application list information, Carlink HMI sends the target application list information to the mobile phone interconnection management program via the Carlink vehicle-side SDK and the Carlink mobile phone-side SDK. The mobile phone interconnection management program then returns the target application information of the target application in the target application list information to Carlink HMI. After receiving the target application information, Carlink HMI displays the target application information in the application list on the vehicle-side.

[0107] In some embodiments, when you need to start the target application on the mobile phone on the vehicle side, please refer to Figure 7 , Figure 7 is a schematic diagram of starting a mobile phone application on a vehicle terminal provided by an embodiment of the present invention, such as Figure 7 As shown, the user can directly click on the target application in the application list of the vehicle terminal, such as application C. At this time, the display interface of the vehicle terminal will display the display content of application C on the mobile phone in the form of a window.

[0108] For details, see Figure 8 , Figure 8 yes Figure 7 A flow chart of the corresponding data interaction is as follows: Figure 8As shown, after the user clicks on the icon representing the mobile application on the display interface of the car machine, Carlink HMI will call the Carlink car machine SDK interface to request to start the application. Carlink car machine SDK will encapsulate the startup instruction through the Carlink protocol and send it to the Carlink mobile phone SDK. Carlink mobile phone SDK will forward the startup instruction to the interconnection management program. After receiving the startup instruction, the interconnection management program calls the system interface to start the application on the virtual screen of the mobile phone. After the application is started on the virtual display screen, the Android system will notify the interconnection management program of the startup result. The interconnection management program will call the Carlink mobile phone SDK interface to synchronize the status to the Carlink car machine SDK. The Carlink car machine SDK callback notifies CarlinkHMI. After receiving the notification, Carlink HMI will generate a display window and call the SDK interface to update the screen projection parameters according to the display window. Then, the audio and video stream data sent by the mobile phone will be decoded and played on the display window, so as to achieve the purpose of controlling and playing the application content of the mobile phone application on the car machine.

[0109] In some embodiments, when the user needs to switch the display mode of the display window on the vehicle side, the user can directly perform corresponding operations on the display window on the vehicle side, thereby controlling the display mode of the mobile phone application to switch. Fig. 9 , Fig. 9 is a flow chart of data interaction between the vehicle terminal and the mobile terminal when the mode is switched according to an embodiment of the present invention, such as Fig. 9 As shown in the figure, when the user clicks the full-screen switch button on the display window of the car machine, Carlink HMI sends a display mode switch command to the mobile phone according to the process. When the mobile phone detects the full-screen switch command, it notifies the event to the interconnection management program, and the interconnection management program notifies CarlinkHMI through the Carlink mobile SDK interface. Carlink HMI creates a new full-screen window to receive full-screen video stream data. After receiving the full-screen audio and video stream data, Carlink HMI calls the Carlink car machine SDK to decode the full-screen audio and video stream data, and plays the decoded audio and video stream data in the newly created full-screen window.

[0110] In some embodiments, when the user needs to close the mobile phone application on the vehicle side, the user can directly perform corresponding operations on the mobile phone application on the vehicle side, thereby controlling the mobile phone application to perform application closing operations. For details, please refer to Fig.10 , Fig.10 is a flow chart of data interaction between the vehicle terminal and the mobile terminal when performing an application closing operation provided by an embodiment of the present invention, such as Fig.10As shown, the data interaction process between the vehicle side and the mobile phone side when performing the application closing operation is similar to the data interaction process between the vehicle side and the mobile phone side when performing the application starting operation. The difference is that when the application is closed, the last process part Carlink HMI also needs to hide or close the display window on the display interface of the vehicle side.

[0111] So far, the description of data interaction between the mobile terminal and the user terminal in some embodiments is completed.

[0112] According to the method described in the above embodiments, this embodiment will be further described from the perspective of a data processing device. The data processing device can be implemented as an independent entity or integrated into an electronic device, such as a terminal. The terminal can include a mobile phone, a tablet computer, etc.

[0113] See also Fig.11 , Fig.11 is a structural diagram of a data processing device applied to a mobile terminal provided by an embodiment of the present invention, such as Fig.11 As shown, the data processing device 100 provided in the embodiment of the present invention is applied to a mobile terminal. The data processing device 100 includes: a starting module 101 and a first sending module 102;

[0114] The starting module 101 is used to start the target application in response to receiving an application starting instruction for the target application on the mobile terminal sent by the user terminal when in communication connection with the user terminal.

[0115] The first sending module 102 is used to send the encoded data corresponding to the application content of the started target application to the user terminal, so that the user terminal can play the application content of the target application.

[0116] The application content includes at least one of audio data and video data, and the target application is a preset application displayed on the user terminal.

[0117] In this embodiment, the first sending module 102 provided in this embodiment includes a first encoding unit and a first sending unit;

[0118] The first encoding unit is used to encode the application content of the started target application to obtain the first audio and video stream data.

[0119] The first sending unit is used to send the first audio and video stream data to the user terminal, so that the user terminal plays the decoded first audio and video stream data on the display interface of the user terminal.

[0120] In some embodiments, see Fig.12 , Fig.12is another structural diagram of a data processing device applied to a mobile terminal provided by an embodiment of the present invention, such as Fig.12 As shown, the data processing device 100 provided in this embodiment further includes a second sending module 103, and the second sending module 103 is used to send target application information of the target application on the mobile terminal to the user terminal to support the user terminal to display the target application information.

[0121] As an optional embodiment, the second sending module 103 provided in this embodiment is also specifically used for: in response to receiving a request information for obtaining a target application list sent by a user terminal, sending the target application information of the target application on the mobile terminal to the user terminal, so as to support the user terminal to display the target application list composed of the target application information.

[0122] In some embodiments, the second sending module 103 provided in this embodiment includes a second sending unit and a third sending unit;

[0123] The second sending unit is used to send the application list information of the mobile terminal to the user terminal in response to the first request information sent by the user terminal, so that the user terminal can determine the target application according to the application list information.

[0124] The third sending unit is used to send the target application information of the target application to the user terminal in response to the second request information sent by the user terminal, so as to support the user terminal to display the target application list composed of the target application information.

[0125] The application list information provided in this embodiment includes identification information of at least one application in the mobile terminal, and the target application information includes information of the application name and application icon of the target application.

[0126] In some embodiments, the startup module 101 provided in this embodiment includes a drawing unit and a startup unit;

[0127] The drawing unit is used to draw a virtual display screen on the mobile terminal in response to receiving an application start instruction for a target application on the mobile terminal sent by the user terminal.

[0128] The starting unit is used to start the target application and play the application content of the target application on the virtual display screen.

[0129] In some embodiments, see Fig.12 , the data processing device 100 provided in this embodiment further includes a first switching module 104 and a third sending module 105;

[0130] The first switching module 104 is configured to switch the first display mode of the display screen for playing the application content to the second display mode in response to a display mode switching instruction sent by the user terminal.

[0131] The second display mode is the display mode specified by the display mode switching instruction.

[0132] The third sending module 105 is used to send the encoded data corresponding to the application content of the target application in the second display mode to the user terminal, so that the user terminal can play the application content in the second display mode.

[0133] In some embodiments, the third sending module 105 provided in this embodiment includes a second encoding unit and a fourth sending unit;

[0134] The second encoding unit is used to encode the application content in the second display mode to obtain second audio and video stream data.

[0135] The fourth sending unit is used to send the second audio and video stream data to the user terminal, so that the user terminal plays the decoded second audio and video stream data on the display interface of the user terminal.

[0136] In some embodiments, see Fig.13 , Fig.13 is a structural diagram of a data processing device applied to a user terminal provided by an embodiment of the present invention, such as Fig.13 As shown, the data processing device 200 provided in the embodiment of the present invention is applied to a user terminal, and the data processing device 200 includes: a first instruction generating module 201, a first receiving module 202 and a playing module 203;

[0137] The first instruction generation module 201 is used to generate an application start instruction in response to a user start operation on a target application on the user terminal when in communication connection with the mobile terminal, and send the application start instruction to the mobile terminal.

[0138] The target application is an application on a mobile terminal.

[0139] The first receiving module 202 is used to receive first audio and video stream data sent by a mobile terminal.

[0140] The first audio and video stream data is data obtained by encoding the display content of the started target application by the mobile terminal.

[0141] The playing module 203 is used to decode the first audio and video stream data and play the decoded first audio and video stream data.

[0142] In some embodiments, see Fig.14 , Fig.14 is another structural diagram of a data processing device applied to a user terminal provided by an embodiment of the present invention. The data processing device 200 provided by this embodiment further includes a fourth sending module 204, a determining module 205, a fifth sending module 206 and a second receiving module 207;

[0143] The fourth sending module 204 is used to send first request information for obtaining application list information to the mobile terminal.

[0144] The determination module 205 is used to determine the target application displayed in the application list according to the application list information returned by the mobile terminal.

[0145] The fifth sending module 206 is configured to send second request information for acquiring target application information of a target application to the mobile terminal.

[0146] The second receiving module 207 is used to receive the target application information returned by the mobile terminal, and display the target application information in the application list.

[0147] The application list information provided in this embodiment includes identification information of at least one application in the mobile terminal, and the target application information includes information of the application name and application icon of the target application.

[0148] In some embodiments, the determination module 205 provided in this embodiment includes an acquisition unit, a deletion unit, and a determination unit;

[0149] The acquisition unit is used to acquire identification information of the local application on the user terminal.

[0150] The deleting unit is used to delete the identification information of the local application from the application list information returned by the mobile terminal to obtain the target application list information.

[0151] The determination unit is used to determine the application in the target application list information as the target application.

[0152] In some embodiments, see Fig.14 , the data processing device 200 further includes a generating module 208;

[0153] The generating module 208 is used to generate a display window in a preset area on the display interface of the user terminal.

[0154] In some embodiments, the playback module 203 provided in this embodiment is also used to play the first audio and video stream data after decoding in the display window.

[0155] In some embodiments, when the application content of the target application is played in the user terminal, please continue to refer to Fig.14 , the data processing device 200 further includes a second switching module 209, a sixth sending module 210, a third receiving module 211, and a decoding module 212;

[0156] The second switching module 209 is used to generate a display mode switching instruction in response to a display mode switching operation performed by a user on a target application.

[0157] The sixth sending module 210 is configured to send a display mode switching instruction to the mobile terminal.

[0158] The third receiving module 211 is used to receive the second audio and video stream data returned by the mobile terminal.

[0159] The decoding module 212 is used to decode the second audio and video stream data and play the decoded second audio and video stream data in a target display mode, where the target display mode is a display mode specified by the display mode switching instruction.

[0160] In some embodiments, see Fig.14 , the data processing device 200 further includes a marking module 213;

[0161] The marking module 213 is used to mark the target application in the application list of the user terminal.

[0162] During specific implementation, the above modules and / or units can be implemented as independent entities, or can be arbitrarily combined to be implemented as the same or several entities. The specific implementation of the above modules and / or units can refer to the previous method embodiments. The specific beneficial effects that can be achieved can also refer to the beneficial effects in the previous method embodiments, which will not be repeated here.

[0163] Also, see Fig.15 , Fig.15 1 is a schematic diagram of a structure of an electronic device provided by an embodiment of the present invention, and the electronic device may be a mobile terminal such as a smart phone, a tablet computer, or the like. Fig.15 As shown, the electronic device 300 includes a processor 301 and a memory 302. The processor 301 is electrically connected to the memory 302.

[0164] The processor 301 is the control center of the electronic device 300. It uses various interfaces and lines to connect various parts of the entire electronic device. It executes various functions of the electronic device 300 and processes data by running or loading applications stored in the memory 302 and calling data stored in the memory 302, thereby monitoring the electronic device 300 as a whole.

[0165] In this embodiment, the processor 301 in the electronic device 300 will load the instructions corresponding to the processes of one or more applications into the memory 302 according to the following steps, and the processor 301 will run the application stored in the memory 302, thereby implementing any step in the data processing method provided in the above embodiment.

[0166] The electronic device 300 can implement the steps in any embodiment of the data processing method provided in the embodiments of the present invention, and therefore can achieve the beneficial effects that can be achieved by any data processing method provided in the embodiments of the present invention. Please refer to the previous embodiments for details and will not be repeated here.

[0167] See also Fig.16 , Fig.16 is another structural schematic diagram of an electronic device provided by an embodiment of the present invention, such as Fig.16 As shown, Fig.16 The specific structural block diagram of the electronic device provided by the embodiment of the present invention is shown, and the electronic device can be used to implement the data processing method provided in the above embodiment. The electronic device 400 can be a mobile terminal such as a smart phone or a laptop computer.

[0168] The RF circuit 410 is used to receive and send electromagnetic waves, realize the mutual conversion between electromagnetic waves and electrical signals, and thus communicate with a communication network or other devices. The RF circuit 410 may include various existing circuit elements for performing these functions, such as antennas, radio frequency transceivers, digital signal processors, encryption / decryption chips, user identity module (SIM) cards, memories, etc. The RF circuit 410 can communicate with various networks such as the Internet, corporate intranets, wireless networks, or communicate with other devices through wireless networks. The above-mentioned wireless networks may include cellular telephone networks, wireless local area networks, or metropolitan area networks. The above-mentioned wireless networks can use various communication standards, protocols and technologies, including but not limited to Global System for Mobile Communication (GSM), Enhanced Data GSM Environment (EDGE), Wideband Code Division Multiple Access (WCDMA), Code Division Multiple Access (CDMA), Time Division Multiple Access (TDMA), Wireless Fidelity (Wi-Fi) (such as Institute of Electrical and Electronics Engineers standards IEEE 802.11a, IEEE 802.11b, IEEE802.11g and / or IEEE802.11n), Voice over Internet Protocol (VoIP), Worldwide Interoperability for Microwave Access (Wi-Max), other protocols for email, instant messaging and short messages, and any other suitable communication protocols, even those that have not yet been developed.

[0169] The memory 420 may be used to store software programs and modules, such as program instructions / modules corresponding to the data processing method in the above-mentioned embodiment. The processor 480 executes various functional applications and processes data by running the software programs and modules stored in the memory 420.

[0170] The memory 420 may include a high-speed random access memory, and may also include a non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some examples, the memory 420 may further include a memory remotely arranged relative to the processor 480, and these remote memories may be connected to the electronic device 400 via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

[0171] The input unit 430 can be used to receive input digital or character information, and generate keyboard, mouse, joystick, optical or trackball signal input related to user settings and function control. Specifically, the input unit 430 may include a touch-sensitive surface 431 and other input devices 432. The touch-sensitive surface 431, also known as a touch display screen or a touchpad, can collect user touch operations on or near it (such as operations performed by users using fingers, styluses, or any other suitable objects or accessories on or near the touch-sensitive surface 431), and drive corresponding connection devices according to a pre-set program. Optionally, the touch-sensitive surface 431 may include a touch detection device and a touch controller. Among them, the touch detection device detects the user's touch orientation, detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts it into touch point coordinates, and then sends it to the processor 480, and can receive and execute commands sent by the processor 480. In addition, the touch-sensitive surface 431 can be implemented in various types such as resistive, capacitive, infrared, and surface acoustic waves. In addition to the touch-sensitive surface 431, the input unit 430 may further include other input devices 432. Specifically, other input devices 432 may include but are not limited to one or more of a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, a joystick, and the like.

[0172] The display unit 440 can be used to display information input by the user or information provided to the user and various graphical user interfaces of the electronic device 400, which can be composed of graphics, text, icons, videos and any combination thereof. The display unit 440 may include a display panel 441, and optionally, the display panel 441 may be configured in the form of LCD (Liquid Crystal Display), OLED (Organic Light-Emitting Diode), etc. Further, the touch-sensitive surface 431 may cover the display panel 441, and when the touch-sensitive surface 431 detects a touch operation on or near it, it is transmitted to the processor 480 to determine the type of the touch event, and then the processor 480 provides corresponding visual output on the display panel 441 according to the type of the touch event. Although in the figure, the touch-sensitive surface 431 and the display panel 441 are implemented as two independent components to implement input and output functions, in some embodiments, the touch-sensitive surface 431 and the display panel 441 can be integrated to implement input and output functions.

[0173] The electronic device 400 may also include at least one sensor 450, such as a light sensor, a motion sensor, and other sensors. Specifically, the light sensor may include an ambient light sensor and a proximity sensor, wherein the ambient light sensor may adjust the brightness of the display panel 441 according to the brightness of the ambient light, and the proximity sensor may generate an interrupt when the flip cover is closed or closed. As a type of motion sensor, the gravity acceleration sensor can detect the magnitude of acceleration in each direction (generally three axes), and can detect the magnitude and direction of gravity when stationary. It can be used for applications that identify the posture of the mobile phone (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), vibration recognition related functions (such as pedometer, tapping), etc.; as for other sensors such as gyroscopes, barometers, hygrometers, thermometers, infrared sensors, etc. that can also be configured in the electronic device 400, they will not be repeated here.

[0174] The audio circuit 460, the speaker 461, and the microphone 462 can provide an audio interface between the user and the electronic device 400. The audio circuit 460 can transmit the electrical signal converted from the received audio data to the speaker 461, which is converted into a sound signal for output; on the other hand, the microphone 462 converts the collected sound signal into an electrical signal, which is received by the audio circuit 460 and converted into audio data, and then the audio data is output to the processor 480 for processing, and then sent to another terminal through the RF circuit 410, or the audio data is output to the memory 420 for further processing. The audio circuit 460 may also include an earplug jack to provide communication between an external headset and the electronic device 400.

[0175] The electronic device 400 can help the user receive requests, send information, etc. through the transmission module 470 (such as a Wi-Fi module), which provides the user with wireless broadband Internet access. Although the transmission module 470 is shown in the figure, it is understandable that it is not a necessary component of the electronic device 400 and can be omitted as needed without changing the essence of the invention.

[0176] The processor 480 is the control center of the electronic device 400. It uses various interfaces and lines to connect various parts of the entire mobile phone. By running or executing software programs and / or modules stored in the memory 420, and calling data stored in the memory 420, it executes various functions of the electronic device 400 and processes data, thereby monitoring the electronic device as a whole. Optionally, the processor 480 may include one or more processing cores; in some embodiments, the processor 480 may integrate an application processor and a modem processor, wherein the application processor mainly processes the operating system, user interface, and application programs, etc., and the modem processor mainly processes wireless communications. It can be understood that the above-mentioned modem processor may not be integrated into the processor 480.

[0177] The electronic device 400 also includes a power supply 490 (such as a battery) for supplying power to various components. In some embodiments, the power supply can be logically connected to the processor 480 through a power management system, so that the power management system can manage charging, discharging, and power consumption management. The power supply 490 can also include any components such as one or more DC or AC power supplies, recharging systems, power failure detection circuits, power converters or inverters, and power status indicators.

[0178] Although not shown, the electronic device 400 also includes a camera (such as a front camera, a rear camera), a Bluetooth module, etc., which will not be described in detail here. Specifically in this embodiment, the display unit of the electronic device is a touch screen display, and the mobile terminal also includes a memory, and one or more programs, wherein one or more programs are stored in the memory, and are configured to be executed by one or more processors to implement any step of the data processing method provided in the above embodiment.

[0179] In specific implementation, the above modules can be implemented as independent entities, or can be arbitrarily combined and implemented as the same or several entities. The specific implementation of the above modules can be found in the previous method embodiments, which will not be repeated here.

[0180] Those skilled in the art can understand that all or part of the steps in the various methods of the above embodiments can be completed by instructions, or by controlling related hardware through instructions, and the instructions can be stored in a computer-readable storage medium and loaded and executed by a processor. To this end, an embodiment of the present invention provides a storage medium, which stores multiple instructions, and the instructions can be executed by the processor to implement any step of the data processing method provided in the above embodiments.

[0181] The storage medium may include: a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, etc.

[0182] Since the instructions stored in the storage medium can execute the steps in any embodiment of the data processing method provided in the embodiments of the present invention, the beneficial effects that can be achieved by any data processing method provided in the embodiments of the present invention can be achieved. Please refer to the previous embodiments for details and will not be repeated here.

[0183] The above is a detailed introduction to a data processing method, device, electronic device and storage medium provided in the embodiments of the present application. Specific examples are used in this article to illustrate the principles and implementation methods of the present application. The description of the above embodiments is only used to help understand the method and its core idea of ​​the present application. At the same time, for those skilled in the art, according to the idea of ​​the present application, there will be changes in the specific implementation methods and application scope. In summary, the content of this specification should not be understood as a limitation on the present application. Moreover, for those of ordinary skill in the art, without departing from the principles of the present invention, several improvements and modifications can be made, and these improvements and modifications are also regarded as the protection scope of the present invention.

Claims

1. A data processing method, characterized in that: Applied to a mobile terminal, the method comprises: In a case of being in communication connection with a user terminal, in response to receiving an application start instruction for a target application on the mobile terminal sent by the user terminal, start the target application; The encoded data corresponding to the application content of the started target application is sent to the user terminal so that the user terminal can play the application content of the target application, the application content includes at least one of audio data and video data, and the target application is a preset application displayed on the user terminal.

2. The method according to claim 1, characterized in that Before the step of starting the target application in response to receiving an application starting instruction for the target application on the mobile terminal sent by the user terminal, the method further includes: The target application information of the target application on the mobile terminal is sent to the user terminal to support the user terminal to display the target application information.

3. The method according to claim 2, characterized in that The sending the target application information of the target application on the mobile terminal to the user terminal to support the user terminal to display the target application information includes: In response to receiving the request information for obtaining the target application list sent by the user terminal, the target application information of the target application on the mobile terminal is sent to the user terminal to support the user terminal to display the target application list composed of the target application information.

4. The method according to claim 3, characterized in that The step of sending the target application information of the target application on the mobile terminal to the user terminal in response to receiving the request information for obtaining the target application list sent by the user terminal, so as to support the user terminal to display the target application list composed of the target application information, includes: In response to the first request information sent by the user terminal, sending the application list information of the mobile terminal to the user terminal, so that the user terminal determines the target application according to the application list information; In response to the second request information sent by the user terminal, the target application information of the target application is sent to the user terminal to support the user terminal in displaying a target application list composed of the target application information.

5. The method according to claim 4, characterized in that The application list information includes identification information of at least one application in the mobile terminal, and the target application information includes information of an application name and an application icon of the target application.

6. The method according to claim 1, characterized in that The step of starting the target application in response to receiving an application starting instruction sent by the user terminal for the target application on the mobile terminal comprises: In response to receiving an application start instruction for a target application on the mobile terminal sent by the user terminal, drawing a virtual display screen on the mobile terminal; The target application is started, and application content of the target application is played on the virtual display screen.

7. The method according to claim 1, characterized in that The sending of the encoded data corresponding to the application content of the started target application to the user terminal so that the user terminal plays the application content of the target application includes: Encoding the application content of the started target application to obtain first audio and video stream data; The first audio and video stream data is sent to the user terminal, so that the user terminal plays the decoded first audio and video stream data on the display interface of the user terminal.

8. The method according to claim 1, characterized in that In the case where the application content of the target application is played in the user terminal, the method further includes: In response to the display mode switching instruction sent by the user terminal, switching a first display mode of a display screen playing the application content to a second display mode, where the second display mode is a display mode specified by the display mode switching instruction; The encoded data corresponding to the application content of the target application in the second display mode is sent to the user terminal, so that the user terminal plays the application content in the second display mode.

9. The method according to claim 8, characterized in that The sending the encoded data corresponding to the application content of the target application in the second display mode to the user terminal so that the user terminal plays the application content in the second display mode includes: Encoding the application content in the second display mode to obtain second audio and video stream data; The second audio and video stream data is sent to the user terminal, so that the user terminal plays the decoded second audio and video stream data on the display interface of the user terminal.

10. A data processing method, characterized in that: Applied to a user terminal, the method comprises: In the case of communication connection with a mobile terminal, in response to a user starting operation on a target application on the user terminal, generating an application start instruction, and sending the application start instruction to the mobile terminal, the target application being an application on the mobile terminal; Receiving first audio and video stream data sent by the mobile terminal, where the first audio and video stream data is data obtained by encoding the display content of the started target application by the mobile terminal; The first audio and video stream data is decoded and played.

11. The method according to claim 10, characterized in that Before the step of generating an application startup instruction in response to a user's startup operation on the target application on the user terminal, and sending the application startup instruction to the mobile terminal, the method further includes: Sending first request information for obtaining application list information to the mobile terminal; Determining a target application displayed in the application list according to the application list information returned by the mobile terminal; Sending second request information for acquiring target application information of a target application to the mobile terminal; The target application information returned by the mobile terminal is received, and the target application information is displayed in an application list.

12. The method according to claim 11, characterized in that The application list information includes identification information of at least one application in the mobile terminal, and the target application information includes information of an application name and an application icon of the target application.

13. The method according to claim 12, characterized in that The determining, according to the application list information returned by the mobile terminal, a target application displayed in the application list, comprises: Obtaining identification information of a local application on the user terminal; Deleting the identification information of the local application from the application list information returned by the mobile terminal to obtain target application list information; An application in the target application list information is determined as a target application.

14. The method according to claim 10, characterized in that Before the step of decoding the first audio and video stream data, the method further includes: Generating a display window in a preset area on the display interface of the user terminal; The playing of the first audio and video stream data after decoding includes: The first audio and video stream data after decoding is played in the display window.

15. The method according to claim 10, characterized in that In the case where the application content of the target application is played in the user terminal, the method further includes: generating a display mode switching instruction in response to a display mode switching operation performed by a user on the target application; Sending the display mode switching instruction to the mobile terminal; Receiving second audio and video stream data returned by the mobile terminal; The second audio and video stream data is decoded and played in a target display mode, where the target display mode is a display mode specified by the display mode switching instruction.

16. The method according to claim 11, characterized in that After the step of displaying the target application information in the application list, the method further includes: The target application in the application list is marked.

17. A data processing device, characterized in that: Applied to a mobile terminal, the device comprises: a starting module, configured to start the target application on the mobile terminal in response to receiving an application starting instruction for the target application sent by the user terminal when the mobile terminal is in communication connection with the user terminal; The first sending module is used to send the encoded data corresponding to the application content of the started target application to the user terminal so that the user terminal can play the application content of the target application, the application content includes at least one of audio data and video data, and the target application is a preset application displayed on the user terminal.

18. A data processing device, characterized in that: Applied to a display terminal, the device comprises: A first instruction generation module is used to generate an application startup instruction in response to a user's startup operation on a target application on the user terminal when the mobile terminal is in communication connection with the mobile terminal, and send the application startup instruction to the mobile terminal, wherein the target application is an application on the mobile terminal; A first receiving module, configured to receive first audio and video stream data sent by the mobile terminal, wherein the first audio and video stream data is data obtained by encoding the display content of the started target application by the mobile terminal; The playing module is used to decode the first audio and video stream data and play the decoded first audio and video stream data.

19. An electronic device, characterized in that: The electronic device comprises a processor, a memory, and a computer program stored in the memory and executable on the processor, and the processor implements the steps in the method according to any one of claims 1 to 16 when executing the computer program.

20. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps in the method according to any one of claims 1 to 16 are implemented.

Images