Screen sharing method of mobile terminal, mobile terminal and storage medium

By sending screen sharing requests between mobile terminals and parsing session name fields, combining the method of recording and encoding interface content, the problem of low screen sharing efficiency in mobile terminals in the prior art is solved, and fast and efficient screen sharing is achieved.

CN114765603BActive Publication Date: 2025-03-14ZTE CORP
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202011635623.8
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2020-12-31
Publication Date
2025-03-14
Estimated Expiration
2040-12-31

AI Technical Summary

Technical Problem

In the prior art, mobile terminal screen sharing is inefficient, and additional programs are required to download and register additional accounts.

Method used

The screen sharing request is sent to the second mobile terminal through the first mobile terminal, and the request includes the mobile phone number of the second mobile terminal and the first SIP INVITE message, parsing the session name field to determine the sharing type, and recording the interface content encoded as a video stream to send.

Benefits of technology

It realizes rapid screen sharing, reduces the problem of low efficiency for users during screen sharing, and improves the efficiency of screen sharing in mobile terminals.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114765603B_ABST
    Figure CN114765603B_ABST
Patent Text Reader

Abstract

An embodiment of the present invention provides a screen sharing method for a mobile terminal, the method comprising: a first mobile terminal defines a session name field of session header information in a first SIP INVITE message as a specific value; the first mobile terminal sends a screen sharing request to a second mobile terminal; when the first mobile terminal receives an indication of receiving screen sharing returned by the second mobile terminal, the first mobile terminal records the interface content of the first mobile terminal and encodes the recorded content into a video stream; the first mobile terminal sends the video stream to the second mobile terminal for screen sharing. Through the present invention, the problem of low efficiency of mobile terminal screen sharing is solved, thereby achieving the effect of improving the efficiency of mobile terminal screen sharing.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The embodiments of the present invention relate to the communication field, and in particular, to a screen sharing method of a mobile terminal, a mobile terminal and a storage medium. Background Art

[0002] In the prior art, in the process of implementing mobile terminal screen sharing, it is usually necessary to install the same third-party application on two terminals, then register accounts, and perform mobile terminal screen sharing by searching for accounts.

[0003] However, the screen sharing method in the prior art requires downloading an additional program and registering an additional account to realize screen sharing, and the efficiency of screen sharing is low. Summary of the invention

[0004] The embodiments of the present invention provide a screen sharing method of a mobile terminal, a mobile terminal and a storage medium, so as to at least solve the problem of low efficiency of screen sharing of a mobile terminal in the related art.

[0005] According to an embodiment of the present invention, a screen sharing method for a mobile terminal is provided, comprising: a first mobile terminal defines a session name field of session header information in a first SIP INVITE message as a specific value; the first mobile terminal sends a screen sharing request to a second mobile terminal, wherein the screen sharing request includes a mobile phone number on the second mobile terminal, and the screen sharing request also includes the first SIP INVITE message; when the second mobile terminal receives the screen sharing request, it parses the first SIP INVITE message in the screen sharing request to obtain the session name field of the session header information of the first SIP INVITE message; when the session name field is the specific value, it prompts that there is an invitation for remote desktop sharing; when the session name field is empty, it processes according to a default RCS video sharing service process; when the first mobile terminal receives an indication of receiving screen sharing returned by the second mobile terminal, the first mobile terminal records the interface content of the first mobile terminal and encodes the recorded content into a video stream; the first mobile terminal sends the video stream to the second mobile terminal for screen sharing.

[0006] According to another embodiment of the present invention, a screen sharing method for a mobile terminal is provided, comprising: a second mobile terminal receives a screen sharing request from a first mobile terminal, wherein the screen sharing request includes a mobile phone number on the second mobile terminal, and the screen sharing request also includes a first SIP INVITE message; the second mobile terminal parses the first SIP INVITE message, and when a session name field of session header information in the first SIP INVITE message is a specific value, prompts an invitation for remote desktop sharing, and when the session name field is empty, processes the message according to a default RCS video sharing service process; the second mobile terminal sends an indication of receiving screen sharing or an indication of rejecting screen sharing to the first mobile terminal; when the second mobile terminal sends the indication of receiving screen sharing to the first mobile terminal, the second mobile terminal receives a video stream sent by the first mobile terminal for screen sharing, wherein the video stream is obtained by recording the interface content of the first mobile terminal by the first mobile terminal and encoding the recorded content.

[0007] According to another embodiment of the present invention, a first mobile terminal is provided, comprising: a defining unit, configured to define a session name field of session header information in a first SIP INVITE message as a specific value; a first sending unit, configured to send a screen sharing request to a second mobile terminal, wherein the screen sharing request includes a mobile phone number on the second mobile terminal, and the screen sharing request also includes the first SIP INVITE message, and when the second mobile terminal receives the screen sharing request, the first SIP INVITE message in the screen sharing request is parsed to obtain the session name field of the session header information of the first SIP INVITE message, and when the session name field is the specific value, a prompt is given that there is an invitation for remote desktop sharing, and when the session name field is empty, a default RCS video sharing service process is used for processing; a recording unit, configured to record the interface content of the first mobile terminal and encode the recorded content into a video stream when the first mobile terminal receives an indication of receiving screen sharing returned by the second mobile terminal; and a second sending unit, configured for the first mobile terminal to send the video stream to the second mobile terminal for screen sharing.

[0008] According to another embodiment of the present invention, a second mobile terminal is provided, comprising: a first receiving unit, configured to receive a screen sharing request from the first mobile terminal, wherein the screen sharing request includes a mobile phone number on the second mobile terminal, and the screen sharing request also includes a first SIP INVITE message; a parsing unit, configured to parse the first SIP INVITE message, and when a session name field of session header information in the first SIP INVITE message is a specific value, prompt an invitation for remote desktop sharing, and when the session name field is empty, process the message according to a default RCS video sharing service flow; a sending unit, configured to send an indication of receiving screen sharing or an indication of rejecting screen sharing to the first mobile terminal; and a second receiving unit, configured to receive a video stream sent by the first mobile terminal for screen sharing when the second mobile terminal sends the indication of receiving screen sharing to the first mobile terminal, wherein the video stream is obtained by recording the interface content of the first mobile terminal by the first mobile terminal and encoding the recorded content.

[0009] According to yet another embodiment of the present invention, a computer-readable storage medium is provided, in which a computer program is stored, wherein the computer program is configured to execute the steps of any one of the above method embodiments when run.

[0010] According to another embodiment of the present invention, there is provided an electronic device, including a memory and a processor, wherein the memory stores a computer program, and the processor is configured to run the computer program to execute the steps in any one of the above method embodiments.

[0011] Through the present invention, when sharing the screen of a mobile terminal, the first mobile terminal can directly initiate a screen sharing request to the second mobile terminal through the mobile phone number of the second mobile terminal, and carry an identifier that the request is a screen sharing request through the first SIP INVITE message, thereby achieving the effect of quickly sharing the screen. Therefore, the problem of low efficiency of mobile terminal screen sharing can be solved, thereby achieving the effect of improving the efficiency of mobile terminal screen sharing. BRIEF DESCRIPTION OF THE DRAWINGS

[0012] Figure 1 is a hardware structure block diagram of a mobile terminal according to a screen sharing method of a mobile terminal according to an embodiment of the present invention;

[0013] Figure 2 is a flow chart of a screen sharing method of a mobile terminal according to an embodiment of the present invention;

[0014] Figure 3is a flow chart of another screen sharing method of a mobile terminal according to an embodiment of the present invention;

[0015] Figure 4 is a flowchart of another screen sharing method of a mobile terminal according to an embodiment of the present invention;

[0016] Figure 5 is an interactive schematic diagram of a screen sharing method of a mobile terminal according to an embodiment of the present invention;

[0017] Figure 6 is a schematic structural diagram of a first mobile terminal according to an embodiment of the present invention;

[0018] Figure 7 is a schematic structural diagram of a second mobile terminal according to an embodiment of the present invention. DETAILED DESCRIPTION

[0019] Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings and in combination with the embodiments.

[0020] It should be noted that the terms "first", "second", etc. in the specification and claims of the present invention and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence.

[0021] The method embodiments provided in the embodiments of the present application can be executed in a mobile terminal, a computer terminal or a similar computing device. Taking running on a mobile terminal as an example, Figure 1 FIG. 1 is a hardware structure diagram of a mobile terminal of a method for sharing a screen of a mobile terminal according to an embodiment of the present invention. Figure 1 As shown, the mobile terminal may include one or more ( Figure 1 Only one is shown in the figure) a processor 102 (the processor 102 may include but is not limited to a processing device such as a microprocessor MCU or a programmable logic device FPGA) and a memory 104 for storing data, wherein the mobile terminal may also include a transmission device 106 and an input / output device 108 for communication functions. It can be understood by those skilled in the art that Figure 1 The structure shown is for illustration only and does not limit the structure of the mobile terminal. Figure 1 More or fewer components as shown, or with Figure 1 Different configurations are shown.

[0022] The memory 104 can be used to store computer programs, for example, software programs and modules of application software, such as the computer program corresponding to the screen sharing method of the mobile terminal in the embodiment of the present invention. The processor 102 executes various functional applications and data processing by running the computer program stored in the memory 104, that is, to implement the above method. The memory 104 may include a high-speed random access memory, and may also include a non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some instances, the memory 104 may further include a memory remotely arranged relative to the processor 102, and these remote memories may be connected to the mobile terminal via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

[0023] The transmission device 106 is used to receive or send data via a network. The specific example of the above network may include a wireless network provided by a communication provider of the mobile terminal. In one example, the transmission device 106 includes a network adapter (Network Interface Controller, referred to as NIC), which can be connected to other network devices through a base station so as to communicate with the Internet. In one example, the transmission device 106 can be a radio frequency (RF) module, which is used to communicate with the Internet wirelessly.

[0024] In this embodiment, a screen sharing method of a mobile terminal is provided. Figure 2 is a flow chart of a screen sharing method for a mobile terminal according to an embodiment of the present invention. Figure 2 As shown, the process includes the following steps:

[0025] S202, the first mobile terminal defines the session name field of the session header information in the first SIP INVITE message as a specific value;

[0026] S204, the first mobile terminal sends a screen sharing request to the second mobile terminal, wherein the screen sharing request includes the mobile phone number of the second mobile terminal, and the screen sharing request also includes the first SIP INVITE message, and when the second mobile terminal receives the screen sharing request, the second mobile terminal parses the first SIP INVITE message in the screen sharing request to obtain the session name field of the session header information of the first SIP INVITE message, and when the session name field is the specific value, prompts that there is an invitation for remote desktop sharing, and when the session name field is empty, processes according to the default RCS video sharing service process;

[0027] S206, when the first mobile terminal receives the screen sharing receiving instruction returned by the second mobile terminal, the first mobile terminal records the interface content of the first mobile terminal and encodes the recorded content into a video stream;

[0028] S208: The first mobile terminal sends the video stream to the second mobile terminal for screen sharing.

[0029] Optionally, the screen sharing method of the above-mentioned mobile terminal can be applied to, but not limited to, the process of sharing screens between mobile terminals. The first mobile terminal can be a terminal for sharing screens, and the second mobile terminal can be a terminal for displaying the screen of the first mobile terminal. If the first mobile terminal initiates a screen sharing request to the second mobile terminal, the screen sharing request can be directly sent to the second mobile terminal through the mobile phone number of the second mobile terminal. If the second mobile terminal agrees to screen sharing, the first mobile terminal records the interface content of the first mobile terminal and shares it with the second mobile terminal. The second mobile terminal can display the interface content shared by the first mobile terminal and operate the interface content, then the interface of the first mobile terminal performs corresponding processing according to the operation of the second mobile terminal, thereby realizing the sharing of the screen of the first mobile terminal to the second mobile terminal.

[0030] As an optional example, the method further includes:

[0031] When receiving the pause instruction sent by the second mobile terminal, the first mobile terminal pauses recording the interface content, or the first mobile terminal pauses sending the video stream to the second mobile terminal.

[0032] As an optional example, during the screen sharing process, the method further includes:

[0033] The first mobile terminal receives a SIP UPDATE message sent by the second mobile terminal, wherein the second mobile terminal, after performing a touch operation on the screen interface of the first mobile terminal, fills the touch operation and the touch position of the touch operation into a specific field of the SIP UPDATE message;

[0034] The first mobile terminal parses the SIP UPDATE message to obtain the touch operation and the touch position of the touch operation.

[0035] As an optional example, the method further includes:

[0036] The first mobile terminal establishes an instant messaging session with the second mobile terminal;

[0037] The first mobile terminal receives a session message sent by the second mobile terminal, and when parsing the session message to include a specific field, obtains a touch operation performed by the second mobile terminal on the screen interface of the first mobile terminal during the screen sharing process and a touch position of the touch operation recorded in the specific field;

[0038] The first mobile terminal forwards the touch operation and the touch position of the touch operation to the screen sharing application.

[0039] As an optional example, the method further includes:

[0040] The first mobile terminal receives a second SIP invite message sent by the second mobile terminal;

[0041] The first mobile terminal parses the second sip invite message to obtain the touch operation performed by the second mobile terminal on the screen interface of the first mobile terminal during the screen sharing process and the touch position of the touch operation.

[0042] As an optional example, a screen sharing method of a mobile terminal is provided, such as Figure 3 As shown, the above method includes:

[0043] S302, the second mobile terminal receives a screen sharing request from the first mobile terminal, wherein the screen sharing request includes a mobile phone number on the second mobile terminal, and the screen sharing request also includes a first SIP INVITE message;

[0044] S304, the second mobile terminal parses the first SIP INVITE message, and when the session name field of the session header information in the first SIP INVITE message is a specific value, prompts that there is an invitation for remote desktop sharing, and when the session name field is empty, processes according to the default RCS video sharing service process;

[0045] S306, the second mobile terminal sends an instruction to receive screen sharing or an instruction to reject screen sharing to the first mobile terminal;

[0046] S308, when the second mobile terminal sends the indication of receiving screen sharing to the first mobile terminal, the second mobile terminal receives the video stream sent by the first mobile terminal to perform screen sharing, wherein the video stream is obtained by the first mobile terminal recording the interface content of the first mobile terminal and encoding the recorded content.

[0047] As an optional example, during the screen sharing process, the method further includes:

[0048] After the second mobile terminal performs a touch operation on the screen interface of the first mobile terminal, the second mobile terminal fills the touch operation and the touch position of the touch operation into a specific field of the SIP UPDATE message;

[0049] The second mobile terminal sends a SIP UPDATE message to the first mobile terminal, so that the first mobile terminal parses the SIP UPDATE message to obtain the touch operation and the touch position of the touch operation.

[0050] As an optional example, during the screen sharing process, the method further includes:

[0051] The second mobile terminal establishes an instant messaging session with the first mobile terminal;

[0052] The second mobile terminal sends a session message to the first mobile terminal, wherein the session message includes a specific field, and the specific field records the touch operation performed by the second mobile terminal on the screen interface of the first mobile terminal during screen sharing and the touch position of the touch operation.

[0053] As an optional example, during the screen sharing process, the method further includes:

[0054] The second mobile terminal sends a second SIP invite message to the first mobile terminal, wherein the second SIP invite message includes a touch operation performed by the second mobile terminal on the screen interface of the first mobile terminal during screen sharing and a touch position of the touch operation.

[0055] As an optional example, during the screen sharing process, the method further includes:

[0056] The second mobile terminal sends a pause instruction to the first mobile terminal, so that the first mobile terminal pauses recording interface content, or pauses sending recorded content to the second mobile terminal.

[0057] A specific example is used for illustration. The first mobile terminal and the second mobile terminal in the embodiment of the present application may be mobile communication terminals, and may be mobile terminals supporting Rich Communication Suite (RCS) services. The relevant standard information of RCS is GSMA RCC.71RCC.07

[0058] In the embodiment of the present application, the first mobile terminal and the second mobile terminal may be mobile phones. Taking a mobile phone supporting RCS as an example, mobile phone A may send a screen sharing request to mobile phone B, and mobile phone B responds to mobile phone A with an indication of receiving sharing, then mobile phone A may send the shared content to mobile phone B for display, and the user clicks on the screen content of mobile phone A displayed on mobile phone B to control the screen content of mobile phone A. The software part of the present application is divided into 6 modules. The modules may include: m1: desktop sharing service initiator control module. M2: desktop screen recording module. m3: video encoding module. m4: RCS protocol parsing module. m5: video decoding module. m6: desktop sharing service receiving end control module.

[0059] m1: Desktop sharing service initiator control module. This module is the user entrance for initiating remote desktop sharing. It has two functions: providing an operation interface for users to operate and responding to operations from remote mobile users.

[0060] m1-1 provides users with a process of inputting a phone number and initiating remote desktop sharing. For example, an interface can be provided for users to select a person in the address book, or to input a phone number, and then choose to initiate remote desktop sharing, or after a remote desktop sharing application is started, the user can choose to share his desktop with a remote phone.

[0061] m1-2 analyzes and processes the data information returned by the remote user operation. For example, if the user of mobile phone B clicks the screen, mobile phone B will send a message back, and mobile phone A will analyze and process the message and respond to the click.

[0062] m2: In the RCS video sharing service, this application consists of a desktop screen recording module, which is responsible for capturing the screen interface of mobile phone A and transmitting the data of the screen display content to m3 for video encoding.

[0063] m3: Video encoding module, responsible for encoding the data of the screen display content into a video stream according to a specific format, such as video encoded in H.264 format.

[0064] m4: RCS protocol parsing module. The RCS video sharing service uses the Session Initiation Protocol (SIP) to establish a session with mobile phone B. The relevant standard information of SIP is: IETF RFC3261. Mobile phone A will pass some parameters of video sharing through SIP invite message, and will update session information through SIP update message. In the embodiment of the present application, based on the extension of some optional fields in the protocol that were originally used only for manual analysis and not for program control, these extended fields are parsed to realize remote desktop sharing. For example, specific characters are used to inform that the request is a request to establish screen sharing.

[0065] m5: Video decoding module. Mobile phone B receives the video stream sent by mobile phone A, decodes it and displays it on the screen.

[0066] m6: desktop sharing service receiving end control module, which is responsible for receiving interface display and user screen operation (such as touching the menu on the screen interface) events, and sending the events back to mobile phone A.

[0067] The specific steps can be as follows Figure 4 As shown in steps S401 to S415.

[0068] process Figure 4 In S401: user A operates A's mobile phone and selects B's number as the target to start the remote desktop process. B's phone number can be directly entered, or the contact can be found from the address book or call log, and then B's phone number is automatically extracted as the target object. A clear desktop sharing operation menu is provided on the interface for the user to select and start the remote desktop process.

[0069] S402: Mobile phone A initiates an RCS video sharing service session invitation message to mobile phone B. In the message, the session name field of the session header information in the SIP INVITE is defined as a specific value to indicate that it is a special RCS video sharing service - remote desktop sharing service.

[0070] In the RCS service protocol, the session name field of the SIP INVITE message is not processed and is set to empty by default, that is:

[0071] "s="

[0072] In this embodiment, as an implementation example, it is set to "DesktopShare", that is, "s = DesktopShare"

[0073] S402: Mobile phone B receives A's RCS video sharing service session invitation message. S404: Mobile phone B parses the session name line in the message header to determine whether it is a remote desktop sharing service. If the name is a specific value for the implementation agreement, such as "s = DesktopShare", it indicates that it is a remote desktop sharing service. S405-1: Mobile phone B prompts the user on the screen that there is a remote desktop sharing invitation and waits for the user to operate. If the name is empty, S405-2: Process according to the default RCS video sharing service process.

[0074] S406: The user of mobile phone B touches the screen to accept the invitation, and mobile phone B sends a response message to mobile phone A.

[0075] S407: After mobile phone A receives the response message from mobile phone B, the RCS video sharing session is established and mobile phone A enters the remote desktop sharing state. Mobile phone A starts recording the screen and encodes it into a video stream in the session negotiation format and sends it to mobile phone B. Further,

[0076] S407-1, the remote sharing state of mobile phone A means that the front-end interface of mobile phone A will have a status prompt and a control entry to exit this state, and the background starts to enter the screen recording and video encoding state;

[0077] S407-2, the frame rate of screen recording can be set by the user according to the content of desktop sharing to ensure a better user experience. For example, if you want to provide the desktop of mobile phone A to mobile phone B to control mobile phone A, then the interface of mobile phone A will not change too quickly, and the screen can be recorded and encoded at a frame rate of 15fps; if it is a shared game, the screen can be recorded and encoded at the frame rate of the game video.

[0078] S407-3, the resolution parameters of the video encoding adopt the parameters determined in the session negotiation between mobile phone A and mobile phone B.

[0079] S408: Mobile phone B receives the video sent by mobile phone A and displays it on the screen according to the interface design of remote desktop sharing.

[0080] S408-1, remote desktop sharing, mobile phone A sends the screen recording of its own mobile phone, that is, the full-screen image displayed on the screen of mobile phone A. Although the video stream is compiled according to the resolution negotiated by the session, when it is sent to mobile phone B, a suitable display area still needs to be made according to the screen of mobile phone B.

[0081] S408-2, mobile phone B should be able to fully display the desktop image of mobile phone A.

[0082] At this point, based on the RCS video sharing service, mobile phone A sends the image of its screen to mobile phone B for display in real time.

[0083] S409, the user operates on mobile phone B. In step S408, the full screen interface on the screen of mobile phone A is displayed on the screen of mobile phone B. For example, if you click on the screen, the program will determine the touch point location area and perform different processing according to the area. Figure 5 shown. Figure 5 In the example, phone A sends the full screen image to phone B, and phone B displays the screen shared by phone A. If you click on the screen shared by phone A on phone B to form a touch point (solid point), the position of the point needs to be transmitted to phone A.

[0084] S410: If the touch point is within the full-screen image area of ​​mobile phone A, it is interpreted as an operation on mobile phone A. S411-1: Record the position coordinates of the touch point on the screen, process and package it into a touch event of the user on mobile phone A. The parameter information of the touch event includes the event type and position coordinates. The position coordinates of the touch point on the screen of mobile phone B should be combined with the position area of ​​the full-screen image of mobile phone A on the screen of mobile phone B, and further converted into the relative position ratio of the touch point in the full-screen image of mobile phone A. Furthermore, assuming that click Figure 5 The coordinates of the solid point touch point on the B phone are (540, 1500), and the A full screen image is (0, 100) in the upper left corner and (1080, 2020) in the lower right corner of the B screen area. Then the coordinates of this touch point on the A screen need to subtract an offset of 100 to become (440, 1500). Considering the difference in screen resolution between A and B, a scaling ratio must also be considered. Therefore, in order to accurately locate the position of the touch point on the A screen, this touch point uses a proportional value, x = 0.407 (i.e. 440 / 1080), y = 0.781 (i.e. 1500 / 1920).

[0085] Furthermore, the types of touch events on the screen by the user include click, double-click, long press, drag, etc., which are exactly the same as the touch event definitions of general Android phones / Iphone phones / Winphone phones.

[0086] S411-2: If the touch point is outside the full-screen area of ​​mobile phone A, it is interpreted as not an operation on mobile phone A, and is processed according to the touch of the current interface of mobile phone B.

[0087] S412, mobile phone B sends the user operation event to mobile phone A. Further, there are multiple ways to send the message back to A:

[0088] By using the session update message, the user operation event is filled into the specific field of the SIP UPDATE message, and a session update message request for the RCS service is sent to mobile phone A. In the RCS service framework, after a session is established, mobile phone A or B is allowed to send a session update message. In addition, the responding party can refuse the session update. When the receiving party refuses the session update, the current session will not be affected. Using this feature, two extended attributes are defined in the media information of the UPDATE message. The first one indicates that this is the type of remote user operation event, and the second one indicates the coordinates of the touch point. The example is as follows:

[0089] a=remote_action click

[0090] a=0.407 / 0.781

[0091] In the RCS service, multiple sessions are allowed to be established between users at the same time. When a video sharing service is established, a real-time chat session is established. In this way, the chat session can be used to send packaged user operation events. When A receives the chat message data, it parses the user operation time for remote desktop sharing according to the specific field information, and then forwards the event to the remote sharing application for processing.

[0092] The sip invite message of the RCS service is used to initiate a session invitation message again, and the user operation time is encapsulated into the data field of the message and returned to A.

[0093] S413, mobile phone A receives the SIP UPDATE message and needs to parse the description information of the message. When parsing the two new pieces of information in S8, it knows that this is a remote click operation of the user on mobile phone A, and saves the information of the user operation event.

[0094] S414, mobile phone A further analyzes the user operation event, replaces the corresponding coordinates transmitted by the SIP UPDATE message with the real coordinate positions on the current screen, and responds to the event according to the current application interface.

[0095] S415, mobile phone A sends a response message of the session update request to mobile phone B, rejecting the session update request initiated by mobile phone B. Preferably, according to the definition of the SIP protocol, a 48x response message can be selected. This type of message will not affect the current session, and will not initiate a session update, nor will it have any impact on the current session.

[0096] Through the above steps, mobile phone A can send its desktop to mobile phone B, and the user's operations on mobile phone B can be responded to on mobile phone A.

[0097] The advantage of the above embodiment is that users can directly initiate desktop sharing services based on mobile phone numbers, which greatly reduces the threshold for remote desktop between users. Ordinary users can initiate and use it at any time.

[0098] Moreover, this application is based on the framework of RCS services. RCS is a service that 5G terminals must support by default, and mobile terminals must support its basic protocols by default. Therefore, the technical difficulties of complex mobility management can be omitted, and it is easy to implement on the terminal; at the same time, this method can help operators add new business scenarios and increase revenue without modifying the network.

[0099] Through the description of the above implementation methods, those skilled in the art can clearly understand that the method according to the above embodiment can be implemented by means of software plus a necessary general hardware platform, and of course can also be implemented by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present invention is essentially or the part that contributes to the prior art can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, a magnetic disk, or an optical disk), and includes a number of instructions for a terminal device (which can be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods of various embodiments of the present invention.

[0100] In the present embodiment, a first mobile terminal is also provided, and the device is used to implement the above-mentioned embodiment and preferred implementation mode, and the description has been made no further. As used below, the term "module" can implement a combination of software and / or hardware of a predetermined function. Although the device described in the following embodiments is preferably implemented in software, the implementation of hardware, or a combination of software and hardware is also possible and conceived.

[0101] Figure 6 is a first mobile terminal in an embodiment of the present application, such as Figure 6 As shown, including:

[0102] A defining unit 602, configured to define a session name field of the session header information in the first SIP INVITE message as a specific value;

[0103] The first sending unit 604 is configured to send a screen sharing request to the second mobile terminal, wherein the screen sharing request includes a mobile phone number on the second mobile terminal, and the screen sharing request also includes the first SIP INVITE message. When the second mobile terminal receives the screen sharing request, it parses the first SIP INVITE message in the screen sharing request to obtain the session name field of the session header information of the first SIP INVITE message. When the session name field is the specific value, it prompts that there is an invitation for remote desktop sharing. When the session name field is empty, it is processed according to the default RCS video sharing service process.

[0104] The recording unit 606 is configured to record the interface content of the first mobile terminal and encode the recorded content into a video stream when the first mobile terminal receives the instruction of receiving screen sharing returned by the second mobile terminal;

[0105] The second sending unit 608 is used for the first mobile terminal to send the video stream to the second mobile terminal for screen sharing.

[0106] As an optional example, the first mobile terminal further includes:

[0107] The processing unit is used to, during the screen sharing process, when receiving a pause instruction sent by the second mobile terminal, cause the first mobile terminal to pause recording the interface content, or cause the first mobile terminal to pause sending the video stream to the second mobile terminal.

[0108] As an optional example, the first mobile terminal further includes:

[0109] A first receiving unit is configured to receive a SIP UPDATE message sent by the second mobile terminal during the screen sharing process, wherein the second mobile terminal fills the touch operation and the touch position of the touch operation into a specific field of the SIP UPDATE message after performing a touch operation on the screen interface of the first mobile terminal;

[0110] The first parsing unit is configured to parse the SIP UPDATE message to obtain the touch operation and the touch position of the touch operation.

[0111] As an optional example, the first mobile terminal further includes:

[0112] an establishing unit, configured to establish an instant messaging session with the second mobile terminal during the screen sharing process;

[0113] a second receiving unit, configured to receive a session message sent by the second mobile terminal, and, when parsing the session message to include a specific field, obtain a touch operation performed by the second mobile terminal on the screen interface of the first mobile terminal during the screen sharing process and a touch position of the touch operation recorded in the specific field;

[0114] The forwarding unit is used to forward the touch operation and the touch position of the touch operation to the screen sharing application.

[0115] As an optional example, the first mobile terminal further includes:

[0116] a third receiving unit, configured to receive, during the screen sharing process, a second sip invite message sent by the second mobile terminal;

[0117] The second parsing unit is used to parse the second sip invite message to obtain the touch operation performed by the second mobile terminal on the screen interface of the first mobile terminal during the screen sharing process and the touch position of the touch operation.

[0118] For other examples of this embodiment, please refer to the above examples and will not be described in detail here.

[0119] Figure 7 is another first mobile terminal in the embodiment of the present application, such as Figure 7 As shown, including:

[0120] The first receiving unit 702 is used to receive a screen sharing request from the first mobile terminal, wherein the screen sharing request includes a mobile phone number on the second mobile terminal, and the screen sharing request also includes a first SIP INVITE message;

[0121] The parsing unit 704 is used to parse the first SIP INVITE message, and when the session name field of the session header information in the first SIP INVITE message is a specific value, prompt that there is an invitation for remote desktop sharing, and when the session name field is empty, process it according to the default RCS video sharing service process;

[0122] A sending unit 706, configured to send an indication of receiving screen sharing or an indication of rejecting screen sharing to the first mobile terminal;

[0123] The second receiving unit 708 is used to receive the video stream sent by the first mobile terminal for screen sharing when the second mobile terminal sends the indication of receiving screen sharing to the first mobile terminal, wherein the video stream is obtained by recording the interface content of the first mobile terminal by the first mobile terminal and encoding the recorded content.

[0124] As an optional example, the second mobile terminal further includes:

[0125] A filling unit, configured to fill the touch operation and the touch position of the touch operation into a specific field of the SIP UPDATE message after the second mobile terminal performs a touch operation on the screen interface of the first mobile terminal during the screen sharing process;

[0126] The second sending unit is used to send a SIP UPDATE message to the first mobile terminal, so that the first mobile terminal parses the SIP UPDATE message to obtain the touch operation and the touch position of the touch operation.

[0127] As an optional example, the second mobile terminal further includes:

[0128] An establishing unit, configured to establish an instant messaging session with the first mobile terminal during screen sharing;

[0129] The third sending unit is used to send a session message to the first mobile terminal, wherein the session message includes a specific field, and the specific field records the touch operation performed by the second mobile terminal on the screen interface of the first mobile terminal during screen sharing and the touch position of the touch operation.

[0130] As an optional example, the second mobile terminal further includes:

[0131] The fourth sending unit is used to send a second SIP invite message to the first mobile terminal during screen sharing, wherein the second SIP invite message includes the touch operation performed by the second mobile terminal on the screen interface of the first mobile terminal during screen sharing and the touch position of the touch operation.

[0132] As an optional example, the second mobile terminal further includes:

[0133] The fifth sending unit is used for, during the screen sharing process, the second mobile terminal sending a pause instruction to the first mobile terminal, so that the first mobile terminal pauses recording interface content, or pauses sending recorded content to the second mobile terminal.

[0134] For other examples of this embodiment, please refer to the above examples and will not be described in detail here.

[0135] An embodiment of the present invention further provides a computer-readable storage medium, in which a computer program is stored, wherein the computer program is configured to execute the steps of any of the above method embodiments when running.

[0136] In an exemplary embodiment, the computer-readable storage medium may include, but is not limited to, various media that can store computer programs, such as a USB flash drive, a read-only memory (ROM), a random access memory (RAM), a mobile hard disk, a magnetic disk or an optical disk.

[0137] An embodiment of the present invention further provides an electronic device, including a memory and a processor, wherein a computer program is stored in the memory, and the processor is configured to run the computer program to execute the steps in any one of the above method embodiments.

[0138] In an exemplary embodiment, the electronic device may further include a transmission device and an input / output device, wherein the transmission device is connected to the processor, and the input / output device is connected to the processor.

[0139] For specific examples in this embodiment, reference may be made to the examples described in the above embodiments and exemplary implementation modes, and this embodiment will not be described in detail herein.

[0140] Obviously, those skilled in the art should understand that the above modules or steps of the present invention can be implemented by a general computing device, they can be concentrated on a single computing device, or distributed on a network composed of multiple computing devices, they can be implemented by a program code executable by a computing device, so that they can be stored in a storage device and executed by the computing device, and in some cases, the steps shown or described can be executed in a different order than here, or they can be made into individual integrated circuit modules, or multiple modules or steps therein can be made into a single integrated circuit module for implementation. Thus, the present invention is not limited to any specific combination of hardware and software.

[0141] The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. For those skilled in the art, the present invention may have various modifications and variations. Any modification, equivalent replacement, improvement, etc. made within the principle of the present invention shall be included in the protection scope of the present invention.

Claims

1. A screen sharing method for a mobile terminal, characterized in that: include: The first mobile terminal defines the session name field of the session header information in the first SIP INVITE message as a specific value; The first mobile terminal sends a screen sharing request to the second mobile terminal, wherein the screen sharing request includes a mobile phone number on the second mobile terminal, and the screen sharing request also includes the first SIP INVITE message. When the second mobile terminal receives the screen sharing request, it parses the first SIP INVITE message in the screen sharing request to obtain the session name field of the session header information of the first SIP INVITE message. When the session name field is the specific value, it prompts that there is an invitation for remote desktop sharing. When the session name field is empty, it is processed according to a default RCS video sharing service process. When the first mobile terminal receives the screen sharing receiving instruction returned by the second mobile terminal, the first mobile terminal records the interface content of the first mobile terminal and encodes the recorded content into a video stream; The first mobile terminal sends the video stream to the second mobile terminal for screen sharing; During the screen sharing process, the first mobile terminal receives a SIP UPDATE message sent by the second mobile terminal, wherein, after performing a touch operation on the screen interface of the first mobile terminal, the second mobile terminal fills the touch operation and the touch position of the touch operation into a specific field of the SIP UPDATE message; and the first mobile terminal parses the SIP UPDATE message to obtain the touch position of the touch operation.

2. The method according to claim 1, characterized in that During the screen sharing process, the method further includes: When receiving the pause instruction sent by the second mobile terminal, the first mobile terminal pauses recording the interface content, or the first mobile terminal pauses sending the video stream to the second mobile terminal.

3. The method according to claim 1, characterized in that During the screen sharing process, the method further includes: The first mobile terminal establishes an instant messaging session with the second mobile terminal; The first mobile terminal receives a session message sent by the second mobile terminal, and when parsing the session message to include a specific field, obtains a touch operation performed by the second mobile terminal on the screen interface of the first mobile terminal during the screen sharing process and a touch position of the touch operation recorded in the specific field; The first mobile terminal forwards the touch operation and the touch position of the touch operation to the screen sharing application.

4. The method according to claim 1, characterized in that: During the screen sharing process, the method further includes: The first mobile terminal receives a second SIP invite message sent by the second mobile terminal; The first mobile terminal parses the second sipInvite message to obtain the touch operation performed by the second mobile terminal on the screen interface of the first mobile terminal during the screen sharing process and the touch position of the touch operation.

5. A screen sharing method for a mobile terminal, characterized in that: include: The second mobile terminal receives a screen sharing request from the first mobile terminal, wherein the screen sharing request includes a mobile phone number on the second mobile terminal, and the screen sharing request also includes a first SIP INVITE message; The second mobile terminal parses the first SIP INVITE message, and when the session name field of the session header information in the first SIP INVITE message is a specific value, prompts that there is an invitation for remote desktop sharing, and when the session name field is empty, processes it according to a default RCS video sharing service process; The second mobile terminal sends an instruction to receive screen sharing or an instruction to reject screen sharing to the first mobile terminal; In the case where the second mobile terminal sends the instruction to receive screen sharing to the first mobile terminal, the second mobile terminal receives the video stream sent by the first mobile terminal to perform screen sharing, wherein the video stream is obtained by the first mobile terminal recording the interface content of the first mobile terminal and encoding the recorded content; During screen sharing, the second mobile terminal sends a SIP UPDATE message to the first mobile terminal, wherein after performing a touch operation on the screen interface of the first mobile terminal, the second mobile terminal fills the touch operation and the touch position of the touch operation into a specific field of the SIP UPDATE message.

6. A first mobile terminal, characterized in that: include: A defining unit, configured to define a session name field of the session header information in the first SIP INVITE message as a specific value; A first sending unit is configured to send a screen sharing request to a second mobile terminal, wherein the screen sharing request includes a mobile phone number on the second mobile terminal, and the screen sharing request also includes the first SIP INVITE message, and when the second mobile terminal receives the screen sharing request, the second mobile terminal parses the first SIP INVITE message in the screen sharing request to obtain the session name field of the session header information of the first SIP INVITE message, and when the session name field is the specific value, prompts that there is an invitation for remote desktop sharing, and when the session name field is empty, processes according to a default RCS video sharing service process; a recording unit, configured to record the interface content of the first mobile terminal and encode the recorded content into a video stream when the first mobile terminal receives the instruction of receiving screen sharing returned by the second mobile terminal; A second sending unit, configured for the first mobile terminal to send the video stream to the second mobile terminal for screen sharing; The first mobile terminal is also used for: during the screen sharing process, the first mobile terminal receives a SIP UPDATE message sent by the second mobile terminal, wherein, after the second mobile terminal performs a touch operation on the screen interface of the first mobile terminal, the touch operation and the touch position of the touch operation are filled into a specific field of the SIP UPDATE message; the first mobile terminal parses the SIP UPDATE message to obtain the touch position of the touch operation.

7. A second mobile terminal, characterized in that: include: A first receiving unit, configured to receive a screen sharing request from a first mobile terminal, wherein the screen sharing request includes a mobile phone number on the second mobile terminal, and the screen sharing request also includes a first SIP INVITE message; a parsing unit, configured to parse the first SIP INVITE message, and when a session name field of session header information in the first SIP INVITE message is a specific value, prompt that there is an invitation for remote desktop sharing, and when the session name field is empty, process according to a default RCS video sharing service process; a sending unit, configured to send an instruction to receive screen sharing or an instruction to reject screen sharing to the first mobile terminal; a second receiving unit, configured to receive a video stream sent by the first mobile terminal to perform screen sharing when the second mobile terminal sends the instruction to receive screen sharing to the first mobile terminal, wherein the video stream is obtained by recording the interface content of the first mobile terminal by the first mobile terminal and encoding the recorded content; The second mobile terminal is also used for: during the screen sharing process, the second mobile terminal sends a SIP UPDATE message to the first mobile terminal, wherein, after the second mobile terminal performs a touch operation on the screen interface of the first mobile terminal, the second mobile terminal fills the touch operation and the touch position of the touch operation into a specific field of the SIP UPDATE message.

8. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, wherein when the computer program is executed by a processor, the steps of the method described in any one of claims 1 to 4 are implemented, or the steps of the method described in claim 5 are implemented.

9. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the computer program, the processor implements the steps of the method described in any one of claims 1 to 4, or implements the steps of the method described in claim 5.

Citation Information

Patent Citations

  • Method for implementing desktop sharing and control of mobile terminals and mobile terminal

    CN101674110A

  • Method and system for providing multimedia content sharing service while conducting communication service

    CN103748610A