A screen projection display control method, device and computer readable storage medium

Abstract

The application discloses a screen projection display control method and device and a computer readable storage medium, wherein the method comprises the following steps: receiving a file dragging instruction with a mobile phone screen projection window as a target area on a computer side; then, extracting a target file corresponding to the file dragging instruction on the computer side, and sending the target file to a mobile phone side which maintains a screen projection connection with the computer side; finally, adjusting one or more of a window position, a window size and a window resolution of the mobile phone screen projection window according to a display control signal on the computer side, and executing information display corresponding to the screen projection content signal in the adjusted mobile phone screen projection window. A humanized screen projection display control scheme is realized, so that when the mobile phone side reversely projects to the computer side, the mobile phone screen projection window of the computer side can be adaptively adjusted according to displayed file information, the file display effect is optimized, and the user experience is enhanced.

Description

TECHNICAL FIELD

[0001] The present application relates to the field of mobile communication, and in particular to a screen projection display control method, device and computer readable storage medium. BACKGROUND

[0002] In the prior art, with the continuous development of intelligent terminal devices, users have higher and higher application requirements for terminal devices, especially, nowadays, mobile phone reverse screen projection to computer is widely used, so that the computer can execute the function application of the mobile phone in a more convenient and fast operation mode. However, when the mobile phone is reversely projected to the computer, the mobile phone screen window on the computer is generally a mirror copy of the screen display area of the mobile phone itself. Therefore, when the mobile phone performs any file display or program execution, the display mode of the mobile phone is used for display. It can be seen that even if the display content of the mobile phone is projected to the mobile phone screen window on the computer, the operation optimization of the keyboard or mouse is obtained, but the display level does not change substantially, which cannot further optimize the display control level for users, and the user experience needs to be further improved. SUMMARY

[0003] In order to solve the above technical defects in the prior art, the present application provides a screen projection display control method, which comprises:

[0004] Receiving a file drag instruction with a mobile phone screen window as a target area on a computer.

[0005] Extracting a target file corresponding to the file drag instruction on the computer, and sending the target file to a mobile phone connected to the computer by screen projection.

[0006] Receiving a screen projection content signal and a display control signal sent by the mobile phone on the computer, wherein the screen projection content signal is generated according to file content information of the target file, and the display control signal is generated according to file attribute information of the target file.

[0007] Adjusting one or more of the window position, window size and window resolution of the mobile phone screen window on the computer according to the display control signal, and executing information display corresponding to the screen projection content signal in the adjusted mobile phone screen window.

[0008] Optionally, the receiving a file drag instruction with a mobile phone screen window as a target area on a computer comprises:

[0009] Displaying the mobile phone screen window with an initial size and resolution at an initial position on the computer.

[0010] Receiving a file dragging instruction targeting a preset area in the mobile phone screen projection window.

[0011] Optionally, the extracting the target file corresponding to the file dragging instruction on the computer side and sending the target file to a mobile phone side in screen projection connection with the computer side comprises:

[0012] When the file dragging instruction is responded in the preset area, obtaining a storage directory of the target file on the computer side.

[0013] Sending the target file under the storage directory from the computer side to the mobile phone side through a preset communication link between the computer side and the mobile phone side.

[0014] Optionally, the receiving the screen projection content signal and the display control signal sent by the mobile phone side on the computer side comprises:

[0015] After the target file is received on the mobile phone side, a target application program corresponding to the target file is invoked.

[0016] Obtaining a running state and an operating state of the target application program on the computer side.

[0017] Optionally, the receiving the screen projection content signal and the display control signal sent by the mobile phone side on the computer side further comprises:

[0018] According to the running state, determining a first window parameter related to display in the screen projection content signal.

[0019] According to the operating state, determining a second window parameter related to operation in the display control signal.

[0020] Optionally, the receiving the screen projection content signal and the display control signal sent by the mobile phone side on the computer side further comprises:

[0021] Obtaining file content information of the target file, and generating the screen projection content signal in combination with the first window parameter.

[0022] Obtaining file attribute information of the target file, and generating the display control signal in combination with the second window parameter.

[0023] Optionally, the adjusting one or more of a window position, a window size and a window resolution of the mobile phone screen projection window on the computer side according to the display control signal and executing information display corresponding to the screen projection content signal in the adjusted mobile phone screen projection window comprises:

[0024] Before the information display, one or more of the window position, the window size and the window resolution of the mobile phone screen projection window is set by the second window parameter.

[0025] When the information display corresponding to the screen projection content signal is performed in the adjusted mobile phone screen projection window, one or more of the window position, the window size and the window resolution is adjusted again in real time by the first window parameter.

[0026] Optionally, the adjusting the one or more of the window position, the window size and the window resolution of the mobile phone screen projection window according to the display control signal on the computer side, and performing the information display corresponding to the screen projection content signal in the adjusted mobile phone screen projection window, further comprises:

[0027] When the target application program is closed, the one or more of the window position, the window size and the window resolution adjusted at the closing time is recorded.

[0028] When the target application program is opened again and the target file with the same file attribute information is identified, the mobile phone screen projection window is set according to the one or more of the window position, the window size and the window resolution recorded in history.

[0029] The application further provides a screen projection display control device, which comprises a memory, a processor and a computer program stored in the memory and executable on the processor, and the computer program realizes the steps of the screen projection display control method according to any one of the above when executed by the processor.

[0030] The application further provides a computer readable storage medium, which stores a screen projection display control program, and the screen projection display control program realizes the steps of the screen projection display control method according to any one of the above when executed by a processor.

[0031] The screen projection display control method, device and computer readable storage medium of the present application are implemented by receiving a file dragging instruction with a mobile phone screen projection window as a target area at a computer end, then extracting a target file corresponding to the file dragging instruction at the computer end and sending the target file to a mobile phone end in screen projection connection with the computer end, then receiving a screen projection content signal and a display control signal sent by the mobile phone end at the computer end, wherein the screen projection content signal is generated according to file content information of the target file, and the display control signal is generated according to file attribute information of the target file, and finally adjusting one or more of a window position, a window size and a window resolution of the mobile phone screen projection window at the computer end according to the display control signal and performing information display corresponding to the screen projection content signal in the adjusted mobile phone screen projection window. A humanized screen projection display control scheme is realized, so that when the mobile phone end is reversely projected to the computer end, the mobile phone screen projection window of the computer end can be adaptively adjusted according to displayed file information, the file display effect is optimized, and the user experience is enhanced. BRIEF DESCRIPTION OF DRAWINGS

[0032] The present application will be further described below in combination with the drawings and embodiments, wherein:

[0033] Figure 1 is a hardware structure schematic diagram of a mobile terminal involved in the present application;

[0034] Figure 2 is a communication network system architecture diagram provided by an embodiment of the present application;

[0035] Figure 3 is a flowchart of a first embodiment of the screen projection display control method of the present application;

[0036] Figure 4 is a flowchart of a second embodiment of the screen projection display control method of the present application;

[0037] Figure 5 is a flowchart of a third embodiment of the screen projection display control method of the present application;

[0038] Figure 6 is a flowchart of a fourth embodiment of the screen projection display control method of the present application;

[0039] Figure 7 is a flowchart of a fifth embodiment of the screen projection display control method of the present application;

[0040] Figure 8 is a flowchart of a sixth embodiment of the screen projection display control method of the present application;

[0041] Figure 9 is a flowchart of a seventh embodiment of the screen projection display control method of the present application;

[0042] Figure 10 is a flowchart of an eighth embodiment of the screen projection display control method of the present application. DETAILED DESCRIPTION

[0043] It should be understood that the specific embodiments described herein merely exemplify the application and should not be used to limit the application.

[0044] In the following description, the suffixes used for elements, such as "module", "part", or "unit", are used only for convenience of explanation and have no specific meaning. Thus, "module", "part", or "unit" can be mixedly used.

[0045] A terminal can be implemented in various forms. For example, the terminal described in the present application can include a mobile terminal such as a mobile phone, a tablet, a notebook computer, a palmtop computer, a Personal Digital Assistant (PDA), a Portable Media Player (PMP), a navigation device, a wearable device, a smart band, a pedometer, etc., and a stationary terminal such as a digital TV, a desktop computer, etc.

[0046] In the following description, a mobile terminal will be exemplified, and those skilled in the art will understand that the configuration according to the embodiments of the present application can be applied to a stationary type terminal, except for elements particularly used for mobile purposes.

[0047] Referring to Figure 1 , which is a hardware structure diagram of a mobile terminal implementing various embodiments of the present application, the mobile terminal 100 can include an RF (Radio Frequency) unit 101, a WiFi module 102, an audio output unit 103, an A / V (audio / video) input unit 104, a sensor 105, a display unit 106, a user input unit 107, an interface unit 108, a memory 109, a processor 110, and a power supply 111, etc. Those skilled in the art will understand that the mobile terminal structure shown in Figure 1 the present application does not limit the mobile terminal, and the mobile terminal can include more or less components than those shown in the diagram, or combine certain components, or arrange the components differently.

[0048] Hereinafter, the components of the mobile terminal will be described in detail. Figure 1

[0049] ​The radio frequency unit 101 can be used for receiving and transmitting signals in information or communication processes. Specifically, the radio frequency unit 101 receives downlink information from a base station and provides the received information to the processor 110 for processing. In addition, the radio frequency unit 101 transmits uplink data to the base station. Generally, the radio frequency unit 101 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, etc. In addition, the radio frequency unit 101 can communicate with the network and other devices through wireless communication. The wireless communication can use any communication standard or protocol, including but not limited to GSM (Global System for Mobile communication), GPRS (General Packet Radio Service), CDMA2000 (Code Division Multiple Access 2000), WCDMA (Wideband Code Division Multiple Access), TD-SCDMA (Time Division-Synchronous Code Division Multiple Access), FDD-LTE (Frequency Division Duplexing-Long Term Evolution), TDD-LTE (Time Division Duplexing-Long Term Evolution), etc.

[0050] The WiFi belongs to a short-range wireless transmission technology. The WiFi module 102 can help the user to send and receive e-mails, browse web pages, and access streaming media, etc. It provides the user with wireless broadband Internet access. Although Figure 1 The WiFi module 102 is shown, but it is understood that it does not belong to the necessary components of the mobile terminal, and can be omitted as needed without changing the essence of the application.

[0051] The audio output unit 103 can convert audio data, which is received by the radio frequency unit 101 or the WiFi module 102 or stored in the memory 109, into an audio signal and output the audio signal as sound when the mobile terminal 100 is in a call signal reception mode, a call mode, a recording mode, a voice recognition mode, a broadcast reception mode, etc. In addition, the audio output unit 103 can provide audio output related to a particular function performed by the mobile terminal 100 (e.g., a call signal reception sound, a message reception sound, etc.). The audio output unit 103 can include a speaker, a buzzer, etc.

[0052] The A / V input unit 104 is configured to receive audio or video signals. The A / V input unit 104 can include a graphics processor (GPU) 1041 and a microphone 1042. The graphics processor 1041 processes image data of a still picture or a video obtained by an image capture device (e.g., a camera) in a video call mode or an image call mode. Processed image frames can be displayed on the display unit 106. Processed image frames can be stored in the memory 109 (or other storage medium) or transmitted via the radio frequency unit 101 or the WiFi module 102. The microphone 1042 can receive sound (audio data) via the microphone 1042 in a phone call mode, a recording mode, a voice recognition mode, or the like, and can process such sound into audio data. Processed audio (voice) data can be converted into a format transmittable to a mobile communication base station via the radio frequency unit 101 in the case of the phone call mode. The microphone 1042 can implement various types of noise cancellation (or suppression) algorithms to cancel (or suppress) noise or interference generated in the process of receiving and transmitting audio signals.

[0053] The mobile terminal 100 also includes at least one sensor 105, such as a light sensor, a motion sensor, and other sensors. Specifically, the light sensor includes an ambient light sensor and a proximity sensor, wherein the ambient light sensor can adjust the brightness of the display panel 1061 according to the brightness of ambient light, and the proximity sensor can turn off the display panel 1061 and / or the backlight when the mobile terminal 100 is moved to the ear. As one of the motion sensors, the accelerometer sensor can detect the magnitude of acceleration in each direction (generally three axes), and can detect the magnitude and direction of gravity when at rest, and can be used for applications that recognize the posture of the mobile phone (such as switching between landscape and portrait screens, related games, magnetometer posture calibration), vibration recognition related functions (such as pedometers, taps), and the like. As for the fingerprint sensor, pressure sensor, iris sensor, molecular sensor, gyroscope, barometer, hygrometer, thermometer, infrared sensor, and other sensors that can be configured to the mobile phone, they are not described here.

[0054] The display unit 106 is configured to display information input by a user or information provided to the user. The display unit 106 can include a display panel 1061, which can be configured in the form of a liquid crystal display (LCD), an organic light-emitting diode (OLED), or the like.

[0055] The user input unit 107 can be used to receive input numerals or character information, and to generate key signal inputs related to user settings of the mobile terminal and control of functions. Specifically, the user input unit 107 can include a touch panel 1071 and other input devices 1072. The touch panel 1071, also called a touch screen, can collect a touch operation of a user on or proximate thereto (such as an operation of the user using a finger, a stylus, or any suitable object or accessory on or proximate to the touch panel 1071), and can drive a corresponding connection device according to a pre-set program. The touch panel 1071 can include two parts, a touch detecting device and a touch controller. The touch detecting device detects a user's touch position and detects a signal resulting from a touch operation, and transmits the signal to the touch controller. The touch controller receives touch information from the touch detecting device, converts it into touch coordinates, and transmits the touch coordinates to the processor 110, and can receive commands from the processor 110 and execute them. In addition, the touch panel 1071 can be implemented in various types such as a resistive type, a capacitive type, an infrared type, and a surface acoustic wave type. In addition to the touch panel 1071, the user input unit 107 can include other input devices 1072. Specifically, the other input devices 1072 can include one or more of, but are not limited to, a physical keyboard, function keys (such as a volume control button, a switch button, etc.), a trackball, a mouse, a joystick, etc.

[0056] Further, the touch panel 1071 can cover the display panel 1061, and when the touch panel 1071 detects a touch operation on or proximate thereto, can transmit the same to the processor 110 to determine a type of the touch event, and then the processor 110 can provide a corresponding visual output on the display panel 1061 according to the type of the touch event. Although in the above description, the touch panel 1071 and the display panel 1061 are implemented as two separate components to achieve the input and output functions of the mobile terminal, in some embodiments, the touch panel 1071 and the display panel 1061 can be integrated to achieve the input and output functions of the mobile terminal, without being limited thereto. Figure 1

[0057] The interface unit 108 serves as an interface through which at least one external device can be connected with the mobile terminal 100. For example, the external device can include a wired or wireless headset port, an external power (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device having an identification module, an audio input / output (I / O) port, a video I / O port, an earphone port, etc. The interface unit 108 can be used to receive input (e.g., data information, power, etc.) from an external device and to transmit the received input to one or more elements within the mobile terminal 100, or can be used to transmit data between the mobile terminal 100 and the external device. ​

[0058] The memory 109 can be used to store software programs and various data. The memory 109 can mainly include a program storage area and a data storage area, wherein the program storage area can store an operating system, application programs required by at least one function (such as a sound playing function, an image playing function, etc.), and the like; and the data storage area can store data created according to the use of the mobile phone (such as audio data, a phone book, etc.), and the like. In addition, the memory 109 can include a high-speed random access memory, and can also include a nonvolatile memory, such as at least one magnetic disk storage device, a flash memory device, or other volatile solid-state memory device.

[0059] The processor 110 is the control center of the mobile terminal, connects all parts of the mobile terminal through various interfaces and lines, executes various functions of the mobile terminal and processes data by running or executing software programs and / or modules stored in the memory 109 and calling data stored in the memory 109, and thus performs overall monitoring on the mobile terminal. The processor 110 can include one or more processing units; preferably, the processor 110 can integrate an application processor and a modem processor, wherein the application processor mainly processes an operating system, a user interface, and application programs, and the like, and the modem processor mainly processes wireless communication. It can be understood that the above-mentioned modem processor can also not be integrated into the processor 110.

[0060] The mobile terminal 100 can also include a power supply 111 (such as a battery) for supplying power to various components; preferably, the power supply 111 can be logically connected to the processor 110 through a power management system, so as to realize functions such as management of charging, discharging, and power consumption management through the power management system.

[0061] Although Figure 1 It is not shown that the mobile terminal 100 can also include a Bluetooth module and the like, which will not be described here.

[0062] In order to facilitate understanding of the embodiments of the present application, the communication network system based on the mobile terminal of the present application is described below.

[0063] Please refer to Figure 2 , Figure 2 A communication network system architecture diagram provided by the embodiments of the present application, the communication network system is a LTE system of general mobile communication technology, the LTE system includes sequentially connected UE (User Equipment, user equipment) 201, E-UTRAN (Evolved UMTS Terrestrial Radio Access Network, evolved UMTS terrestrial radio access network) 202, EPC (Evolved Packet Core, evolved packet core network) 203 and operator's IP service 204.

[0064] Specifically, the UE 201 can be the terminal 100 described above, which will not be repeated here.

[0065] The E-UTRAN 202 includes eNode-Bs 2021 and other eNode-Bs 2022. The eNode-B 2021 can be connected to the other eNode-Bs 2022 through backhaul (e.g., X2 interface), the eNode-B 2021 is connected to the EPC 203, and the eNode-B 2021 can provide access for the UE 201 to the EPC 203.

[0066] The EPC 203 can include a MME (Mobility Management Entity, mobility management entity) 2031, a HSS (Home Subscriber Server, home subscriber server) 2032, other MMEs 2033, a SGW (Serving Gate Way, serving gateway) 2034, a PGW (PDN Gate Way, packet data network gateway) 2035, and a PCRF (Policy and Charging Rules Function, policy and charging rules function) 2036. The MME 2031 is a control node for processing signaling between the UE 201 and the EPC 203, and provides bearer and connection management. The HSS 2032 is used to provide some registers to manage functions such as a home location register (not shown in the figure), and to save some user-specific information about service features, data rates, etc. All user data can be transmitted through the SGW 2034, the PGW 2035 can provide IP address allocation and other functions for the UE 201, and the PCRF 2036 is a policy and charging control policy decision point for service data flow and IP bearer resources, which selects and provides available policy and charging control decisions for policy and charging enforcement function units (not shown in the figure).

[0067] The IP service 204 can include the Internet, an intranet, an IMS (IP Multimedia Subsystem, IP multimedia subsystem), or other IP services.

[0068] Although the above describes the LTE system as an example, those skilled in the art should know that the present application is not only applicable to the LTE system, but also applicable to other wireless communication systems, such as GSM, CDMA2000, WCDMA, TD-SCDMA, and future new network systems, etc., which are not limited here.

[0069] Based on the above mobile terminal hardware structure and communication network system, various embodiments of the method of the present application are proposed.

[0070] Embodiment one

[0071] Figure 3 is a flowchart of the first embodiment of the screen projection display control method of the present application. A screen projection display control method, the method comprising:

[0072] S1, receiving a file dragging instruction with a mobile phone screen projection window as a target area at a computer end.

[0073] S2, extracting a target file corresponding to the file dragging instruction at the computer end, and sending the target file to a mobile phone end maintaining screen projection connection with the computer end.

[0074] S3, receiving a screen projection content signal and a display control signal sent by the mobile phone end at the computer end, wherein the screen projection content signal is generated according to file content information of the target file, and the display control signal is generated according to file attribute information of the target file.

[0075] S4, adjusting one or more of a window position, a window size and a window resolution of the mobile phone screen projection window according to the display control signal at the computer end, and executing information display corresponding to the screen projection content signal in the adjusted mobile phone screen projection window.

[0076] Optionally, in the present embodiment, considering that in the prior art, even if the display content of the mobile phone end is projected to the mobile phone screen projection window of the computer end, the operation optimization of the keyboard or the mouse is obtained, but the display level does not change substantially, and the user cannot be brought further optimization of the display control level. Therefore, the present embodiment will adaptively adjust the mobile phone screen projection window according to the specific content of the mobile phone screen projection window, so that the content in the mobile phone screen projection window is more suitable for the display of the computer end, better display effect and operation experience are achieved, and the user experience problem of inconsistent operation experience and display experience caused by single copying of the mobile phone interface is avoided.

[0077] Optionally, in the present embodiment, the mobile phone screen projection window is displayed on the display screen of the computer end in a default initial state. At this time, the mobile phone screen projection window can be in a home page display state, a desktop display state or other application program display state, etc. In this state, a file dragging instruction from outside the mobile phone screen projection window to inside the mobile phone screen projection window is received. It can be understood that the generation object of the file dragging instruction is a specific file of the local of the computer end or the network access of the computer end. When the file can be opened by the application program installed in the mobile phone end, the reverse screen projection display and interaction of the mobile phone end can be completed through the transmission, screen projection and coherent integrated operation.

[0078] Optionally, in the embodiment, the target file corresponding to the file dragging instruction only needs to be installed with the corresponding application on the mobile phone side to realize display and interaction, and does not need to be installed with the corresponding software on the computer side, that is, the computer side is only used to obtain the target file itself and plays a role of reverse screen display, and is not responsible for opening the target file locally on the computer side.

[0079] Optionally, in the embodiment, the computer side receives the screen projection content signal and the display control signal sent by the mobile phone side, wherein the screen projection content signal is generated according to the file content information of the target file, and the display control signal is generated according to the file attribute information of the target file. It can be understood that since the best display and interaction state suitable for the target file is not determined before the target file is opened, in the embodiment, the target file itself is analyzed for certain characteristics before the target file is opened. Specifically, on the one hand, the screen projection content signal is generated according to the file content information of the target file, and on the other hand, the display control signal is generated according to the file attribute information of the target file. The screen projection content signal includes display content and display layout information of the target file after being opened, and the display control signal includes interaction information of the display content of the target file after being opened, for example, text editing by opening a keyboard, game control by opening a virtual joystick, etc.

[0080] Optionally, in the embodiment, the computer side adjusts one or more of the window position, the window size and the window resolution of the mobile phone screen projection window according to the display control signal, and executes information display corresponding to the screen projection content signal in the adjusted mobile phone screen projection window. The window position, the window size or the window resolution of the mobile phone screen projection window is determined according to the display content and the display layout information, so that the target file is displayed in a wider range on the computer side with greater freedom and more suitable resolution.

[0081] Optionally, in the embodiment, taking the display of a document file on a mobile phone as an example, specifically, first, the problem to be solved is that the word and excel documents are displayed on the current computer screen, and there is a problem of being too small to edit or view. That is, at present, when the word document is opened, the mobile phone is applied according to the actual resolution of 1080*2400, so the display scheme is relatively compact, and it is not convenient for users to input and other interactive operations. Therefore, based on the processing idea of the above embodiment, when the wps document application is opened in the computer screen mode, the resolution allocated by the system setting is 1600*1200, instead of the actual resolution of 1080*2400 of the mobile phone, thereby making the display mode of wps in the window as a horizontal tablet, which is more convenient for user operation, input and other interactions, and is more clear and convenient to use compared with the traditional mobile phone screen window. Secondly, in the embodiment, in order to combine the transmission problems of the computer end and the mobile phone end, first, a file transfer protocol is created on the mobile phone end and the computer end, that is, the transfer function of the target file is realized. Specifically, the mobile phone end defines a directory of the memory card (sdcard), which is used to accept the files sent by the computer end. The computer screen window listens to the mouse drag event, and if it finds that there is a drag file, it listens to the mouse release event. After release, the drag file path is obtained, and the target file is sent to the socket of the mobile phone end through the socket communication mode. When the mobile phone end receives the target file sending information, the data is read in turn and saved to the corresponding path of the sdcard until the computer end sends it. When the mobile phone end accepts and saves it, according to whether the suffix of the file is doc, excel or other format, the activity process (Activtiy) of the corresponding wps office application program is opened, so as to realize the one-key opening of the computer end word, excel and other target files on the mobile phone end, and the optimized display and interactive control.

[0082] The beneficial effect of the embodiment is that, by receiving a file dragging instruction with the mobile phone screen window as a target area on the computer side, then extracting a target file corresponding to the file dragging instruction on the computer side, and sending the target file to the mobile phone side which maintains screen projection connection with the computer side, then receiving a screen projection content signal and a display control signal sent by the mobile phone side on the computer side, wherein the screen projection content signal is generated according to the file content information of the target file, and the display control signal is generated according to the file attribute information of the target file, and finally adjusting one or more of the window position, window size and window resolution of the mobile phone screen window on the computer side according to the display control signal, and performing information display corresponding to the screen projection content signal in the adjusted mobile phone screen window, a humanized screen projection display control scheme is realized, so that when the mobile phone side reversely projects to the computer side, the mobile phone screen window of the computer side can be adaptively adjusted according to the displayed file information, the file display effect is optimized, and the user experience is enhanced.

[0083] Embodiment two

[0084] Figure 4 is a flowchart of the second embodiment of the screen projection display control method of the application, based on the above-mentioned embodiment, the file dragging instruction with the mobile phone screen window as a target area received on the computer side comprises:

[0085] S11, display the mobile phone screen window with an initial size and resolution at an initial position on the computer side.

[0086] S12, receive a file dragging instruction with a preset area in the mobile phone screen window as a target area.

[0087] Optionally, in the embodiment, the blank area in the mobile phone screen window is taken as the above-mentioned preset area, and when the dragging instruction terminates in the preset area, it is detected whether the mobile phone side is installed with an application program capable of opening the target file.

[0088] Optionally, in the embodiment, if the mobile phone side does not have an application program capable of opening the target file, the application program capable of running on the mobile phone side system is downloaded from the computer side, and it is prompted whether to send to the mobile phone side to open the target file before the program installation.

[0089] The beneficial effect of the embodiment is that the mobile phone screen projection window is displayed in the initial size and resolution at the initial position of the computer end; then, a file dragging instruction with a preset area in the mobile phone screen projection window as a target area is received. A file dragging processing scheme is provided for a humanized screen projection display control scheme, so that when the mobile phone end is reversely projected to the computer end, the mobile phone screen projection window of the computer end can be adaptively adjusted according to the displayed file information, the file display effect is optimized, and the user experience is enhanced.

[0090] Embodiment three

[0091] Figure 5 The flowchart is a third embodiment of the screen projection display control method of the application, based on the above-mentioned embodiment, the target file corresponding to the file dragging instruction is extracted at the computer end, and the target file is sent to the mobile phone end which maintains a screen projection connection with the computer end, comprising:

[0092] S21, when the file dragging instruction responds in the preset area, the storage directory of the target file in the computer end is acquired.

[0093] S22, the target file in the storage directory is sent from the computer end to the mobile phone end through the preset communication link between the computer end and the mobile phone end.

[0094] Optionally, in the embodiment, the application program capable of running in the mobile phone end system is downloaded from the computer end, and the user is prompted whether to send to the mobile phone end to open the program installation before the target file. If the user chooses to agree to send, the program installation package and the target file are sent to the mobile phone end at the same time.

[0095] Optionally, in the embodiment, the computer end waits for the mobile phone end to install the above-mentioned application program, and when the installation is completed, it is displayed through the mobile phone screen projection window that the program installation has been completed and the target file will be opened soon.

[0096] The beneficial effect of the embodiment is that when the file dragging instruction responds in the preset area, the storage directory of the target file in the computer end is acquired; then, the target file in the storage directory is sent from the computer end to the mobile phone end through the preset communication link between the computer end and the mobile phone end. A target file opening scheme is provided for a humanized screen projection display control scheme, so that when the mobile phone end is reversely projected to the computer end, the mobile phone screen projection window of the computer end can be adaptively adjusted according to the displayed file information, the file display effect is optimized, and the user experience is enhanced.

[0097] Embodiment four

[0098] Figure 6is a flow chart of a fourth embodiment of the screen projection display control method of the present application, based on the above-mentioned embodiments, the receiving, at the computer end, of the screen projection content signal and the display control signal sent by the mobile phone end comprises:

[0099] S31, after receiving the target file at the mobile phone end, the target application program corresponding to the target file is called.

[0100] S32, the running state and the operation state of the target application program on the computer end are obtained.

[0101] Optionally, in the present embodiment, the running state and the operation state of the target application program on the mobile phone end are known, but directly copying the running state and the operation state of the target application program on the mobile phone end to the computer end may obviously cause that it is difficult to control through screen recognition or mouse on the computer end. Therefore, in the present embodiment, the running state and the operation state of the computer version application program corresponding to the target application program are determined first, for example, if the mobile phone end wps software opens a document file, the running state and the operation state of the computer end wps application program are obtained.

[0102] Optionally, in the present embodiment, the running state includes horizontal and vertical screen running state, page layout, etc., and the operation state includes mouse single click, double click, drag, etc. and the operation mode synchronized with the computer end, etc.

[0103] The beneficial effects of the present embodiment are that, after receiving the target file at the mobile phone end, the target application program corresponding to the target file is called, and then the running state and the operation state of the target application program on the computer end are obtained. A matching scheme of the target application program is provided for realizing a humanized screen projection display control scheme, so that when the mobile phone end reversely projects to the computer end, the mobile phone projection window of the computer end can be adaptively adjusted according to the displayed file information, the file display effect is optimized, and the user experience is enhanced.

[0104] Embodiment five

[0105] Figure 7 is a flow chart of a fifth embodiment of the screen projection display control method of the present application, based on the above-mentioned embodiments, the receiving, at the computer end, of the screen projection content signal and the display control signal sent by the mobile phone end further comprises:

[0106] S33, determining the first window parameter related to display in the screen projection content signal according to the running state.

[0107] S34, determining the second window parameter related to operation in the display control signal according to the operation state.

[0108] Optionally, in the embodiment, the first window parameter related to display in the screen projection content signal is determined according to the running state, for example, for the above-mentioned horizontal and vertical screen running state, page layout, etc., the appropriate resolution ratio, display length-width ratio, etc. are adjusted, and meanwhile, the display ratio of the tab and content in the document editing is determined, thereby comprehensively determining the first window parameter related to display.

[0109] Optionally, in the embodiment, the second window parameter related to operation in the display control signal is determined according to the operation state, for example, for the above-mentioned operation state including mouse single click, double click, drag, etc., the operation mode synchronized with the computer end is determined, the mouse display size in the window, the positioning and response of the mouse single click, double click, drag corresponding area, etc. are determined as the second window parameter for adjusting the operation related to the computer end.

[0110] The embodiment has the beneficial effect that the first window parameter related to display in the screen projection content signal is determined according to the running state, and then the second window parameter related to operation in the display control signal is determined according to the operation state. The setting mode of the window parameter is provided for realizing a humanized screen projection display control scheme, so that when the mobile phone end is reversely projected to the computer end, the mobile phone screen projection window of the computer end can be adaptively adjusted according to the displayed file information, the file display effect is optimized, and the user experience is enhanced.

[0111] Embodiment six

[0112] Figure 8 is a flowchart of the sixth embodiment of the screen projection display control method of the application, based on the above-mentioned embodiments, the screen projection content signal and the display control signal sent by the mobile phone end are received at the computer end, and the method further comprises:

[0113] S35, the file content information of the target file is acquired, and the screen projection content signal is generated in combination with the first window parameter.

[0114] S36, the file attribute information of the target file is acquired, and the display control signal is generated in combination with the second window parameter.

[0115] Optionally, in the embodiment, the file content information of the target file is acquired, and the screen projection content signal is generated in combination with the first window parameter, for example, for different types of document files (text files, table files, etc.), the first window parameter is adaptively adjusted, and then the screen projection content signal is obtained, which is directly used for controlling the modification and display of the mobile phone screen projection window.

[0116] Optionally, in the embodiment, the file attribute information of the target file is acquired, and the display control signal is generated in combination with the second window parameter, for example, for different file attribute information, mouse and keyboard operation of the document type, joystick operation of the game type, etc., the display control signal is obtained after adaptive adjustment of the second window parameter, and is directly used for control of the control signal generation and response mode in the mobile phone screen mirroring window range, including mouse moving speed, response sensitivity, preset calling of keyboard combination key, etc.

[0117] The beneficial effect of the embodiment is that the file content information of the target file is acquired, and the screen mirroring content signal is generated in combination with the first window parameter; then, the file attribute information of the target file is acquired, and the display control signal is generated in combination with the second window parameter. Two independent signal regulation modes are provided for a humanized screen mirroring display control scheme, so that when the mobile phone end is reversely screen mirrored to the computer end, the mobile phone screen mirroring window of the computer end can be adaptively adjusted according to the displayed file information, the file display effect is optimized, and the user experience is enhanced.

[0118] Embodiment Seven

[0119] Figure 9 is a flowchart of the seventh embodiment of the screen mirroring display control method of the application, based on the above-mentioned embodiments, the display control signal is used to adjust one or more of the window position, the window size and the window resolution of the mobile phone screen mirroring window on the computer end, and the information display corresponding to the screen mirroring content signal is performed in the adjusted mobile phone screen mirroring window, including:

[0120] S41, before the information display, one or more of the window position, the window size and the window resolution of the mobile phone screen mirroring window is set through the second window parameter.

[0121] S42, when the information display corresponding to the screen mirroring content signal is performed in the adjusted mobile phone screen mirroring window, one or more of the window position, the window size and the window resolution is adjusted again in real time through the first window parameter.

[0122] Optionally, in the embodiment, before the information display, one or more of the window position, the window size and the window resolution of the mobile phone screen mirroring window is set through the second window parameter, and at the same time, in the process of modifying the window, the smooth transition and text prompt from the original window to the updated window are maintained.

[0123] Optionally, in this embodiment, when the information display corresponding to the screen mirroring content signal is performed in the adjusted mobile phone screen mirroring window, the editing, processing and other operation adjustment information of the target file is obtained in real time. Then, the first window parameter is updated in real time according to the real-time adjustment information, and one or more of the window position, the window size and the window resolution can be adjusted again in real time, that is, the mobile phone screen mirroring window on the computer side can be dynamically adjusted to meet the processing needs of the target file, game process and the like at different stages of the user.

[0124] The beneficial effects of this embodiment are that, before the information display, one or more of the window position, the window size and the window resolution of the mobile phone screen mirroring window are set by the second window parameter; and when the information display corresponding to the screen mirroring content signal is performed in the adjusted mobile phone screen mirroring window, one or more of the window position, the window size and the window resolution are adjusted again in real time by the first window parameter. An adaptive and dynamic control method is provided for a humanized screen mirroring display control scheme, so that when the mobile phone side is reversely screen mirrored to the computer side, the mobile phone screen mirroring window on the computer side can be adaptively adjusted according to the displayed file information, the file display effect is optimized, and the user experience is enhanced.

[0125] Embodiment eight

[0126] Figure 10 is a flowchart of the eighth embodiment of the screen mirroring display control method of the application, based on the above-mentioned embodiments, after the window position, the window size and the window resolution of the mobile phone screen mirroring window on the computer side are adjusted according to the display control signal, and the information display corresponding to the screen mirroring content signal is performed in the adjusted mobile phone screen mirroring window, the method comprises:

[0127] S51, when the target application program is closed, one or more of the window position, the window size and the window resolution adjusted at the closing time are recorded.

[0128] S52, when the target application program is opened again and the target file with the same file attribute information is identified, the mobile phone screen mirroring window is set according to one or more of the historically recorded window position, the window size and the window resolution.

[0129] Optionally, in this embodiment, one or more of the window position, the window size and the window resolution of the target file at different stages such as editing, reading and the like, or different stages such as game setting, game reading, game process, game pause, game voice and the like are recorded.

[0130] Optionally, in the embodiment, in the subsequent screen projection display process, the historical recorded optimal window parameters (for example, the parameters with the maximum probability) are read to adaptively adjust the mobile phone screen projection window.

[0131] The beneficial effect of the embodiment is that when the target application program is closed, one or more of the window position, the window size and the window resolution adjusted at the closing time are recorded; and when the target application program is opened again and the target file with the same file attribute information is identified, the mobile phone screen projection window is set according to one or more of the historical recorded window position, the window size and the window resolution. A more user-friendly screen projection display control scheme is provided, which is more in line with the user's usage habits, so that when the mobile phone is reversely projected to the computer, the mobile phone screen projection window of the computer can be adaptively adjusted according to the displayed file information, the file display effect is optimized, and the user experience is enhanced.

[0132] Embodiment Nine

[0133] Based on the above-mentioned embodiments, the application further provides a screen projection display control device, which comprises a memory, a processor and a computer program stored in the memory and executable on the processor, and the computer program implements the steps of the screen projection display control method according to any one of the above-mentioned embodiments when executed by the processor.

[0134] It should be noted that the above-mentioned device embodiments and method embodiments belong to the same concept, and the specific implementation process is detailed in the method embodiments, and the technical features in the method embodiments are all applicable to the device embodiments, which will not be repeated here.

[0135] Embodiment Ten

[0136] Based on the above-mentioned embodiments, the application further provides a computer readable storage medium, which stores a screen projection display control program, and the screen projection display control program implements the steps of the screen projection display control method according to any one of the above-mentioned embodiments when executed by a processor.

[0137] It should be noted that the above-mentioned medium embodiments and method embodiments belong to the same concept, and the specific implementation process is detailed in the method embodiments, and the technical features in the method embodiments are all applicable to the medium embodiments, which will not be repeated here.

[0138] It should be noted that, in this document, the terms "comprises", "comprising", or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but can also include other elements not expressly listed or inherent to such process, method, article, or apparatus. An element proceeded by "comprises a" does not, without more constraints, exclude the presence of additional identical elements in the process, method, article, or apparatus that comprises the element.

[0139] The above-mentioned embodiment numbers of the present application are only for description, and do not represent the advantages and disadvantages of the embodiments.

[0140] From the above description of the embodiments, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be realized by means of software and the necessary general hardware platform, and of course, they can also be realized by hardware, but in many cases, the former is a better embodiment. Based on such understanding, the technical solutions of the present application can be embodied in the form of a software product, which is stored in a storage medium (such as a ROM / RAM, a magnetic disk, or an optical disk) and includes a plurality of instructions for causing a terminal (which can be a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the methods described in the embodiments of the present application.

[0141] The embodiments of the present application are described above in combination with the drawings, but the present application is not limited to the above-mentioned specific embodiments, and the above-mentioned specific embodiments are only illustrative and not restrictive. Those skilled in the art can make many forms under the inspiration of the present application without departing from the scope of the present application, and these are all within the protection scope of the present application.

Claims

1. A screen projection display control method, characterized in that, The method includes: Receive file drag-and-drop commands on the computer with the mobile phone screen mirroring window as the target area; Extract the target file corresponding to the file drag-and-drop instruction on the computer and send the target file to the mobile phone that is connected to the computer for screen mirroring. The computer receives a screen projection content signal and a display control signal sent by the mobile phone, wherein the screen projection content signal is generated based on the file content information of the target file, and the display control signal is generated based on the file attribute information of the target file; On the computer, the window position, window size, and window resolution of the mobile phone screen projection window are adjusted according to the display control signal, and information display corresponding to the screen projection content signal is executed in the adjusted mobile phone screen projection window.

2. The screen projection display control method according to claim 1, characterized in that, The process of receiving a file drag-and-drop command on the computer with the mobile phone screen mirroring window as the target area includes: The mobile phone projection window is displayed at the initial position on the computer with an initial window size and resolution; Receive a file drag-and-drop command targeting a preset area within the mobile phone screen mirroring window.

3. The screen projection display control method according to claim 2, characterized in that, The step of extracting the target file corresponding to the file drag-and-drop instruction on the computer and sending the target file to the mobile phone that maintains a screen mirroring connection with the computer includes: When the file drag-and-drop command is responded to in the preset area, the storage directory of the target file on the computer is obtained; The target file in the storage directory is sent from the computer to the mobile phone via a pre-set communication link between the computer and the mobile phone.

4. The screen projection display control method according to claim 3, characterized in that, The step of receiving the screen projection content signal and display control signal sent by the mobile phone on the computer includes: After receiving the target file on the mobile device, the target application corresponding to the target file is invoked; Obtain the running status and operation status of the target application on the computer.

5. The screen projection display control method according to claim 4, characterized in that, The step of receiving the screen projection content signal and display control signal sent by the mobile phone on the computer terminal also includes: Determine the first window parameters related to display in the screen projection content signal based on the operating status; The second window parameters related to the operation in the display control signal are determined based on the operation state.

6. The screen projection display control method according to claim 5, characterized in that, The step of receiving the screen projection content signal and display control signal sent by the mobile phone on the computer terminal also includes: Obtain the file content information of the target file, and generate the screen projection content signal by combining it with the first window parameters; Obtain the file attribute information of the target file and generate the display control signal in combination with the second window parameters.

7. The screen projection display control method according to claim 6, characterized in that, The step of adjusting one or more of the window position, window size, and window resolution of the mobile phone projection window on the computer according to the display control signal, and performing information display corresponding to the projection content signal in the adjusted mobile phone projection window, includes: Before the information is displayed, one or more of the following parameters of the mobile phone screen projection window are set: window position, window size, and window resolution; When displaying information corresponding to the screen projection content signal in the adjusted mobile phone projection window, one or more of the window position, window size, and window resolution are adjusted in real time using the first window parameters.

8. The screen projection display control method according to claim 7, characterized in that, The step of adjusting one or more of the window position, window size, and window resolution of the mobile phone screen projection window on the computer according to the display control signal, and then performing information display corresponding to the screen projection content signal in the adjusted mobile phone screen projection window, includes: When the target application is closed, record one or more of the following: the window position, the window size, and the window resolution after the closing time is adjusted: When the target application is reopened and the target file with the same file attribute information is identified, the mobile screen mirroring window is set according to one or more of the window position, window size, and window resolution recorded in history.

9. A screen projection display control device, characterized in that, The device includes a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the computer program, when executed by the processor, implements the steps of the screen projection control method as described in any one of claims 1 to 8.

10. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a screen projection control program, which, when executed by a processor, implements the steps of the screen projection control method as described in any one of claims 1 to 8.

Images