Screen projection control method and device, computer equipment and storage medium

Abstract

The invention relates to a screen projection control method and device, computer equipment, a storage medium and a computer program product. The method comprises the following steps: acquiring gesture information of a preset gesture under the condition of establishing communication connection with screen projection equipment; converting the gesture information into a corresponding screen projection instruction; and performing screen projection control on the screen projection equipment based on the screen projection instruction. By adopting the method, the convenience of screen projection control can be improved, and the efficiency of screen projection control is improved.

Description

Technical Field

[0001] The present application relates to the technical field of screen mirroring control, and in particular, to a screen mirroring control method, device, computer device, storage medium, and computer program product. Background Art

[0002] With the development of screen mirroring technology, it has been widely used in daily life. After screen mirroring, videos or pictures viewed on a mobile terminal, or the entire displayed content, can be screen mirrored to a screen mirroring device to realize viewing the videos or pictures triggered by the mobile terminal on the screen mirroring device.

[0003] In current screen mirroring operations, the user needs to first click the screen mirroring button, then wait for a period of time to search for available screen mirroring devices, select a target screen mirroring device from the available devices, and connect to the target screen mirroring device to perform screen mirroring. During the screen mirroring process, various click operations still need to be performed on the target screen mirroring device to adjust and control the screen on the target screen mirroring device, and the screen mirroring control efficiency is relatively low. Summary of the Invention

[0004] Based on this, in view of the above technical problems, it is necessary to provide a screen mirroring control method, device, computer device, computer-readable storage medium, and computer program product that can improve the screen mirroring control efficiency.

[0005] In a first aspect, the present application provides a screen mirroring control method. The method includes:

[0006] Obtaining gesture information of a preset gesture when a communication connection is established with a screen mirroring device;

[0007] Converting the gesture information into a corresponding screen mirroring instruction;

[0008] Performing screen mirroring control on the screen mirroring device based on the screen mirroring instruction.

[0009] In a second aspect, the present application further provides a screen mirroring control device. The device includes:

[0010] A gesture acquisition module, configured to obtain gesture information of a preset gesture when a communication connection is established with a screen mirroring device;

[0011] A gesture conversion module, configured to convert the gesture information into a corresponding screen mirroring instruction;

[0012] A screen mirroring control module, configured to perform screen mirroring control on the screen mirroring device based on the screen mirroring instruction.

[0013] In a third aspect, the present application further provides a computer device. The computer device includes a memory and a processor. The memory stores a computer program, and when the processor executes the computer program, the following steps are implemented:

[0014] When a communication connection is established with a screen mirroring device, obtain gesture information of a preset gesture;

[0015] Convert the gesture information into a corresponding screen mirroring instruction;

[0016] Based on the screen mirroring instruction, perform screen mirroring control on the screen mirroring device.

[0017] In a fourth aspect, the present application further provides a computer-readable storage medium. The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the following steps are implemented:

[0018] When a communication connection is established with a screen mirroring device, obtain gesture information of a preset gesture;

[0019] Convert the gesture information into a corresponding screen mirroring instruction;

[0020] Based on the screen mirroring instruction, perform screen mirroring control on the screen mirroring device.

[0021] In a fifth aspect, the present application further provides a computer program product. The computer program product includes a computer program, and when the computer program is executed by a processor, the following steps are implemented:

[0022] When a communication connection is established with a screen mirroring device, obtain gesture information of a preset gesture;

[0023] Convert the gesture information into a corresponding screen mirroring instruction;

[0024] Based on the screen mirroring instruction, perform screen mirroring control on the screen mirroring device.

[0025] For the above screen mirroring control method, device, computer device, storage medium, and computer program product, by obtaining the gesture information of the preset gesture when a communication connection is established with the screen mirroring device, converting the gesture information into a corresponding screen mirroring instruction, and performing screen mirroring control on the screen mirroring device based on the screen mirroring instruction, it is possible to control the screen mirroring device through gestures on the electronic device, improve the convenience of screen mirroring control, and thus improve the efficiency of screen mirroring control. BRIEF DESCRIPTION OF THE DRAWINGS

[0026] To more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the following briefly introduces the accompanying drawings required for the description of the embodiments or the prior art. Obviously, the accompanying drawings in the following description are only some embodiments of the present application. For those of ordinary skill in the art, without creative efforts, other accompanying drawings can be obtained based on these drawings.

[0027] Figure 1 It is an application environment diagram of the screen mirroring control method in an embodiment;

[0028] Figure 2 It is a flowchart of the screen mirroring control method in an embodiment;

[0029] Figure 3 It is a schematic flowchart of establishing a communication connection between an electronic device and a screen mirroring device in an embodiment;

[0030] Figure 4 It is a schematic flowchart of step 302 in an embodiment;

[0031] Figure 5 It is a triggering schematic diagram of a target application in an embodiment;

[0032] Figure 6 It is a schematic diagram of the control interface of the screen mirroring device in an embodiment;

[0033] Figure 7 It is a schematic diagram of the control page of the screen mirroring device in an embodiment;

[0034] Figure 8 It is a schematic flowchart of the screen mirroring control method in another embodiment;

[0035] Figure 9 It is a structural block diagram of the screen mirroring control device in an embodiment;

[0036] Figure 10 It is an internal structure diagram of a computer device in an embodiment. Detailed implementation manners

[0037] In order to make the purpose, technical solutions and advantages of the present application clearer, the following further details the present application in combination with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0038] The screen mirroring control method provided by the embodiments of the present application can be applied to, for example Figure 1In the application environment shown. Among them, the electronic device 102 communicates with the screen mirroring device 104 through a network. When the electronic device 102 establishes a communication connection with the screen mirroring device 104, it obtains the gesture information of a preset gesture. The electronic device 102 converts the gesture information into a corresponding screen mirroring instruction and performs screen mirroring control on the screen mirroring device 104 based on the screen mirroring instruction. Among them, the electronic device 102 can be, but is not limited to, various personal computers, laptop computers, smart phones, tablet computers, Internet of Things devices, and portable wearable devices. The Internet of Things devices can be smart speakers, smart TVs, smart air conditioners, in-vehicle intelligent devices, etc. The portable wearable devices can be smart watches, smart bracelets, head-mounted devices, etc. The screen mirroring device 104 can be an electronic device including a display screen. The electronic device 102 can be a terminal or a server; the screen mirroring device 104 can also be a terminal or a server.

[0039] In one embodiment, as Figure 2 shown, a screen mirroring control method is provided. Taking the electronic device in Figure 1 as an example, the following steps 202 to 206 are included.

[0040] Step 202, when a communication connection is established with the screen mirroring device, obtain the gesture information of a preset gesture.

[0041] When the electronic device establishes a communication connection with the screen mirroring device, the user performs a gesture operation. If the gesture operation performed by the user meets the preset gesture, the electronic device can obtain the gesture information of the preset gesture. Among them, the gesture information can include information such as gesture style, gesture identifier, or gesture meaning.

[0042] When an electronic device first establishes a communication connection with a screen mirroring device, the electronic device can obtain the connection information of the screen mirroring device and establish a communication connection with the screen mirroring device through the connection information. For example, it can connect to the screen mirroring device by scanning the QR code connection information of the screen mirroring device, or obtain the connection information of the screen mirroring device through NFC (Near Field Communication) technology, or obtain the connection information of the screen mirroring device through a human-computer interaction interface, etc. Among them, the connection information is the information used to establish a communication connection. When the electronic device first establishes a communication connection with the screen mirroring device, it can perform security verification and communication protocol verification on the device information of the screen mirroring device. When the electronic device has established a communication connection with the screen mirroring device, it can automatically connect by determining whether the preset connection conditions are met. Among them, the preset connection conditions can be, for example, that the distance from the screen mirroring device meets the distance threshold and the signal strength of the communication connection is greater than the strength threshold, at least one of which is satisfied. It can be understood that when the electronic device has established a communication connection with the screen mirroring device, it can also obtain the connection information of the screen mirroring device and establish a communication connection with the screen mirroring device again through the connection information. For example, the electronic device and the screen mirroring device have already been connected, but in the scenario where the distance between the electronic device and the screen mirroring device is relatively far and the distance does not meet the distance threshold, so the automatic connection cannot be achieved. Then, the electronic device can scan the connection QR code of the screen mirroring device to obtain the connection information of the screen mirroring device, so as to achieve reconnection with the screen mirroring device.

[0043] Optionally, the electronic device and the screen mirroring device can achieve a communication connection through protocols such as TCP / IP (Transmission Control Protocol / Internet Protocol), Internet of Things communication protocol, and near field communication protocol. The electronic device and the screen mirroring device can ensure the security of data transmission through a secure transmission protocol, such as DTLS (Datagram Transport Layer Security).

[0044] It can be understood that the electronic device can detect the user's gesture operations through sensors. The gesture operations include gesture swiping, gesture clicking, etc. The electronic device can recognize the gesture operations detected by the sensors through a gesture recognition algorithm. If the gesture operation belongs to a preset gesture, the gesture information of the preset gesture is obtained.

[0045] Step 204, convert the gesture information into a corresponding screen mirroring instruction.

[0046] The electronic device converts the obtained gesture information of the preset gesture into a corresponding screen mirroring instruction. Among them, the screen mirroring instruction is an instruction used to instruct the screen mirroring device to perform screen mirroring. For example, the screen mirroring instruction is full-screen display, window display, volume up, volume down, fast forward, or rewind, etc.

[0047] Optionally, according to the correspondence between the gesture information of the preset gesture and the screen mirroring instruction, the gesture information can be converted into the corresponding screen mirroring instruction. In an actual application scenario, the obtained gesture information of the preset gesture can be used as the gesture information to be confirmed, and it is checked whether there is the gesture information to be confirmed in the pre-stored gesture instruction relationship table. If there is the gesture information to be confirmed in the gesture instruction relationship table, the screen mirroring instruction corresponding to the gesture information to be confirmed is used as the target screen mirroring instruction, that is, the gesture information of the preset gesture is converted into the target screen mirroring instruction. The gesture instruction relationship table is a table used to represent the correspondence between the gesture information and the screen mirroring instruction, and the gesture instruction relationship table can be predefined and stored in the electronic device in advance.

[0048] Step 206, perform screen mirroring control on the screen mirroring device based on the screen mirroring instruction.

[0049] The electronic device can perform screen mirroring control on the screen mirroring device based on the screen mirroring instruction. Among them, the screen mirroring device can refer to the target device for screen mirroring of the electronic device, that is, the screen of the electronic device is displayed on the screen mirroring device; it can also refer to a device that is communicatively connected to the electronic device but does not display the screen of the electronic device. For example, the screen mirroring device can play the application screen on the screen mirroring device, and the electronic device can control the screen played on the screen mirroring device based on the screen mirroring instruction. Correspondingly, the screen mirroring control includes controlling the screen of the electronic device displayed on the screen mirroring device or controlling the screen of the screen mirroring device. That is to say, the electronic device can control the screen mirroring screen on the screen mirroring device, and the screen mirroring screen on the screen mirroring device can be the screen mirrored by the electronic device or the screen played by the screen mirroring device itself.

[0050] Optionally, the electronic device can send the screen mirroring instruction to the screen mirroring device to control the screen mirroring device to implement the operation corresponding to the screen mirroring instruction. In one example, the electronic device can obtain the connection information of the screen mirroring device by scanning the connection QR code of the screen mirroring device, establish a communication connection with the screen mirroring device based on the connection information, obtain the gesture information of the preset gesture, and convert the gesture information into the corresponding screen mirroring instruction. For example, if the preset gesture is a gesture of two fingers sliding inwards simultaneously, and the corresponding screen mirroring instruction is window display, then the screen mirroring instruction of window display is sent to the screen mirroring device to control the screen on the screen mirroring device to be displayed in a window.

[0051] In the above screen mirroring control method, by obtaining the gesture information of the preset gesture when establishing a communication connection with the screen mirroring device, converting the gesture information into the corresponding screen mirroring instruction, and performing screen mirroring control on the screen mirroring device based on the screen mirroring instruction, it is possible to control the screen mirroring device through gestures, improve the operation convenience of controlling the screen mirroring device, thereby improving the efficiency of screen mirroring control and enhancing the user experience.

[0052] In one embodiment, asFigure 3 As shown, establishing a communication connection with a screen mirroring device includes the following steps 302 to 306.

[0053] Step 302, in response to a trigger operation on a target application, display a scanning window of the target application.

[0054] In response to a trigger operation for running a target application, an electronic device displays a scanning window of the target application, and the scanning window can scan an object within the field of view of the scanning window. Among them, the target application is an application for obtaining corresponding information by scanning an information carrier through the scanning window. For example, scanning a QR code can obtain the information corresponding to the QR code, and scanning the connection QR code of the screen mirroring device can obtain the connection information of the screen mirroring device, etc. Optionally, the scanning window of the target application can be dynamically displayed. For example, at least one scanning line is displayed in the scanning window, and the scanning line can repeatedly move in the direction from top to bottom, indicating the dynamic display of the corresponding scanning window. The trigger operation on the target application can be a click operation or a swipe operation, etc.

[0055] In this embodiment, a target application is installed on the electronic device. In response to a trigger operation on the target application, the target application runs, the target application displays a scanning window, and scans an object within the field of view through the scanning window. Among them, the target application can be a camera application, a scanning application, etc.

[0056] Optionally, the scanning window can be communicatively connected to the camera of the electronic device through a target interface. In response to a trigger operation on the target application, the target interface between the target application and the camera is opened, and an object within the field of view of the camera is obtained through the target interface and scanned. That is to say, the field of view of the camera can be used as the field of view of the scanning window.

[0057] Step 304, obtain the connection information of the screen mirroring device through the scanning window.

[0058] By scanning the connection information of the screen mirroring device through the scanning window, the connection information of the screen mirroring device can be obtained. The connection information of the screen mirroring device can be represented by a QR code, a barcode, or other encoded information. In an actual application scenario, the electronic device scans the QR code of the screen mirroring device through the scanning window, and the QR code of the screen mirroring device includes the connection information, authentication information, etc. of the screen mirroring device, so that the connection information of the screen mirroring device can be obtained. The connection information is information for realizing a communication connection.

[0059] Step 306, establish a communication connection with the screen mirroring device based on the connection information.

[0060] The electronic device can establish a communication connection with the screen mirroring device based on the connection information of the screen mirroring device. In this embodiment, after the electronic device establishes a communication connection with the screen mirroring device, the electronic device can obtain the information on the screen mirroring device, and the screen mirroring device can receive the information sent by the electronic device. That is, the electronic device and the screen mirroring device can achieve information interaction. The electronic device can send a screen mirroring instruction to the screen mirroring device, and the screen mirroring device can receive the screen mirroring instruction sent by the electronic device and execute the corresponding screen mirroring instruction. Optionally, after the electronic device establishes a communication connection with the screen mirroring device based on the connection information, the screen mirroring device can be added to the whitelist device list, and the whitelist device list refers to the list of screen mirroring devices that have established a communication connection with the electronic device.

[0061] In this embodiment, by responding to the triggering operation of the target application, presenting the scanning window of the target application, obtaining the connection information of the screen mirroring device through the scanning window, and establishing a communication connection with the screen mirroring device based on the connection information, the communication connection between the electronic device and the screen mirroring device can be quickly and conveniently realized, the screen mirroring efficiency can be improved, and at the same time, the screen mirroring control can be quickly realized, and the efficiency of the screen mirroring control can be improved.

[0062] In some embodiments, as Figure 4 shown, step 302 of presenting the scanning window of the target application in response to the triggering operation of the target application includes the following steps 402 to 406.

[0063] Step 402, in response to the triggering of a preset swipe gesture, present the application icons of the selectable applications.

[0064] In response to the triggering of a preset swipe gesture, the electronic device can present the application icons of the selectable applications installed on the electronic device on the desktop. The preset swipe gesture can be, for example, a swipe gesture of a preset pattern, a swipe gesture in a preset direction, or a swipe gesture at a preset angle, etc. Presenting the application icons of the selectable applications can present the application icons of the selectable applications in a dynamic manner. For example, the application icons can be cyclically scrolled and presented through an icon list, or the application icons of all applications can be presented in an array.

[0065] In an optional embodiment, the preset sliding gesture may start from the right-angle vertex of the electronic device and slide along the diagonal direction of the electronic device to a preset position. Understandably, the sliding trajectory of the preset sliding gesture may be a straight-line trajectory along the diagonal of the electronic device, or may not be a straight-line trajectory. For example, it may slide from the lower left corner of the electronic device towards the upper right corner, or start from the lower right corner of the electronic device and slide towards the upper left corner of the electronic device, or slide from the upper left corner of the electronic device towards the lower right corner, or slide from the upper right corner of the electronic device towards the lower left corner, etc. When the sliding trajectory reaches the preset position, the application icons of the optional applications are displayed. It may be that when the sliding trajectory reaches an arc region at a preset distance from the starting right-angle vertex, the application icons of the optional applications are displayed. For example, if sliding starts from the lower left corner of the electronic device, when the sliding trajectory reaches 3 cm or 4.5 cm from the lower left vertex, the application icons of the optional applications are displayed. For instance, when the sliding trajectory reaches 3 cm from the lower left vertex, the application icons of the first part of the optional applications are displayed, and when the sliding trajectory reaches 4.5 cm from the lower left vertex, the application icons of the second part of the optional applications are displayed. Moreover, the application icons of the first part of the optional applications can be displayed in an arc region with the lower left vertex as the center and a radius of 3 cm, and the application icons of the second part of the optional applications can be displayed in an arc region with the lower left vertex as the center and a radius of 4.5 cm.

[0066] Step 404, in response to a selection operation on the trigger area of the target application in the optional applications, display the marking information of the application icon of the target application; the marking information is used to represent that the application icon of the target application is selected.

[0067] The marking information is a prompt message indicating that the application icon of the target application is selected. The marking information can be, for example, a highlighted display message, a prominent display message, or other prompt messages. The electronic device displays the marking information of the application icon of the target application in response to a selection operation on the trigger area of the target application in the optional applications. Among them, the trigger area corresponding to the target application can be the area corresponding to the application icon of the target application, or an area covering the application icon, or an annular area around the application icon. The area of the trigger area of the target application can be larger than the area of the application icon of the target application. Optionally, the trigger area corresponding to the target application can include a magnetic attraction area, which is beneficial to improving the triggering sensitivity and triggering speed.

[0068] In an actual application scenario, in response to a selection operation on the trigger area corresponding to the target application in the optional applications, the application icon of the target application is highlighted to represent that the application icon of the target application is selected, that is, the target application is selected.

[0069] Step 406: after displaying the mark information of the application icon of the target application, in response to the triggering of the lifting operation, displaying the scanning window of the target application.

[0070] In this embodiment, after displaying the mark information of the application icon of the target application, in response to the triggering of the lifting operation, the target application is run and the scanning window of the target application is displayed. Optionally, in response to the triggering of the lifting operation, the application icon of the optional application disappears and the scanning window of the target application is displayed on the display interface.

[0071] In one example, if Figure 5 As shown, in response to the triggering of a preset sliding gesture, the preset sliding gesture is sliding from the lower left corner of the electronic device along the diagonal direction toward the upper right corner. When the sliding reaches 3 cm from the lower left corner vertex, the application icon of the optional application corresponding to the first arc area 502 is displayed. The sliding continues. When the sliding reaches 4.5 cm from the lower left corner vertex, the application icon of the optional application in the second arc area 504 is displayed. In response to the selection operation of the trigger area 508 corresponding to the target application 506 in the optional application, the application icon of the target application 506 is highlighted. After the application icon of the target application 506 is highlighted, in response to the triggering of the lifting operation, the scanning window 510 of the target application 506 is displayed, and at the same time, the application icon of the optional application disappears (not shown in the figure).

[0072] In this embodiment, in response to the triggering of a preset sliding gesture, the application icon of the optional application is displayed, and in response to the selection operation of the triggering area of the target application in the optional application, the marking information of the application icon of the target application is displayed. After displaying the marking information of the application icon of the target application, in response to the triggering of a lift operation, the scanning window of the target application is displayed. It is possible to trigger the opening of the target application through a single lift operation, quickly call out the target application, and thus quickly open the scanning window of the target application, thereby improving the convenience of scanning and opening, and being able to quickly establish a communication connection with the projection device.

[0073] In one embodiment, establishing a communication connection with a screen projection device includes:

[0074] Identify whether the projection device is a whitelist device; if the projection device is a whitelist device and the distance between the projection device and the projection device is less than the distance threshold, establish a communication connection with the projection device.

[0075] A whitelist device refers to a device that has established a communication connection with an electronic device. The electronic device can store the device information of all whitelist devices in the form of a list, that is, the electronic device stores a whitelist device list. In the process of identifying whether a screen mirroring device belongs to the whitelist devices, the device information of the screen mirroring device can be obtained and compared with the device information in the whitelist device list. If the device information of the screen mirroring device exists in the whitelist device list, then the screen mirroring device belongs to the whitelist devices; otherwise, the screen mirroring device does not belong to the whitelist devices. Among them, the device information of the screen mirroring device can include device identification, device type, communication protocol, and communication interface, etc. The communication protocol refers to the supported communication protocol.

[0076] In one example, the screen mirroring device can broadcast in real time and broadcast its device information. When the electronic device receives the broadcast of the screen mirroring device, it can obtain the device information of the screen mirroring device, so as to identify whether the corresponding screen mirroring device belongs to the whitelist devices based on the device information. In addition, the screen mirroring device can also broadcast its location. When the electronic device receives the broadcast of the screen mirroring device, it can obtain the location of the screen mirroring device. Based on the positioning information of the electronic device and the obtained location of the screen mirroring device, the distance between the electronic device and the screen mirroring device can be calculated.

[0077] Optionally, if the screen mirroring device belongs to the whitelist devices and the distance between the electronic device and the screen mirroring device is less than the distance threshold, a communication connection is established with the screen mirroring device based on the historical connection information. Among them, the historical connection information refers to the connection information corresponding to the connection established with the screen mirroring device. When the electronic device establishes a communication connection with the screen mirroring device, it can save the connection information corresponding to the screen mirroring device for which the communication connection is established.

[0078] Optionally, if the screen mirroring device belongs to the whitelist devices, the distance between the electronic device and the screen mirroring device is less than the distance threshold, and the strength of the communication signal between the electronic device and the screen mirroring device is greater than the signal strength threshold, a communication connection is established with the screen mirroring device based on the historical connection information.

[0079] In this embodiment, by identifying whether the screen mirroring device belongs to the whitelist devices, if the screen mirroring device belongs to the whitelist devices and the distance between the electronic device and the screen mirroring device is less than the distance threshold, a communication connection is established with the screen mirroring device, that is, the automatic connection between the electronic device and the screen mirroring device is realized. The device information of the screen mirroring device can no longer be verified, thereby simplifying the operation process of screen mirroring connection, improving the screen mirroring efficiency and screen mirroring control efficiency, and at the same time improving the user experience.

[0080] In some embodiments, the above method further includes: disconnecting from the screen mirroring device in response to the trigger of screen mirroring off.

[0081] In response to the trigger of screen mirroring off, the electronic device disconnects from the screen mirroring device. Herein, "screen mirroring off" means ending screen mirroring or turning off screen mirroring. In a possible application scenario, after the electronic device establishes a communication connection with the screen mirroring device and turns on screen mirroring, it can transmit the screen on the electronic device to the screen mirroring device and control the screen on the screen mirroring device through a preset gesture on the electronic device. In response to the trigger of screen mirroring off, the screen mirroring device stops playing the screen of the electronic device, and the electronic device disconnects from the screen mirroring device. In another possible application scenario, after the electronic device establishes a communication connection with the screen mirroring device and turns on screen mirroring, it can control the screen played on the screen mirroring device through a preset gesture on the electronic device. In response to the trigger of screen mirroring off, the electronic device disconnects from the screen mirroring device, but the screen mirroring device can continue to play the screen content according to the previous settings of the electronic device.

[0082] In this embodiment, in response to the trigger of screen mirroring off and disconnecting from the screen mirroring device, when there is no need to control the screen mirroring device, network resources can be released in time, avoiding waste of network resources and improving resource utilization.

[0083] In some embodiments, the above method further includes:

[0084] Detecting the communication signal strength of the communication connection with the screen mirroring device to obtain a signal detection result; adjusting the screen clarity of the screen mirroring device based on the signal detection result.

[0085] In this embodiment, when establishing a communication connection with the screen mirroring device, the electronic device obtains the gesture information of the preset gesture, converts the gesture information into a corresponding screen mirroring instruction, and controls the screen mirroring device based on the screen mirroring instruction. During the screen mirroring process, the communication signal strength of the communication connection with the screen mirroring device is detected to obtain a signal detection result, and the screen clarity of the screen mirroring device is adjusted based on the signal detection result. For example, if the signal detection result is that the signal is good, the screen clarity of the screen mirroring device is increased; if the signal detection result is that the signal is poor, the screen clarity of the screen mirroring device is decreased.

[0086] Optionally, the electronic device can detect the communication signal strength of the connection with the screen mirroring device in real time to obtain a signal detection result, or detect the communication signal strength of the connection with the screen mirroring device at intervals of a preset duration to obtain a signal detection result. The preset duration can be set according to the actual application scenario, for example, it can be 2 minutes, 5 minutes, or 10 minutes, etc.

[0087] In a possible application scenario, when the electronic device establishes a communication connection with the screen mirroring device, the screen mirroring control is enabled to start screen mirroring. The screen of the electronic device can be projected onto the screen mirroring device for playback. The electronic device continuously detects the communication signal strength of the communication connection with the screen mirroring device to obtain a signal detection result. If the signal detection result indicates good signal, the screen clarity of the screen mirroring device is increased; if the signal detection result indicates poor signal, the screen clarity of the screen mirroring device is decreased.

[0088] In this embodiment, during the screen mirroring process, the communication signal strength of the communication connection with the screen mirroring device is detected to obtain a signal detection result, and the screen clarity of the screen mirroring device is adjusted based on the signal detection result. This can reduce the requirements for network quality for screen mirroring and adaptively adjust the screen mirroring quality according to the network quality, thereby improving the utilization rate of network resources.

[0089] In some embodiments, there are multiple screen mirroring devices; before obtaining the gesture information of the preset gesture, the above method further includes:

[0090] For the target screen mirroring device, in response to the triggering of the control page of the target screen mirroring device, the control page of the target screen mirroring device is displayed; where the target screen mirroring device is any one of the multiple screen mirroring devices;

[0091] Obtaining the gesture information of the preset gesture includes:

[0092] On the control page of the target screen mirroring device, obtain the gesture information of the preset gesture;

[0093] Performing screen mirroring control on the screen mirroring device based on the screen mirroring instruction includes:

[0094] Performing screen mirroring control on the target screen mirroring device based on the screen mirroring instruction.

[0095] In this embodiment, there are multiple screen mirroring devices, that is, the electronic device can establish communication connections with multiple screen mirroring devices simultaneously. Any one of the multiple screen mirroring devices is used as the target screen mirroring device. For the target screen mirroring device, in response to the triggering of the control page of the target screen mirroring device, the control page of the target screen mirroring device is displayed. On the control page of the target screen mirroring device, the gesture information of the preset gesture is obtained, the gesture information is converted into a corresponding screen mirroring instruction, and screen mirroring control is performed on the target screen mirroring device based on the screen mirroring instruction. That is to say, each screen mirroring device corresponds to a corresponding control page, and the gesture information of the preset gesture is obtained on the control page, and screen mirroring control is performed on the corresponding screen mirroring device based on the gesture information of the preset gesture obtained on the control page. Among them, the multiple screen mirroring devices can be different types of screen mirroring devices, such as televisions, projectors, monitors, etc.

[0096] Optionally, one of the screen mirroring devices is used as the target screen mirroring device. In response to the triggering of the control page of the target screen mirroring device, the control page of the target screen mirroring device can be, for example, the settings page of the target screen mirroring device; the control page of the target screen mirroring device is displayed, and the user can perform gesture operations on the displayed control page. When the electronic device recognizes a preset gesture, the gesture information of the preset gesture is obtained, and the gesture information of the preset gesture is converted into a corresponding screen mirroring instruction, and the target screen mirroring device is controlled for screen mirroring based on the screen mirroring instruction. By analogy, other screen mirroring devices can be used as the target screen mirroring device for corresponding screen mirroring control. It can be understood that the gesture operations corresponding to different screen mirroring devices can be the same or different, and the screen mirroring instructions corresponding to the same gesture operation obtained on the control pages of different screen mirroring devices can be the same or different, that is, different screen mirroring devices can implement the control of different screen mirroring instructions through the corresponding control pages.

[0097] In one example, multiple screen mirroring devices communicatively connected to the electronic device can be displayed in the form of a list, such as Figure 6 shown. Screen mirroring device A, screen mirroring device B, and screen mirroring device C are the screen mirroring devices that establish a communication connection with the electronic device in the current situation. When screen mirroring is enabled, the screen of the electronic device can be played simultaneously through screen mirroring device A, screen mirroring device B, and screen mirroring device C, or the electronic device can simultaneously control the screens played by screen mirroring device A, screen mirroring device B, and screen mirroring device B itself. In response to the triggering of the control of screen mirroring device A, the control page of screen mirroring device A is displayed, such as Figure 7 shown. The device information of screen mirroring device A is displayed on the control page of screen mirroring device A, and the first gesture information of the preset gesture can be obtained in the control area. The first gesture information is converted into a corresponding first screen mirroring instruction, and the screen mirroring device A is controlled for screen mirroring based on the first screen mirroring instruction. By analogy, in response to the triggering of the control of screen mirroring device B, the control page of screen mirroring device B can also be displayed, so as to control screen mirroring device B based on the second screen mirroring instruction; and in response to the triggering of the control of screen mirroring device C, the control page of screen mirroring device C is displayed, so as to control screen mirroring device C based on the third screen mirroring instruction.

[0098] In this embodiment, by responding to the triggering of the control page of the target screen mirroring device, displaying the control page of the target screen mirroring device, obtaining the gesture information of the preset gesture on the control page of the target screen mirroring device, converting the gesture information into a corresponding screen mirroring instruction, and controlling the target screen mirroring device for screen mirroring based on the screen mirroring instruction, separate screen mirroring control can be implemented for multiple screen mirroring devices, thereby improving the efficiency of screen mirroring control.

[0099] In some application scenarios, there are multiple screen mirroring devices that simultaneously establish communication connections with an electronic device. The multiple screen mirroring devices can be devices of different types, and one or more communication protocols supported by the multiple screen mirroring devices are also the communication protocols supported by the electronic device, that is, the electronic device supports multiple communication protocols. It can be realized that the electronic device can be compatible with multiple screen mirroring devices at the same time and establish communication connections with multiple screen mirroring devices simultaneously.

[0100] In one embodiment, as Figure 8 shown, a screen mirroring control method is provided, which is applied to an electronic device and includes the following steps 802 to step 812.

[0101] Step 802, identify whether the target screen mirroring device belongs to the whitelist device; wherein, the target screen mirroring device is any one of the multiple screen mirroring devices.

[0102] Step 804, if the target screen mirroring device belongs to the whitelist device and the distance between the electronic device and the target screen mirroring device is less than the distance threshold, establish a communication connection with the target screen mirroring device.

[0103] Step 806, in response to the triggering of the control page of the target screen mirroring device, display the control page of the target screen mirroring device.

[0104] Step 808, in the case of establishing a communication connection with the screen mirroring device, obtain the gesture information of the preset gesture on the control page of the target screen mirroring device.

[0105] Step 810, convert the gesture information into a corresponding screen mirroring instruction.

[0106] Step 812, perform screen mirroring control on the target screen mirroring device based on the screen mirroring instruction.

[0107] In the above embodiment, if the target screen mirroring device belongs to the whitelist device and the distance between the electronic device and the target screen mirroring device is less than the distance threshold, establish a communication connection with the target screen mirroring device, obtain the gesture information of the preset gesture on the control page corresponding to the target screen mirroring device, and perform screen mirroring control on the target screen mirroring device based on the screen mirroring instruction corresponding to the gesture information of the preset gesture, which can realize the automatic connection with the screen mirroring device, improve the convenience of the screen mirroring operation, and realize the screen mirroring control of the screen mirroring device through gesture operation, which can improve the convenience of the screen mirroring control, thereby improving the efficiency of the screen mirroring control.

[0108] It should be understood that although the steps in the flowcharts involved in the above-described embodiments are sequentially shown according to the indications of the arrows, these steps are not necessarily executed sequentially in the order indicated by the arrows. Unless there is a clear description in this article, there is no strict order limit for the execution of these steps, and these steps can be executed in other orders. Moreover, at least a part of the steps in the flowcharts involved in the above-described embodiments may include multiple steps or multiple stages. These steps or stages are not necessarily executed at the same moment, but can be executed at different moments, and the execution order of these steps or stages is not necessarily sequential, but can be executed alternately or in turn with at least a part of other steps or steps or stages in other steps.

[0109] Based on the same inventive concept, an embodiment of the present application further provides a screen mirroring control device for implementing the screen mirroring control method described above. The implementation solutions provided by this device to solve problems are similar to the implementation solutions recorded in the above method. Therefore, the specific limitations in one or more embodiments of the screen mirroring control device provided below can refer to the limitations on the screen mirroring control method in the above text, and will not be elaborated here.

[0110] In one embodiment, as Figure 9 shown, a screen mirroring control device is provided, including: a gesture acquisition module 902, a gesture conversion module 904, and a screen mirroring control module 906, where:

[0111] The gesture acquisition module 902 is configured to acquire gesture information of a preset gesture when a communication connection is established with a screen mirroring device;

[0112] The gesture conversion module 904 is configured to convert the gesture information into a corresponding screen mirroring instruction;

[0113] The screen mirroring control module 906 is configured to perform screen mirroring control on the screen mirroring device based on the screen mirroring instruction.

[0114] In one embodiment, the screen mirroring control device further includes a communication connection module, which is configured to:

[0115] In response to a trigger operation on a target application, display a scanning window of the target application; obtain connection information of the screen mirroring device through the scanning window; establish a communication connection with the screen mirroring device based on the connection information.

[0116] In one embodiment, the communication connection module is further configured to:

[0117] In response to the triggering of a preset sliding gesture, display the application icons of selectable applications; in response to a selection operation on the triggering area of a target application among the selectable applications, display the marking information of the application icon of the target application; the marking information is used to indicate that the application icon of the target application is selected; after displaying the marking information of the application icon of the target application, in response to the triggering of a lifting operation, display the scanning window of the target application.

[0118] In one embodiment, the communication connection module is further configured to:

[0119] Identify whether the screen mirroring device belongs to the whitelist device; if the screen mirroring device belongs to the whitelist device and the distance from the screen mirroring device is less than the distance threshold, establish a communication connection with the screen mirroring device.

[0120] In one embodiment, the screen mirroring control device further includes a screen mirroring closing module, which is configured to:

[0121] In response to the triggering of screen mirroring closing, disconnect from the screen mirroring device.

[0122] In one embodiment, the screen mirroring control device further includes a signal detection module, which is configured to:

[0123] Detect the communication signal strength of the communication connection with the screen mirroring device to obtain a signal detection result; adjust the clarity of the screen mirroring picture of the screen mirroring device based on the signal detection result.

[0124] In one embodiment, there are multiple screen mirroring devices, and the screen mirroring control device further includes a control page module, which is configured to, before obtaining the gesture information of the preset gesture, for the target screen mirroring device, in response to the triggering of the control page of the target screen mirroring device, display the control page of the target screen mirroring device; the target screen mirroring device is any one of the multiple screen mirroring devices;

[0125] The gesture acquisition module is further configured to: on the control page of the target screen mirroring device, obtain the gesture information of the preset gesture;

[0126] The screen mirroring control module is further configured to: perform screen mirroring control on the target screen mirroring device based on the screen mirroring instruction.

[0127] Each module in the above screen mirroring control device can be implemented in whole or in part by software, hardware, and their combination. The above modules can be embedded in the processor of the computer device in hardware form or be independent of it, or can be stored in the memory of the computer device in software form, so that the processor can call and execute the operations corresponding to the above modules.

[0128] In one embodiment, a computer device is provided. The computer device can be a terminal, and its internal structure diagram can be as Figure 10As shown in the figure. The computer device includes a processor, a memory, an input / output interface, a communication interface, a display unit, and an input device. Among them, the processor, the memory, and the input / output interface are connected through a system bus, and the communication interface, the display unit, and the input device are connected to the system bus through the input / output interface. Among them, the processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The input / output interface of the computer device is used to exchange information between the processor and external devices. The communication interface of the computer device is used to communicate with external terminals in a wired or wireless manner, and the wireless manner can be implemented through WIFI, a mobile cellular network, NFC (Near Field Communication), or other technologies. The computer program, when executed by the processor, implements a screen mirroring control method. The display unit of the computer device is used to form a visually visible picture, which can be a display screen, a projection device, or a virtual reality imaging device. The display screen can be a liquid crystal display screen or an electronic ink display screen. The input device of the computer device can be a touch layer covering the display screen, or a button, a trackball, or a touchpad provided on the computer device housing, or an external keyboard, touchpad, or mouse, etc.

[0129] Those skilled in the art can understand that Figure 10 the structure shown in the figure is only a block diagram of some structures related to the solution of this application, and does not constitute a limitation on the computer device to which the solution of this application is applied. The specific computer device may include more or fewer components than those shown in the figure, or combine certain components, or have different component arrangements.

[0130] This application embodiment also provides a computer-readable storage medium. One or more non-volatile computer-readable storage media containing computer-executable instructions, when the computer-executable instructions are executed by one or more processors, cause the processors to execute the steps of the screen mirroring control method.

[0131] This application embodiment also provides a computer program product containing instructions, which, when running on a computer, causes the computer to execute the screen mirroring control method.

[0132] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data for analysis, stored data, displayed data, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties, and the collection, use, and processing of relevant data need to comply with relevant laws, regulations, and standards.

[0133] Those of ordinary skill in the art can understand that all or part of the processes in the methods of the above embodiments can be completed by instructing relevant hardware through a computer program. The computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above methods. Among them, any reference to a memory, database, or other medium used in the embodiments provided in the present application can include at least one of non-volatile and volatile memories. Non-volatile memory can include Read-Only Memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetoresistive random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. By way of illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM), etc. The databases involved in the embodiments provided in the present application can include at least one of relational databases and non-relational databases. Non-relational databases can include distributed databases based on blockchain, etc., without limitation. The processors involved in the embodiments provided in the present application can be general-purpose processors, central processors, graphics processors, digital signal processors, programmable logic devices, data processing logics based on quantum computing, etc., without limitation.

[0134] The technical features of the above embodiments can be combined arbitrarily. For the sake of concise description, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, it should be considered as the scope recorded in this specification.

[0135] The above-described embodiments merely represent several implementation manners of the present application. Their descriptions are relatively specific and detailed, but they should not be construed as limiting the patent scope of the present application. It should be noted that for those of ordinary skill in the art, without departing from the concept of the present application, several modifications and improvements can still be made, and these all belong to the protection scope of the present application. Therefore, the protection scope of the present application should be subject to the appended claims.

Claims

1. A screen mirroring control method, characterized in that, The method includes: When establishing a communication connection with a screen mirroring device, obtaining gesture information of a preset gesture; Converting the gesture information into a corresponding screen mirroring instruction; Based on the screen mirroring instruction, performing screen mirroring control on the screen mirroring device.

2. The method according to claim 1, wherein The establishing a communication connection with the screen mirroring device includes: In response to a trigger operation on a target application, presenting a scanning window of the target application; Obtaining connection information of the screen mirroring device through the scanning window; Based on the connection information, establishing a communication connection with the screen mirroring device.

3. The method according to claim 2, wherein The in response to a trigger operation on a target application, presenting a scanning window of the target application includes: In response to the trigger of a preset swipe gesture, presenting application icons of optional applications; In response to a selection operation on a trigger area of a target application among the optional applications, displaying marking information of the application icon of the target application; the marking information is used to indicate that the application icon of the target application is selected; After the displaying the marking information of the application icon of the target application, in response to the trigger of a lift operation, presenting a scanning window of the target application.

4. The method according to claim 1, wherein The establishing a communication connection with the screen mirroring device includes: Identifying whether the screen mirroring device belongs to a whitelist device; If the screen mirroring device belongs to a whitelist device and the distance between the screen mirroring device and the device is less than a distance threshold, establishing a communication connection with the screen mirroring device.

5. The method according to any one of claims 1 to 4, characterized in that, The method further includes: In response to the trigger of screen mirroring off, disconnecting from the screen mirroring device.

6. The method according to claim 1, wherein The method further includes: Detecting the signal strength of a communication signal connected to the screen mirroring device to obtain a signal detection result; Based on the signal detection result, adjusting the clarity of the screen mirroring screen of the screen mirroring device.

7. The method according to claim 1, wherein There are multiple screen mirroring devices; before obtaining the gesture information of the preset gesture, the method further includes: For a target screen mirroring device, in response to a trigger on the control page of the target screen mirroring device, presenting the control page of the target screen mirroring device; the target screen mirroring device is any one of the multiple screen mirroring devices; The obtaining the gesture information of the preset gesture includes: On the control page of the target screen mirroring device, obtaining the gesture information of the preset gesture; The based on the screen mirroring instruction, performing screen mirroring control on the screen mirroring device includes: Based on the screen mirroring instruction, performing screen mirroring control on the target screen mirroring device.

8. A screen mirroring control device, characterized in that, The device includes: A gesture obtaining module, configured to obtain gesture information of a preset gesture when establishing a communication connection with a screen mirroring device; A gesture conversion module, configured to convert the gesture information into a corresponding screen mirroring instruction; A screen mirroring control module, configured to perform screen mirroring control on the screen mirroring device based on the screen mirroring instruction.

9. A computer device, comprising a memory and a processor, the memory storing a computer program, characterized in that, When the processor executes the computer program, the steps of the method according to any one of claims 1 to 7 are implemented.

10. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 7 are implemented.

Images