A method, apparatus, device, and storage medium for realizing intelligent screen projection

Abstract

This invention discloses a method, apparatus, device, and storage medium for implementing intelligent screen projection, belonging to the field of mobile terminal technology. The method includes: a mobile terminal scanning its surrounding devices to acquire multiple hardware devices; the mobile terminal determining a hardware device that supports screen projection from the multiple hardware devices and using the screen-projection-enabled hardware device as the projection terminal; when it detects that a user has opened an application software that supports screen projection, the mobile terminal uses the projection terminal to intelligently project the application software.

Description

Technical Field

[0001] This invention relates to the field of communication technology, and in particular to a method, apparatus, device, and storage medium for realizing intelligent screen projection. Background Technology

[0002] Screen mirroring will solve the problems caused by small screens. Currently, there are many screen mirroring solutions on the market, but if ordinary users haven't used screen mirroring before, they won't have any concept of it. Because they don't know that screen mirroring exists, they won't use it. Summary of the Invention

[0003] The main objective of this invention is to provide a method, apparatus, device, and storage medium for intelligent screen projection, which automatically detects projection devices and informs the user that a projection device has been found so that projection can begin.

[0004] To achieve the above objectives, embodiments of the present invention provide a method for implementing intelligent screen projection, comprising the following steps:

[0005] The mobile terminal scans its surrounding devices to obtain information about multiple hardware devices;

[0006] The mobile terminal determines the hardware device that supports screen projection from the plurality of hardware devices, and uses the hardware device that supports screen projection as the screen projection terminal.

[0007] When the mobile terminal detects that a user has opened an application that supports screen mirroring, it uses the screen mirroring terminal to intelligently mirror the application.

[0008] To achieve the above objectives, embodiments of the present invention provide a device for implementing intelligent screen projection, comprising:

[0009] The scanning module is used to acquire multiple hardware devices by scanning the surrounding devices;

[0010] The determining module is used to determine the hardware device that supports screen projection from the plurality of hardware devices, and to designate the hardware device that supports screen projection as the screen projection terminal.

[0011] The intelligent screen mirroring module is used to intelligently mirror the application software when it is detected that the user has opened an application software that supports screen mirroring.

[0012] To achieve the above objectives, this invention also proposes a device for implementing intelligent screen projection. The device includes a memory, a processor, a program stored in the memory and executable on the processor, and a data bus for establishing communication between the processor and the memory. When the program is executed by the processor, it implements the steps of the aforementioned method.

[0013] To achieve the above objectives, embodiments of the present invention also provide a storage medium for computer-readable storage, wherein the storage medium stores one or more programs, which can be executed by one or more processors to implement the steps of the aforementioned method.

[0014] The present invention proposes a method, apparatus, device, and storage medium for realizing intelligent screen projection, which enables users to be aware of the screen projection function and trigger the screen projection function under specific conditions. It can be triggered through simple operations, allowing users to know that the current device and environment support screen projection, thereby improving the user experience. Attached Figure Description

[0015] Figure 1 This is a flowchart of a method for implementing intelligent screen projection provided in Embodiment 1 of the present invention.

[0016] Figure 2 This is a schematic diagram of a device for implementing intelligent screen projection provided in Embodiment 2 of the present invention.

[0017] Figure 3 This is a system structure block diagram for implementing intelligent screen projection provided in Embodiment 3 of the present invention.

[0018] Figure 4 This is a flowchart of a method for implementing intelligent screen projection provided in Embodiment 4 of the present invention. Detailed Implementation

[0019] It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.

[0020] In the following description, the use of suffixes such as "module," "part," or "unit" to denote elements is solely for the purpose of illustrative purposes and has no inherent meaning. Therefore, "module," "part," or "unit" may be used interchangeably.

[0021] Figure 1 This is a flowchart of a method for implementing intelligent screen projection provided in Embodiment 1 of the present invention, as follows: Figure 1 As shown, it includes:

[0022] Step S101: The mobile terminal scans its surrounding devices to obtain multiple hardware devices;

[0023] Step S102: The mobile terminal determines the hardware device that supports screen projection from the plurality of hardware devices, and uses the hardware device that supports screen projection as the screen projection terminal.

[0024] Step S103: When it is detected that a user has opened an application software that supports screen casting, the mobile terminal uses the screen casting terminal to intelligently cast the application software.

[0025] The hardware devices supporting screen casting in this embodiment of the invention include any of the following: a screen casting device, a device with screen casting functionality, and a device with third-party screen casting application software; the application software supporting screen casting includes any of the following: video application software, image application software, and document application software. The hardware devices include smartphones, smart TVs, etc.

[0026] The process by which the mobile terminal determines which hardware device supports screen casting from the plurality of hardware devices includes: the mobile terminal acquiring parameter information for each hardware device; when the parameter information of the hardware device includes screen casting parameters, the mobile terminal determines that the hardware device is a hardware device that supports screen casting; when the parameter information of the hardware device does not include screen casting parameters, the mobile terminal determines that the hardware device is a hardware device that does not support screen casting. The screen casting parameters include the display, support for Miracast, DLNA (Digital Life Alliance), or AirPlay.

[0027] The process of the mobile terminal determining the hardware device that supports screen projection from the plurality of hardware devices further includes: the mobile terminal sending the plurality of hardware devices to the network side, so that the network side can determine whether each hardware device is a hardware device that supports screen projection based on a pre-stored database, and send the determination result to the mobile terminal; the mobile terminal determining the hardware device that supports screen projection based on the determination result.

[0028] The embodiments of the present invention further include: when the mobile terminal turns on the WIFI switch, it detects whether there is a hardware device that supports screen casting through WIFI Direct Connection; when the mobile terminal detects that there is a hardware device that supports screen casting, it uses the hardware device that supports screen casting as the screen casting terminal.

[0029] Figure 2 This is a schematic diagram of a device for implementing intelligent screen projection provided in Embodiment 2 of the present invention, as shown below. Figure 2 As shown, it includes: a scanning module, a determining module, and a smart projection module. The scanning module is used to scan surrounding devices to acquire multiple hardware devices; the determining module is used to determine from the multiple hardware devices that support projection and use the screen-projection-enabled hardware device as the projection terminal; the smart projection module is used to intelligently project the application software using the projection terminal when it detects that a user has opened an application software that supports projection.

[0030] The hardware device supporting screen casting in this embodiment of the invention includes any one of the following: a screen casting device, a device with screen casting functionality, and a device with third-party screen casting application software; the application software supporting screen casting includes any one of the following: video application software, image application software, and document application software.

[0031] This embodiment of the invention also includes: a detection module, used to detect whether there is a hardware device that supports screen casting when the WIFI switch is turned on via WIFI Direct Connection, and when a hardware device that supports screen casting is detected, the hardware device that supports screen casting is used as the screen casting terminal.

[0032] This invention also proposes a device for implementing intelligent screen projection. The device includes a memory, a processor, a program stored in the memory and executable on the processor, and a data bus for establishing communication between the processor and the memory. When the program is executed by the processor, it implements the steps of the aforementioned method.

[0033] This invention also provides a storage medium for computer-readable storage, wherein the storage medium stores one or more programs that can be executed by one or more processors to implement the steps of the aforementioned method.

[0034] This invention uses Wi-Fi to check if the current environment supports screen mirroring. The search is triggered when the user turns on Wi-Fi. The search is triggered when there is a screen mirroring device or a device that supports screen mirroring in the current wireless network environment.

[0035] Figure 3 This is a system structure block diagram for implementing intelligent screen projection provided in Embodiment 3 of the present invention, as shown below. Figure 3 As shown, it includes a screen casting trigger module, a screen casting search module, a screen casting prompt module, and a screen casting connection module.

[0036] Screen mirroring trigger module: The screen mirroring function can be triggered after the user turns on the Wi-Fi switch.

[0037] Screen mirroring search module: Based on Wi-Fi, it first scans the entire network (devices surrounding the terminal) to identify existing hardware devices. Then, it identifies whether the hardware device supports screen mirroring, such as Miracast, DLNA, or AirPlay. Alternatively, it supports software installation, allowing partnerships with third parties to install relevant software on the mobile phone or screen mirroring device for high-quality screen mirroring.

[0038] The screen mirroring search module of this application can be implemented in the following two ways:

[0039] The first method involves turning on the Wi-Fi switch on the terminal. Without needing to connect to a specific network, the device can search for and retrieve information via Wi-Fi Direct.

[0040] The second method involves turning on the Wi-Fi switch on the terminal, connecting to a specific network, and then searching for devices to retrieve information.

[0041] The identification of whether a hardware device supports screen mirroring in this application can be achieved in the following two ways:

[0042] The first method involves configuring the device to search for devices that support Wi-Fi Direct (there's an international standard for this). Only devices that support Wi-Fi Direct can be found. Alternatively, it can check if the projection device has projection software B installed. Only devices with software B installed can be considered as projection-enabled. If software B is installed, when the terminal device and the projection device establish a network connection, the terminal sends data, and the projection device receives and displays the data.

[0043] The second approach: For example, the database is hosted on a server. When manufacturer A launches product B, the database evaluates whether product B meets the screen mirroring function. If it does, the data is written to the database. The database can also store data by type, such as whether smartphones or smart TVs support screen mirroring.

[0044] When querying, the system matches information such as device type, brand, model, and operating system.

[0045] Screen casting notification module: If a screen casting device is detected, a pop-up window will notify the user when screen casting is available. For example, this could be displayed when opening a video app to play a video, a document app to view a document, or an image editing app to view an image. Users can choose to enable or disable screen casting.

[0046] Screen mirroring connection module: Based on the search results, if direct screen mirroring is supported, the user is taken directly to the device selection interface. If there is only one device, the connection is established directly. If there are multiple devices, the user is prompted to select the connection target. If screen mirroring software is required, a help page is opened to guide the user through the process.

[0047] In this embodiment of the invention, after identifying a screen projection device (projection terminal), it will not directly connect, but will intelligently remind the user whether to turn on screen projection based on different scenarios.

[0048] Scene:

[0049] 1. The user is currently at the office or at home (based on GPS data statistics and analysis);

[0050] 2. Is the current time zone of the user suitable for enabling screen mirroring? (For example, is it suitable to enable screen mirroring during holidays or weekday entertainment times?)

[0051] 3. Based on points 1 and 2 above, when a user may need to cast their screen while operating on the terminal (opening a game, playing a video, browsing pictures, editing files, drawing, etc.), the user will be prompted to enable screen casting.

[0052] User confirms screen mirroring is enabled:

[0053] 1. If the screen mirroring device supports direct screen mirroring, then you can proceed to the screen mirroring link.

[0054] 2. If the screen mirroring device meets the requirements for adding screen mirroring, but cannot directly mirror (e.g., the device can install screen mirroring software, but it is not currently installed), then based on the previously identified results, the user will be guided to screen mirroring via a webpage (e.g., downloading the relevant screen mirroring software).

[0055] Figure 4 This is a flowchart of a method for implementing intelligent screen projection provided in Embodiment 4 of the present invention, as shown below. Figure 4 As shown, it includes:

[0056] Step 401: The user triggered screen mirroring detection;

[0057] Since it is designed for Wi-Fi screen mirroring, the trigger point is the Wi-Fi switch being turned on.

[0058] Step 402: Has a device supporting screen mirroring been detected?

[0059] The detection of screen mirroring devices is divided into two parts: one part is the detection of devices that can start screen mirroring directly; the other part is the detection of devices that support screen mirroring by installing software. This part can also serve as an entry point for promoting third-party screen mirroring software.

[0060] Step 403: Screen projection scenario identified;

[0061] If a device that supports screen mirroring is detected, the user will be notified via a pop-up window at an appropriate time that screen mirroring is currently available. For example, this could be when opening a video app to play a video, a document app to view a document, or an image editing app to view images. The user can choose to enable screen mirroring or disable it.

[0062] Step 404: Trigger the screen mirroring prompt interface;

[0063] Once screen mirroring is detected as an available environment, the UI should prompt the user at an appropriate time. Simply turning on Wi-Fi doesn't automatically indicate a need for screen mirroring; however, data analysis of the mirroring scenario can help determine the optimal timing for the prompt, such as when the user starts playing a video, viewing a document, or browsing images.

[0064] Step 405: Does the user choose to cast their screen?

[0065] The screen mirroring prompt interface allows users to choose to turn it off or continue mirroring. The prompt interface can be designed with different functions to meet different needs.

[0066] Step 406: Can I cast the screen directly?

[0067] Based on the test results of step 402, if the device can be directly projected, then the projection process will begin directly; if the test results indicate that software needs to be installed, the user needs to install the software before projecting.

[0068] Step 407: Open the help interface to guide users to cast their screens according to the tutorial.

[0069] The onboarding page that users open will introduce specific installation methods and usage instructions. This not only provides users with a way to cast their screens but also promotes screen casting software on the market.

[0070] Those skilled in the art will understand that all or some of the steps in the methods disclosed above, as well as the functional modules / units in the systems and devices, can be implemented as software, firmware, hardware, or suitable combinations thereof.

[0071] In hardware implementations, the division between functional modules / units mentioned in the above description does not necessarily correspond to the division of physical components; for example, a physical component may have multiple functions, or a function or step may be performed collaboratively by several physical components. Some or all physical components may be implemented as software executed by a processor, such as a central processing unit, digital signal processor, or microprocessor, or as hardware, or as an integrated circuit, such as an application-specific integrated circuit. Such software may be distributed on a computer-readable medium, which may include computer storage media (or non-transitory media) and communication media (or transient media). As is known to those skilled in the art, the term computer storage media includes volatile and non-volatile, removable and non-removable media implemented in any method or technology for storing information (such as computer-readable instructions, data structures, program modules, or other data). Computer storage media includes, but is not limited to, RAM, ROM, EEPROM, flash memory or other memory technologies, CD-ROM, digital versatile disc (DVD) or other optical disc storage, magnetic cartridges, magnetic tape, disk storage or other magnetic storage devices, or any other medium that can be used to store desired information and is accessible to a computer. Furthermore, as is known to those skilled in the art, communication media typically contain computer-readable instructions, data structures, program modules, or other data in modulated data signals such as carrier waves or other transmission mechanisms, and may include any information delivery medium.

[0072] The preferred embodiments of the present invention have been described above with reference to the accompanying drawings, but this does not limit the scope of the invention. Any modifications, equivalent substitutions, and improvements made by those skilled in the art without departing from the scope and spirit of the present invention should be within the scope of the present invention.

Claims

1. A method for implementing intelligent screen projection, characterized in that, Includes the following steps: When a mobile terminal turns on its Wi-Fi, it scans for multiple hardware devices in its vicinity. The mobile terminal determines the hardware device that supports screen projection from the plurality of hardware devices, and uses the hardware device that supports screen projection as the screen projection terminal. When the mobile terminal detects that a user has opened an application that supports screen mirroring, it uses the screen mirroring terminal to intelligently mirror the application. The mobile terminal determines a hardware device that supports screen projection from among the plurality of hardware devices, and uses the hardware device that supports screen projection as the screen projection terminal, including: The system detects whether any of the multiple hardware devices support screen mirroring by directly connecting via Wi-Fi. When the mobile terminal detects the existence of a hardware device that supports screen mirroring, it uses the hardware device that supports screen mirroring as the screen mirroring terminal.

2. The method according to claim 1, characterized in that, The hardware devices that support screen casting include any of the following: screen casting devices, devices with screen casting functionality, and devices with third-party screen casting application software; the application software that supports screen casting includes any of the following: video application software, image application software, and document application software.

3. The method according to claim 2, characterized in that, The mobile terminal determines the hardware devices that support screen projection from the plurality of hardware devices, including: The mobile terminal acquires parameter information of each hardware device; When the parameter information of the hardware device includes screen projection parameters, the mobile terminal determines that the hardware device is a hardware device that supports screen projection. When the parameter information of the hardware device does not include screen projection parameters, the mobile terminal determines that the hardware device is a hardware device that does not support screen projection.

4. The method according to claim 2, characterized in that, The mobile terminal further identifies the hardware devices that support screen projection from the plurality of hardware devices, including: The mobile terminal sends the multiple hardware devices to the network side, so that the network side can determine whether each hardware device is a hardware device that supports screen projection based on a pre-stored database, and send the determination result to the mobile terminal. Based on the judgment result, the mobile terminal determines the hardware device that supports screen projection.

5. A device for realizing intelligent screen projection, characterized in that, include: The scanning module is used by the mobile terminal to scan the surrounding devices and obtain information about multiple hardware devices when the WIFI switch is turned on. The determining module is used to determine the hardware device that supports screen projection from the plurality of hardware devices, and to designate the hardware device that supports screen projection as the screen projection terminal. The intelligent screen projection module is used to intelligently project the application software using the screen projection terminal when it is detected that the user has opened an application software that supports screen projection. The determining module is configured to determine, from the plurality of hardware devices, a hardware device that supports screen projection, and designate the hardware device that supports screen projection as the screen projection terminal, including: The determining module is used to detect whether there is a hardware device that supports screen projection among the multiple hardware devices via WIFI direct connection; when a hardware device that supports screen projection is detected, the hardware device that supports screen projection is used as the screen projection terminal.

6. The apparatus according to claim 5, characterized in that, The hardware devices that support screen casting include any of the following: screen casting devices, devices with screen casting functionality, and devices with third-party screen casting application software; the application software that supports screen casting includes any of the following: video application software, image application software, and document application software.

7. A device for realizing intelligent screen projection, characterized in that, The device includes a memory, a processor, a program stored in the memory and executable on the processor, and a data bus for enabling communication between the processor and the memory. When the program is executed by the processor, it implements the steps of the method for implementing intelligent screen projection as described in any one of claims 1-4.

8. A storage medium for computer-readable storage, characterized in that, The storage medium stores one or more programs, which can be executed by one or more processors to implement the steps of the method for implementing intelligent screen projection as described in any one of claims 1-4.

Images