Screen mirroring management methods and terminal devices

CN115696633BActive Publication Date: 2026-09-01GUANGDONG OPPO MOBILE TELECOMMUNICATIONS CORP LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202211293673.1
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-10-21
Publication Date
2026-09-01
Estimated Expiration
2042-10-21

AI Technical Summary

Technical Problem

[0003]但上述投屏方法需要用户操作,导致存在投屏效率低、用户使用体验差的问题

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN115696633B_ABST
    Figure CN115696633B_ABST
Patent Text Reader

Abstract

This application provides a screen mirroring management method and a terminal device, applied to a first terminal device. While improving user privacy, it achieves seamless and efficient screen mirroring, enhancing the user experience. The method includes: receiving screen mirroring request information from a second terminal device; determining whether the device has previously connected to a first wireless network, which is the wireless network currently shared by both the first and second terminal devices; and, if it is determined that the device has previously connected to the first wireless network, performing screen mirroring based on the aforementioned screen mirroring request information.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This application relates to the field of terminal technology, and in particular to a screen projection management method and terminal device. Background Technology

[0002] With the development of internet technology, users can now use screen mirroring technology to project content from one terminal device onto other terminal devices, thus meeting users' needs for using terminal devices in specific scenarios and providing a better user experience.

[0003] However, the above screen mirroring methods require user operation, resulting in low screen mirroring efficiency and poor user experience. Summary of the Invention

[0004] This application provides a screen casting management method and terminal device, which improves user privacy while achieving seamless and efficient screen casting, thus enhancing the user experience.

[0005] In a first aspect, a screen mirroring management method is provided, applied to a first terminal device. The method includes: receiving screen mirroring request information from a second terminal device; determining whether the device has previously connected to a first wireless network, wherein the first wireless network is a wireless network currently jointly connected to by the first terminal device and the second terminal device; and, if it is determined that the device has previously connected to the first wireless network, performing screen mirroring based on the screen mirroring request information.

[0006] In this application, the first terminal device can directly perform screen mirroring on the second terminal device that sent the screen mirroring request information, provided that the currently connected first wireless network is a wireless network it has previously connected to, without requiring user operation. In other words, this application can default to historically connected wireless networks as networks with higher security. That is, since the first terminal device has previously connected to the wireless network, it indicates that the environment under the wireless network is relatively secure, and the possibility of user privacy leakage is low when mirroring under the wireless network, resulting in a better user experience.

[0007] Secondly, a terminal device is provided, comprising: a receiving module, a judging module, and a processing module. The receiving module is used to receive screen mirroring request information from a second terminal device; the judging module is used to judge whether the device has previously connected to a first wireless network, wherein the first wireless network is a wireless network currently shared by the first terminal device and the second terminal device; and the processing module is used to perform screen mirroring based on the screen mirroring request information when it is determined that the device has previously connected to the first wireless network.

[0008] Thirdly, another terminal device is provided, comprising a processor coupled to a memory for executing instructions in the memory to implement the methods in any of the possible implementations of the first aspect described above. Optionally, the terminal device further includes a memory. Optionally, the terminal device further includes a communication interface, to which the processor is coupled.

[0009] Fourthly, a processor is provided, comprising: an input circuit, an output circuit, and a processing circuit. The processing circuit is used to receive signals through the input circuit and transmit signals through the output circuit, causing the processor to execute the method in any possible implementation of the first aspect described above.

[0010] In specific implementation, the processor can be a chip, the input circuit can be an input pin, the output circuit can be an output pin, and the processing circuit can be a transistor, gate circuit, flip-flop, and various logic circuits. The input signal received by the input circuit can be received and input by, for example, but not limited to, a receiver, and the signal output by the output circuit can be output to, for example, but not limited to, a transmitter and transmitted by the transmitter. Furthermore, the input circuit and the output circuit can be the same circuit, which is used as the input circuit and the output circuit at different times. This application does not limit the specific implementation of the processor and various circuits.

[0011] Fifthly, a processing apparatus is provided, including a processor and a memory. The processor is used to read instructions stored in the memory and to receive signals via a receiver and transmit signals via a transmitter to execute the method in any of the possible implementations of the first aspect described above.

[0012] Optionally, there may be one or more processors and one or more memories.

[0013] Alternatively, the memory can be integrated with the processor, or the memory can be set up separately from the processor.

[0014] In specific implementation, the memory can be a non-transitory memory, such as read-only memory (ROM), which can be integrated with the processor on the same chip or set on different chips. The embodiments of this application do not limit the type of memory or the way the memory and processor are set.

[0015] It should be understood that the relevant data interaction process, such as sending indication information, can be the process of outputting indication information from the processor, and receiving capability information can be the process of the processor receiving input capability information. Specifically, the processed output data can be output to the transmitter, and the input data received by the processor can come from the receiver. Here, the transmitter and receiver can be collectively referred to as a transceiver.

[0016] The processing device in the fifth aspect above can be a chip. The processor can be implemented in hardware or software. When implemented in hardware, the processor can be a logic circuit, integrated circuit, etc. When implemented in software, the processor can be a general-purpose processor that reads software code stored in memory. The memory can be integrated into the processor or located outside the processor and exist independently.

[0017] In a sixth aspect, a computer program product is provided, comprising: a computer program (also referred to as code or instructions) that, when executed, causes a computer to perform the method described in the first aspect.

[0018] In a seventh aspect, a computer-readable storage medium is provided that stores a computer program (also referred to as code or instructions) that, when executed on a computer, causes the computer to perform the methods in any of the possible implementations of the first aspect described above. Attached Figure Description

[0019] Figure 1 This is a schematic diagram of the application scenario provided in the embodiments of this application;

[0020] Figure 2 This is a schematic diagram of the system architecture of the terminal device provided in the embodiments of this application;

[0021] Figure 3 This is a flowchart illustrating an example of the screen mirroring management method provided in this application embodiment;

[0022] Figure 4 This is a flowchart illustrating a specific example of the screen mirroring management method provided in this application embodiment;

[0023] Figure 5 This is a schematic diagram of a smartwatch interface for screen mirroring management provided in an embodiment of this application;

[0024] Figure 6 This is a schematic diagram of a mobile phone interface for screen mirroring management provided in an embodiment of this application;

[0025] Figure 7 This is another schematic diagram of the mobile phone interface for screen mirroring management provided in the embodiments of this application;

[0026] Figure 8 This is another schematic diagram of the smartwatch interface for screen mirroring management provided in the embodiments of this application;

[0027] Figure 9 This is a structural block diagram of an example of a terminal device provided in an embodiment of this application;

[0028] Figure 10 This is a schematic diagram of another example of the terminal device provided in the embodiments of this application. Detailed Implementation

[0029] The technical solutions in this application will now be described with reference to the accompanying drawings.

[0030] To facilitate a clear description of the technical solutions in the embodiments of this application, the terms "first" and "second" are used in the embodiments of this application to distinguish identical or similar items with essentially the same function and effect. For example, "first instruction" and "second instruction" are used to distinguish different user instructions and do not limit their order. Those skilled in the art will understand that the terms "first" and "second" do not limit the quantity or execution order, and the terms "first" and "second" are not necessarily different.

[0031] It should be noted that, in this application, the words "exemplarily" or "for example" are used to indicate examples, illustrations, or explanations. Any embodiment or design described as "exemplarily" or "for example" in this application should not be construed as being more preferred or advantageous than other embodiments or designs. Specifically, the use of words such as "exemplarily" or "for example" is intended to present the relevant concepts in a specific manner.

[0032] Furthermore, "at least one" refers to one or more, while "more than one" refers to two or more. "And / or" describes the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can mean: A alone, A and B simultaneously, or B alone, where A and B can be singular or plural. The character " / " generally indicates that the preceding and following related objects are in an "or" relationship. "At least one of the following" or similar expressions refer to any combination of these items, including any combination of single or plural items. For example, at least one of a, b, and c can mean: a, or b, or c, or a and b, or a and c, or b and c, or a, b, and c, where a, b, and c can be single or multiple.

[0033] Figure 1 This is a schematic block diagram illustrating application scenario 100 provided in an embodiment of this application. Figure 1 The application scenario 100 shown includes a first terminal device 101 and a second terminal device 102. The first terminal device 101 can project its displayed content onto the second terminal device 102 via wireless network and / or Bluetooth, etc., which is not limited in this application.

[0034] It should be understood that the first terminal device 101 can also project its screen onto other terminal devices, or the second terminal device 102 can also project its screen onto the first terminal device 101 or other terminal devices; this application does not limit this. This application mainly takes the projection of the first terminal device 101 onto the second terminal device 102 as an example.

[0035] It should also be understood that the first terminal device 101 and the second terminal device 102 mentioned above can be terminal devices of the same type or different types, and this application does not limit them in this regard.

[0036] However, in the above scenarios, screen mirroring requires user intervention, resulting in low efficiency and a poor user experience.

[0037] Therefore, embodiments of this application provide a screen mirroring management method and a terminal device. The first terminal device can directly mirror the screen from the second terminal device that sent the screen mirroring request information, provided that the currently connected first wireless network is a previously connected wireless network, without requiring user intervention. In other words, this application can default to previously connected wireless networks as networks with higher security. Since the first terminal device has previously connected to this wireless network, it indicates that the environment under this wireless network is relatively secure, and the possibility of user privacy leakage when mirroring under this wireless network is low, resulting in a better user experience.

[0038] It should be understood that the terminal devices involved in the embodiments of this application may be mobile phones, tablet computers, laptops, handheld computers, mobile internet devices (MID), wearable devices, virtual reality (VR) devices, augmented reality (AR) devices, smart screens, artificial intelligence (AI) speakers, headphones, terminals in industrial control, terminals in self-driving, terminals in remote medical surgery, terminals in smart grids, terminals in transportation safety, terminals in smart cities, terminals in smart homes, personal digital assistants (PDAs), etc., and the embodiments of this application are not limited to these.

[0039] For example, Figure 2 This is a schematic diagram of the system architecture of the terminal device provided in the embodiments of this application.

[0040] like Figure 2 As shown, the terminal device includes a processor 210, a transceiver 220, and a power supply 230.

[0041] Optionally, the terminal device may also include a memory 240. The processor 210, transceiver 220 and memory 240 can communicate with each other through an internal connection path to transfer charging data. The memory 240 is used to store computer programs, and the processor 210 is used to call and run the computer programs from the memory 240.

[0042] The aforementioned terminal equipment may also include a power supply 230 for providing power to various devices or circuits in the terminal equipment.

[0043] The processor 210 and memory 240 can be combined into a single processing device, but more commonly they are separate components. The processor 210 executes the program code stored in memory 240 to achieve the aforementioned functions. In specific implementations, the memory 240 can be integrated into the processor 210, or it can be independent of the processor 210.

[0044] In addition, to further enhance the functionality of the terminal device, it may also include one or more of an input unit 250 and a sensor 260.

[0045] Understandable Figure 2 The operations and / or functions of each module in the terminal device shown are respectively for implementing the corresponding processes in the following method embodiments. For details, please refer to the descriptions in the following method embodiments; to avoid repetition, detailed descriptions are appropriately omitted here.

[0046] Understandable Figure 2 The processor 210 in the terminal device shown may include one or more processing units, such as an application processor (AP), a modem processor, a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural network processing unit (NPU). These different processing units may be independent devices or integrated into one or more processors.

[0047] The processor 210 may also include a memory for storing instructions and data. In some embodiments, the memory in the processor 210 is a cache memory. This memory can store instructions or data that the processor 210 has just used or that are used repeatedly. If the processor 210 needs to use the instruction or data again, it can retrieve it directly from the aforementioned memory. This avoids repeated accesses, reduces the waiting time of the processor 210, and thus improves the efficiency of the system.

[0048] In some embodiments, the processor 210 may include one or more interfaces. Interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0049] The UART interface is a universal serial data bus used for asynchronous communication. This bus can be a bidirectional communication bus. It converts the data to be transmitted between serial and parallel communication. In some embodiments, the UART interface is typically used to connect the processor 210 and the transceiver 220. For example, the processor 210 communicates with the Bluetooth module in the transceiver 220 via the UART interface to implement Bluetooth functionality. In some embodiments, the audio circuitry 270 can transmit audio signals to the transceiver 220 via the UART interface.

[0050] The GPIO interface can be configured via software. It can be configured as a control signal or a data signal. In some embodiments, the GPIO interface can be used to connect the processor 210 to the transceiver 220, audio module circuit 280, sensor 260, etc. The GPIO interface can also be configured as an I2C interface, I2S interface, UART interface, etc.

[0051] It is understood that the interface connection relationships between the modules illustrated in the embodiments of this application are merely illustrative and do not constitute a structural limitation on the terminal device. In other embodiments of this application, the terminal device may also employ different interface connection methods or combinations of multiple interface connection methods as described in the above embodiments.

[0052] Understandable Figure 2 The power supply 230 shown is used to supply power to the processor 210, memory 240, input unit 250 and transceiver 220, etc.

[0053] Transceiver 220 can provide solutions for wireless communication applications on terminal devices, including wireless local area networks (WLANs) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), and infrared (IR) technologies. Transceiver 220 can be one or more devices integrating at least one communication processing module.

[0054] The memory 240 can be used to store computer executable program code, including instructions. The memory 240 may include a program storage area and a data storage area. The program storage area may store the operating system, at least one application program required for a function, etc. The data storage area may store data created during the use of the terminal device (such as charging data), etc. Furthermore, the memory 240 may include high-speed random access memory, and may also include non-volatile memory, such as at least one disk storage device, flash memory device, universal flash storage (UFS), etc. The processor 210 executes various functional applications and data processing of the terminal device by running instructions stored in the memory 240 and / or instructions stored in memory located within the processor.

[0055] The terminal device can implement audio functions through the audio circuit 270 and application processor, such as playing a prompt tone to indicate that charging is complete or that charging has started.

[0056] The audio circuit 270 is used to convert digital audio information into analog audio signal output, and also to convert analog audio input into digital audio signal. The audio circuit 270 can also be used for encoding and decoding audio signals. In some embodiments, the audio circuit 270 may be located in the processor 210, or some functional modules of the audio circuit 270 may be located in the processor 210.

[0057] To make the objectives and technical solutions of this application clearer and more intuitive, the screen projection management method and terminal device provided in the embodiments of this application will be described in detail below with reference to the accompanying drawings and examples. It should be understood that the specific embodiments described herein are merely illustrative of this application and are not intended to limit this application.

[0058] Figure 3 This is a schematic flowchart illustrating a screen mirroring management method 300 provided in an embodiment of this application. This method 300 can be applied to... Figure 1 The application scenarios shown can be applied to other scenarios as well, and this application does not limit this application. For example... Figure 3 As shown, the method 300 may include the following steps:

[0059] S301, the first terminal device receives a screen mirroring request from the second terminal device.

[0060] It should be understood that the first terminal device can receive the screen mirroring request information from the second terminal device through the currently connected wireless network. Alternatively, it can receive the screen mirroring request information through other means, such as Bluetooth, and this application does not limit this.

[0061] S302, the first terminal device determines whether it has previously connected to the first wireless network, wherein the first wireless network is the wireless network currently connected to by both the first terminal device and the second terminal device.

[0062] It should be understood that the first wireless network may be a wireless network provided by the first terminal device, a wireless network provided by the second terminal device, or a wireless network provided by a third-party device; this application does not limit this.

[0063] In one possible implementation, the first terminal device can determine whether the first wireless network is a wireless network that has been previously connected to, based on the first wireless network and historical connection data.

[0064] It should be understood that historical connection data may include multiple applications and the number of times those multiple applications have connected to the first terminal device before the current moment.

[0065] It should also be understood that the aforementioned historically connected wireless networks can be interpreted as wireless networks that have been connected to at least once in the past, or wireless networks that have been connected to multiple times in the past; this application does not limit this interpretation. Users can set the number of connections mentioned above according to their own needs.

[0066] S303, when it is determined that the device has previously connected to the first wireless network, the first terminal device casts a screen based on the aforementioned screen casting request information.

[0067] For example, the first terminal device can send screen-sharing content to the second terminal device via the first wireless network. Correspondingly, the second terminal device can receive and project the screen based on the screen-sharing content.

[0068] Optionally, if it is determined that the first terminal device has not previously connected to the first wireless network, the first terminal device may not perform any operation. That is, if the second terminal device does not receive any response from the first terminal device, the second terminal device may determine that the first terminal device has rejected the screen mirroring request, and thus may end the screen mirroring request.

[0069] In this application, the first terminal device can directly perform screen mirroring on the second terminal device that sent the screen mirroring request information, provided that the currently connected first wireless network is a wireless network it has previously connected to, without requiring user operation. In other words, this application can default to historically connected wireless networks as networks with higher security. That is, since the first terminal device has previously connected to the wireless network, it indicates that the environment under the wireless network is relatively secure, and the possibility of user privacy leakage is low when mirroring under the wireless network, resulting in a better user experience.

[0070] It should be understood that the first terminal device can determine whether the second terminal device is connected to the same wireless network through the aforementioned screen mirroring request information, and then, if it is determined that they are connected to the same wireless network, screen mirroring can be achieved through that wireless network.

[0071] For example, the screen mirroring request information can be sent by the second terminal device through the first wireless network. That is, as long as the first terminal device can receive the screen mirroring request information, it indicates that the first terminal device and the second terminal device are currently connected to the same wireless network. Alternatively, the screen mirroring request information can carry information about a wireless network (i.e., the aforementioned second wireless network). The first terminal device can also determine that the second wireless network and its currently connected wireless network (i.e., the first wireless network) are the same wireless network based on the information of the second wireless network. This application does not limit this.

[0072] The following description focuses on the screen mirroring management method provided in this application, using the example of sending screen mirroring request information through the aforementioned first wireless network, the first terminal device being a mobile phone, and the second terminal device being a tablet computer.

[0073] Figure 4 This is a schematic flowchart illustrating a screen mirroring management method 400 provided in an embodiment of this application. This method 400 can also be applied to... Figure 1 The application scenarios shown can be applied to other scenarios as well, and this application does not limit this application. For example... Figure 4 As shown, the method 400 includes the following steps:

[0074] S401, the tablet computer sends a screen mirroring request to the mobile phone via the first wireless network. Correspondingly, the mobile phone receives the screen mirroring request.

[0075] It should be understood that when the mobile phone receives the above screen mirroring request information, the mobile phone can determine that the tablet computer is currently connected to the same wireless network (i.e., the above-mentioned first wireless network).

[0076] S402, the mobile phone determines whether it has previously connected to the first wireless network, which is the wireless network currently shared by the mobile phone and the tablet.

[0077] In one possible implementation, the mobile phone can determine whether the first wireless network is a wireless network that the mobile phone has previously connected to, based on the first wireless network and historical connection data.

[0078] Table 1 shows the historical connection data mentioned above.

[0079] First Wireless Network 3 Third wireless network 1

[0080] As shown in Table 1, the historical connection data above shows the wireless networks that the mobile phone has historically connected to, including the first wireless network and the third wireless network. The mobile phone has historically connected to the first wireless network 3 times and the mobile phone has historically connected to the third wireless network 1 time.

[0081] It should be understood that the aforementioned historically connected wireless networks can be understood as wireless networks that have been connected to at least once in the past, or wireless networks that have been connected to multiple times in the past; this application does not limit this.

[0082] In one possible scenario, set historically connected wireless networks to those that have been connected to at least once in the past.

[0083] For example, based on the historical connection data shown in Table 1, the mobile phone can determine that the first wireless network is a wireless network that it has connected to three times before the current time. Since the number of times the first wireless network has been historically connected to satisfies the condition of at least once, the mobile phone can determine that it is a wireless network that has been historically connected to.

[0084] For example, if the mobile phone is currently connected to a third wireless network, the mobile phone can also determine, based on the historical connection data shown in Table 1, that the third wireless network is a wireless network that it has connected to once before the current time. Since the number of times the third wireless network has been connected to in the past meets the requirement of at least once, the mobile phone can also determine that it is a wireless network that has been connected to in the past.

[0085] In another possible scenario, the previously connected wireless networks can be set to the wireless networks that have been connected to multiple times in the past.

[0086] For example, based on the historical connection data shown in Table 1, the mobile phone can determine that the first wireless network is a wireless network that it has connected to three times before the current time. Since the number of times the first wireless network has been historically connected is sufficient, the mobile phone can determine that it is a wireless network that has been historically connected to.

[0087] For example, if the mobile phone is currently connected to a third wireless network, the mobile phone can also determine, based on the historical connection data shown in Table 1, that the third wireless network is a wireless network that it has connected to once before the current time. Since the number of times the third wireless network has been connected in the past does not meet the requirement of multiple times, the mobile phone can determine that the third wireless network is not a wireless network that has been connected in the past.

[0088] S403, upon confirming a previous connection to the aforementioned first wireless network, the mobile phone sends screen mirroring content to the tablet computer based on the aforementioned screen mirroring request information. Correspondingly, the tablet computer receives the aforementioned screen mirroring content.

[0089] For example, a mobile phone can send screen-projected content to a tablet computer via a first wireless network.

[0090] Optionally, if it is determined that the phone has not previously connected to the first wireless network, the phone may not perform any operation. That is, if the tablet does not receive any response from the phone, it can determine that the phone has rejected the screen mirroring request and thus end the screen mirroring request.

[0091] S404, the tablet computer displays the above-mentioned screen-projected content.

[0092] Optionally, to further meet users' privacy and security needs, before S303 and / or S403 above, i.e., before the first terminal device confirms screen mirroring, the first terminal device may also output a reminder message to inform the user that screen mirroring is about to be performed on another terminal device. This allows the user to perform screen mirroring only if they are certain that the current interface content of the first terminal device can be made public. In other words, while achieving seamless screen mirroring, user privacy and security are further improved, enhancing the user experience.

[0093] It should be understood that the aforementioned reminder information may include text reminder information and / or non-text reminder information, and this application does not limit this.

[0094] In one possible scenario, where it is convenient for the user to view the display interface of the first terminal device, the aforementioned reminder information can be a text reminder.

[0095] The following description uses a smartwatch as the first terminal device and a TV as the second terminal device to illustrate the screen casting management method provided in this application.

[0096] For example, a smartwatch can determine a scenario where it is convenient for the user to view the smartwatch's display interface when it detects that the user is using the device (such as watching videos) or when the smartwatch detects that the device body is not covered.

[0097] Figure 5 The smartwatch interface 500 for screen mirroring management provided in this embodiment of the application. Figure 5 As shown in the smartwatch interface 5a, this interface displays the user interface for the music application, which can indicate that the user is currently listening to music on the smartwatch, i.e., the current scenario is for the user to conveniently view the smartwatch.

[0098] In this scenario, if the smartwatch receives a screen mirroring request from another terminal device (such as a TV), the smartwatch can determine that screen mirroring can be performed through the TV if it is sure that the currently connected wireless network is a previously connected wireless network.

[0099] In one possible scenario, set the historically connected wireless networks to the wireless networks that have been connected to multiple times in the past.

[0100] For example, the TV sends a screen mirroring request to the smartwatch via a first wireless network. Correspondingly, the smartwatch receives this screen mirroring request. Based on the historical connection data shown in Table 1 above, the smartwatch can determine that the first wireless network is one it has connected to three times before the current time. Since the first wireless network has been connected to multiple times in the past, the smartwatch can determine that it is a previously connected wireless network and thus determine that screen mirroring can be performed via this first wireless network.

[0101] like Figure 5 As shown in the smartwatch interface 5b, if it is confirmed that screen casting to the TV is possible, the smartwatch can also display the text message "Screen casting to TV is coming soon" on the current interface to inform the user, and send the screen casting content to the TV within a preset time period (i.e., the first preset time period), and then the TV displays the screen casting content, thus realizing the screen casting.

[0102] For example, the smartwatch sends screen-casting content to the battery via a first wireless network. Correspondingly, the TV receives the screen-casting content and then casts it.

[0103] Optionally, users can also operate the smartwatch during the first preset time period to refuse or prohibit the screen mirroring operation.

[0104] For example, a user can click or touch any physical button on the smartwatch to refuse or disable the screen mirroring operation. The physical button may include the power button, volume button, etc., and this application does not limit the scope of the operation.

[0105] In another possible scenario, where it is inconvenient for the user to view the display interface of the first terminal device, the aforementioned reminder information may also be a non-text reminder information.

[0106] It should be understood that the aforementioned non-textual reminder information may include at least one of voice reminder information, vibration reminder information, or light signal reminder information, and this application does not limit this.

[0107] It should also be understood that the first terminal device can determine that the current scenario is one inconvenient for the user to view the display interface of the first terminal device if it detects that the device body is obstructed or the user is not using it.

[0108] The following description uses a mobile phone as the first terminal device and a television as the second terminal device to illustrate the screen casting management method provided in this application.

[0109] Figure 6 The mobile interface 600 for screen mirroring management provided in this embodiment of the application. Figure 6 As shown in the mobile phone interface 6a, the mobile phone interface is currently obscured, such as when there are other items on the current display screen of the mobile phone, or when the mobile phone is currently in the user's bag or pocket.

[0110] In this scenario, if a mobile phone receives a screen mirroring request from another terminal device (such as a TV), the phone can determine that screen mirroring can be performed through the TV if it is certain that the currently connected wireless network is a previously connected wireless network.

[0111] Similarly, the mobile phone can determine whether the first wireless network is a wireless network that the mobile phone has previously connected to based on the historical connection data shown in Table 1. For specific details, please refer to the description of the above embodiments. To avoid repetition, it will not be repeated here.

[0112] like Figure 6 As shown in the mobile phone interface 6b, when it is determined that screen mirroring can be done through the TV, the mobile phone detects that the current device body is blocked. The mobile phone can vibrate to let the user know or be aware of the information that the screen is about to be mirrored to the TV, and send the mirrored content to the TV within a first preset time period, so that the TV can display the mirrored content.

[0113] For example, the screen-projected content can be sent by a mobile phone via a first wireless network.

[0114] It should be understood that the aforementioned mobile phone interface 6b can be in a screen-off state or a screen-on state displaying the aforementioned text prompt message "Screencast to TV soon"; this application does not limit this.

[0115] Similarly, users can also operate their mobile phones within the first preset time period to refuse or prohibit the screen mirroring operation. For specific details, please refer to the above embodiments. To avoid repetition, they will not be repeated here.

[0116] It should be understood that the above description of the screen projection management method provided by this application is based solely on the example of vibration as a non-textual reminder. In addition, the non-textual reminder can also be either a voice reminder or a light signal reminder, or it can include at least one of a voice reminder, a vibration reminder, or a light signal reminder. This application does not limit this.

[0117] In one possible implementation, the number of specific reminder messages included in the aforementioned non-text reminder information is set by the user based on their own needs.

[0118] For example, if a user has high requirements for the privacy and security of their device, the user can set the non-text reminder information in a screen casting task to include voice reminder information, vibration reminder information and light signal reminder information at the same time, so as to ensure that the user can know the screen casting status in time before casting, thereby avoiding privacy leakage.

[0119] In another possible implementation, the number of specific reminder messages included in the aforementioned non-text reminder information can also be determined by the mobile phone.

[0120] For example, the mobile phone can determine the specific number of non-text notification messages by judging whether the content displayed on the current screen or the content displayed on the screen before it is turned off involves user privacy. If the current screen involves keywords such as account, amount, or payment, there can be multiple non-text notification messages. For example, a voice reminder can be accompanied by vibration, so that the user can be informed of the screen mirroring status in a timely manner, thereby avoiding privacy leaks.

[0121] For example, before sending the aforementioned non-text reminder, the mobile phone can determine, based on historical screen mirroring data, that if the number of times the user manually refuses or blocks screen mirroring under the current wireless network is less than a preset threshold, the mobile phone can determine that the non-text reminder is any one of a voice reminder, a vibration reminder, or a light signal reminder. Alternatively, the mobile phone can determine, based on historical screen mirroring data, that if the number of times the user manually refuses or blocks screen mirroring under the current wireless network is greater than or equal to a preset threshold, the non-text reminder is multiple of a voice reminder, a vibration reminder, and a light signal reminder.

[0122] It should be understood that, in addition to the voice reminders, vibration reminders, and light signal reminders shown above, the aforementioned non-text reminders may also be other types of information, and this application does not limit them.

[0123] Optionally, when it is determined that the first terminal device has not connected to the aforementioned first wireless network in the past, the first terminal device may also display a target interface, which displays a first function button, so that the user can achieve screen projection by operating the first function button.

[0124] The following description uses a mobile phone as the first terminal device and an in-vehicle infotainment system as the second terminal device to illustrate the screen projection management method provided in this application.

[0125] Figure 7 The mobile interface 700 for screen mirroring management provided in this application embodiment. For example... Figure 7 As shown in interface 7a, this interface displays the user interface of the video application, which can indicate that the user is currently watching a video on their mobile phone.

[0126] In this scenario, if a mobile phone receives a screen mirroring request from another terminal device (such as a car infotainment system), the phone can determine that it cannot mirror its screen through the car infotainment system if it is certain that the currently connected wireless network is not a previously connected wireless network.

[0127] Similarly, the mobile phone can determine whether the first wireless network is a wireless network that the mobile phone has previously connected to based on the historical connection data shown in Table 1. For specific details, please refer to the description of the above embodiments. To avoid repetition, it will not be repeated here.

[0128] like Figure 7 As shown in the phone's interface 7b, even if screen mirroring via the car's infotainment system is not possible, the phone can still display a "Mirror to Car Infotainment System on Unknown Network" function button (i.e., the first function button mentioned above) on the current screen. As shown in interface 7b, if the user needs to display the mirrored content via the car's infotainment system, the user can click the "Mirror to Car Infotainment System on Unknown Network" function button. The phone detects the user's click on the first function button, generates a command to send the mirrored content, and executes the corresponding operation. Correspondingly, the car's infotainment system can also display the mirrored content on its interface upon receiving it. This avoids the phone directly rejecting or blocking the mirroring, which could negatively impact the user experience.

[0129] Optionally, if no user operation on the first function key is detected within the second preset time period, the phone may also refuse or disable screen mirroring.

[0130] Optionally, before screen mirroring, the first terminal device can determine whether to mirror the screen based on the application corresponding to the current interface and the status information of the second terminal device, in order to further improve the user experience.

[0131] It should be understood that the above status information may be the same or different for different terminal devices, and this application does not limit this.

[0132] The following describes in detail the screen projection management method provided in this application, taking the first terminal device as a wearable terminal device, such as a smartwatch, and the second terminal device as an in-vehicle terminal device, i.e., a car infotainment system.

[0133] Figure 8 The smartwatch interface 800 for screen mirroring management provided in this application embodiment. For example... Figure 8 As shown in interface 8a, this interface displays the user interface of the video application.

[0134] In this scenario, if the smartwatch receives a screen mirroring request from another terminal device (such as a car infotainment system), the smartwatch can determine whether it can mirror the screen through the car infotainment system, based on the video application corresponding to the current interface and the vehicle's driving status, provided that the currently connected wireless network is a previously connected wireless network.

[0135] In one possible implementation, the smartwatch can determine whether to project the screen via the vehicle's infotainment system based on reference information, video applications, and the aforementioned driving conditions.

[0136] Table 2 shows the above reference information.

[0137] High-speed driving status Music apps, navigation apps static state Video apps, music apps, navigation apps

[0138] As shown in Table 2, the above reference information indicates the applications that can be projected in both high-speed driving and stationary driving conditions. Specifically, music and navigation applications are allowed to be projected while driving at high speed, and video, music, and navigation applications are allowed to be projected while stationary.

[0139] like Figure 8 As shown in the smartwatch interface 8a, the current application is a video application. If the driving state is stationary, the smartwatch can determine that it can project the screen through the car's infotainment system.

[0140] It should be understood that the driving states and applications shown in the above reference information are merely illustrative. In addition, the driving states may also include low-speed driving state, night driving state, daytime driving state, congested driving state, smooth driving state, etc., and the applications may also include SMS applications, telephone applications, weather applications, etc. This application does not limit these.

[0141] It should also be understood that the aforementioned vehicle driving status information can be carried by the vehicle's infotainment system via screen mirroring requests. Alternatively, it can be determined by a smartwatch.

[0142] For example, the vehicle system can determine that the vehicle is currently stationary based on its own displacement speed, and enable the smartwatch to know this status through the aforementioned screen projection request information.

[0143] For example, a smartwatch can determine that the vehicle is currently stationary based on its own displacement velocity.

[0144] like Figure 8 As shown in the smartwatch interface 8b, if it is confirmed that the screen can be projected to the car system, the smartwatch can also display the text message "Screen projection to the car system is about to be completed" on the current interface to inform the user, and send the projection content to the car system within a preset time period (i.e., the first preset time period), and then the car system displays the projection content, thus realizing the projection.

[0145] Similarly, users can also operate the smartwatch within the first preset time period to refuse the screen mirroring. For details, please refer to the above embodiments. To avoid repetition, they will not be repeated here.

[0146] Optionally, to further improve driving safety, the vehicle's infotainment system can also send a new driving status to the smartwatch when it detects a change in the vehicle's driving status. In this way, if the smartwatch determines that the new driving status does not match the application corresponding to the current interface, it can promptly end or pause the screen mirroring to reduce the impact on the user and improve driving safety.

[0147] Optionally, to ensure the continuity of user device use, the first terminal device in the above embodiments can also perform screen projection when the power consumption meets the preset threshold, so as to avoid problems such as screen projection interruption caused by excessively low power consumption.

[0148] It should also be understood that the various embodiments described above can be coupled to each other, and this application does not limit this. Furthermore, the sequence number of each process does not imply the order of execution; the execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of this application.

[0149] The above text combines Figures 1 to 8 The screen mirroring management method of the embodiments of this application is described in detail below. Figure 9 and Figure 10 This application describes in detail the terminal device of the embodiments.

[0150] Figure 9 This application illustrates a terminal device 900 according to an embodiment of the present application. The terminal device 900 includes: a receiving module 901, a judging module 902, and a processing module 903.

[0151] The receiving module 901 is used to receive screen projection request information from the second terminal device; the judging module 902 is used to judge whether the device has previously connected to the first wireless network, wherein the first wireless network is the wireless network currently connected to by the first terminal device and the second terminal device; and the processing module 903 is used to perform screen projection based on the screen projection request information when it is determined that the device has previously connected to the first wireless network.

[0152] Optionally, the aforementioned screen mirroring request information is sent through the aforementioned first wireless network.

[0153] Optionally, the judgment module 902 is used to: determine whether the second wireless network is the same wireless network as the first wireless network based on the information of the second wireless network; the processing module 903 is used to: determine whether the first wireless network has been connected in the past when it is determined that the second wireless network is the same wireless network as the first wireless network.

[0154] Optionally, the processing module 903 is configured to: output reminder information, the reminder information including text reminder information and / or non-text reminder information, the non-text reminder information including at least one of voice reminder information, vibration reminder information or light signal reminder information, the reminder information being used to indicate that the screen will be projected onto the second terminal device; and, if no user operation is detected within a first preset time period, project the screen based on the projection request information.

[0155] Optionally, the processing module 903 is configured to: display a target interface when it is determined that the first wireless network has not been connected in the past, the target interface displaying a first function key; and cast the screen based on the screen casting request information when a user operation on the first function key is detected.

[0156] Optionally, the processing module 903 is configured to refuse screen projection if no user operation on the first function key is detected within a second preset time period.

[0157] Optionally, the first terminal device is a wearable terminal device, and / or the second terminal device is an in-vehicle terminal device. The screen projection request information also carries information about the current driving status of the second terminal device. The processing module 903 is used to: determine whether the application corresponding to the current interface is an application that is allowed to be projected under the current driving status. The current driving status includes any one of high-speed driving status, low-speed driving status, night driving status, daytime driving status, congested driving status, and smooth driving status. When it is determined that the application is an application that is allowed to be used under the current driving status, screen projection is performed based on the screen projection request.

[0158] It should be understood that the terminal device 900 here is embodied in the form of a functional module. The term "module" here can refer to application-specific integrated circuits (ASICs), electronic circuits, processors (e.g., shared processors, proprietary processors, or group processors, etc.) and memories for executing one or more software or firmware programs, integrated logic circuits, and / or other suitable components supporting the described functions. In an alternative example, those skilled in the art will understand that the terminal device 900 may specifically be the first terminal device in the above embodiments, or the functions of the first terminal device in the above embodiments may be integrated into the terminal device 900. The terminal device 900 may be used to execute the various processes and / or steps corresponding to the first terminal device in the above method embodiments; to avoid repetition, these will not be elaborated further here.

[0159] The aforementioned terminal device 900 has the function of implementing the corresponding steps performed by the first terminal device in the above method; the above function can be implemented by hardware or by hardware executing corresponding software. The hardware or software includes one or more modules corresponding to the above function.

[0160] In the embodiments of this application, Figure 9 The terminal device 900 in the text can also be a chip or a chip system, such as a system on chip (SoC).

[0161] Figure 10 Another terminal device 1000 provided in this application embodiment is illustrated. The terminal device 1000 includes a processor 1001, a memory 1002, a communication interface 1003, and a bus 1004. The memory 1002 stores instructions, and the processor 1001 executes the instructions stored in the memory 1002. The processor 1001, memory 1002, and communication interface 1003 are interconnected via the bus 1004.

[0162] The processor 1001 is configured to: receive screen mirroring request information from the second terminal device; determine whether it has previously connected to the first wireless network, wherein the first wireless network is the wireless network currently connected to by the first terminal device and the second terminal device; and, when it is determined that it has previously connected to the first wireless network, perform screen mirroring based on the screen mirroring request information.

[0163] Optionally, the memory 1002 may include read-only memory and random access memory, and provide instructions and data to the processor 1001. A portion of the memory 1002 may also include non-volatile random access memory. For example, the memory 1002 may also store device type information. The processor 1001 can be used to execute instructions stored in the memory, and when the processor executes the instructions, the processor 1001 can perform the various steps and / or processes corresponding to the first terminal device in the above method embodiments.

[0164] It should be understood that, in the embodiments of this application, the processor may be a Central Processing Unit (CPU), or it may be other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor may be a microprocessor or any conventional processor, etc.

[0165] In implementation, each step of the above method can be completed by integrated logic circuits in the processor's hardware or by instructions in software. The steps of the method disclosed in the embodiments of this application can be directly manifested as execution by a hardware processor, or as a combination of hardware and software modules within the processor. The software modules can reside in random access memory, flash memory, read-only memory, programmable read-only memory, electrically erasable programmable memory, registers, or other mature storage media in the art. This storage medium is located in memory, and the processor executes the instructions in the memory, combining them with its hardware to complete the steps of the above method. To avoid repetition, detailed descriptions are omitted here.

[0166] Those skilled in the art will recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0167] Those skilled in the art will understand that, for the sake of convenience and brevity, the specific working processes of the systems, devices, and units described above can be referred to the corresponding processes in the foregoing method embodiments, and will not be repeated here.

[0168] In the several embodiments provided in this application, it should be understood that the disclosed systems, apparatuses, and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative; for instance, the division of the units described above is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between apparatuses or units may be electrical, mechanical, or other forms.

[0169] The units described above as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0170] In addition, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit.

[0171] If the aforementioned functions are implemented as software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or a portion of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0172] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of protection of the above claims.

Claims

1. A screen mirroring management method, characterized in that, Applied to a first terminal device, the method includes: Receive screen mirroring request information from a second terminal device, the screen mirroring request information being sent through a first wireless network; Determine whether the device has previously connected to the first wireless network, where the first wireless network is the wireless network currently shared by the first terminal device and the second terminal device. When it is determined that the user has previously connected to the first wireless network, screen projection is performed based on the screen projection request information.

2. The method according to claim 1, characterized in that, The screen mirroring request information carries information about the second wireless network. Before determining whether the first wireless network has been connected in the past, the method further includes: Based on the information from the second wireless network, determine whether the second wireless network is the same wireless network as the first wireless network; The determination of whether the first wireless network has been connected in the past includes: If it is determined that the second wireless network and the first wireless network are the same wireless network, it is determined whether the first wireless network has been connected in the past.

3. The method according to claim 1, characterized in that, Before casting the screen based on the casting request information, the method further includes: Output reminder information, which includes text reminder information and / or non-text reminder information. The non-text reminder information includes at least one of voice reminder information, vibration reminder information or light signal reminder information. The reminder information is used to indicate that the screen will be projected onto the second terminal device. The screen projection based on the projection request information includes: If no user operation is detected within the first preset time period, screen projection is performed based on the screen projection request information.

4. The method according to claim 1, characterized in that, The method further includes: When it is determined that the first wireless network has not been connected in the past, the target interface is displayed, and the target interface displays the first function button; When a user operation on the first function key is detected, screen projection is performed based on the screen projection request information.

5. The method according to claim 4, characterized in that, The method further includes: If no user operation on the first function key is detected within the second preset time period, screen projection is refused.

6. The method according to claim 1, characterized in that, The first terminal device is a wearable terminal device, and / or the second terminal device is a vehicle-mounted terminal device. The screen projection request information also carries information about the current driving status of the second terminal device. Before projecting the screen based on the screen projection request information, the method further includes: Determine whether the application corresponding to the current interface is an application that is allowed to be projected under the current driving state. The current driving state includes any one of the following: high-speed driving state, low-speed driving state, night driving state, daytime driving state, congested driving state, and smooth driving state. The screen projection based on the projection request information includes: When it is determined that the application is an application that is allowed to be used in the current driving state, screen projection is performed based on the screen projection request.

7. A terminal device, characterized in that, The terminal device is a first terminal device, comprising: A receiving module is used to receive screen projection request information from a second terminal device, wherein the screen projection request information is sent through a first wireless network; The determination module is used to determine whether the device has previously connected to the first wireless network, where the first wireless network is the wireless network currently connected to both the first terminal device and the second terminal device. The processing module is used to cast the screen based on the screen casting request information when it is determined that the device has historically connected to the first wireless network.

8. A terminal device, characterized in that, It includes a processor and a memory, the memory being used to store code instructions; the processor being used to execute the code instructions to perform the method as described in any one of claims 1 to 6.

9. A computer-readable storage medium, characterized in that, Used to store a computer program, the computer program including instructions for implementing the method as described in any one of claims 1 to 6.

10. A computer program product, said computer program product comprising computer program code, characterized in that, When the computer program code is run on a computer, it causes the computer to implement the method as described in any one of claims 1 to 6.

Citation Information

Patent Citations

  • Method and device of smart TV for connecting wireless network

    CN106210914A

  • Control method and device, screen projection method and device, storage medium and electronic equipment

    CN109819493A