Display system, terminal device, and terminal device control method

Abstract

The invention provides a display system, a terminal device and a terminal device control method. The terminal device control method includes: executing, by a processor of the terminal device, a streaming function to capture at least a portion of a display screen of the terminal device, the at least a portion of the display screen being transmitted to an external display; when the processor receives the wake-up signal, the processor starts a display screen of the terminal device to display a display picture; stopping, by the processor, execution of the streaming function during the pause period, so that the processor stops capturing the display frame; and after the pause period ends, resuming execution of the streaming function to resume transmission of at least one part of the display picture to the external display. Therefore, the automatic unlocking function of the terminal device can be normally operated, so that the operation smoothness is improved.

Description

Technical Field

[0001] The present disclosure relates to a technology for controlling images on a display screen, and more particularly to a display system, a terminal device, and a terminal device control method. Background Art

[0002] With the development of computer and network communication technology, various terminal devices have become indispensable tools in people's lives. Taking laptops or smart phones as an example, "remote control" and "cloud collaboration" are one of the application technologies that have received attention in recent years. These application technologies can improve work efficiency and allow users to share or control the same screen using different terminal devices in different locations. However, the "fluidity" of these application technologies in operation will directly affect the user experience, and there are still many areas where current technologies can be optimized and improved. Summary of the invention

[0003] The present disclosure relates to a terminal device control method, comprising: executing a streaming function through a processor of the terminal device to capture at least a portion of a display screen of the terminal device, wherein at least a portion of the display screen is transmitted to an external display; when the processor receives a wake-up signal, the processor turns on the display screen of the terminal device to display the display screen; stopping the execution of the streaming function during a pause period through the processor so that the processor stops capturing the display screen; and resuming the execution of the streaming function after the pause period ends to resume transmitting at least a portion of the display screen to the external display.

[0004] In one embodiment, a method for stopping execution of a streaming function during a pause period includes: executing a pause function, wherein the pause function is used to temporarily interrupt the streaming function.

[0005] In one embodiment, during the pause period, the external display continues to execute the projection program, and the projection program is used to call the streaming function to display the virtual screen image on the external display.

[0006] In one embodiment, the method for resuming execution of a streaming function includes: executing a callback sub-function in the streaming function to generate update area information and description information, wherein the update area information is used to record the area or position of the virtual screen image that needs to be updated, and the description information is used to record the update data of the area or position.

[0007] In one embodiment, the terminal device control method further includes: during the pause period, when the processor determines that one or more preset conditions occur, the processor releases the screen lock state of the terminal device; wherein the one or more preset conditions include: the distance between the terminal device and the portable device is less than a set value.

[0008] In one embodiment, the portable device is a wearable device, which is used to generate touch signals and / or physiological signals, and to determine whether the portable device is in a wearable state based on the touch signals and / or physiological signals; one or more preset conditions also include: the portable device is in a wearable state.

[0009] In one embodiment, the one or more preset conditions further include: the terminal device and the portable device log in to the same account.

[0010] The present disclosure relates to a terminal device, comprising a communication circuit, a display screen, and a processor. The communication circuit is used to communicate with an external display. The processor is coupled to the communication circuit and the display screen, and is used to execute a streaming function to capture at least a portion of a display screen of the terminal device, wherein at least a portion of the display screen is transmitted to the external display. When the processor receives a wake-up signal, the processor turns on the display screen to display the display screen, and stops executing the streaming function during a pause period, so that the processor stops capturing the display screen. After the pause period ends, the processor resumes executing the streaming function to resume transmitting at least a portion of the display screen to the external display.

[0011] In one embodiment, during the pause period, the processor is used to execute a pause function, where the pause function is used to temporarily interrupt the streaming function.

[0012] In one embodiment, during the pause period, the external display continues to execute the projection program, and the projection program is used to call the streaming function to display the virtual screen image on the external display.

[0013] In one embodiment, the processor is used to execute the callback sub-function in the streaming function to generate update area information and description information. The update area information is used to record the area or position of the virtual screen image to be updated, and the description information is used to record the update data of the area or position.

[0014] In one embodiment, when the processor determines that one or more preset situations occur, the processor releases the screen lock state of the terminal device; wherein the one or more preset situations include: the distance between the terminal device and the portable device is less than a set value.

[0015] In one embodiment, the portable device is a wearable device, which is used to generate touch signals and / or physiological signals, and to determine whether the portable device is in a wearable state based on the touch signals and / or physiological signals; one or more preset conditions also include: the portable device is in a wearable state.

[0016] In one embodiment, the one or more preset conditions further include: the terminal device and the portable device log in to the same account.

[0017] The present disclosure relates to a display system, including a display screen and a terminal device. The terminal device is communicatively connected to the display screen and an external display to display a display image through the display screen and / or the external display. When the terminal device executes a streaming function, the terminal device is used to capture at least a portion of the display image, and at least a portion of the display image is transmitted to the external display. When the terminal device receives a wake-up signal, the terminal device drives the display screen to display the display image, and stops executing the streaming function during a pause period so that the terminal device stops capturing the display image. After the pause period ends, the terminal device resumes executing the streaming function to resume transmitting at least a portion of the display image to the external display.

[0018] In one embodiment, during the pause period, the terminal device is used to execute a pause function, where the pause function is used to temporarily interrupt the streaming function.

[0019] In one embodiment, during the pause period, the external display continues to execute the projection program, and the projection program is used to call the streaming function to display the virtual screen image on the external display.

[0020] In one embodiment, the terminal device is used to execute the callback sub-function in the streaming function to generate update area information and description information. The update area information is used to record the area or position of the virtual screen image to be updated, and the description information is used to record the update data of the area or position.

[0021] In one embodiment, when the terminal device determines that one or more preset situations occur, the terminal device releases the screen lock state of the terminal device; wherein the one or more preset situations include: the distance between the terminal device and the portable device is less than a set value.

[0022] In one embodiment, the portable device is a wearable device, which is used to generate touch signals and / or physiological signals, and to determine whether the portable device is in a wearable state based on the touch signals and / or physiological signals; one or more preset conditions also include: the portable device is in a wearable state.

[0023] By executing the pause function when receiving the wake-up signal, the terminal device will be able to pause capturing the display screen or generating the streaming signal during the pause period. Accordingly, the automatic unlocking function in the terminal device will be able to operate normally and will not be restricted due to the detection of the "screen sharing" state, allowing the user to quickly and intuitively unlock the terminal device through the portable device worn on the body, thereby improving the smoothness of operation. BRIEF DESCRIPTION OF THE DRAWINGS

[0024] Figure 1A Schematic diagram of a terminal device and a display system according to some embodiments of the present disclosure.

[0025] Figure 1BSchematic diagram of a terminal device and a display system according to some embodiments of the present disclosure.

[0026] Figure 2 is a flow chart of a terminal device control method according to some embodiments of the present disclosure.

[0027] Figure 3 Schematic diagram of a terminal device and a display system according to other embodiments of the present disclosure.

[0028] Figure 4 Schematic diagram of a terminal device and a display system according to other embodiments of the present disclosure. DETAILED DESCRIPTION

[0029] The following will disclose multiple embodiments of the present invention with the accompanying drawings. For the purpose of clear description, many practical details will be described together in the following description. However, it should be understood that these practical details should not be used to limit the present invention. That is, in some embodiments of the present invention, these practical details are not necessary. In addition, in order to simplify the drawings, some conventional structures and elements will be depicted in a simple schematic manner in the drawings.

[0030] In this document, when an element is referred to as "connected" or "coupled", it may refer to "electrically connected" or "electrically coupled". "Connected" or "coupled" may also be used to indicate that two or more elements cooperate or interact with each other. In addition, although the terms "first", "second", etc. are used in this document to describe different elements, the terms are only used to distinguish between elements or operations described by the same technical terms. Unless the context clearly indicates otherwise, the terms do not specifically refer to or imply an order or sequence, nor are they used to limit the present invention.

[0031] Figure 1A Schematic diagram of a display system 100 according to some embodiments of the present disclosure. The display system 100 includes a terminal device 110, an external display 120, and a portable device 130. The terminal device 110 includes a communication circuit 111, a display screen 112, a processor 113, and a memory 114. The communication circuit 111 is used to communicate with the external display 120 through wireless transmission technology (such as WiFi, AirPlay, Miracast), so that data can be transmitted between the terminal device 110 and the external display 120. The processor 113 is coupled to the communication circuit 111, the display screen 112, and the memory 114, and is used to control the display screen 112 to provide a display image.

[0032] In one embodiment, the processor 113 is used to transmit at least a portion of the display screen of the terminal device 110 to the external display 120 through the communication circuit 111, so that the external display 120 displays a virtual screen image (virtual display). In other words, after the terminal device 110 creates a virtual screen image on the external display 120, the images presented by the display screen 112 of the terminal device 110 and the external display 120 can be synchronized with each other (i.e., screen projection) or extended from each other (i.e., screen expansion). Since there are many ways to create a virtual screen image, and people skilled in the art can understand the method of generating a virtual screen image, it will not be repeated here.

[0033] The memory 114 is installed with the operating system P1 of the terminal device 110 and the projection program P2. In one embodiment, when the processor 113 executes the projection program P2, the processor 113 will call the streaming function in the operating system P1 to capture at least a portion of the display screen of the display screen 112 as a streaming signal, but the present disclosure is not limited to calling the streaming function. In some embodiments, the streaming signal may also include an audio signal generated by the terminal device 110 along with the display screen. The external display 120 may generate and establish a virtual screen image according to the streaming signal. In one embodiment, the streaming function may be one of the application programming interface (API) functions of the operating system P1.

[0034] In one embodiment, the terminal device 110 can be connected to the portable device 130 through wireless transmission technology, and then determine the distance D between the terminal device 110 and the portable device 130 (e.g., based on the strength of the wireless signal). In another embodiment, the terminal device 110 and the portable device 130 are respectively provided with corresponding distance sensors (e.g., optical distance sensors or acoustic distance sensors), so that the terminal device 110 can determine the distance D between the terminal device 110 and the portable device 130. Since those skilled in the art can understand the method for determining the distance D between the terminal device 110 and the portable device 130, it will not be further described here.

[0035] In some embodiments, the portable device 130 is a wearable device and is provided with a wearable sensor. For example, when the user wears the portable device 130 (e.g., on the wrist), the wearable sensor of the portable device 130 can determine that the portable device 130 is in a "wearable state" when it detects a touch signal (e.g., detecting a voltage or current signal generated by a change in the capacitance value of a capacitor) or a physiological signal of the user (e.g., pulse, body temperature).

[0036] In the application scenarios of some embodiments, such as Figure 1BAs shown, the terminal device 110 is a user's laptop computer, the portable device 130 can be a device worn / attached to the user (such as a smart watch), and the external display 120 can be a TV screen or a projection device. The terminal device 110 is used to transmit at least a portion of the display screen to the external display 120 in the form of a streaming signal (hereinafter referred to as the "screen sharing" state). In addition, when the user does not perform any operation on the terminal device 110 for a period of time (such as 1 minute), the terminal device 110 will turn off the display screen 112 to save power (hereinafter referred to as the "screen lock" state). When the terminal device 110 enters the screen lock state, the user is usually in a state of temporarily leaving the terminal device (such as temporarily leaving the seat).

[0037] In one embodiment, since the terminal device 110 and the portable device 130 are both owned by the same user (for example, the terminal device 110 and the portable device 130 log into the same user account), the portable device 130 can be used to release the "screen lock" state of the terminal device 110. However, if the terminal device 110 is in the "screen sharing" state at this time, in order to prevent the user's personal information from being accidentally revealed to others, the operating system P1 of the terminal device 110 may prevent the screen lock state of the terminal device 110 from being released by the portable device 130.

[0038] The present disclosure can be used to solve the problem that “when the terminal device 110 is in the screen sharing and screen locking states at the same time, the operating system P1 causes the system limitation that the portable device 130 cannot be used to release the screen locking state”. Figure 2 FIG2 is a schematic diagram of a terminal device control method according to some embodiments of the present disclosure. In step S201, the processor 113 of the terminal device 110 executes a streaming function to capture at least a portion of the display screen of the terminal device 110, and generates a streaming signal according to the captured result. The terminal device 110 transmits the streaming signal to the external display 120. In one embodiment, the streaming signal also includes an audio signal generated by the terminal device 110 along with the display screen.

[0039] The "streaming function" is a program or instruction set / installed in the terminal device 110, for example: an operating instruction or API function in the operating system P1 of the terminal device 110, and can be called or called by other software. Taking the operating system macOS as an example, the streaming function can be the system API function "CGDisplayStreamCreateWithDispatchQueue", which is used to capture the display screen. When the projection program P2 is executed and the projection program P2 calls the streaming function, the operating system P1 of the terminal device 110 will be able to know that a program (i.e., the projection program P2) is ready to perform the action of "capturing the display screen".

[0040] In one embodiment, when the projection program P2 executes the streaming function for the first time, the operating system P1 controls the terminal device 110 to display a "permission notification" screen to notify the user that the projection program P2 is about to capture the display screen, and prompt the user to grant the projection program P2 permission to capture the display screen (i.e., execute the streaming function). In some embodiments, when the user operates the terminal device 110 to allow the projection program P2 to capture the display screen (i.e., execute the streaming function), a "listening event" is simultaneously registered in the operating system P1 to monitor the power management status of the terminal device 110 and confirm in real time whether the terminal device 110 has entered the "screen lock" state.

[0041] In step S202 , the external display 120 receives the streaming signal and generates / creates a virtual screen image according to the streaming signal. The virtual screen image is the same as the display image of the display screen 112 of the terminal device 110 , or is an extension of the display image.

[0042] In step S203, when the terminal device 110 has not been operated for a period of time (e.g., within five minutes) (e.g., no input signal is received from input devices such as keyboard, mouse and touch pad), the processor 113 will turn off (i.e., not light up) the display screen 112, so that the terminal device 110 enters the screen lock state. In one embodiment, the terminal device 110 does not turn off the projection program P2 and the streaming function at this time, and the timing signal (timing) of the terminal device 110 for the display screen will be temporarily turned off, so that the operating system P1 enters the sleep state. In this case, the terminal device 110 will suspend the transmission of the streaming signal to the external display 120, and the external display 120 will be turned off (i.e., not light up).

[0043] In step S204, the processor 113 of the terminal device 110 determines whether a wake-up signal is received. The "wake-up signal" is used to control the processor 113 to drive / turn on (i.e., light up) the display screen 112 to display the display screen. In one embodiment, the "wake-up signal" may be any input signal generated by the input device of the terminal device 110, such as any key on the keyboard is clicked, the mouse is moved, or the touchpad detects a touch event, but the present disclosure is not limited to this, and the "wake-up signal" may be generated in any suitable manner. For example, in other embodiments, the "wake-up signal" may also be automatically generated by the terminal device 110 when it detects that the angle between the display screen 112 and the keyboard exceeds a specific angle (e.g., 90 degrees). If the judgment of step S204 is "yes", step S205 will be executed. If the judgment of step S204 is "no", step S204 can be executed again.

[0044] In step S205, when the processor 113 of the terminal device 110 receives the wake-up signal, the processor 113 controls the display screen 112 to turn on and displays a "display screen prompting the user to enter unlock information" (hereinafter referred to as the "unlock screen"). When the processor displays the unlock screen, the user can manually enter the unlock information to unlock the screen (in this case, the unlock information can be a password entered by the user in the field of the unlock screen, or a fingerprint entered by the user through the fingerprint sensor of the terminal device). In addition, when the processor 113 displays the unlock screen, the portable device 130 can automatically enter the unlock information in the subsequent step S206 (in this case, the unlock information can be a password automatically entered by the portable device 130 in the field of the unlock screen).

[0045] It is worth mentioning that in step S205, the processor 113 will also execute / call the pause function, so that the terminal device 110 stops calling the streaming function (that is, stops capturing the display screen) and stops generating the streaming signal during a pause period (such as 1 second). At this time, since the external display 120 does not receive the streaming signal, the external display 120 will not be lit (for example, the unlock screen will not be displayed) and will remain in the off state.

[0046] In step S206, during the pause period (i.e., during the call of the pause function), the processor 113 determines whether the distance D between the terminal device 110 and the portable device 130 is less than a preset setting value (e.g., one meter). If the judgment of step S206 is "yes" (i.e., the distance D between the terminal device 110 and the portable device 130 is less than the setting value), the processor 113 may execute step S207 to receive the unlock information automatically input by the portable device 130, and release the screen lock state of the terminal device 110 according to the unlock information automatically input. If the judgment of step S206 is "no", the processor 113 receives and executes step S203 again.

[0047] In step S208, when the screen lock state of the terminal device 110 is released, the processor 113 of the terminal device 110 terminates the pause function and calls the streaming function again, so that the terminal device 110 resumes transmitting the streaming signal to the external display 120. In some embodiments, when the processor 113 calls the streaming function again, the processor 113 is also used to execute one of the callback sub-functions in the streaming function to generate "update area information" and "description information", so that the processor 113 can generate the streaming signal according to the "update area information" and "description information". The "update area information" is used to record the area or position of the virtual screen image that needs to be updated (for example, the "update area information" can record that only the central area of ​​the image has changed and needs to be updated, and the other regionalized surfaces have not changed and do not need to be updated). The "description information" is the update data of the area / position that needs to be updated in the display image, for example: the updated brightness value of each pixel in the area or position that needs to be updated.

[0048] In some embodiments, the "pause function" may be an API function "CGDisplayStreamStop" of the operating system P1, which is used to temporarily stop capturing the display image and generating the streaming signal, or temporarily interrupt / disable the streaming function. When the processor 113 calls the pause function, it only pauses to generate the streaming signal, but the processor 113 does not close / end the projection program P2. Therefore, in step S208, the processor 113 does not need to restart the projection program P2, avoiding the problem that restarting the projection program P2 may cause the display screen 112 to flicker.

[0049] In addition, in step S208, the processor 113 may resume transmitting the streaming signal to the external display 120 before turning on (i.e., lighting up) the external display 120. Therefore, the temporary suspension of the processor 113 from generating the streaming signal will not be reflected in the display of the external display 120. In summary, in steps S205 to S208, the display screen 112 and the external display 120 will not flicker, and the user will not notice that the processor 113 executes / calls the pause function, so that Figure 2 The terminal device control method can greatly improve the user experience.

[0050] In some embodiments, the terminal device 110 and the portable device 130 need to log in to the same user account, and a wireless connection needs to be established between each other, or each has the ability to connect to the network N. Accordingly, the terminal device 110 can confirm the identity of the user through the wireless connection or the network N with the portable device 130. For example, the terminal device 110 can be connected to a server to determine whether the first account currently logged in by the terminal device 110 on the server matches the second account logged in by the portable device 130 on the server. When the terminal device 110 confirms in step S207 that the first account matches the second account, the terminal device 110 will receive the unlocking information automatically input by the portable device 130 and automatically release the current screen lock state.

[0051] In some embodiments, the terminal device 110 may also confirm whether the portable device 130 is in a wearable state. As described above, the portable device 130 may determine whether the portable device 130 is worn on the user (i.e., whether it is in a wearable state) based on whether a touch signal and / or a physiological signal is detected. For example, when the portable device 130 detects a touch signal and / or a physiological signal, the portable device 130 determines that it is in a wearable state, otherwise it is not. The portable device 130 may transmit the result of the determination of whether it is in a wearable state to the server. The terminal device 110 may be connected to the server to know whether the portable device 130 is in a wearable state. When the terminal device 110 confirms that the portable device 130 is in a wearable state in step S207, the terminal device 110 will receive the unlocking information automatically input by the portable device 130 and automatically release the current screen lock state.

[0052] In summary, during the pause period, when the processor 113 of the terminal device 110 determines that one or more of the following preset situations occur, the processor 113 will receive the unlocking information automatically input by the portable device 130 in step S207 to automatically release the screen lock state: (1) the distance D between the terminal device 110 and the portable device 130 is less than the set value, (2) the terminal device 110 and the portable device 130 log in to the same account, (3) the terminal device 110 determines that the portable device 130 is in a wearable state.

[0053] The "released screen lock state" described in the aforementioned embodiment refers to the processor 113 controlling the display screen 112 to remove the unlock screen and display the working screen of the terminal device 110 before entering the screen lock state (such as: the desktop of the operating system P1). It should be particularly mentioned here that the method of "releasing the screen lock state" is not limited to the aforementioned method. When the terminal device 110 determines that one or more of the above-mentioned preset conditions are met during the pause period, the terminal device 110 can also directly release the screen lock state in step S207 without receiving the unlock information automatically input by the portable device 130.

[0054] In addition, in one embodiment, steps S206 to S207 may be an independently running unlocking mechanism, and need not be activated until after step S205. In other words, even if the processor 113 has not yet executed the pause function, the processor 113 can still determine whether the distance between the terminal device 110 and the portable device 130 is less than the set value according to the unlocking mechanism in the operating system P1. At this time, since the processor 113 is still executing the streaming function, even if the processor 113 confirms that the portable device 130 is close to the terminal device, the protection mechanism of the operating system P1 will still automatically prohibit the portable device 130 from unlocking the terminal device 110.

[0055] The terminal device control method disclosed in the present disclosure temporarily stops capturing the display screen, and uses the idle time during the pause period to allow the unlocking mechanism to operate normally. Accordingly, the system limitation of the operating system P1 that "when the terminal device 110 is in the screen sharing and screen locking states at the same time, the portable device 130 cannot be used to unlock the screen" can be overcome.

[0056] Figure 3 FIG. 3 is a schematic diagram of a display system 300 according to some embodiments of the present disclosure. Figure 3 In, with Figure 1B Similar elements related to the embodiments of the present invention are denoted by the same reference numerals for easy understanding, and the specific principles of similar elements have been described in detail in the previous paragraphs. Figure 3 The components have a cooperative operation relationship and need to be introduced, which will not be repeated here.

[0057] The display system 300 includes a terminal device 310, an external display 320, a portable device 330, and a display screen 340. In this embodiment, the terminal device 310 (e.g., a computer host) and the display screen 340 (e.g., a display panel) are independent devices, and a communication connection is established between them in a wired or wireless manner. The terminal device 310 is also communicatively connected to the external display 320 to display a display image through the display screen 340 and / or the external display 320.

[0058] When the terminal device 310 executes the streaming function, the terminal device 310 is used to capture at least a portion of the display screen, and the at least a portion of the display screen will be transmitted to the external display 320. As in the above embodiment, the screens presented by the display screen 340 and the external display 320 can be synchronized with each other (i.e., screen projection) or extended from each other (i.e., screen expansion). In addition, when the terminal device 310 receives the wake-up signal, the terminal device 310 can also execute Figure 2 The control method shown executes / calls the pause function, and when the distance between the portable device 330 and the terminal device 310 is less than a set value, the screen lock state of the terminal device 310 is released.

[0059] Figure 4 FIG. 4 is a schematic diagram of a display system 400 according to some embodiments of the present disclosure. Figure 4 In, with Figure 1B Similar elements related to the embodiments of the present invention are denoted by the same reference numerals for easy understanding, and the specific principles of similar elements have been described in detail in the previous paragraphs. Figure 1B The components have a cooperative operation relationship and need to be introduced, which will not be repeated here.

[0060] The display system 400 includes a terminal device 410, an external display 420, and a portable device 430. In this embodiment, the terminal device 410 includes a host 410A and a docking station 410B (docking). The host 410A and the docking station 410B are coupled via a signal line (such as USB), and the docking station 410B is also connected to the external display 420 via a wired or wireless communication method to display a display image through the display screen 412 of the terminal device 410 and / or the external display 420. The terminal device 410 can also perform Figure 2 The control method shown executes / calls the pause function, and when the distance between the portable device 430 and the terminal device 410 is less than a set value, the screen lock state of the terminal device 410 is released.

[0061] The various elements, method steps or technical features in the aforementioned embodiments may be combined with each other and are not limited to the order of textual description or the order of presentation of the drawings in the present disclosure.

[0062] Although the present disclosure has been disclosed in the above-mentioned implementation mode, it is not intended to limit the present disclosure. Any person skilled in the art may make various changes and modifications without departing from the spirit and scope of the present disclosure. Therefore, the protection scope of the present disclosure shall be determined by the following claims.

[0063]

Explanation of symbols

[0064] 100: Display system

[0065] 110: Terminal device

[0066] 111: Communication circuit

[0067] 112: Display screen

[0068] 113: Processor

[0069] 114: Memory

[0070] 120: External display

[0071] 130: Portable Devices

[0072] 300: Display system

[0073] 310: Terminal device

[0074] 320: External display

[0075] 330: Portable Device

[0076] 340: Display screen

[0077] 400: Display system

[0078] 410: Terminal device

[0079] 410A: Host

[0080] 410B: Expansion Base

[0081] 412: Display screen

[0082] 420: External display

[0083] 430: Portable Device

[0084] N: Network

[0085] D: Distance

[0086] P1: Operating System

[0087] P2: Projection Program

[0088] S201-S208: steps.

Claims

1. A terminal device control method, characterized in that: Include: Executing a streaming function by a processor of a terminal device to capture at least a portion of a display screen of the terminal device, wherein the at least a portion of the display screen is transmitted to an external display; When the processor receives the wake-up signal, the processor turns on the display screen of the terminal device to display the display image; By means of the processor, the execution of the streaming function is stopped during the pause period, so that the processor stops capturing the display image; as well as After the pause period ends, the streaming function is resumed to resume transmitting the at least a portion of the display image to the external display.

2. The terminal device control method according to claim 1, characterized in that: The method of stopping execution of the streaming function during the pause period includes: A pause function is executed, wherein the pause function is used to temporarily interrupt the streaming function.

3. The terminal device control method according to claim 1, characterized in that: During the pause period, the external display continues to execute a projection program, and the projection program is used to call the streaming function to display a virtual screen image on the external display.

4. The terminal device control method according to claim 3, characterized in that: The method for resuming execution of the streaming function includes: The callback sub-function in the stream function is executed to generate update area information and description information, wherein the update area information is used to record the area or position of the virtual screen image to be updated, and the description information is used to record the update data of the area or the position.

5. The terminal device control method according to claim 1, characterized in that: Also includes: During the pause period, when the processor determines that one or more preset situations occur, the processor releases the screen lock state of the terminal device; The one or more preset conditions include: the distance between the terminal device and the portable device is less than a set value.

6. The terminal device control method according to claim 5, characterized in that: The portable device is a wearable device, and the portable device is used to generate a touch signal and / or a physiological signal, and to determine whether the portable device is in a wearable state according to the touch signal and / or the physiological signal; The one or more preset conditions further include: the portable device is in the wearable state.

7. The terminal device control method according to claim 5, characterized in that: The one or more preset situations further include: the terminal device and the portable device log in to the same account.

8. A terminal device, characterized in that: Include: a communication circuit for communicating with an external display; Display screen; as well as A processor, coupled to the communication circuit and the display screen, for executing a streaming function to capture at least a portion of a display screen of the terminal device, wherein the at least a portion of the display screen is transmitted to the external display; When the processor receives the wake-up signal, the processor turns on the display screen to display the display image, and stops executing the streaming function during the pause period, so that the processor stops capturing the display image; After the suspension period ends, the processor resumes executing the streaming function to resume transmitting the at least a portion of the display image to the external display.

9. The terminal device according to claim 8, characterized in that: During the pause period, the processor is used to execute a pause function, and the pause function is used to temporarily interrupt the streaming function.

10. The terminal device according to claim 8, characterized in that: During the pause period, the external display continues to execute a projection program, and the projection program is used to call the streaming function to display a virtual screen image on the external display.

11. The terminal device according to claim 10, characterized in that: The processor is used to execute the callback sub-function in the streaming function to generate update area information and description information. The update area information is used to record the area or position of the virtual screen image to be updated, and the description information is used to record the update data of the area or the position.

12. The terminal device according to claim 8, characterized in that: When the processor determines that one or more preset situations occur, the processor releases the screen lock state of the terminal device; The one or more preset conditions include: the distance between the terminal device and the portable device is less than a set value.

13. The terminal device according to claim 12, characterized in that: The portable device is a wearable device, and the portable device is used to generate a touch signal and / or a physiological signal, and to determine whether the portable device is in a wearable state according to the touch signal and / or the physiological signal; The one or more preset conditions further include: the portable device is in the wearable state.

14. The terminal device according to claim 12, characterized in that: The one or more preset situations further include: the terminal device and the portable device log in to the same account.

15. A display system, characterized in that: Include: Display screen; as well as a terminal device, communicatively connected to the display screen and the external display, so as to display a display image through the display screen and / or the external display, wherein when the terminal device executes the streaming function, the terminal device is used to capture at least a portion of the display image, and the at least a portion of the display image is transmitted to the external display; When the terminal device receives the wake-up signal, the terminal device drives the display screen to display the display image, and stops executing the streaming function during the pause period, so that the terminal device stops capturing the display image; After the suspension period ends, the terminal device resumes executing the streaming function to resume transmitting the at least a portion of the display image to the external display.

16. The display system according to claim 15, characterized in that: During the pause period, the terminal device is used to execute a pause function, and the pause function is used to temporarily interrupt the streaming function.

17. The display system according to claim 15, characterized in that: During the pause period, the external display continues to execute a projection program, and the projection program is used to call the streaming function to display a virtual screen image on the external display.

18. The display system according to claim 17, characterized in that: The terminal device is used to execute the callback sub-function in the streaming function to generate update area information and description information. The update area information is used to record the area or position of the virtual screen image to be updated, and the description information is used to record the update data of the area or the position.

19. The display system according to claim 15, characterized in that: When the terminal device determines that one or more preset situations occur, the terminal device releases the screen lock state of the terminal device; The one or more preset conditions include: the distance between the terminal device and the portable device is less than a set value.

20. The display system according to claim 19, characterized in that: The portable device is a wearable device, and the portable device is used to generate a touch signal and / or a physiological signal, and to determine whether the portable device is in a wearable state according to the touch signal and / or the physiological signal; The one or more preset conditions further include: the portable device is in the wearable state.

Images