Display methods, smart terminals, and storage media

Abstract

This application discloses a display method, a smart terminal, and a storage medium. The method includes: in response to a screen projection operation, acquiring first display information for displaying a first interface; and sending the first display information to a display device, causing the display device to output a second interface in at least one target area based on the first display information. By employing the method proposed in this application, the display device outputs a second interface in at least one target area based on the display information sent by the screen projection device for displaying the first interface. This better meets the needs of users for screen projection, improves operational flexibility, and makes more rational use of display resources, thereby enhancing the user experience.

Description

Technical Field

[0001] This application relates to the field of display technology, specifically to a display method, a smart terminal, and a storage medium. Background Technology

[0002] With the widespread adoption of smart terminals, their functions are becoming increasingly diverse, and the screen mirroring function included in smart terminals has gradually attracted attention. Screen mirroring refers to the ability of a smart terminal acting as a mirroring device to project an image onto another smart terminal acting as a display device, allowing the viewer to see the image displayed on the mirrored device.

[0003] In the process of conceiving and implementing this application, the inventors discovered at least the following problems: due to the different display sizes of the smart terminals of the projection device and the display device, when the image of the projection device is projected onto the display device for display, the image is usually displayed in the central area of ​​the display device with a proportionally scaled image, and no content is displayed in the surrounding or side areas of the displayed image, resulting in blackouts, wasting display resources, poor operability, and poor user experience.

[0004] The preceding description is intended to provide general background information and does not necessarily constitute prior art. Summary of the Invention

[0005] To address the aforementioned technical issues, this application provides a method, a smart terminal, and a storage medium that can improve the utilization rate of display resources in the display area of ​​a display device, enhance operational flexibility, better meet the needs of users for screen projection, and thus improve the user experience.

[0006] In a first aspect, this application provides a display method applicable to screen projection devices, the method comprising:

[0007] In response to the screen mirroring operation, obtain the first display information used to display the first interface;

[0008] The first display information is sent to the display device so that the display device outputs a second interface in at least one target area based on the first display information.

[0009] Optionally, it includes at least one of the following:

[0010] The first region has a different display size from at least one of the target regions, and the first region includes the area in the projection device where the first interface is displayed;

[0011] The first display information includes display size information for at least one of the target areas.

[0012] Optionally, the first interface includes a desktop interface;

[0013] The step of obtaining the first display information for displaying the first interface includes:

[0014] The desktop elements in the desktop interface are obtained, and the first display information is determined or generated based on the desktop elements, so that the display device generates the second interface based on the first display information; or...

[0015] The second interface is determined or generated based on the desktop elements of the desktop interface, and the first display information is determined based on the second interface.

[0016] Optionally, the second interface includes at least two applications;

[0017] The method further includes:

[0018] The first display information does not include the second interface;

[0019] Receive a first startup command sent by the display device, and determine a first application based on the application identifier in the first startup command; or...

[0020] The first display information includes the second interface;

[0021] Receive the first startup command and determine the first application based on the coordinate information in the first startup command.

[0022] Optionally, the method further includes:

[0023] Receive a first launch command for a first application sent by the display device, or respond to a first launch operation for the first application;

[0024] When the first application meets the preset conditions, the first size information is determined according to the first startup instruction or the first startup operation;

[0025] Obtain the second interface of the first application corresponding to the first size information, and determine the first display information based on the second interface; or, obtain the target interface information of the first application corresponding to the first size information, and determine or generate the first display information based on the target interface information.

[0026] Optionally, determining or generating the first display information based on the target interface information includes: obtaining or generating the second interface based on the target interface information and the first size information, and determining the first display information based on the interface information of the second interface.

[0027] Optionally, the method further includes:

[0028] Receive a posture adjustment command sent by the display device, or respond to a posture adjustment operation for the first interface;

[0029] The first dimension information is updated according to the posture adjustment command or posture adjustment operation, and new first display information is determined or generated based on the updated first dimension information.

[0030] Optionally, the method further includes:

[0031] When the first application does not meet the preset conditions, the second interface is determined or generated based on the original interface information and the first size information of the first application, and the first display information is determined based on the second interface; or,

[0032] The first display information is determined based on the original interface information and the first size information, so that the display device performs preset processing on the original interface information based on the first size information to determine or generate the second interface.

[0033] Optionally, determining or generating the second interface based on the first application and the first size information includes: performing preset processing on the first application based on the first size information to generate a second interface corresponding to the first application.

[0034] Optionally, the preset processing includes proportional enlargement processing or filling processing.

[0035] Optionally, the first start instruction may include first size information, or the first size information may be determined according to the type of the first start instruction.

[0036] Optionally, the first preset condition is that the identifier of the first application matches the identifier library, or the first preset condition is that the first application has interface information of multiple sizes.

[0037] Optionally, the at least one target area includes a first target area and a second target area, and the second interface corresponding to the first application is displayed in the first target area;

[0038] The method further includes:

[0039] Receive a second startup command for the second application sent by the display device, or respond to a second startup operation for the second application;

[0040] Send second display information corresponding to the second application to the display device, so that the display device displays a third interface in the second target area according to the second display information.

[0041] Optionally, the method further includes:

[0042] The system receives a scaling instruction sent by the display device, obtains third display information based on the second size information in the scaling instruction, and sends the third display information to the display device.

[0043] Optionally, the third display information includes a fourth interface, which includes the second interface adjusted according to the second size information; or, the third display information includes interface information corresponding to the second size information of the second interface.

[0044] Secondly, this application provides a display method applicable to a display device, the method comprising:

[0045] Receive first display information sent by the screen projection device, the first display information being used to display a first interface in a first area of ​​the screen projection device;

[0046] A second interface is output in at least one target area based on the first display information.

[0047] Optionally, the first display information includes first size information;

[0048] The step of outputting a second interface in at least one target area based on the first display information includes:

[0049] The second interface is determined or generated based on the first size information and the interface information of the first interface, and the second interface is output in the at least one target area.

[0050] Optionally, the method further includes:

[0051] In response to the posture adjustment operation, the posture adjustment command is sent to the projection device;

[0052] Receive new first display information sent by the projection device, and display it according to the new first display information or the new first display information and the updated size information.

[0053] Optionally, the method further includes:

[0054] The second interface receives a first launch operation for the first application and sends the application information of the first application to the screen projection device. Optionally, the application information includes an application identifier and / or coordinate information.

[0055] Optionally, when the first display information includes the second interface, the application information may include coordinate information; when the first display information does not include the second interface, the application information may include an application identifier.

[0056] Optionally, the at least one target area includes a first target area and a second target area, and the second interface corresponding to the first application is displayed in the first target area;

[0057] The method further includes:

[0058] Receive a second launch operation for the second application, and send a second launch command for the second application to the screen projection device;

[0059] Receive second display information for the second application, and display a third interface in the second target area according to the second display information.

[0060] Optionally, the method further includes:

[0061] Receive a zoom operation for the second interface, and send the second size information corresponding to the zoom operation to the projection device;

[0062] Receive the third display information sent by the projection device that corresponds to the second size information, and display it according to the third display information.

[0063] Thirdly, this application provides a display method applicable to a projection display system, the projection display system including a projection device and a display device, the method comprising:

[0064] Optionally, the projection device responds to the projection display operation by sending first display information for displaying the first interface to the display device;

[0065] The display device outputs a second interface in at least one target area based on the first display information.

[0066] Optionally, the screen projection device displays a first application, and the display device displays an application icon including the first application according to the first display information sent by the screen projection device;

[0067] The method further includes:

[0068] In response to a launch operation on the application icon on the second interface, the display device sends a close command for the first application to the projection device, so that the projection device stops displaying the first application.

[0069] Optionally, the projection device displays the first application in a first area. After the display device sends the shutdown command to the projection device, the display device displays the first application in a first target area. The first target area has a different display size than the first area, and the first target area is an area within the at least one target area.

[0070] Optionally, the display device displays a first application in the first target area;

[0071] The method further includes:

[0072] The projection device responds to the launch operation of the application icon for the first application by sending a close command for the first application to the display device, so that the display device stops displaying the first application.

[0073] Optionally, after receiving a response from the display device that the first application is closed, the projection device displays the first application in a first area, the first area having a different display size than the first target area.

[0074] Fourthly, this application also provides a screen projection device, which includes:

[0075] The acquisition unit is used to acquire first display information for displaying the first interface in response to the screen projection operation;

[0076] The sending unit is configured to send the first display information to the display device, so that the display device outputs a second interface in at least one target area according to the first display information.

[0077] In addition, other optional implementations of the projection device can be found in the relevant content of the first aspect above, and will not be described in detail here.

[0078] Fifthly, this application also provides a display device, which includes:

[0079] A receiving unit is configured to receive first display information sent by a screen projection device, wherein the first display information is used to display a first interface in a first area of ​​the screen projection device.

[0080] The display unit is used to output a second interface in at least one target area based on the first display information.

[0081] In addition, other alternative implementations of the display device in this regard can be found in the relevant content of the second aspect above, and will not be described in detail here.

[0082] Sixthly, this application also provides a smart terminal, including: a memory and a processor, wherein the memory stores a display program, and when the display program is executed by the processor, it implements the steps of any of the above display methods.

[0083] In a seventh aspect, this application also provides a computer-readable storage medium storing a computer program that, when executed by a processor, implements the steps of any of the above display methods.

[0084] As described above, the display method of this application can be applied to a screen projection device, including the steps of: in response to a screen projection operation, acquiring first display information for displaying a first interface; and sending the first display information to the display device so that the display device outputs a second interface in at least one target area according to the first display information. Through the above technical solution, when screen projection is performed via a screen projection device, the image displayed on the display device is different from the image projected by the screen projection device. This solves the problem of black bars appearing in the image projected onto the display device when the aspect ratios of the screen projection device and the display device are different. It allows for better display of the projected interface, improves operational flexibility, better meets the needs of users for screen projection, and thus enhances the user experience. Attached Figure Description

[0085] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this application and, together with the description, serve to explain the principles of this application. To more clearly illustrate the technical solutions of the embodiments of this application, the drawings used in the description of the embodiments will be briefly introduced below. Obviously, those skilled in the art can obtain other drawings based on these drawings without any creative effort.

[0086] Figure 1 A schematic diagram of the hardware structure of a smart terminal to implement the various embodiments of this application;

[0087] Figure 2 A communication network system architecture diagram provided for an embodiment of this application;

[0088] Figure 3 This is a flowchart illustrating the display method according to the first embodiment;

[0089] Figure 4a This is an interface diagram illustrating the connection establishment method according to the first embodiment;

[0090] Figure 4b This is another interface diagram showing the establishment of a connection according to the display method illustrated in the first embodiment;

[0091] Figure 4c This is a schematic diagram of the switching animation of the display method shown in the first embodiment;

[0092] Figure 4d It is a display method according to the first embodiment that projects the interface diagram of the first application;

[0093] Figure 4e It is another interface diagram of the first application projected in the display method shown in the first embodiment;

[0094] Figure 4fThis is a timing diagram of the display method according to the first embodiment;

[0095] Figure 5 This is a flowchart illustrating the display method according to the second embodiment;

[0096] Figure 6a This is an interface diagram illustrating the application of the split-screen display method according to the second embodiment;

[0097] Figure 6b This is another interface diagram of the application of the display method shown in the second embodiment;

[0098] Figure 6c This is a timing diagram illustrating the application of screen splitting in the display method according to the second embodiment;

[0099] Figure 7a This is an interface diagram showing the posture change according to the display method illustrated in the second embodiment;

[0100] Figure 7b This is another interface diagram showing the posture change according to the display method illustrated in the second embodiment;

[0101] Figure 8 This is a flowchart illustrating the display method according to the third embodiment;

[0102] Figure 9a This is a schematic diagram of the structure of a display device according to an embodiment of this application;

[0103] Figure 9b This is another structural schematic diagram of a display device provided according to an embodiment of this application.

[0104] The realization of the objectives, functional features, and advantages of this application will be further explained in conjunction with the embodiments and with reference to the accompanying drawings. The accompanying drawings have illustrated specific embodiments of this application, which will be described in more detail below. These drawings and textual descriptions are not intended to limit the scope of the concept in any way, but rather to illustrate the concepts of this application to those skilled in the art through reference to specific embodiments. Detailed Implementation

[0105] Exemplary embodiments will now be described in detail, examples of which are illustrated in the accompanying drawings. When the following description relates to the drawings, unless otherwise indicated, the same numbers in different drawings denote the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with this application. Rather, they are merely examples of apparatuses and methods consistent with some aspects of this application as detailed in the appended claims.

[0106] It should be noted that, in this document, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes that element. Optionally, components, features, and elements with the same names in different embodiments of this application may have the same meaning or different meanings, the specific meaning of which needs to be determined by its interpretation in that specific embodiment or further in conjunction with the context of that specific embodiment.

[0107] It should be understood that although the terms first, second, third, etc., may be used herein to describe various information, such information should not be limited to these terms. These terms are only used to distinguish information of the same type from one another. Optionally, without departing from the scope of this document, first information may also be referred to as second information, and similarly, second information may also be referred to as first information. Depending on the context, the word “if” as used herein may be interpreted as “when…” or “in response to determination”. Furthermore, as used herein, the singular forms “a,” “an,” and “the” are intended to also include the plural forms unless the context indicates otherwise. It should be further understood that the terms “comprising,” “including,” indicate the presence of the stated feature, step, operation, element, component, item, kind, and / or group, but do not exclude the presence, occurrence, or addition of one or more other features, steps, operations, elements, components, items, kinds, and / or groups. The terms “or,” “and / or,” “including at least one of the following,” etc., as used in this application, may be interpreted as inclusive, or mean any one or any combination thereof. Optionally, "including at least one of the following: A, B, C" means "any one of the following: A; B; C; A and B; A and C; B and C; A and B and C," or "A, B, or C" or "A, B, and / or C" means "any one of the following: A; B; C; A and B; A and C; B and C; A and B and C." Exceptions to this definition only occur when the combination of elements, functions, steps, or operations is inherently mutually exclusive in some way.

[0108] It should be understood that although the steps in the flowcharts of this application's embodiments are shown sequentially according to the arrows, these steps are not necessarily executed in the order indicated by the arrows. Unless explicitly stated herein, there is no strict order restriction on the execution of these steps, and they can be executed in other orders. Moreover, at least some of the steps in the figures may include multiple sub-steps or multiple stages. These sub-steps or stages are not necessarily completed at the same time, but can be executed at different times, and their execution order is not necessarily sequential, but can be performed alternately or in turn with other steps or at least a portion of the sub-steps or stages of other steps.

[0109] Depending on the context, the words “if” or “suppose” as used here can be interpreted as “when” or “in response to determination” or “in response to detection.” Similarly, depending on the context, the phrases “if determination” or “if detection (of the stated condition or event)” can be interpreted as “when determination” or “in response to determination” or “when detection (of the stated condition or event)” or “in response to detection (of the stated condition or event).”

[0110] It should be noted that step designations such as S301 and S302 are used in this document for the purpose of more clearly and concisely describing the corresponding content, and do not constitute a substantial limitation on the order. In specific implementation, those skilled in the art may execute S302 first and then S301, etc., but these should all be within the protection scope of this application.

[0111] It should be understood that the specific embodiments described herein are merely illustrative of this application and are not intended to limit this application.

[0112] In the following description, the use of suffixes such as "module," "part," or "unit" to denote elements is solely for the purpose of illustrative purposes and has no specific meaning in itself. Therefore, "module," "part," or "unit" may be used interchangeably.

[0113] The projection device or display device in this application can be a smart terminal, which can be implemented in various forms. Optionally, the smart terminal described in this application can include smart terminals such as mobile phones, tablets, laptops, handheld computers, personal digital assistants (PDAs), portable media players (PMPs), navigation devices, wearable devices, smart bracelets, pedometers, etc., as well as fixed terminals such as digital TVs and desktop computers.

[0114] The following description will use a smart terminal as an example. Those skilled in the art will understand that, apart from elements specifically designed for mobile purposes, the construction according to the embodiments of this application can also be applied to fixed-type terminals.

[0115] Please see Figure 1 This is a schematic diagram of the hardware structure of a smart terminal implementing various embodiments of this application. The smart terminal 100 may include: an RF (Radio Frequency) unit 101, a WiFi module 102, an audio output unit 103, an A / V (Audio / Video) input unit 104, a sensor 105, a display unit 106, a user input unit 107, an interface unit 108, a memory 109, a processor 110, and a power supply 111, etc. Those skilled in the art will understand that... Figure 1 The smart terminal structure shown does not constitute a limitation on the smart terminal. A smart terminal may include more or fewer components than shown, or combine certain components, or have different component arrangements.

[0116] The following is combined Figure 1 A detailed introduction to each component of the smart terminal:

[0117] The radio frequency unit 101 can be used for receiving and transmitting signals during information transmission or calls. Specifically, it receives downlink information from the base station and processes it with the processor 110; additionally, it transmits uplink data to the base station. Typically, the radio frequency unit 101 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low-noise amplifier, and a duplexer. Optionally, the radio frequency unit 101 can also communicate wirelessly with networks and other devices. The aforementioned wireless communications may use any communication standard or protocol, including but not limited to GSM (Global System of Mobile communication), GPRS (General Packet Radio Service), CDMA2000 (Code Division Multiple Access 2000), WCDMA (Wideband Code Division Multiple Access), TD-SCDMA (Time Division-Synchronous Code Division Multiple Access), FDD-LTE (Frequency Division Duplexing-Long Term Evolution), TDD-LTE (Time Division Duplexing-Long Term Evolution), and 5G, etc.

[0118] WiFi is a short-range wireless transmission technology. Smart terminals, through the WiFi module 102, can help users send and receive emails, browse web pages, and access streaming media, providing users with wireless broadband internet access. Although Figure 1 WiFi module 102 is shown, but it is understood that it is not a necessary component of a smart terminal and can be omitted as needed without changing the essence of the invention.

[0119] The audio output unit 103 can convert audio data received by the radio frequency unit 101 or the WiFi module 102 or stored in the memory 109 into audio signals and output them as sound when the smart terminal 100 is in call signal receiving mode, call mode, recording mode, voice recognition mode, broadcast receiving mode, etc. Furthermore, the audio output unit 103 can also provide audio output related to specific functions performed by the smart terminal 100 (optionally, call signal receiving sound, message receiving sound, etc.). The audio output unit 103 may include a speaker, a buzzer, etc.

[0120] The A / V input unit 104 is used to receive audio or video signals. The A / V input unit 104 may include a graphics processing unit (GPU) 1041 and a microphone 1042. The GPU 1041 processes image data of still images or videos acquired by an image capture device (such as a camera) in video capture mode or image capture mode. The processed image frames can be displayed on the display unit 106. The image frames processed by the GPU 1041 can be stored in the memory 109 (or other storage medium) or transmitted via the radio frequency unit 101 or the WiFi module 102. The microphone 1042 can receive sound (audio data) in operating modes such as telephone call mode, recording mode, and voice recognition mode, and can process such sound into audio data. The processed audio (voice) data can be converted into a format that can be transmitted to a mobile communication base station via the radio frequency unit 101 in telephone call mode. The microphone 1042 can implement various types of noise cancellation (or suppression) algorithms to eliminate (or suppress) noise or interference generated during the reception and transmission of audio signals.

[0121] The smart terminal 100 also includes at least one sensor 105, such as a light sensor, a motion sensor, and other sensors. Optionally, the light sensor includes an ambient light sensor and a proximity sensor. Optionally, the ambient light sensor can adjust the brightness of the display panel 1061 according to the ambient light level, and the proximity sensor can turn off the display panel 1061 and / or backlight when the smart terminal 100 is moved to the ear. As a type of motion sensor, the accelerometer sensor can detect the magnitude of acceleration in various directions (generally three axes), and can detect the magnitude and direction of gravity when stationary. It can be used for applications that recognize the phone's posture (such as landscape / portrait switching, related games, magnetometer posture calibration), vibration recognition related functions (such as pedometer, tapping), etc. Other sensors that can also be configured in the phone, such as fingerprint sensors, pressure sensors, iris sensors, molecular sensors, gyroscopes, barometers, hygrometers, thermometers, and infrared sensors, will not be described in detail here.

[0122] The display unit 106 is used to display information input by the user or information provided to the user. The display unit 106 may include a display panel 1061, which may be configured in the form of a liquid crystal display (LCD), an organic light-emitting diode (OLED), or the like.

[0123] User input unit 107 can be used to receive input numerical or character information, and generate key signal inputs related to user settings and function control of the smart terminal. Optionally, user input unit 107 may include touch panel 1071 and other input devices 1072. Touch panel 1071, also known as a touch screen, can collect touch operations performed by the user on or near it (such as operations performed by the user using a finger, stylus, or any suitable object or accessory on or near touch panel 1071), and drive corresponding connection devices according to a pre-set program. Touch panel 1071 may include two parts: a touch detection device and a touch controller. Optionally, the touch detection device detects the user's touch position and the signal generated by the touch operation, and transmits the signal to the touch controller; the touch controller receives touch information from the touch detection device, converts it into touch point coordinates, sends it to processor 110, and can receive and execute commands sent by processor 110. Optionally, touch panel 1071 can be implemented using various types such as resistive, capacitive, infrared, and surface acoustic wave. In addition to the touch panel 1071, the user input unit 107 may also include other input devices 1072. Optionally, other input devices 1072 may include, but are not limited to, one or more of the following: physical keyboard, function keys (such as volume control buttons, power buttons, etc.), trackball, mouse, joystick, etc., without being specifically limited here.

[0124] Optionally, the touch panel 1071 may cover the display panel 1061. When the touch panel 1071 detects a touch operation on or near it, it transmits the information to the processor 110 to determine the type of touch event. Subsequently, the processor 110 provides corresponding visual output on the display panel 1061 based on the type of touch event. Although in Figure 1 In this embodiment, the touch panel 1071 and the display panel 1061 are two independent components to realize the input and output functions of the smart terminal. However, in some embodiments, the touch panel 1071 and the display panel 1061 can be integrated to realize the input and output functions of the smart terminal. The specific implementation is not limited here.

[0125] Interface unit 108 serves as an interface through which at least one external device can connect to smart terminal 100. Optionally, the external device may include a wired or wireless headset port, an external power supply (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device with an identification module, an audio input / output (I / O) port, a video I / O port, a headphone port, etc. Interface unit 108 may be used to receive input from the external device (optionally, data information, power, etc.) and transmit the received input to one or more elements within smart terminal 100, or it may be used to transmit data between smart terminal 100 and the external device.

[0126] The memory 109 can be used to store software programs and various data. The memory 109 may primarily include a program storage area and a data storage area. Optionally, the program storage area may store the operating system, applications required for at least one function (such as sound playback, image playback, etc.), etc.; the data storage area may store data created based on the use of the mobile phone (such as audio data, phonebook, etc.). Optionally, the memory 109 may include high-speed random access memory, and may also include non-volatile memory, optionally at least one disk storage device, flash memory device, or other volatile solid-state storage device.

[0127] The processor 110 is the control center of the smart terminal. It connects various parts of the smart terminal via various interfaces and lines. By running or executing software programs and / or modules stored in the memory 109, and by calling data stored in the memory 109, it performs various functions and processes data of the smart terminal, thereby providing overall monitoring of the smart terminal. The processor 110 may include one or more processing units; preferably, the processor 110 may integrate an application processor and a modem processor. Optionally, the application processor mainly handles the operating system, user interface, and applications, while the modem processor mainly handles wireless communication. It is understood that the modem processor may not be integrated into the processor 110.

[0128] The smart terminal 100 may also include a power supply 111 (such as a battery) that supplies power to various components. Preferably, the power supply 111 can be logically connected to the processor 110 through a power management system, thereby enabling functions such as managing charging, discharging, and power consumption through the power management system.

[0129] although Figure 1 As not shown, the smart terminal 100 may also include a Bluetooth module, etc., which will not be described in detail here.

[0130] To facilitate understanding of the embodiments of this application, the communication network system on which the smart terminal of this application is based is described below.

[0131] Please see Figure 2 , Figure 2 This application provides a communication network system architecture diagram. The communication network system is an LTE system based on the universal mobile communication technology. The LTE system includes a UE (User Equipment) 201, an E-UTRAN (Evolved UMTS Terrestrial Radio Access Network) 202, an EPC (Evolved Packet Core) 203, and the operator's IP services 204, which are connected in sequence.

[0132] Optionally, UE201 can be the aforementioned smart terminal 100, which will not be described in detail here.

[0133] E-UTRAN202 includes eNodeB2021 and other eNodeB2022s. Optionally, eNodeB2021 can connect to other eNodeB2022s via backhaul (optionally via the X2 interface). eNodeB2021 connects to EPC203 and can provide UE201 with access to EPC203.

[0134] EPC203 may include MME (Mobility Management Entity) 2031, HSS (Home Subscriber Server) 2032, other MMEs 2033, SGW (Serving Gateway) 2034, PGW (Packet Data Network Gateway) 2035, and PCRF (Policy and Charging Rules Function) 2036, etc. Optionally, MME2031 is the control node that handles signaling between UE201 and EPC203, providing bearer and connection management. HSS2032 is used to provide registers to manage functions such as the Home Location Register (not shown in the figure) and stores user-specific information such as service characteristics and data rates. All user data can be sent through SGW2034. PGW2035 can provide UE 201 IP address allocation and other functions. PCRF2036 is the policy and charging control decision point for service data flow and IP bearer resources. It selects and provides available policy and charging control decisions for the policy and charging enforcement function unit (not shown in the figure).

[0135] IP services 204 may include the Internet, intranet, IMS (IP Multimedia Subsystem), or other IP services.

[0136] Although the above description uses the LTE system as an example, those skilled in the art should know that this application is not only applicable to the LTE system, but also to other wireless communication systems, such as GSM, CDMA2000, WCDMA, TD-SCDMA, and future new network systems (such as 5G), etc., without limitation here.

[0137] Based on the above-described intelligent terminal hardware structure and communication network system, various embodiments of this application are proposed.

[0138] It should be noted that the same or similar parts between the various embodiments in this application can be referred to each other. In the various embodiments of this application, and the various implementation methods / methods / implementations within each embodiment, unless otherwise specified or logically conflicting, the terminology and / or descriptions between different embodiments and between the various implementation methods / methods / implementations within each embodiment are consistent and can be mutually referenced. The technical features in different embodiments and the various implementation methods / methods / implementations within each embodiment can be combined according to their inherent logical relationships to form new embodiments, implementation methods, methods, or implementation approaches. The above-described embodiments of this application do not constitute a limitation on the scope of protection of this application.

[0139] First Embodiment

[0140] The display method, smart terminal, and storage medium provided in the embodiments of this application will be described in further detail below. Please refer to... Figure 3 , Figure 3 This is a flowchart illustrating a display method according to the first embodiment. Figure 3 The display method shown includes steps S301 to S303. This display method is implemented through the interaction of the projection device 30 and the display device 31. In the display method of this embodiment, both the projection device 30 and the display device 31 can be... Figure 1 The execution can be performed by the smart terminal shown, or by the chip within the smart terminal. This smart terminal can be applied to... Figure 2 The communication network system shown. Optionally, the display method of this embodiment can also be executed by the server or server cluster corresponding to the projection device 30 or the display device 31. Figure 3 The method shown takes a smart terminal as an example. The display method disclosed in this embodiment includes the following steps:

[0141] Step S301: The projection device responds to the projection operation and obtains the first display information for displaying the first interface.

[0142] In this application embodiment, smart terminals include an increasing number of functions, one of which is screen projection. Screen projection refers to the ability of a smart terminal acting as a projection device to project an image onto a smart terminal acting as a display device, allowing the user to view the image from the projection device on the display device. Different smart terminals may have different aspect ratios. If the aspect ratios of the projection device and the display device are different, the projected image cannot be scaled proportionally. Optionally, when displaying the image projected by the projection device, the display device may stretch the image, potentially causing distortion and affecting the user's viewing experience. Alternatively, when displaying the image projected by the projection device, the display device may only scale it proportionally to the width or height of the display size, filling areas without an image with black, resulting in black areas. This also affects the user's viewing experience, wastes display resources, has poor operability, and negatively impacts the user experience.

[0143] Optionally, a screen mirroring device can be understood as a device used to project images, and a display device can be understood as a device used to display images projected by the screen mirroring device. Projection refers to the operation where the screen mirroring device sends display data to the display device, which then displays the data. Users can trigger the screen mirroring operation through a screen mirroring control. Optionally, this operation can be triggered by the user through a screen mirroring control in the notification bar, a screen mirroring control within an application, or a screen mirroring function triggered in settings; this application does not limit the scope of this. The screen mirroring device can respond to the screen mirroring operation by obtaining first display information for displaying the first interface. Optionally, the first interface can be a desktop interface or the interface of an application. Optionally, taking a desktop interface as an example, the desktop interface can be the interface displayed after the device is powered on. Taking a mobile phone as an example, the desktop interface of the screen mirroring device can be an interface including elements such as the application's wallpaper, time, weather, and application icons. Optionally, taking the first interface as the interface of a certain application as an example, the first interface can be the interface for running the application, and the first interface includes elements in the application.

[0144] Optionally, the projection device can display a first interface in a first area. After receiving the first display information sent by the projection device, the display device outputs a second interface in at least one target area. The display sizes of the first area and the at least one target area can be different or the same. Optionally, the display size of the first area can be larger or smaller than the display size of the at least one target area; this application does not limit this. This allows for the use of different projection methods in different usage scenarios, making it more convenient for users to view and operate, thereby improving the user experience. Optionally, the first display information may include display size information for each target area. When the projection device sends the first display information to the display device, the display device can display the second interface in one or more target areas based on the first display information and the display size information included in the first display information.

[0145] Optionally, the first display information may include information about the second interface. After receiving the first display information, the display device can directly display the information based on the first display information. Optionally, the first display information may include target interface information corresponding to the second interface. After receiving the first display information, the display device can generate or determine the second interface and display it based on the target interface information. The target interface information can be information that the display device can generate or determine regarding the second interface. Optionally, the first display information may include original interface information and size information (e.g., first size information) corresponding to the first interface. After receiving the first display information, the display device can determine or generate the second interface based on the original interface information and the first size information, such as the second interface of the first size information, and output the second interface in at least one target area, such as displaying the second interface in the target area of ​​the first size information. Optionally, the size information may be preset size information, i.e., default size information, or size information selected or determined by the user. This application does not limit this.

[0146] Optionally, taking a first interface including a desktop interface as an example, after establishing a connection with the display device, the projection device can send first display information to the display device for displaying the first interface. The display device then displays the projected image, i.e., the second interface, based on the first display information. Optionally, the projection device can obtain the desktop elements of the desktop interface (i.e., the first interface) displayed on the projection device, determine or generate the first display information based on the desktop elements, and send the first display information to the display device. After receiving the first display information, the display device can determine or generate the second interface based on the first display information (such as desktop elements) and display the generated second interface (such as the desktop interface) in a target area.

[0147] Optionally, taking a first interface including a desktop interface as an example, the projection device can acquire desktop elements in the desktop interface (i.e., the first interface) displayed on the projection device, and determine or generate a second interface based on the desktop elements. Optionally, the projection device can simulate the generation of the second interface, and determine first display information based on the generated second interface to send to the display device. After receiving the first display information, the display device can display the second interface in a target area. Optionally, the aforementioned desktop elements may include elements such as wallpaper, time, weather, and application icons in the first desktop interface. Optionally, since the first interface is the desktop interface of the projection device, the second interface generated based on the desktop elements is also a desktop interface. Optionally, the second interface generated by the display device and the second interface generated by the projection device may be different interfaces, but both provide the functions of a desktop interface, and optionally, provide the function of displaying application icons.

[0148] Optionally, in addition to displaying the desktop interface, the screen mirroring device can also display the interface of a specific application. Taking the interface of a first application as an example, when the screen mirroring device receives a first launch command for the first application sent by the display device, or responds to a first launch operation for the first application, it determines whether the first application meets preset conditions. Optionally, the first launch command can be a user action on the application icon of the first application displayed on the desktop interface of the display device. For example, if the display device is a computer, it can be a launch command by clicking the icon of the first application displayed on the desktop interface with a mouse, and then the display device sends the first launch command to the screen mirroring device. Optionally, the first launch operation can be a user launch operation on the screen mirroring device for the first application. Optionally, when it is determined that the first application meets the preset conditions, first size information is determined according to the first launch command or the first launch operation. This first size information is the display size of the target area on the display device to which the second interface is to be projected. This first size information can be a default display size or a display size selected or determined by the user. This first size information can be information indicating the display size of the target area on the display device by the screen mirroring device. The screen projection device can obtain the second interface of the first application corresponding to the first size information, and determine the first display information based on the second interface.

[0149] Optionally, the projection device can also obtain the target interface information of the first application corresponding to the first size information. This could be information that the display device can generate or determine regarding the second interface, and then determine or generate the first display information based on the target interface information, so that the display device can display information according to the first display information. It should be noted that one approach is for the projection device to directly generate the first display information based on the second interface projected onto the display device; another approach is for the projection device to generate the first display information based on the target interface information of the first application that the display device can display the second interface, rather than directly obtaining the information of the second interface. These two approaches are different.

[0150] Optionally, for the first application, during development, it can be designed to adapt to devices with different display sizes, i.e., applications suitable for devices with different resolutions. Optionally, when the projection device determines that the first application can adapt to the display size indicated by the first size information (or the display resolution corresponding to the first size information), the projection device can determine that the first application meets preset conditions, thereby obtaining the second interface of the first application corresponding to the first size information, and determining the first display information based on the second interface. Optionally, the projection device can obtain the target interface information of the first application corresponding to the first size information, and determine or generate the first display information based on the target interface information. Optionally, the projection device can obtain or generate the second interface based on the target interface information and the first size information, and determine the first display information based on the interface information of the second interface. The projection device can then send the first display information to the display device, and the display device can display the interface of the first application in the target area according to the first display information.

[0151] Optionally, if the projection device determines that the target application cannot adapt to the display size indicated by the first size information (or the display resolution corresponding to the first size information), that is, if the projection device determines that the first application does not meet the above-mentioned preset conditions, the projection device can determine or generate a second interface based on the original interface information of the first application and the first size information, and determine the first display information based on the interface information of the second interface. Optionally, the projection device can determine the first display information based on the original interface information and the first size information, and after sending the first display information to the display device, the display device can perform preset processing on the original interface information based on the first size information to determine or generate the second interface and display it. Optionally, the elements of the second interface and the first interface displayed by the projection device can be the same, that is, the second interface displayed on the display device can be obtained by proportionally scaling (adjusting the resolution) the first interface. The original interface information of the first application can be the original information of the first application's interface, rather than the information processed by the projection device based on the original interface information. Optionally, the above-mentioned target interface information can be determined or generated by the projection device based on the original interface information. Optionally, since the first application does not meet the preset conditions, the aforementioned first size information may be the display size of the target area of ​​the display device displaying the second interface. The aspect ratio of the first size information may be the same as that of the display size of the interface (first interface) of the first application displayed by the projection device, i.e., proportional.

[0152] Optionally, when the aspect ratio of the first size information to the display size of the interface (first interface) of the first application displayed on the projection device is different, the projection device determines the first display information based on the original interface information and the first size information. This first size information is used to indicate the display size of the target area for displaying the second interface on the display device. After receiving the first display information determined by the projection device, the display device can perform preset processing on the original interface information based on the first size information in the first display information to determine or generate the second interface. For example, it can scale (adjust the resolution) the interface portion of the first application, or increase it proportionally. The display device can then perform preset processing on the area outside the scaled (adjusted resolution) interface within the target area indicated by the first size information to obtain the interface in that target area, i.e., the second interface. Optionally, the preset processing may include solid color fill processing, such as solid color fill processing, or other fill processing methods, which are not limited in this application.

[0153] Optionally, when installing the first application, the screen mirroring device can detect whether the first application can adapt to the display size indicated by the first size information (or the display resolution corresponding to the first size information). Optionally, if the first application has interface information of at least one size, it is determined that it can adapt, and the screen mirroring device can add the first application to the startup whitelist; otherwise, it can add the first application to the startup blacklist. Optionally, in addition to whether the first application adapts to the display size indicated by the first size information (or the display resolution corresponding to the first size information), the preset condition can also be whether the first application is an application in the startup whitelist. Optionally, the whitelist can also be a preset identifier library, in which case the first application is matched with applications in the identifier library, so that the screen mirroring device and the display device can quickly determine whether they can adapt to the display size indicated by the first size information (or the display resolution corresponding to the first size information) after establishing a communication connection. Optionally, the aforementioned first display information can be generated and stored in advance by the screen projection device. That is, the aforementioned second interface or target interface information of the first application can be generated and stored in advance by the screen projection device. When it is determined that the first application meets the preset conditions, the pre-generated information is directly obtained, thereby enabling faster screen projection display. Optionally, the aforementioned first display information can also be generated in real time by the screen projection device. That is, it can be generated by the screen projection device when it determines that the first application meets the preset conditions. The second interface or target interface information of the first application can both be generated by the screen projection device when it determines that the first application meets the preset conditions. This application does not limit this.

[0154] Optionally, as described above, the first display information determined or generated by the screen projection device may include a second interface determined or generated by the screen projection device based on desktop elements. This second interface has a different display size than the first interface displayed by the screen projection device. Alternatively, it may be a second interface generated based on the original interface information and the first size information of the first application. This second interface may have the same display size as the first interface displayed by the screen projection device. If the interface currently displayed by the screen projection device is referred to as the first display interface, then the aforementioned second interface may be a second display interface simulated and generated by the screen projection device in the background (such as the second display), which can be understood as a second interface simulated in a display other than the currently displayed one. It is understood that for the same application (such as the first application or the desktop application), only one interface can be displayed in the foreground on the screen projection device. The interface displayed in the foreground is the first display. Other second interfaces can also be simulated and generated in the background, that is, the simulated second interface is the second display. Then, the first display information is determined based on the second interface generated in the second display and sent to the display device. Optionally, an application can only correspond to one display, i.e., one display interface. This means that an application can only display one application interface; it cannot run an application and display two different interfaces simultaneously. Optionally, for a screen mirroring device, there is only one primary display, but it can include multiple secondary displays, meaning that multiple applications can run in the background, generating multiple secondary interfaces for each application.

[0155] Step S302: The projection device sends the aforementioned first display information to the display device.

[0156] Optionally, the projection device can establish a wired or wireless communication connection with the display device, and send the aforementioned first display information to the display device directly or indirectly. Optionally, the connection can be established through a Universal Serial Bus (USB) or a wireless local area network. This application does not limit the connection method (data transmission method) between the projection device and the display device.

[0157] Step S303: The display device outputs a second interface in at least one target area based on the first display information described above.

[0158] Optionally, the target area is the interface area of ​​the display device that the projection device projects onto the screen. This target area can be one or multiple, and the sizes of each target area can be the same or different, depending on the usage scenario and application. Optionally, after the projection device and the display device establish a communication connection, a desktop interface can be displayed; that is, the first interface can be the desktop interface. After displaying the desktop interface, the first interface can be the interface of a specific application (such as the first application) installed on the projection device. Optionally, the first display information can carry indication information for indicating the display size of the target area, such as first size information.

[0159] Optionally, taking a first interface including a desktop interface as an example, the display device can receive first display information, which is determined or generated based on the desktop elements of the first interface (i.e., the desktop interface) obtained by the projection device. The display device can then generate a desktop interface (second interface) based on the desktop elements included in the first display information and display the generated second interface. The second interface generated by the display device may be different from the second interface displayed by the projection device. Optionally, in this method, the desktop interface (second interface) displayed by the display device is generated by the display device. The desktop interface generated by the display device based on the desktop elements can be a desktop interface simulated by the display device running a desktop launcher. Optionally, desktop elements may include wallpaper, time, weather, application icons, etc. The display device can then run a desktop launcher to simulate a desktop interface including wallpaper, time, weather, and application icons. Optionally, for wallpapers or application icons, if they are system-preset wallpapers or application icons, they can be displayed on the desktop interface (second interface) in a way that is the same as or similar to the desktop interface included in the first interface. If they are not system-preset wallpapers or application icons, the desktop element may not be displayed on the desktop interface (second interface). Therefore, the desktop interface (second interface) can be different from the desktop interface included in the first interface.

[0160] Optionally, taking a first interface including a desktop interface as an example, the display device can receive first display information, which is determined based on a second interface determined or generated by the projection device. This second interface is a desktop interface determined or generated by the projection device based on desktop elements and used for display on the display device. In this method, the desktop interface displayed by the display device is generated by the projection device, and the display device only displays the information after receiving the first display information. The projection device can determine or generate a second interface (the desktop interface used for display on the display device) in a non-first display interface, i.e., a second display, based on the desktop elements in the first desktop interface. Then, the projection device sends the first display information determined based on this second interface (the desktop interface used for display on the display device) to the display device. The display device can display the second interface in a first target area, where the first target area is an area within at least one target area. It should be noted that since the projection device generates the second interface in the second display, this second interface operates in the background of the projection device, only simulating interface generation and is not displayed by the projection device, but by the display device.

[0161] Optionally, before the projection device acquires the desktop elements in the desktop interface included in the first interface, it can also send display information of the first interface (i.e., the desktop interface displayed by the projection device) to the display device. That is, after establishing a communication connection with the projection device, the display device can receive the display information of the first interface sent by the projection device and display the first interface before displaying the second interface including the desktop interface. Optionally, after the display device displays the first interface, the display device can display a switching animation, and then display the second interface (desktop interface) upon receiving the first display information. Optionally, the display size of the first area and the target area are different. The display size of the target area can be twice the display size of the first area, or it can be other display sizes. This application does not limit this. Optionally, taking the display size of the target area as twice the display size of the first area as an example, the switching animation can be a folding screen-like opening animation from the first interface to obtain the second interface, or a scroll-like unfolding animation from the first interface to the left, right, top, or bottom to obtain the second interface. Optionally, the second interface can also be displayed directly after the switching animation. This application does not limit this.

[0162] Optionally, taking the first interface as the interface of the first application as an example, the display device can receive first display information. This first display information is determined by the projection device based on the second interface corresponding to the first size information obtained when the first application is running, when the projection device determines that the first application meets preset conditions. Optionally, based on the received first display information, the display device can display the second interface in the target area of ​​the display size (display resolution corresponding to the first size information) indicated by the first size information. Since the first application is an application installed on the projection device, it can only run on the projection device after projection. Therefore, the projection device simulates the second interface in a non-first display interface (non-first display) and sends the first display information determined according to the second interface to the display device for display.

[0163] Optionally, when the projection device determines that the first application does not meet the preset conditions, it can determine or generate a second interface based on the original interface information and the first size information of the first application. That is, it can simulate a second interface with the first size information in a non-first display interface (non-first display), and send the first display information determined based on the second interface to the display device. At this time, the second interface can be proportional to the display size of the first interface (the interface of the projection device displaying the first application), that is, the aspect ratio is the same. After receiving the first display information, the display device can display the second interface (the interface of the first application). Optionally, the projection device can also determine the first display information based on the original interface information and the first size information of the first application, and send the determined first display information to the display device. The display device can perform preset processing on the original interface information based on the first size information, thereby determining or generating the second interface. The display size indicated by the first size information may not be proportional to the display size of the first application's interface (the aspect ratio may differ). If the second interface is displayed directly in the target area of ​​the first size information, the target area cannot be completely filled, resulting in blank spaces. The display device can then perform preset processing on the blank areas to determine or generate the second interface and display it in the target area. Optionally, the preset filling processing can be to fill the blank areas with color, optionally, white or black.

[0164] Optionally, the display device can receive the user's first launch command for the first application on the displayed desktop interface (second interface). When the first display information used to display the desktop interface does not include the second interface, i.e., the desktop interface is a second interface generated by the display device based on the desktop elements in the first display information, the user can input the first launch command for the first application through the desktop interface displayed by the display device. The projection device does not know the specific interface of the second interface (desktop interface) generated by the display device, including the elements, and optionally the positions of one or more application icons. Therefore, the projection device cannot know which application has been launched. In this case, the display device can include the application identifier of the first application in the first launch command and send it to the display device. The display panel then determines the first application based on the application identifier, and the projection device can run the first application and project the interface of the first application onto the display device. Optionally, the display device can receive the launch operation for the first application through hardware such as a keyboard or mouse on the second interface (desktop interface). This application does not limit this.

[0165] Optionally, the display device can receive a first launch command from the user for the first application on the displayed desktop interface (second interface). When the first display information for displaying the desktop interface includes the second interface, the desktop interface is determined or generated by the projection device based on the desktop elements of the desktop interface included in the first interface. If the user clicks the application icon of the first application on the desktop interface (second interface) with the mouse, the display device can send the application information of the first application to the projection device in the first launch command. This application information can be the coordinate information of the user's mouse movement on the desktop interface (second interface). This is because the desktop interface is determined or generated by the projection device, and the display device does not know the application icons included in the desktop interface, that is, the display device does not know which application the user has launched. After the display device sends the coordinate information as application information to the projection device, the projection device determines that the first application has been launched based on the position of at least one application icon in the generated desktop interface and the received coordinate information. Then, the projection device can run the first application and project the interface of the first application onto the display device.

[0166] Please see Figures 4a-4b , Figure 4a and Figure 4b All diagrams are interface diagrams illustrating the connection establishment method shown in the first embodiment. For a more illustrative purpose, this application uses a mobile phone as the projection device and a personal computer as the display device for illustration and explanation. Figure 4a As shown, in the screen projection device, the screen projection device and at least one device capable of establishing a communication connection can be displayed in the smart interconnection center module on the negative one screen, such as... Figure 4aDevices 1, 2, 3, and 4 are shown. Optionally, the projection device can use one or more methods such as Bluetooth, WiFi, USB, Android Debug Bridge (ADB), or LAN, which are not limited in this application. Optionally, the projection device discovers nearby connectable display devices via Bluetooth broadcast and displays them in the Smart Interconnection Center on the projection device. After the user selects a display device (e.g., device 1), the projection device requests multi-screen collaboration, that is, the projection device initiates a communication request to the display device. The display device can display a prompt message for establishing a communication connection, such as "Mobile phone xx requests multi-screen collaboration, allow?". Optionally, the user can confirm the establishment of a communication connection between the display device and the projection device using the PC keyboard and / or mouse, that is, trigger the "Yes" control. At this time, the projection device and the display device establish a communication connection.

[0167] like Figure 4b As shown, after the projection device and the display device establish a communication connection, the smart interconnection center on the negative one screen of the projection device can display the interface for establishing the communication connection with the display device, such as... Figure 4b As shown in the projection device, the desktop interface of the projection device (i.e., the desktop interface included in the first interface) can be as follows: Figure 4b As shown in the lower left corner, the first interface includes time, weather, and application icons. The screen mirroring device can send the first display information determined based on the desktop elements to the display device. The display device can then determine or generate a second interface based on the desktop elements and display it in a target area. Optionally, the screen mirroring device can determine or generate a second interface (the desktop interface displayed by the display device) based on the desktop elements and send the first display information determined based on this second interface to the display device. The display device can then display the second interface in the target area. Optionally, Figure 4b This is merely one example of a second interface (the desktop interface displayed on the display device), and is not intended to limit the scope of the second interface. Optionally, if the user clicks on the display device (Device 1) again in the Smart Interconnection Center, the communication connection between the projection device and the display device can be disconnected.

[0168] Please refer to the following: Figure 4c , Figure 4c This is a schematic diagram of the switching animation of the display method shown in the first embodiment, such as... Figure 4c As shown, Figure 4c Only two examples of transition animations are shown; other transition animations may be included, and this application does not limit this. Figure 4c On the top, there's an animation similar to a foldable screen opening. The display device first receives the display information of the first interface sent by the projection device and displays the first interface, then displays the second interface with an animation similar to opening a book. For example... Figure 4cBelow, there is an animation similar to a scrolling screen unfolding. Optionally, the display device can first receive the display information of the first interface sent by the projection device, display the first interface, and then display the second interface in an animation similar to a scroll unfolding from left to right simultaneously. Figure 4c The animation shown is for illustrative purposes only and does not impose any limitations on the switching animation. In actual applications, the switching animation can be determined based on the wallpaper, etc.

[0169] Please see Figure 4d and Figure 4e , Figure 4d and Figure 4e All of these are interface diagrams of the first application projected in the display method shown in the first embodiment. For example... Figure 4d As shown, if the projection device receives a first launch command for the first application from the display device, or responds to a first launch operation for the first application, and determines that the first application meets preset conditions, it determines the first size information according to the first launch command or the first launch operation, and obtains the second interface of the first application corresponding to the first size information in a non-first display interface (non-first display), i.e., the second display. Figure 4d As shown in the lower left corner. Alternatively, the projection device can obtain the target interface information of the first application corresponding to the first size information. After receiving the first display information determined based on the target interface information, the display device can display the second interface according to the target interface information. After receiving the first display information determined based on the second interface, the display device can display the second interface in the target area, such as... Figure 4d As shown in Figure 401.

[0170] Optionally, if the projection device determines that the first application does not meet the preset conditions, it determines or generates a second interface in a non-first display interface (non-first display) based on the original interface information of the first application and the first size information, such as... Figure 4d As shown in the lower right corner. Optionally, the second interface generated by simulating the first application is not displayed on the projection device. The projection device can determine the first display information based on the generated second interface and send the first display information to the display device. The display device displays the second interface based on the received first display information. At this time, the display size of the second interface can be proportional to the first interface (the display size of the projection device displaying the first application), such as... Figure 4e As shown in 403, optionally, Figure 4e402 represents the desktop interface displayed by the display device. Optionally, when the projection device determines that the first application does not meet the preset conditions, it determines the first display information based on the original interface information and the first size information of the first application. After receiving the first display information, the display device can perform preset processing on the original interface information according to the first size to determine or generate a second interface. Optionally, the original interface information can be the information of the original interface of the first application. The display device can stretch or scale the interface of the first application proportionally according to the original interface information and display the stretched or scaled interface of the first application in the target area corresponding to the first size information. If the display size of the interface of the first application is not proportional to the display size of the target area, there will be empty areas. The display device can fill the empty areas. Optionally, color filling processing can be performed, such as... Figure 4e As shown in 404 below, the second interface displayed in the target area 404 includes the interface of the first application after being stretched or proportionally scaled in the centered area, with the areas on both sides filled with white.

[0171] Please refer to the following: Figure 4f , Figure 4f This is a timing diagram illustrating the display method according to the first embodiment. For example... Figure 4f As shown, firstly, the projection device establishes a communication connection with the display device. In one scenario, the projection device determines or generates a second interface: the projection device determines or generates the second interface based on desktop elements, and then sends the first display information determined based on the second interface to the display device. The display device can then display the second interface in the target area based on the first display information. In another scenario, the projection device does not determine or generate a second interface. Instead, the projection device acquires desktop elements, determines or generates first display information based on the desktop elements, and sends the first display information to the display device. The display device then determines or generates a second interface based on the received first display information and displays the generated second interface in the target area.

[0172] exist Figure 3 In the described method, the projection device, in response to a projection operation, acquires first display information for displaying a first interface, and sends the first display information to a display device, so that the display device outputs and displays a second interface in at least one target area according to the first display information. Therefore, based on Figure 3 The described method can improve the utilization rate of display resources in the display area of ​​the display device, increase the flexibility of operation, better meet the needs of users for screen casting, improve the flexibility of screen casting operation, and make more reasonable use of display resources, thereby enhancing the user experience.

[0173] Second Embodiment

[0174] Please see Figure 5 , Figure 5 This is another flowchart illustrating a display method according to the second embodiment. Figure 5 The processing method shown includes steps S501 to S504. This display method is implemented through interaction between the projection device 50 and the display device 51. In the display method of the application embodiment, both the projection device 50 and the display device 51 can be... Figure 1 The execution can be performed by the smart terminal shown, or by the chip within the smart terminal. This smart terminal can be applied to... Figure 2 The communication network system shown. Optionally, the display method of this embodiment can also be executed by the server or server cluster corresponding to the projection device 30 or the display device 31. Figure 5 The method shown takes a smart terminal as an example. The display method disclosed in this embodiment includes the following steps:

[0175] Step S501: The display device receives a second startup operation for the second application and sends a second startup command for the second application to the projection device.

[0176] Optionally, after establishing a communication connection with the display device, the projection device can display at least one control in at least one target area. This control can be displayed in a menu bar or navigation bar. Optionally, the menu bar can include controls for creating a new target area, pinning a target area to the front, minimizing a target area, maximizing a target area, and closing a target area. The navigation bar can include controls for returning, returning to the desktop, and historical tasks. Optionally, for the desktop interface included in the second interface displayed by the display device, the display size of the second interface is different from the display size (resolution) of the desktop interface included in the first interface displayed by the projection device. The interface content of the second interface can be similar, and the elements included are also similar to those of the first interface, such as wallpaper, add, time, and application icons. Optionally, the user can operate the second interface using the keyboard, mouse, or other input devices of the display device to trigger corresponding commands. The display device can then send the commands to the projection device, which responds to the user's input commands and sends display information to the display device, which then displays other interfaces included in the second interface, such as application interfaces.

[0177] Optionally, the user's operation on the second interface (desktop interface) via the input device of the display device can be consistent with that of the screen projection device. Optionally, the user can use the mouse to flip left and right to view all application icons, and the user can also click on an application icon to open a specific application. The user can also exit and return to the desktop while the application interface is displayed, or return to the previous layer application interface if the application has multiple layers. Optionally, the "Create Target Area" control included in the menu bar can be used to display the interface of another application in another target area. Optionally, it can be used in application split-screen display scenarios. Application split-screen refers to using two applications simultaneously within the display area of ​​the smart terminal, while for the display device, two applications can be used separately through two target areas. The aforementioned "Fixed Target Area at the Foreground" control can be used to keep a specific target area always on top, allowing users to interact with the interface within that area at any time. The "Minimize Target Area" control temporarily hides the target area from the desktop of the display device. The "Maximize Target Area" control can enlarge the target area until it is displayed in full screen. The "Close Target Area" control can be used to close the target area. Optionally, if the user closes all target areas through the display device, the display device sends a disconnect command to the projection device, which disconnects the communication connection between the display device and the projection device. Optionally, the "Back" control included in the navigation bar can be used to return to the previous interface. Optionally, the "Return to Desktop" control can exit an application and display the desktop interface (second interface), or minimize the target area used to display an application and display the desktop interface (second interface). Optionally, the "History Tasks" control can be used to view thumbnails of the target areas of various applications displayed on the desktop of the display device.

[0178] Optionally, taking at least one target area including a first target area and a second target area as an example, after the display device displays the desktop interface and the interface of the first application in the first target area, the user can input an application split-screen command through the projection device. Specifically, the user clicks the "Create New Target Area" control and then clicks one of the multiple application icons displayed on the desktop interface (e.g., the application icon of the second application). The display device receives the application launch operation from the user's clicked application icon. Consistent with the first launch command, the display device can send a second launch command for the second application to the projection device. This second launch command may include application information. Optionally, this application information may be the application identifier of the second application or coordinate information.

[0179] Step S502: The projection device receives a second startup command for the second application sent by the display device, or responds to a second startup operation for the second application.

[0180] Optionally, the projection device can receive a second launch command for the second application sent by the display device. The projection device can also receive a second launch operation for the second application from the projection device. Optionally, this second launch operation for the second application is a launch operation whereby the display device does not display the second application interface in the first target area; that is, the second launch operation includes split-screen display and projection, which is different from the first launch operation for the first application.

[0181] Optionally, after receiving the second start command or the second start operation, the projection device can simulate running the second application and simulate the interface (third interface) of the second application in a non-first display interface (non-first display), i.e., the second display. Optionally, similar to the operation of the first application, it first determines whether the second application meets preset conditions. If it does, it obtains the third interface of the second application corresponding to the first size information and determines the second display information based on the third interface. Alternatively, if the projection device determines that the second application meets preset conditions, it obtains the target interface information of the second application corresponding to the first size information and determines or generates the second display information based on the target interface information of the second application. Optionally, it obtains or generates the third interface based on the target interface information of the second application and the first size information, and determines the second display information based on the interface information of the third interface. The third interface is the interface projected onto the display device and displayed in the second target area.

[0182] Optionally, when the projection device determines that the second application does not meet the preset conditions, it can generate a third interface based on the original interface information of the second application and the first size information, and determine the second display information based on the third interface. Optionally, the projection device determines the second display information based on the original interface information of the second application and the first size information, so that the display device can perform preset processing on the original interface information based on the first size information to generate the third interface. Optionally, the projection device can perform preset processing on the first application based on the first size information to generate the third interface of the second application. The preset processing may include proportional enlargement or reduction processing, and filling processing.

[0183] Step S503: The projection device sends the second display information corresponding to the second application to the display device.

[0184] Optionally, the specific implementation of step S503 can be found in the description of step S302 in the above embodiment, and will not be repeated here. Optionally, in step S503, the projection device sends second display information corresponding to the second application to the display device.

[0185] Step S504: The display device displays the third interface in the second target area according to the second display information.

[0186] Similarly, the display device receives the second display information and displays the third interface in the second target area. The second target area does not overlap with the first target area. That is, the desktop interface or the interface of the first application displayed by the display device does not overlap, thereby achieving the effect of running two applications in one display area and displaying the interfaces of two applications in a screen mirroring device, that is, achieving the purpose of split-screen display of applications.

[0187] Please refer to the following: Figure 6a , Figure 6a This is an interface diagram illustrating the application of the split-screen display method according to the second embodiment, such as... Figure 6a As shown, the menu bar is located in the upper left corner of the target area on the left. Optionally, controls 61-65 in the target area on the left indicate that a navigation bar is located below the target area, as shown in control 65 of the target area on the left. Optionally, the menu bar includes controls 61 for creating a new target area, 62 for maximizing the target area, 63 for minimizing the target area, 64 for pinning the target area to the front, and 65 for closing the target area. In the navigation bar 66, the triangle on the left can be a back control, the circle in the middle can be a return to desktop control, and the square on the right can be a history task control. Optionally, Figure 6a The controls shown are merely examples; other controls may also be included, and this application does not limit this. After the user clicks the "Create Target Area" control 61, they can click the application icon of the second application. For example... Figure 6a As indicated by the mouse cursor, if the desktop interface is generated by the display device, the display device can determine the application identifier of the second application and send a second launch command carrying the application identifier of the second application to the projection device. If the desktop interface is generated by the projection device, the display device can include the currently clicked coordinate information in the second launch command and send it to the projection device, whereby the projection device determines the second application. Optionally, the second launch command may also include first size information, which can be user-selected size information or default size information. The projection device can determine the first size information based on the second launch command, and then the projection device can acquire or generate a third interface simulating the running of the second application, or the projection device can acquire the target interface information of the third interface and determine the second display information based on the third interface or the target interface information of the third interface and send it to the display device. Optionally, the projection device can also generate a third interface based on the original interface information of the second application and the first size information, and determine the first display information based on the third interface, or the projection device can determine the second display information based on the original interface information of the second application and the first size information. Optionally, when the second application meets preset conditions, it can... Figure 6a As shown on the left, if the second application cannot meet the preset conditions, then as follows: Figure 6a As shown on the right.

[0188] Please refer to the following: Figure 6b , Figure 6b This is another interface diagram of the application of the display method shown in the second embodiment, such as... Figure 6b As shown, if the second application meets the preset conditions, then it can proceed as follows: Figure 6b The third interface shown above displays the first application in the first target area and the second application in the second target area. If the second application does not meet the preset conditions, it can be displayed as follows: Figure 6b The third interface is displayed in the second target area, as shown below. Optionally, this second target area can overlap the target area of ​​the desktop interface, that is, it can partially overlap with other target areas. The user can display the target area of ​​the desktop interface in the foreground by triggering the return to desktop control or by triggering the fixed target area to the foreground control.

[0189] Please refer to the following: Figure 6c , Figure 6c This is a timing diagram illustrating the application of screen splitting according to the display method shown in the second embodiment. For example... Figure 6c As shown, if the projection device receives a second launch command or a second launch operation for a second application, in one scenario, the projection device determines new display information, determines or generates a third interface for the second application, and determines the second display information based on the third interface. The projection device then sends the second display information to the display device. In another scenario, the projection device does not determine the new display information, but determines or generates a second interface for the first application. The projection device then sends the first display information determined based on the second interface to the display device. Optionally, the projection device determines new display information upon receiving a launch command or launch operation for any application. Figure 6cWhether a projection device determines new display information refers to the following: If it's only a launch command or operation for a single application, the projection device only needs to determine the first display information and send it to the display device. After the display device receives the first display information and displays the second interface of the first application based on it, if the projection device receives another launch command or operation for a different application, there are two scenarios: One is that no screen splitting is needed, in which case it's similar to the first application, determining the display information based on that application, and the display device still displays the application's interface in the first target area. The other is that screen splitting is required, in which case the display information (second display information) needs to be determined, and the display device displays the application's interface in the second target area. Although the projection device needs to determine new display information in both cases, for the projection device, the first scenario is equivalent to deleting the first display information and generating a new first display information for the application, determining or generating only one first display information at a time; the second scenario involves simultaneously determining or generating two display information, namely the first display information and the second display information. For display devices, in the first case, if the projection device only determines or generates one display information at a time, the display device can display the application interface in the first target area and only needs to cover the original screen in the original target area (first target area). In the second case, the display device needs to display the interface of another application in the second target area.

[0190] Optionally, such as Figure 6a As shown, each target area in the display interface of the display device includes at least one control, one of which is a maximize target area control 62. After the user clicks the maximize target area control 62 of the first target area of ​​the first interface using an input device (such as a keyboard or mouse), the display device sends a scaling command to the projection device. This scaling command may include second size information, which may include the display size information of the display device. In response to the scaling command, the projection device can obtain third display information based on the second size information and send the third display information to the display device. Optionally, the scaling command may also indicate which specific second interface is being scaled. The third display information may include a fourth interface, which is obtained by adjusting the second interface according to the second size information. Optionally, the fourth interface may be obtained by scaling the second interface proportionally or by stretching it to match the second size information, so that the display device can display the fourth interface in full screen. Optionally, the third display information may also include interface information corresponding to the second size information of the second interface. After the third display information is sent to the display device, the display device can directly perform full-screen display based on the interface information corresponding to the second size information of the second interface.

[0191] Optionally, the posture of the projection device can include landscape / portrait mode and motion state. The first posture and the second posture mentioned above can be the landscape and portrait modes of the projection device, respectively, or other postures of the projection device. This application does not limit this. This application takes the switching between the first posture and the second posture as an example of landscape / portrait mode switching: If the first interface displayed by the projection device is in the first posture, and the projection device changes from the first posture to the second posture by the accelerometer of the projection device, optionally, the projection device may receive a posture adjustment operation for the first interface when it detects that the projection device has changed from the portrait mode to the landscape mode. Optionally, the posture adjustment command can be triggered by the user through the display device, that is, the target area can also include a posture adjustment control. By triggering the posture adjustment control, the display device can send a posture adjustment command to the projection device. Optionally, the display device can perform posture adjustment for the interface in a certain target area, or it can perform posture adjustment for the interfaces in all target areas. This application does not limit this. The posture adjustment command can indicate the interface in a certain target area.

[0192] Optionally, the interface displayed on the display device can change with the posture of the projection device. That is, the projection device can update the first size information according to the posture adjustment command or posture adjustment operation, and determine or generate new first display information based on the updated first size information. This first display information can be determined based on the new second interface corresponding to the updated first size information, or it can be determined based on the new target interface information of the first application corresponding to the new first size information. This application does not limit this. Optionally, whether it is a new second interface or a new target interface information, it can be a simulated second interface (the second interface corresponding to the new first size information) obtained by the projection device in a non-first display interface (first display), i.e., the second display, under the second posture, and the new first display information is determined accordingly. After receiving the new first display information, the display device can display it in the target area according to the new first display information or the new first display information and the updated size information.

[0193] Please refer to the following: Figure 7a and Figure 7b , Figure 7a and Figure 7b These are all interface diagrams showing the posture changes according to the display method illustrated in the second embodiment. For example... Figure 7a As shown, the original screen mirroring device was in portrait orientation (first orientation), and the display device showed the following: Figure 7aOn the right side of the screen, when the projection device changes from a portrait orientation (first orientation) to a landscape orientation (second orientation), i.e., in response to the orientation adjustment operation for the first interface, the projection device simulates updating the first size information in a non-first display interface (first display). Based on the updated first size information, it determines or generates new first display information, which may include interface information of the first interface after the orientation adjustment. The projection device then sends the new first display information to the display device, which displays the first interface after the orientation adjustment in the target area, such as... Figure 7a As shown on the left side. Optionally, the updated first size information can be obtained by rotating the first interface counterclockwise by 90 degrees, or by adjusting the width and height of the first interface separately, as shown below. Figure 7a The target area is shown as a dashed line in the display device. Alternatively, as... Figure 7b As shown, when the projection device detects a change in its orientation from portrait (first orientation) to landscape (second orientation) (or receives an orientation adjustment command from the display device), it can simulate a landscape orientation interface in the second display, update the first size information, determine or generate new display information based on the updated first size information, and send the new display information to the display device for display. Figure 7b The target area is shown as a dashed line in the display device.

[0194] exist Figure 5 In the described method, the display device receives a second startup operation for a second application and sends a second startup command to the projection device. The projection device receives the second startup command for the second application and, optionally, responds to the second startup operation for the second application by sending second display information corresponding to the second application to the display device, and displays a third interface in a second target area according to the second display information. Optionally, based on... Figure 5 The described method can send second display information corresponding to the second application to the display device through the screen projection device, so that the display device displays the second interface of the first application in the first target area and the third interface of the second application in the second target area, thereby realizing split-screen display of applications. It makes reasonable use of the display resources of the large screen display area of ​​the display device, making it more operable and better meeting the user's operation and viewing needs, thereby improving the user experience.

[0195] Third Embodiment

[0196] Please see Figure 8 , Figure 8 This is another flowchart illustrating a display method according to the third embodiment. Figure 8The processing method shown includes steps S801 to S802. This display method is implemented through the interaction of the projection device 80 and the display device 81 in the projection system. In the display method of the application embodiment, both the projection device 80 and the display device 81 can be... Figure 1 The execution can be performed by the smart terminal shown, or by the chip within the smart terminal. This smart terminal can be applied to... Figure 2 The communication network system shown. Optionally, the display method of this embodiment can also be executed by the server or server cluster corresponding to the projection device 30 or the display device 31. Figure 8 The method shown takes a smart terminal as an example. The display method disclosed in this embodiment includes the following steps:

[0197] Step S801: The projection device responds to the projection display operation and sends the first display information for displaying the first interface to the display device.

[0198] Optionally, the specific implementation of step S801 can be found in the description of step S301 in the above embodiment, and will not be repeated here.

[0199] Step S802: The display device outputs a second interface in at least one target area based on the first display information described above.

[0200] Optionally, in a screen projection system including a projection device and a display device, both the projection device and the display device can receive a launch operation for the first application. The user can launch the first application through the projection device, and then project the first application onto the display device for display. Optionally, after receiving the launch operation for the first application, the display device sends a first launch command including application information to the projection device, causing the projection device to launch the first application and project it onto the display device for display. Optionally, after receiving the first launch command, the projection device determines whether the first application meets preset conditions. If the first application meets the preset conditions, it determines first size information based on the first launch command or the first launch operation. The display size indicated by the first size information can be a different display size than the display size of the first application on the projection device. The first application is an application installed on the projection device; the projection device provides interface information support for the display device, while the display device only performs the display function. The first display information sent by the projection device to the display device may be determined by the projection device acquiring a second interface corresponding to the first size information simulated by a non-first display interface (i.e., a non-first display (second display)), or by acquiring the target interface information of the first application corresponding to the first size information and determining or generating it based on the target interface information. The target interface information may also be simulated by the second display of the projection device.

[0201] Optionally, if the projection device simulates the generation in the second display, the second interface or target interface information will not be displayed in the foreground of the projection device. However, if the first application running in the background is to be displayed in the foreground of the projection device, the interface corresponding to the size information of the first area needs to be re-acquired or generated before it can be displayed in the foreground of the projection device. Optionally, if the projection device displays the first application in the foreground, i.e., the projection device displays the first application, the display device displays the application icon including the first application according to the first display information sent by the projection device, and the user can input a first launch operation on the application icon of the first application through the display device. The display device can send a first launch command including the application information of the first application to the projection device. Since the projection device displays the first application in the foreground, the projection device needs to simulate and generate the second interface or target interface information of the first application corresponding to the first size information in the second display. Therefore, the projection device cannot generate the interface of the first application in the first display (i.e., the display corresponding to the foreground application). Thus, the display device can send a close command for the first application to the projection device, thereby stopping the projection device from displaying the first application. It should be noted that the aforementioned shutdown command does not shut down the first application; it merely destroys the interface of the first application in the first display of the screen mirroring device, and simulates and generates a second interface or the target interface information of the first application in the second display, thereby determining the first display information. Optionally, after the screen mirroring device stops displaying the first application, the display device can display the first application in a first target area. The first target area and the first area have different display sizes. The first area is the area where the screen mirroring device displays the first application, and the first target area is the area where the display device displays the second interface of the first application. The first target area is an area within at least one target area.

[0202] Optionally, if the first application does not meet the preset conditions, the first application is pre-processed according to its original interface information and first size information to generate a second interface corresponding to the first application. This second interface can be obtained by scaling (increasing or decreasing) the interface of the first application proportionally. Optionally, the proportional scaling process does not require the projection device to simulate the generation of the interface in the second display. It only needs to send the first display information determined by the proportionally scaled interface to the display device. The display device can then display the proportionally scaled interface according to the first display information, thereby synchronously displaying the first application with the projection device.

[0203] Optionally, the display device displays a first application in a first target area. The first application meets preset conditions, and the display size of the first target area is different from the display area of ​​the first area. The interface of the first application displayed on the display device in the first target area is provided by the background of the projection device, for example, it can be simulated and stored by a second display in the background. If the user triggers a first launch operation for the first application in the projection device at this time, the projection device similarly destroys the second interface of the first application simulated in the second display, that is, sends a close command for the first application to the display device, and the display device stops displaying the first application. Optionally, after receiving the response from the display device to close the first application, the projection device can display the first application in a first area, the display size of which is different from the first target area, so that the user can use the functions provided by the first application through the projection device. Optionally, the close command does not cause the display device to close the first application, because the display device does not run the first application; the first application runs in the projection device, and the display device only displays it. The close command here is used to instruct the display device to stop displaying the first application.

[0204] Optionally, if the first application does not meet the preset conditions, the interface of the first application displayed on the display device in the first target area can be obtained by preset processing based on the first interface. The preset processing can be proportional scaling. The projection device can then project the interface of the first application generated in the first display onto the display device for display. The projection device can also continue to display the interface of the first application in the first area, so that the projection device can display the first application synchronously with the display device.

[0205] exist Figure 8 In the described method, the projection device responds to the projection display operation by sending first display information for displaying a first interface to the display device, and the display device outputs a second interface in at least one target area based on the first display information. Therefore, based on Figure 8 The described method allows the display device and the projection device to display the first application separately, or to display synchronously with the projection device. This means that users can use the application on the projection device independently through the display device or the projection device, or to display synchronously. This better meets the needs of users for projection display, makes it more convenient for users to use in different projection scenarios, and improves the flexibility and operability of projection display, thus enhancing the user experience.

[0206] Fourth embodiment

[0207] Based on the above embodiments, the above embodiments provide a screen projection device and a display device corresponding to the above embodiments. Please refer to... Figure 9a , Figure 9aThis is a schematic diagram of the structure of a screen projection device 90 provided in an embodiment of this application. The screen projection device 90 can be applied to the aforementioned screen projection equipment. The screen projection device 90 includes an acquisition unit 901, a sending unit 902, a receiving unit 903, a determining unit 904, an updating unit 905, and a generating unit 906. Optionally:

[0208] The acquisition unit 901 is used to acquire first display information for displaying the first interface in response to the screen projection operation;

[0209] The sending unit 902 is used to send the first display information to the display device so that the display device outputs a second interface in at least one target area according to the first display information.

[0210] Optionally, it includes at least one of the following:

[0211] The first region has a different display size from at least one of the target regions, and the first region includes the area in the projection device where the first interface is displayed;

[0212] The first display information includes display size information for at least one of the target areas.

[0213] Optionally, the first interface includes a desktop interface;

[0214] The acquisition unit 901 is used to acquire first display information for displaying the first interface, specifically for:

[0215] The desktop elements in the desktop interface are obtained, and the first display information is determined or generated based on the desktop elements, so that the display device generates the second interface based on the first display information; or...

[0216] The second interface is determined or generated based on the desktop elements of the desktop interface, and the first display information is determined based on the second interface.

[0217] Optionally, the second interface includes at least two applications;

[0218] The method further includes:

[0219] The first display information does not include the second interface;

[0220] The receiving unit 903 is configured to receive a first startup command sent by the display device, and determine a first application based on the application identifier in the first startup command; or,

[0221] The first display information includes the second interface;

[0222] The receiving unit 903 is further configured to receive the first startup command and determine the first application based on the coordinate information in the first startup command.

[0223] Optionally, the receiving unit 903 is further configured to receive a first startup command for the first application sent by the display device, or to respond to a first startup operation for the first application;

[0224] The determining unit 904 is used to determine the first size information according to the first startup instruction or the first startup operation when the first application meets the preset conditions.

[0225] The acquisition unit 901 is further configured to acquire a second interface of the first application corresponding to the first size information, and determine the first display information based on the second interface; or, acquire target interface information of the first application corresponding to the first size information, and determine or generate the first display information based on the target interface information.

[0226] Optionally, the receiving unit 903 is further configured to receive a posture adjustment command sent by the display device, or to respond to a posture adjustment operation for the first interface;

[0227] The updating unit 905 is used to update the first size information according to the attitude adjustment command or attitude adjustment operation, and to determine or generate new first display information based on the updated first size information.

[0228] Optionally, the acquisition unit 901 is used to determine or generate the first display information based on the target interface information, specifically: to acquire or generate the second interface based on the target interface information and the first size information, and to determine the first display information based on the interface information of the second interface.

[0229] Optionally, the projection device 90 further includes:

[0230] The generation unit 906 is configured to, when the first application does not meet the preset conditions, determine or generate the second interface based on the original interface information and the first size information of the first application, and determine the first display information based on the second interface; or,

[0231] The determining unit 904 is further configured to determine the first display information based on the original interface information and the first size information, so that the display device performs preset processing on the original interface information based on the first size information to determine or generate the second interface.

[0232] Optionally, the at least one target area includes a first target area and a second target area, and the second interface corresponding to the first application is displayed in the first target area;

[0233] The receiving unit 903 is further configured to receive a second startup command for the second application sent by the display device, or to respond to a second startup operation for the second application;

[0234] The sending unit 902 is used to send second display information corresponding to the second application to the display device, so that the display device displays a third interface in the second target area according to the second display information.

[0235] Optionally, the receiving unit 903 is further configured to receive a scaling instruction sent by the display device, obtain third display information according to the second size information in the scaling instruction, and send the third display information to the display device.

[0236] It should be noted that, Figure 9a The operations performed by each unit of the illustrated device can be found in the relevant content of the method embodiment. Details will not be provided here. Each unit can be implemented in hardware, software, or a combination of both.

[0237] Based on the above embodiments, the above embodiments provide a display device corresponding to the above embodiments. Please refer to... Figure 9b , Figure 9b This is a schematic diagram of the structure of a display device 90 provided in an embodiment of this application. The display device 90 can be applied to the aforementioned display equipment, and includes a receiving unit 901, an output unit 902, and a transmitting unit 903. Optionally:

[0238] The receiving unit 901 is used to receive first display information sent by the projection device, the first display information being used to display a first interface in a first area of ​​the projection device;

[0239] The output unit 902 is used to output a second interface in at least one target area based on the first display information.

[0240] Optionally, the first display information includes first size information;

[0241] The output unit 902 is used to output a second interface in at least one target area according to the first display information, specifically for:

[0242] The second interface is determined or generated based on the first size information and the interface information of the first interface, and the second interface is output in the at least one target area.

[0243] Optionally, the display device 90 further includes:

[0244] The sending unit 903 is used to respond to the posture adjustment operation and send the posture adjustment command to the projection device.

[0245] The receiving unit 901 is also used to receive new first display information sent by the projection device, and to display the information based on the new first display information or the new first display information and the updated size information.

[0246] Optionally, the receiving unit 901 is further configured to receive a first launch operation for the first application on the second interface and send the application information of the first application to the screen projection device. Optionally, the application information includes an application identifier and / or coordinate information.

[0247] Optionally, the at least one target area includes a first target area and a second target area, and the second interface corresponding to the first application is displayed in the first target area;

[0248] The receiving unit 901 is further configured to receive a second startup operation for the second application and send a second startup instruction for the second application to the screen projection device;

[0249] Receive second display information for the second application, and display a third interface in the second target area according to the second display information.

[0250] Optionally, the receiving unit 901 is further configured to receive a scaling operation for the second interface and send second size information corresponding to the scaling operation to the projection device;

[0251] Receive the third display information sent by the projection device that corresponds to the second size information, and display it according to the third display information.

[0252] It should be noted that, Figure 9b The operations performed by each unit of the illustrated device can be found in the relevant content of the method embodiment. Details will not be provided here. Each unit can be implemented in hardware, software, or a combination of both.

[0253] This application also provides a display system, which includes a projection device and a display device. The projection device is the projection equipment in the above embodiments, and the display device is the display device in the above embodiments.

[0254] This application also provides a smart terminal, which includes a memory and a processor. The memory stores a display program, and when the display program is executed by the processor, it implements the steps of the display method in any of the above embodiments.

[0255] This application also provides a computer-readable storage medium storing a display program, which, when executed by a processor, implements the steps of the display method in any of the above embodiments.

[0256] In the embodiments of the smart terminal and computer-readable storage medium provided in this application, all the technical features of any of the above-described display method embodiments may be included. The extended and explanatory content of the specification is basically the same as that of the embodiments of the above methods, and will not be repeated here.

[0257] This application also provides a computer program product, which includes computer program code. When the computer program code is run on a computer, it causes the computer to perform the methods described in the various possible implementations above.

[0258] This application also provides a chip, including a memory and a processor. The memory is used to store a computer program, and the processor is used to call and run the computer program from the memory, so that a device with the chip installed performs the methods described in the various possible implementations above.

[0259] It is understood that the above scenarios are merely examples and do not constitute a limitation on the application scenarios of the technical solutions provided in the embodiments of this application. The technical solutions of this application can also be applied to other scenarios. Optionally, it is known to those skilled in the art that with the evolution of system architecture and the emergence of new business scenarios, the technical solutions provided in the embodiments of this application are also applicable to similar technical problems.

[0260] The sequence numbers of the embodiments in this application are for descriptive purposes only and do not represent the superiority or inferiority of the embodiments.

[0261] The steps in the method of this application embodiment can be adjusted, combined, or deleted according to actual needs.

[0262] The units in the device of this application embodiment can be merged, divided, and deleted according to actual needs.

[0263] In this application, the same or similar terms, concepts, technical solutions and / or application scenario descriptions are generally described in detail only when they appear for the first time. When they appear again, they are generally not repeated for the sake of brevity. When understanding the technical solutions and other contents of this application, the same or similar terms, concepts, technical solutions and / or application scenario descriptions that are not described in detail later can be referred to their previous relevant detailed descriptions.

[0264] In this application, the descriptions of the various embodiments have different focuses. For parts that are not described in detail or recorded in a certain embodiment, please refer to the relevant descriptions of other embodiments.

[0265] The technical features of the present application can be combined in any way. For the sake of brevity, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of the present application.

[0266] Through the above description of the embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus necessary general-purpose hardware platforms. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) as described above, and includes several instructions to cause a terminal device (which may be a mobile phone, computer, server, controlled terminal, or network device, etc.) to execute the methods of each embodiment of this application.

[0267] In the above embodiments, implementation can be achieved, in whole or in part, through software, hardware, firmware, or any combination thereof. When implemented in software, it can be implemented, in whole or in part, as a computer program product. A computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the flow or function according to the embodiments of this application is generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, digital subscriber line) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that integrates one or more available media. The available medium can be a magnetic medium (e.g., floppy disk, storage disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., solid-state disk (SSD)).

[0268] The above are merely preferred embodiments of this application and do not limit the patent scope of this application. Any equivalent structural or procedural transformations made using the content of this application's specification and drawings, or direct or indirect applications in other related technical fields, are similarly included within the patent protection scope of this application.

Claims

1. A display method characterized by comprising: The method is applied to a screen projection device, and the method comprises: In response to a screen projection operation, first display information for displaying a first interface is acquired; The first display information is sent to a display device, so that the display device outputs a second interface according to the first display information in at least one target region, the at least one target region comprising a first target region and a second target region; The first display information for displaying the first interface is acquired, and the first interface comprises a desktop interface, which comprises acquiring a desktop element in the desktop interface, determining or generating the first display information according to the desktop element, so that the display device generates the second interface according to the first display information in combination with a system preset wallpaper or application icon that is the same as or similar to the first interface; A first application is displayed in a first region, the first region comprising a region in which the first interface is displayed in the screen projection device, and first display information comprising the first application is sent to the display device, so that the display device displays an application icon comprising the first application in the first target region according to the first display information of the first application; the method further comprises: receiving a closing instruction for the first application sent by the display device in response to a starting operation for the application icon of the first application on the second interface; and stopping displaying the first application based on the closing instruction, the first application being displayed in the first target region of the display device.

2. The method of claim 1, wherein, At least one of the following is included: The display size of the first region is different from that of the at least one target region; The first display information comprises display size information of the at least one target region; The second interface comprises at least two applications.

3. The method of claim 2, wherein, At least one of the following is included: The first display information for displaying the first interface is acquired, which comprises determining or generating the second interface according to the desktop element of the desktop interface, and determining the first display information according to the second interface; The first display information does not comprise the second interface, a first starting instruction sent by the display device is received, and the first application is determined according to an application identifier in the first starting instruction, or the first display information comprises the second interface, and the first starting instruction is received, and the first application is determined according to coordinate information in the first starting instruction.

4. The method according to any one of claims 1 to 3, characterized in that, The method further comprises at least one of the following: A first starting instruction for the first application sent by the display device is received, or, in response to a first starting operation for the first application, first size information is determined according to the first starting instruction or the first starting operation when the first application meets a preset condition, a second interface of the first application corresponding to the first size information is acquired, the first display information is determined according to the second interface, or target interface information of the first application corresponding to the first size information is acquired, and the first display information is determined or generated according to the target interface information; A posture adjustment instruction sent by the display device is received, or, in response to a posture adjustment operation for the first interface, The first size information is updated according to the posture adjustment instruction or the posture adjustment operation, and new first display information is determined or generated according to the updated first size information.

5. The method of claim 4, wherein, The method further comprises: When the first application does not satisfy the preset condition, the second interface is determined or generated according to the original interface information of the first application and the first size information, and the first display information is determined according to the second interface; or The first display information is determined according to the original interface information and the first size information, so that the display device performs preset processing on the original interface information according to the first size information to determine or generate the second interface.

6. The method according to any one of claims 1 to 3, characterized in that, The method further comprises at least one of the following: The second interface corresponding to the first application is displayed in the first target area; The display device sends a second start instruction for a second application, or, in response to a second start operation for the second application, the display device sends second display information corresponding to the second application, so that the display device displays a third interface in the second target area according to the second display information; The display device sends a zoom instruction, and third display information is obtained according to second size information in the zoom instruction, and the third display information is sent to the display device.

7. A display method characterized by comprising: The method applied to a display device comprises: Receiving first display information sent by a projection device, the first display information being used to display a first interface in a first area of the projection device; According to the first display information, a second interface is output in at least one target area, the at least one target area comprising a first target area and a second target area; The first display information is determined or generated by the projection device according to a desktop element in a desktop interface obtained by the projection device, and the second interface is output in the at least one target area according to the first display information, which comprises generating the second interface according to the first display information in combination with a wallpaper or an application icon that is the same as or similar to the first interface and is preset by a system; According to the first display information sent by the projection device, an application icon of the first application is displayed in the first target area, the first application being displayed in a first area of the projection device, the first area comprising an area in which the first interface is displayed in the projection device; the method further comprises: in response to a start operation on the application icon of the first application in the second interface, a close instruction for the first application is sent to the projection device, so that the projection device stops displaying the first application and displays the first application in the first target area.

8. The method of claim 7, wherein, The method comprises at least one of the following: According to the first display information, a second interface is output in at least one target area, which comprises determining or generating the second interface according to first size information and interface information of the first interface, and outputting the second interface in the first target area; receive new first display information sent by the screen projection device, the new first display information being updated according to the posture adjustment instruction sent by the display device or in response to the posture adjustment operation on the first interface, and display according to the new first display information; receive a first starting operation on the first application in the second interface, and send application information of the first application to the screen projection device; receive a second starting operation on a second application, send a second starting instruction on the second application to the screen projection device, receive second display information on the second application, and display a third interface in the second target area according to the second display information; receive a zoom operation on the second interface, send second size information corresponding to the zoom operation to the screen projection device, receive third display information corresponding to the second size information sent by the screen projection device, and display according to the third display information.

9. A smart terminal, characterized in that The smart terminal comprises a memory and a processor, wherein the memory stores a display program, and the display program, when executed by the processor, implements the steps of the display method according to any one of claims 1 to 8.

10. A computer-readable storage medium, characterized in that, The storage medium stores a computer program, and the computer program, when executed by the processor, implements the steps of the display method according to any one of claims 1 to 8.

Images