Display method and device and computer readable storage medium

Abstract

The embodiment of the invention provides a display method, electronic equipment and a computer readable storage medium, the method can be applied to first equipment, and the method can comprise the steps that an application instance of a target application is generated in response to a first operation on the first equipment; the application instance is run in a virtual screen of the first device, and the virtual screen is used for displaying the application instance to a second device connected with the first device in a screen projection mode; and displaying the application instance on the second equipment in a screen projection manner. Thus, the purpose that the target installed on one device is used by multiple devices at the same time can be achieved, that is, the first device can conduct application division about the target application for the second device, and therefore the multiple devices can use the target application at the same time and do not affect one another.

Description

Technical Field

[0001] This document relates to the field of application screen projection technology, and in particular to a display method, device and computer-readable storage medium. Background Art

[0002] In related technologies, screen projection technology is often used to share the same application (hereinafter referred to as application) on different devices. The current screen projection technology generally captures the screen on device A, and then projects the captured screen to device B through screen projection software. The operations performed by the user on the application on device B are transmitted back and act on device A. If an application installed on device A is selected for screen projection, the application can be operated on device B.

[0003] However, in the current screen projection technology, for an application projected to device B, if device A operates the application, the screen on device B will be refreshed and reset immediately, so that the screen displayed on device B is consistent with the screen displayed on device A. Therefore, the projected application can actually only be used on one device at a time and cannot be used by multiple devices at the same time. Summary of the invention

[0004] The embodiments of the present specification provide a display method, a device, and a computer-readable storage medium, which are used to solve the problem that the current display solution cannot realize the same application being used by multiple devices at the same time.

[0005] To solve the above technical problems, the embodiments of this specification are implemented as follows:

[0006] In a first aspect, a display method is provided, which is applied to a first device, and the method includes:

[0007] generating an application instance of a target application in response to a first operation on the first device;

[0008] Running the application instance in a virtual screen of the first device, wherein the virtual screen is used to project and display the application instance to a second device connected to the first device;

[0009] The application instance is projected and displayed on the second device.

[0010] In a second aspect, a display method is provided, which is applied to a second device, and the method includes:

[0011] A picture from a virtual screen of a first device is received and displayed, wherein an application running in the virtual screen is an application instance of a target application.

[0012] In a third aspect, a display device is provided, applied to a first device, the device comprising:

[0013] an instance generation module, configured to generate an application instance of a target application in response to a first operation on the first device;

[0014] An instance running module, used to run the application instance in a virtual screen of the first device, wherein the virtual screen is used to project and display the application instance to a second device connected to the first device;

[0015] A screen projection module is used to project the application instance onto the second device for display.

[0016] In a fourth aspect, a display device is provided, applied to a second device, the device comprising:

[0017] The display module is used to receive and display a picture from a virtual screen of the first device, wherein the application running in the virtual screen is an application instance of a target application.

[0018] In a fifth aspect, an electronic device is provided, including:

[0019] processor;

[0020] a memory for storing instructions executable by the processor;

[0021] The processor is configured to execute the instructions to implement the method as described in the first aspect or the second aspect.

[0022] In a sixth aspect, a computer-readable storage medium is provided. When instructions in the storage medium are executed by a processor of an electronic device, the electronic device is enabled to execute the method described in the first aspect or the second aspect.

[0023] In the embodiments of the present specification, since the first device can respond to the operation and generate an application instance of the target application when receiving the first operation, run the application instance in the virtual screen of the first device, and project the application instance to the second device connected to the first device, rather than directly projecting the target application to the second device, it is possible to achieve the purpose of having an application (target application) installed on one device being used by multiple devices at the same time, that is, the first device can clone the application of the target application for the second device, so that multiple devices can use the target application at the same time without affecting each other. BRIEF DESCRIPTION OF THE DRAWINGS

[0024] In order to more clearly illustrate the embodiments of this specification or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments recorded in this specification. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative labor.

[0025] Figure 1 It is a flowchart of a display method provided by an embodiment of this specification.

[0026] Figure 2 This is a schematic diagram of the application effect of a display method provided by an embodiment of this specification. Figure 1 .

[0027] Figure 3 This is a schematic diagram of the application effect of a display method provided by an embodiment of this specification. Figure 2 .

[0028] Figure 4 This is a schematic diagram of the application effect of a display method provided by an embodiment of this specification. Figure 3 .

[0029] Figure 5 It is a schematic diagram of an application instance retention strategy in a display method provided by an embodiment of the present specification.

[0030] Figure 6 It is a schematic diagram of an implementation structure of a display method provided in an embodiment of this specification.

[0031] Figure 7 It is a detailed flowchart of a display method provided in an embodiment of this specification.

[0032] Figure 8 It is a flowchart of a display method provided by another embodiment of the present specification.

[0033] Fig. 9 It is a schematic diagram of the structure of an electronic device according to an embodiment of the present specification.

[0034] Fig.10 It is a structural schematic diagram of a display device provided by an embodiment of this specification.

[0035] Fig.11 It is a structural schematic diagram of a display device provided by another embodiment of the present specification. DETAILED DESCRIPTION

[0036] In order to enable those skilled in the art to better understand the technical solutions in the embodiments of this specification, the technical solutions in the embodiments of this specification will be clearly and completely described below in conjunction with the drawings in one or more embodiments of this specification. Obviously, the described embodiments are only part of the embodiments of this specification, not all of the embodiments. Based on the embodiments in this specification, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of this document.

[0037] The terms "first", "second", etc. in this specification and claims are used to distinguish similar objects, and are not used to describe a particular order or precedence. It should be understood that the terms used in this way are interchangeable where appropriate, so that the embodiments of this specification can be implemented in an order other than those illustrated or described herein. In addition, "and / or" in this specification and claims means at least one of the connected objects, and the character " / " generally means that the objects associated with each other are in an "or" relationship.

[0038] In order to solve the problem that the current display scheme cannot realize the same application being used by multiple devices at the same time, this specification proposes a display method, device and computer-readable storage medium. The method can be executed by an electronic device or software installed in an electronic device. The electronic device includes but is not limited to any one of smart devices such as a smartphone, a personal computer (PC), a laptop, a tablet computer, an e-reader, an Internet TV, a wearable device, etc.

[0039] A display method provided by an embodiment of this specification is described below with reference to the accompanying drawings.

[0040] An embodiment of the present specification provides a display method, which can be applied to a first device, such as Figure 1 As shown, the method may include:

[0041] Step 101: Generate an application instance of a target application in response to a first operation on the first device.

[0042] The first device or the second device mentioned below can be any one of smart devices such as a smart phone, a personal computer (PC), a laptop, a tablet computer, an e-reader, an Internet TV, a wearable device, etc. The first device and the second device are different devices.

[0043] The target application can be any application installed in the first device, generally an application installed in the first device that supports screen projection. If the user needs to project the target application installed in the first device to the second device, and allow the second device to independently operate the projected application, a first operation can be performed on the first device. Accordingly, the first device generates an application instance of the target application in the first device in response to the first operation. For example, Figure 2As shown, if the user needs to project the application 1 installed in the first device A (such as mobile phone A) to the second device B (mobile phone B), and allow the second device B to independently operate the projected application, then the instance a of the application 1 can be created in the first device A in response to the user's first operation on the first device A. It can be understood that the target application and the application instance of the target application are two independent applications, and the user's operations on the two are independent of each other.

[0044] Optionally, the target application may include a game application or a video application installed in the first device. The following will describe in detail the beneficial effects that can be achieved by the display method provided in the embodiment of this specification when the target application is a game application, which will not be described here.

[0045] The first operation may be a pre-agreed operation gesture for creating an application instance. For example, the first operation may include but is not limited to at least one of the following operations:

[0046] A sliding operation on the target application;

[0047] A long press operation on the target application;

[0048] A double-click operation on the target application.

[0049] As a specific example, the first operation may be a "long press + slide" operation for the target application. For example, when the user chooses to create an application instance for application 1 in the first device A, the user may press and hold the icon of application 1 on the display screen of the first device and quickly slide upward until it slides out of the top of the display screen. Accordingly, the first device will detect the operation gesture, and then determine that an application instance of application 1 needs to be created and create it.

[0050] It should be noted that the specific gesture of the first operation can be flexibly set or customized by the user according to actual needs, and is not limited to the above-mentioned "long press + slide" operation gesture. Of course, the first operation is not limited to the operation gesture, and can also be other operation methods, such as voice operation.

[0051] Optionally, the number of application instances created for a target application may be multiple, that is, the application instance of the target application includes multiple application instances; and / or, the number of target applications is multiple, that is, application instances can be created for multiple applications in the first device respectively. Figure 3 As shown, application instance a and application instance b can be created for application 1 in the first device A (creating two application instances for application 1), application instance a can be created for application 2 in the first device A, and application instance a can be created for application 3 in the first device A. For another example, Figure 4As shown, three application instances may be created for the application 1 in the first device A: instance a of the application 1, instance b of the application 1, and instance c of the application 1.

[0052] Step 102: Run the application instance in a virtual screen of the first device, wherein the virtual screen is used to project and display the application instance to a second device connected to the first device.

[0053] If the first device already has a virtual screen, the application instance is directly run in the virtual screen of the first device; if the first device does not have a virtual screen, a virtual screen is first created in the first device, and then the application instance is run in the virtual screen of the first device. The creation of the virtual screen belongs to the prior art and is not described in detail in this specification.

[0054] If the first terminal has created multiple application instances for the target application, one or more virtual screens may be created accordingly. In this case, step 102 may include: running the multiple application instances in one or more virtual screens of the first device, and the one or more virtual screens are used to project the multiple application instances to multiple second devices connected to the first device. In other words, the first device can project multiple application instances to multiple second devices through one virtual screen, or project multiple application instances to multiple second devices through multiple virtual screens.

[0055] Step 103: Project the application instance onto the second device.

[0056] Before step 103, the first device may establish a connection with the second device through a preset communication method, wherein the preset communication method refers to a short-distance communication method, such as Bluetooth, WIFI, Near Field Communication (NFC) or infrared communication, etc. It can be understood that, compared with communication through the network, the short-distance communication method can not only save network resources and reduce traffic usage, but also reduce communication delay.

[0057] If the first terminal creates multiple application instances for the target application, the first device can project the multiple application instances to multiple second devices respectively, that is, one application instance is projected to one second device (such as Figure 2 and Figure 3 The first device may also project at least two application instances to a second device (such as Figure 4 As shown), when at least two application instances are projected and displayed on a second device, the at least two application instances can be displayed separately in a split-screen manner.

[0058] like Figure 2As shown, after creating instance a for application 1 in the first device A, instance a of application 1 can be displayed on the second device B through screen projection.

[0059] like Figure 3 As shown, after creating instance a and instance b for application 1, instance a for application 2, and instance a for application 3 in the first device A, instance a of application 1 can be displayed on the second device B by screen projection, instance b of application 1 can be displayed on the second device C by screen projection, instance a of application 2 can be displayed on the second device D by screen projection, and instance a of application 3 can be displayed on the second device E by screen projection, that is, different application instances can be projected and displayed on different second devices.

[0060] from Figure 3 It can be seen that there may be multiple target applications supporting screen projection in the first device A (such as mobile phone A), among which application 1 supports screen projection to multiple second devices. After the first device creates instance a and instance b for application 1 and projects the screen to second device B and second device C respectively, the effect of application 1 being installed in one place (installed in the first device) and used by multiple devices at the same time can be achieved.

[0061] like Figure 4 As shown, after creating instance a, instance b and instance c for application 1 in the first device A, instance a of application 1, instance b of application 1 and instance c of application 1 can be projected and displayed on the second device B through screen projection. In specific implementation, the three application instances can be displayed separately in different areas on the screen of the second device B (i.e., split-screen display).

[0062] from Figure 4 It can be seen that the first device A can support the same application to flow to different second devices, so that an application only needs to be installed once on the first device, and does not need to be installed on different devices. In addition, the first device A, which is similar to a "server", does not only refer to a fixed device (such as a specific mobile phone). The role of "server" can be fluid. If the performance of other devices (such as other mobile phones) is good enough, they can also play the role of "server".

[0063] A display method provided in an embodiment of the present application, since the first device can respond to the first operation and generate an application instance of the target application when receiving the first operation, run the application instance in the virtual screen of the first device, and project the application instance to a second device connected to the first device, rather than directly projecting the target application to the second device, it can achieve the purpose of allowing an application (target application) installed on one device to be used by multiple devices at the same time, that is, the first device can perform an application clone (application instance) of the target application for the second device, so that the first device and the second device (that is, multiple devices) can use the target application at the same time without affecting each other.

[0064] Optionally, after the above step 103, that is, after the application instance is projected and displayed on the second device, Figure 1 The method shown may also include:

[0065] receiving operation information sent by the second device;

[0066] Generate an operation instruction according to the operation information to act on the application instance;

[0067] The operation result acting on the application instance is projected and displayed on the second device.

[0068] In this way, the second device is like another display screen of the first device. It can display an application instance consistent with the target application without installing the target application, receive operations on the application instance in real time and display the operation results, so the performance requirements are relatively low. In other words, the first device is similar to a server and the second device is similar to a client. The first device can split the target application installed in itself and project the screen to the second device. The target application does not need to be installed in the second device, so the performance requirements are not high.

[0069] Optionally, after the above step 103, that is, after the application instance is projected and displayed on the second device, Figure 1 The method shown may also include:

[0070] A lock command is executed on the application instance in the first device, wherein the lock command is used to prohibit a user from operating the application instance through the first device.

[0071] like Figure 2 As shown, when the instance a of application 1 in the first device A is projected and displayed on the second device B, the instance a of application 1 in the first device A will be locked. At this time, the user cannot use the instance a of application 1 through the first device A, and can only use the original application 1. By locking the instance a, it is possible to prevent instance a from being used by multiple devices, maintain the independence between the original application 1 and the instance of application 1, and avoid data confusion.

[0072] After any application instance in the first device is projected, it can be locked to ensure that only one device is using the application instance. When no device is using the application instance, the application instance will be released. A target application and an application instance of the target application are two independent applications. Their data is stored in their respective applications and can be used by different devices.

[0073] Furthermore, Figure 1 The method shown may also include: after the first device is disconnected from the second device, retaining or deleting the application instance in the first device according to a preset policy.

[0074] After the screen projection display of the application instance of the target application ends, the first device will not delete the application instance of the target application immediately, but will retain it according to a certain strategy (preset strategy) and delete it after the retention period expires. Among them, the preset strategy can include temporary strategies and persistent strategies. Temporary strategies refer to retention strategies with shorter retention periods, which are generally a few days; persistent strategies refer to retention strategies with longer retention periods, such as retention for more than one month or permanent retention. Temporary strategies are suitable for short-term retention and are used to temporarily share applications with others. Persistent strategies are more for the users themselves. For example, for some long-term applications that often require screen projection, you can consider using this strategy to save data.

[0075] like Figure 5 As shown, after the screen projection display of instance a and instance b of application 1 ends, they can be retained for one day or three days according to the temporary strategy; after the screen projection display of instance a of application 2 and instance a of application 3 ends, they can be retained for one month or permanently according to the persistent strategy.

[0076] In specific implementation, for application instances of different applications, the specific retention policy selected may be determined according to the user's choice. For example, after the screen projection is completed, an option or button for selecting a retention policy may be displayed on the first device for the user to select.

[0077] The reason why the application instance is retained in the first device according to a preset strategy after the first device is disconnected from the second device is to avoid the user repeatedly operating the first device to create an application instance to be projected within a certain period of time; the application instance is deleted after the retention period expires to avoid storing a large amount of useless data in the first device, occupying the storage space of the first device, and reducing the operating speed of the first device.

[0078] A display method provided in an embodiment of this specification can not only solve the problem that the current display solution cannot realize the same application being used by multiple devices at the same time, but also has many beneficial effects:

[0079] 1) Enable low-performance devices to use large applications

[0080] In related technologies, faced with increasingly sophisticated but increasingly large game applications, the performance of many devices may not be able to keep up. If two or more devices want to run a large application at the same time, only one device may be able to meet the performance requirements, while the other devices cannot run.

[0081] After applying the display method provided in this specification, the game application can be installed only in the first device with high performance (that is, the target application is the game application), and multiple application instances can be created for the game application in the first device, and the multiple application instances can be run in one or more virtual screens. The multiple application instances are projected and displayed to multiple second devices, so that multiple second devices other than the first device can also use the same application as the target application. If the user wants to participate in a large-scale battle game, the low-end machine itself may run the game slowly, the device display effect will be very poor, and it is easy to get hot. If it is a high-end machine with strong performance to run, the low-end machine is only used as the machine to be projected, then it can run smoothly. In this way, the purpose of running large-scale games on low-end machines is indirectly achieved.

[0082] 2) Reduced reliance on the network and improved response speed

[0083] In related technologies, when facing multiplayer game interactions, the real-time effect will be affected by the network status.

[0084] After applying the display method provided in this specification, the first device and the second device communicate through short-range communication and are not affected by the network status. The game application (that is, the target application is a game application) does not need to be connected to the Internet, and multiple people can participate in the game. Data processing is only in the first device, and the second device whose screen is projected only exchanges data with the first device. Therefore, the dependence on the network is low, the latency is low, and the response speed is fast.

[0085] 3) Reduced costs

[0086] First, if there is a large game that many users want to play together, since this game application is relatively large, if each mobile phone is installed, it requires traffic to download and takes up mobile phone space. Even if WiFi is used for downloading, it takes time to download, which requires a lot of time cost. After applying the display method provided in the embodiment of this specification, it is only necessary to install the game application in the first device (that is, the target application is the game application), and there is no need to install the game application in the second device, which can achieve the purpose of "installing on one device and playing on multiple devices", thereby saving the user's time cost.

[0087] Secondly, the current technology uses a cloud gaming client, but the games available on this client are limited, and using this client usually requires payment on time. However, by applying the display method provided in the embodiments of this specification, these fees can be avoided, reducing the cost of playing games.

[0088] 4) Improved user experience

[0089] Assuming that the target application is a game application, after applying the display method provided in the embodiment of this specification, the effect of "transmit and play" can be achieved, without the user of the second device having to download the target application additionally, and without occupying the storage space and operating resources of the second device. For example, if a device has already downloaded a large game and wants to share it with other friends to play together, the present invention can use the application instance to cast the screen so that other friends can quickly participate in the game without having to wait for a long time.

[0090] In addition, the display method provided in the embodiments of this specification does not have high performance requirements for the device being projected (second device), because the target application and its instances are all running in the high-performance first device, which allows users of low-performance second devices to also enjoy the experience of participating in large-scale games.

[0091] Combine the following Figure 6 and Figure 7 , a display method provided in this specification is described through a more detailed embodiment.

[0092] like Figure 6 FIG. 1 is a schematic diagram showing an implementation structure of a display method provided in an embodiment of this specification. Figure 6 As shown, the first device 61 may include an application instance data module 611, an application instance management module 612 and an application flow module 613, and the second device 62 may include an application flow module 621. The functions of these modules are briefly introduced below.

[0093] The application instance data module 611 is used to search for the second device, connect to the second device, and receive and send application instance related data, etc. The application instance related data may include but is not limited to the identification of the application instance, the original application corresponding to the application instance, and other information.

[0094] The application instance management module 612 is responsible for displaying the application list that supports screen projection, managing application instances, and managing information of connected devices.

[0095] The application flow module 613 is used for creating application instances, saving, modifying, calling, and projecting data of each instance application.

[0096] The application flow module 621 is used to receive and display application instance data.

[0097] like Figure 7 As shown, an embodiment of this specification provides a display method, which can be applied to a first device. The method may include:

[0098] Step 700, start.

[0099] Step 701: Search for a second device.

[0100] When screen projection is required, the first device can pre-open any communication method that can discover each other, such as Bluetooth, WIFI, NFC or infrared communication, and the second device also opens the corresponding method so that the first device can search for the second device and display it for subsequent connection establishment.

[0101] Step 702: Connect a second device.

[0102] A list of connectable devices may be displayed in the first device, and the second device may be selected for connection.

[0103] Step 703, determine whether the connection is disconnected, if yes, execute step 709; otherwise, execute step 704.

[0104] After the first device is connected to the second device, either party can disconnect at any time.

[0105] Step 704: Select a target application.

[0106] The first device displays applications that can be projected, and selects a target application to be projected to the second device based on the received first operation.

[0107] Step 705 , determine whether there is an application instance of the target application. If yes, execute step 707 ; otherwise, execute step 706 .

[0108] The application instance management module 612 in the first device will perform this step to determine whether the corresponding application instance currently exists, because the previously created application instance will not be deleted immediately after the connection is disconnected. If it exists, it does not need to be created again, and if it does not exist, it will be created.

[0109] Step 706: Generate an application instance of the target application.

[0110] When the application instance management module 612 finds that there is no corresponding instance application, it will create an application instance corresponding to the target application, and the application instance data module 611 will also create corresponding application instance-related data to distinguish the original application (the target application itself), so that the first device and the second device can use the original application and application instance independently.

[0111] Step 707: Run the application instance in the virtual screen.

[0112] Specifically, the application instance management module 612 sends application instance related data to the application flow module 613. After receiving the application instance related data, the application flow module 613 runs the application instance in a newly created virtual screen or an existing virtual screen.

[0113] Step 708: Project the application instance onto a second device.

[0114] The application transfer module 613 in the first device sends the data displayed on the virtual screen to the second device. The application transfer module 621 in the second device 62 receives the data transferred from the first device and displays it to the user. After that, the first device and the second device remain connected, and the two exchange data through the application transfer module until one of them disconnects.

[0115] Figure 6 A display method provided by the illustrated embodiment can also achieve the purpose of using an application (target application) installed on one device by multiple devices at the same time, that is, the first device can perform an application clone (application instance) of the target application for the second device, so that the first device and the second device (i.e., multiple devices) can use the target application at the same time without affecting each other. For example, in a multi-screen collaboration scenario, mobile phone A creates an application instance a of application 1 in mobile phone A for mobile phone B; this application instance a is transferred to mobile phone B, and application instance a is still running in mobile phone A, so mobile phone B does not need strong performance or re-download, and application instance a is only displayed and operated on the screen of mobile phone B.

[0116] like Figure 8 As shown, another embodiment of the present specification provides a display method, which is applied to a second device, and the method may include:

[0117] Step 801: Receive and display a picture from a virtual screen of a first device, wherein the application running in the virtual screen is an application instance of a target application.

[0118] The target application is an application installed in the first device.

[0119] Optional, Figure 8 The method shown may also include:

[0120] receiving an operation on the screen and generating operation information;

[0121] The operation information is sent to the first device, where the operation information is used to generate an operation instruction and act on the application instance.

[0122] pass Figure 8The illustrated embodiment can realize the display of the application clone of the target application in the first device and the feedback of the operation information, so that the first device and the second device (ie, multiple devices) can use the target application at the same time without affecting each other.

[0123] The above is a description of a specific embodiment of the specification. Other embodiments are within the scope of the appended claims. In some cases, the actions or steps recorded in the claims can be performed in an order different from that in the embodiments and still achieve the desired results. In addition, the processes depicted in the drawings do not necessarily require the specific order or continuous order shown to achieve the desired results. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.

[0124] Fig. 9 This is a schematic diagram of the structure of an electronic device according to an embodiment of this specification. Fig. 9 At the hardware level, the electronic device includes a processor, and optionally also includes an internal bus, a network interface, and a memory. The memory may include a memory, such as a high-speed random access memory (RAM), and may also include a non-volatile memory (non-volatile memory), such as at least one disk storage. Of course, the electronic device may also include hardware required for other services.

[0125] The processor, network interface and memory can be interconnected through an internal bus, which can be an ISA (Industry Standard Architecture) bus, a PCI (Peripheral Component Interconnect) bus or an EISA (Extended Industry Standard Architecture) bus. The bus can be divided into an address bus, a data bus, a control bus, etc. For ease of representation, Fig. 9 Only one bidirectional arrow is used in the diagram, but this does not mean that there is only one bus or only one type of bus.

[0126] The memory is used to store the program. Specifically, the program may include a program code, and the program code includes a computer operation instruction. The memory may include a memory and a non-volatile memory, and provides instructions and data to the processor.

[0127] The processor reads the corresponding computer program from the non-volatile memory into the memory and then runs it, forming a display device at the logical level. The processor executes the program stored in the memory and is specifically used to perform the following operations:

[0128] generating an application instance of a target application in response to a first operation on the first device;

[0129] Running the application instance in a virtual screen of the first device, wherein the virtual screen is used to project and display the application instance to a second device connected to the first device;

[0130] The application instance is projected and displayed on the second device.

[0131] The above is as in this manual Fig. 9 The method performed by the display device disclosed in the illustrated embodiment can be applied to a processor or implemented by a processor. The processor may be an integrated circuit chip with signal processing capabilities. In the implementation process, each step of the above method can be completed by an integrated logic circuit of hardware in the processor or an instruction in the form of software. The above processor can be a general-purpose processor, including a central processing unit (CPU), a network processor (NP), etc.; it can also be a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components. The methods, steps and logic block diagrams disclosed in the embodiments of this specification can be implemented or executed. The general-purpose processor can be a microprocessor or the processor can also be any conventional processor, etc. The steps of the method disclosed in the embodiments of this specification can be directly embodied as a hardware decoding processor for execution, or a combination of hardware and software modules in the decoding processor for execution. The software module can be located in a storage medium mature in the art such as a random access memory, a flash memory, a read-only memory, a programmable read-only memory, or an electrically erasable programmable memory, a register, etc. The storage medium is located in the memory, and the processor reads the information in the memory and completes the steps of the above method in combination with its hardware.

[0132] The electronic device may also perform Figure 1 The method and the display device are implemented Figure 1 The functions in the illustrated embodiments will not be described in detail in this specification.

[0133] Of course, in addition to software implementation, the electronic device of this specification does not exclude other implementation methods, such as logic devices or a combination of software and hardware, etc., that is to say, the execution subject of the following processing flow is not limited to each logic unit, but can also be hardware or logic devices.

[0134] The embodiment of the present specification also provides a computer-readable storage medium, which stores one or more programs, wherein the one or more programs include instructions, which, when executed by a portable electronic device including a plurality of application programs, enable the portable electronic device to execute Figure 1 The method of the embodiment shown is specifically used to perform the following operations:

[0135] generating an application instance of a target application in response to a first operation on the first device;

[0136] Running the application instance in a virtual screen of the first device, wherein the virtual screen is used to project and display the application instance to a second device connected to the first device;

[0137] The application instance is projected and displayed on the second device.

[0138] Fig.10 is a schematic diagram of a structure of a display device 1000 according to an embodiment of the present specification. Fig.10 In a software implementation, the display device 1000 may include: an instance generation module 1001, an instance running module 1002 and a screen projection module 1003.

[0139] The instance generation module 1001 is configured to generate an application instance of a target application in response to a first operation on the first device.

[0140] The first device or the second device mentioned below can be any one of smart devices such as a smart phone, a personal computer (PC), a laptop, a tablet computer, an e-reader, an Internet TV, a wearable device, etc. The first device and the second device are different devices.

[0141] The target application can be any application installed in the first device, generally an application installed in the first device that supports screen projection. If the user needs to project the target application installed in the first device to the second device, and allow the second device to independently operate the projected application, a first operation can be performed on the first device. Accordingly, the first device generates an application instance of the target application in the first device in response to the first operation.

[0142] Optionally, the target application may include a game application or a video application installed in the first device.

[0143] The first operation may be a pre-agreed operation gesture for creating an application instance. For example, the first operation may include but is not limited to at least one of the following operations:

[0144] A sliding operation on the target application;

[0145] A long press operation on the target application;

[0146] A double-click operation on the target application.

[0147] It should be noted that the specific gesture of the first operation can be flexibly set or customized by the user according to actual needs, and is not limited to the above-mentioned "long press + slide" operation gesture. Of course, the first operation is not limited to the operation gesture, and can also be other operation methods, such as voice operation.

[0148] Optionally, the number of application instances created for a target application may be multiple, that is, the application instance of the target application includes multiple application instances; and / or, the number of target applications is multiple, that is, application instances can be created for multiple applications in the first device respectively.

[0149] The instance running module 1002 is used to run the application instance in the virtual screen of the first device, wherein the virtual screen is used to project and display the application instance to a second device connected to the first device.

[0150] If a virtual screen already exists in the first device, the application instance is directly run in the virtual screen of the first device; if a virtual screen does not exist in the first device, a virtual screen is first created in the first device, and then the application instance is run in the virtual screen of the first device.

[0151] If the first terminal has created multiple application instances for the target application, one or more virtual screens can be created accordingly. At this time, the instance running module 1002 can be used to: run the multiple application instances in one or more virtual screens of the first device, and the one or more virtual screens are used to project and display the multiple application instances to multiple second devices connected to the first device. In other words, the first device can project and display multiple application instances to multiple second devices through one virtual screen, or project and display multiple application instances to multiple second devices through multiple virtual screens.

[0152] The screen projection module 1003 is used to project the application instance to the second device for display.

[0153] Before projecting the application instance to the second device, the first device may establish a connection with the second device through a preset communication method, wherein the preset communication method refers to a short-range communication method, such as Bluetooth, WIFI, Near Field Communication (NFC) or infrared communication, etc. It can be understood that compared with communicating through the network, using a short-range communication method can not only save network resources and reduce traffic usage, but also reduce communication latency.

[0154] If the first terminal creates multiple application instances for the target application, the first device can project and display the multiple application instances to multiple second devices respectively, that is, one application instance is projected and displayed on one second device; the first device can also project and display at least two application instances to one second device. When at least two application instances are projected and displayed on one second device, the at least two application instances can be displayed separately in a split-screen manner.

[0155] A display device 1000 provided in an embodiment of the present application, since the first device can respond to the operation and generate an application instance of the target application when receiving the first operation, run the application instance in the virtual screen of the first device, and project the application instance to the second device connected to the first device, rather than directly projecting the target application to the second device, it can achieve the purpose of allowing an application (target application) installed on one device to be used by multiple devices at the same time, that is, the first device can perform an application clone (application instance) of the target application for the second device, so that the first device and the second device (that is, multiple devices) can use the target application at the same time without affecting each other.

[0156] Optional, Fig.10 The device shown may also include:

[0157] An information receiving module, used to receive operation information sent by the second device;

[0158] An instruction execution module is used to generate an operation instruction based on the operation information to act on the application instance.

[0159] Correspondingly, the screen projection module 1003 is also used to project the operation results acting on the application instance to the second device.

[0160] In this way, the second device is like another display screen of the first device. It can display an application instance consistent with the target application without installing the target application, receive operations on the application instance in real time and display the operation results, so the performance requirements are relatively low. In other words, the first device is similar to a server and the second device is similar to a client. The first device can split the target application installed in itself and project the screen to the second device. The target application does not need to be installed in the second device, so the performance requirements are not high.

[0161] Optional, Fig.10 The apparatus shown may further include: a locking module, configured to execute a locking command on the application instance in the first device, wherein the locking command is used to prohibit a user from operating the application instance through the first device.

[0162] After any application instance in the first device is projected, it can be locked to ensure that only one device is using the application instance.

[0163] Optional, Fig.10 The apparatus shown may further include: a processing module, configured to retain or delete the application instance in the first device according to a preset policy after the first device is disconnected from the second device.

[0164] After the screen projection display of the application instance of the target application ends, the first device will not delete the application instance of the target application immediately, but will retain it according to a certain strategy (preset strategy) and delete it after the retention period expires. Among them, the preset strategy can include temporary strategies and persistent strategies. Temporary strategies refer to retention strategies with shorter retention periods, which are generally a few days; persistent strategies refer to retention strategies with longer retention periods, such as retention for more than one month or permanent retention. Temporary strategies are suitable for short-term retention and are used to temporarily share applications with others. Persistent strategies are more for the users themselves. For example, for some long-term applications that often require screen projection, you can consider using this strategy to save data.

[0165] The reason why the application instance is retained in the first device according to a preset strategy after the first device is disconnected from the second device is to avoid the user repeatedly operating the first device to create an application instance to be projected within a certain period of time; the application instance is deleted after the retention period expires to avoid storing a large amount of useless data in the first device, occupying the storage space of the first device, and reducing the operating speed of the first device.

[0166] The display device 1000 provided in the embodiment of this specification can also perform Figure 1 method, and implement Figure 1 The functions of the embodiments shown in the figure are the same and the same technical effects are achieved, so the embodiments of this specification will not be described in detail here.

[0167] Fig.11 is a schematic diagram of a display device 1100 according to an embodiment of the present specification. Fig.11 In a software implementation, the display device 1100 may include: a display module 1101.

[0168] The display module 1101 is used to receive and display a picture from a virtual screen of the first device, wherein the application running in the virtual screen is an application instance of a target application.

[0169] The target application is an application installed in the first device.

[0170] Optional, Fig.11 The device shown may also include:

[0171] An information generating module, used for receiving an operation on the screen and generating operation information;

[0172] An information sending module is used to send the operation information to the first device, where the operation information is used to generate an operation instruction and act on the application instance.

[0173] pass Fig.11 The illustrated embodiment can realize the display of the application clone of the target application in the first device and the feedback of the operation information, so that the first device and the second device (ie, multiple devices) can use the target application at the same time without affecting each other.

[0174] The display device 1100 provided in the embodiment of this specification can also perform Figure 8 method, and implement Figure 8 The functions of the illustrated embodiments will not be described in detail in the embodiments of this specification.

[0175] In short, the above description is only a preferred embodiment of this specification and is not intended to limit the protection scope of this specification. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of this specification shall be included in the protection scope of this specification.

[0176] The systems, devices, modules or units described in the above embodiments may be implemented by computer chips or entities, or by products with certain functions. A typical implementation device is a computer. Specifically, the computer may be, for example, a personal computer, a laptop computer, a cellular phone, a camera phone, a smart phone, a personal digital assistant, a media player, a navigation device, an email device, a game console, a tablet computer, a wearable device, or a combination of any of these devices.

[0177] Computer readable media include permanent and non-permanent, removable and non-removable media that can be implemented by any method or technology to store information. Information can be computer readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, compact disk read-only memory (CD-ROM), digital versatile disk (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device. As defined herein, computer readable media does not include temporary computer readable media (transitory media), such as modulated data signals and carrier waves.

[0178] It should also be noted that the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, commodity or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, commodity or device. In the absence of more restrictions, the elements defined by the sentence "comprises a ..." do not exclude the existence of other identical elements in the process, method, commodity or device including the elements.

[0179] Each embodiment in this specification is described in a progressive manner, and the same or similar parts between the embodiments can be referred to each other, and each embodiment focuses on the differences from other embodiments. In particular, for the system embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment.

Claims

1. A display method, applied to a first device, comprising: generating an application instance of a target application in response to a first operation on the first device; Running the application instance in a virtual screen of the first device, wherein the virtual screen is used to project and display the application instance to a second device connected to the first device; The application instance is projected and displayed on the second device.

2. The method according to claim 1, further comprising: receiving operation information sent by the second device; Generate an operation instruction according to the operation information to act on the application instance; The operation result acting on the application instance is projected and displayed on the second device.

3. The method according to claim 1, The target application includes a game application or a video application installed in the first device.

4. The method according to claim 1, further comprising: A lock command is executed on the application instance in the first device, wherein the lock command is used to prohibit a user from operating the application instance through the first device.

5. The method according to claim 1, wherein the first operation comprises at least one of the following: A sliding operation on the target application; A long press operation on the target application; A double-click operation on the target application.

6. The method according to claim 1, further comprising: After the first device is disconnected from the second device, the application instance is retained or deleted in the first device according to a preset policy.

7. The method according to any one of claims 1 to 6, before projecting the application instance to the second device, the method further comprises: Establish a connection with the second device in a preset communication mode, wherein the preset communication mode includes Bluetooth, WIFI, NFC, or infrared communication.

8. The method according to claim 1, wherein the application instance of the target application comprises a plurality of application instances; in, The running of the application instance in the virtual screen of the first device includes: The multiple application instances are run in one or more virtual screens of the first device, and the one or more virtual screens are used to project and display the multiple application instances to multiple second devices connected to the first device.

9. An electronic device, comprising: processor; a memory for storing instructions executable by the processor; The processor is configured to execute the instructions to implement the method according to any one of claims 1 to 8. 10 . A computer-readable storage medium, when instructions in the storage medium are executed by a processor of an electronic device, the electronic device is enabled to execute the method according to any one of claims 1 to 8.

Images