An embedded method, a terminal device and a computer storage medium are provided
By setting the target application's display interface to the operating system background of the terminal device and receiving operation commands, the problem of complex application switching on the terminal device is solved, and a convenient operating experience is achieved.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2019-04-03
- Publication Date
- 2026-03-31
AI Technical Summary
When multiple applications are installed on a terminal device, users need to frequently switch between running applications in the foreground and background, which complicates the operation and reduces the user experience.
By detecting the status of the terminal device, the target application's display interface is set to the operating system's background and displayed. The system also receives display operation commands from the operation interface, enabling the target application's operation interface to be operated in the background.
It eliminates the need to frequently switch between running applications in the foreground and background, making it convenient to operate and improving the user experience.
Smart Images

Figure CN111782094B_ABST
Abstract
Description
Technical Field
[0001] This invention relates to the field of terminal technology, and in particular to an application embedding method, a terminal device, and a computer storage medium. Background Technology
[0002] With the development of technology and the popularization of the internet, various terminal devices are widely used, and users are installing more and more applications on these devices. However, the more applications installed on a terminal device, the more complex the operations involved in using them become, impacting the user experience. For example, when using a navigation map application in a car's infotainment system, if a user needs to turn on or switch radio stations, they must first switch the navigation map application to the background, and then switch it back to the foreground after completing the radio operation. This process is cumbersome and degrades the user experience. Summary of the Invention
[0003] The purpose of this invention is to provide an application embedding method, terminal device, and computer storage medium that enable users to use the target application without switching between foreground and background operation, thus improving user experience.
[0004] To achieve the above objectives, the technical solution of the present invention is implemented as follows:
[0005] In a first aspect, embodiments of the present invention provide an application embedding method applied to a terminal device, the application embedding method comprising:
[0006] After detecting that the terminal device has entered the target state, the display interface of the target application is set as the background of the terminal device's operating system for display.
[0007] Upon receiving a display command for the target application's interface, the target application's interface is displayed so that the user can perform operations on it.
[0008] As one implementation method, setting the display interface of the target application as the background of the operating system of the terminal device includes:
[0009] Create at least one rendering environment object that matches the screen size of the terminal device, the rendering environment object being used to display the background of the operating system;
[0010] Establish a communication link between the rendering environment object and the target application;
[0011] Based on the communication link, the display interface of the target application is rendered into the rendering environment object so that the display interface of the target application is displayed as the background of the operating system of the terminal device.
[0012] As one implementation, receiving the display operation instruction for the operation interface of the target application includes:
[0013] The system detects that a preset area has been pressed for a duration exceeding a set time threshold; or, it receives a key press command that triggers a preset virtual button.
[0014] In one implementation, the operating system is Android, and before receiving the key command triggered by the preset virtual key, the method further includes:
[0015] The display operation instructions of the operation interface bound to the target application are obtained through the Android Interface Definition Language interface of the terminal device screen, and the preset virtual buttons corresponding to the display operation instructions are displayed on the screen of the terminal device.
[0016] In one implementation, the terminal device includes a main screen interface and at least one secondary screen interface. The number of rendering environment objects is the same as the number of screen interfaces on the terminal device. The step of rendering the display interface of the target application into the rendering environment object based on the communication link, so as to display the display interface of the target application as the background of the operating system of the terminal device, includes:
[0017] Based on the communication link, the display interface of the target application is rendered evenly onto the rendering environment object, so as to use the display interface of the target application as the background of the operating system of the terminal device for multi-screen scrolling display on the main screen and each secondary screen.
[0018] As one implementation, creating at least one rendering environment object that matches the screen size of the terminal device includes:
[0019] Create at least one rendering environment object that matches the screen size of the terminal device through the EGL interface.
[0020] As one implementation, rendering the display interface of the target application into the rendering environment object based on the communication link includes:
[0021] Based on the communication link, the display interface of the target application is rendered into the rendering environment object using OpenGL.
[0022] As one implementation method, it also includes:
[0023] Upon detecting that the set zoom-in virtual button has been triggered, a zoom-in command is generated, and the display interface of the target application is zoomed in relative to the screen of the terminal device according to the zoom-in command; and / or,
[0024] Upon detecting that the set virtual zoom-out button has been triggered, a zoom-out command is generated, and the display interface of the target application is zoomed out relative to the screen of the terminal device according to the zoom-out command.
[0025] Secondly, embodiments of the present invention also provide a terminal device, including: a processor and a memory for storing a computer program capable of running on the processor.
[0026] When the processor runs the computer program, it implements the steps of the application embedding method described in the first aspect.
[0027] Thirdly, embodiments of the present invention provide a computer storage medium storing a computer program, which, when executed by a processor, implements the steps of the application embedding method as described in the first aspect.
[0028] The application embedding method, terminal device, and computer storage medium provided in this invention, after detecting that the terminal device has entered a target state, set the display interface of the target application as the background of the terminal device's operating system; upon receiving a display operation instruction for the operation interface of the target application, the operation interface of the target application is displayed for the user to operate on. Thus, the user does not need to switch the target application between foreground and background operation while using it, making operation convenient and improving the user experience. Attached Figure Description
[0029] Figure 1 A flowchart illustrating an application embedding method provided in an embodiment of the present invention;
[0030] Figure 2 This is a schematic diagram of the structure of a terminal device provided in an embodiment of the present invention. Detailed Implementation
[0031] The technical solution of the present invention will be further described in detail below with reference to the accompanying drawings and specific embodiments. Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention pertains. The terminology used herein is for the purpose of describing particular embodiments only and is not intended to limit the invention. The term "and / or" as used herein includes any and all combinations of one or more of the associated listed items.
[0032] See Figure 1 This invention provides an application embedding method that can be applied to terminal devices, comprising the following steps:
[0033] Step S101: After detecting that the terminal device has entered the target state, the display interface of the target application is set as the background of the operating system of the terminal device for display;
[0034] Here, the terminal devices include, but are not limited to, mobile phones, tablets, desktop computers, personal digital assistants, and in-vehicle systems. Understandably, it can be pre-set that the terminal device enters the target state when it is turned on and enters the main screen interface, or when the input area and / or display screen of the terminal device is locked and unlocked, or when switching back to the main screen interface or secondary screen interface from the application's user interface. Understandably, the main screen interface is the interface displayed after the terminal device is powered on, and the secondary screen interface is the new interface displayed after swiping left or right on the main screen interface. The target application includes, but is not limited to, navigation map applications and chat applications. The navigation map application can be Baidu Maps, Gaode Maps, etc., and the chat application can be WeChat, QQ, etc. In this embodiment, a navigation map application is used as the target application. Accordingly, the target application's display interface can show the terminal device's current location, direction of movement, road layout, etc. Setting the target application's display interface as the background of the terminal device's operating system allows users to obtain information such as current location and road layout directly from the main screen and / or secondary screen without needing to open the navigation map application. It should be noted that when the main screen and / or secondary screen include shortcuts, such as icons, of applications installed on the terminal device, setting the target application's display interface as the background of the terminal device's operating system places the shortcuts on a display layer above the target application's display interface. Since the display layer containing the shortcuts is above the target application's display layer, the shortcuts are displayed where they overlap with the target application's display interface. Where the shortcuts do not overlap with the target application's display interface, the target application's display interface is still displayed due to the lack of an upper layer obstruction.
[0035] In one embodiment, setting the display interface of the target application as the background of the operating system of the terminal device includes:
[0036] Create at least one rendering environment object that matches the screen size of the terminal device, the rendering environment object being used to display the background of the operating system;
[0037] Establish a communication link between the rendering environment object and the target application;
[0038] Based on the communication link, the display interface of the target application is rendered into the rendering environment object so that the display interface of the target application is displayed as the background of the operating system of the terminal device.
[0039] Understandably, in order to display the entire screen of the terminal device showing the target application's interface, the size of the rendering environment object can be the same as the screen size of the terminal device. Of course, if only a portion of the terminal device's screen displays the target application's interface, the size of the rendering environment object can be smaller than the terminal device's screen size. Since a terminal device typically has one main screen and at least one secondary screen, to display the target application's interface as the background of the terminal device's operating system on both the main and secondary screens, multiple rendering environment objects may be required; that is, one rendering environment object per interface. Creating at least one rendering environment object matching the terminal device's screen size includes: creating at least one rendering environment object matching the terminal device's screen size through the EGL interface. Based on the communication link between the rendering environment object and the target application, it is equivalent to the rendering environment object and the target application being able to communicate, thereby allowing the target application's interface to be displayed as the background of the terminal device's operating system. In one embodiment, rendering the display interface of the target application into the rendering environment object based on the communication link includes: rendering the display interface of the target application into the rendering environment object using OpenGL based on the communication link. This enables fast and accurate rendering of the target application's display interface into the rendering environment object, thereby displaying the target application's display interface as the background of the terminal device's operating system.
[0040] In one embodiment, the terminal device includes a main screen interface and at least one secondary screen interface. The number of rendering environment objects is the same as the number of screen interfaces of the terminal device. The step of rendering the display interface of the target application into the rendering environment object based on the communication link, so as to display the display interface of the target application as the background of the operating system of the terminal device, includes:
[0041] Based on the communication link, the display interface of the target application is rendered evenly onto the rendering environment object, so as to use the display interface of the target application as the background of the operating system of the terminal device for multi-screen scrolling display on the main screen and each secondary screen.
[0042] Understandably, since the screen size of a terminal device is fixed, and the target application's display interface is only shown on the main screen or secondary screen, the user may not be able to clearly see the content displayed on the target application's display interface. Therefore, the target application's display interface can be rendered evenly across the rendering environment object, so that the target application's display interface serves as the background of the terminal device's operating system and is displayed in a multi-screen scrolling manner on the main screen and each secondary screen. Rendering the target application's display interface evenly across the rendering environment object can mean dividing the target application's display interface into N sub-display interfaces of equal width, and displaying these N sub-display interfaces one-to-one on consecutive main screens and secondary screens, where N is the number of screen interfaces on the terminal device. Correspondingly, by swiping on the main screen and secondary screens, users can switch from the main screen to the secondary screen, or from the secondary screen to the main screen, or from one secondary screen to another, thus achieving the multi-screen scrolling display of the target application's display interface as the background of the terminal device's operating system on the main screen and each secondary screen. This improves the clarity of the target application's display interface and further enhances the user experience.
[0043] Step S102: After receiving the display operation instruction for the operation interface of the target application, display the operation interface of the target application so that the user can operate on the operation interface of the target application.
[0044] Specifically, after receiving a display operation instruction for the target application's interface, the terminal device displays the target application's interface on its current screen, allowing the user to operate on it and thus perform processing operations on the target application. Taking a navigation map application as an example, the navigation map application's interface may display a destination input box, historical search locations, travel mode icons, etc. When the user inputs a destination and enters navigation mode on the navigation map application's interface, the terminal device displays the navigation interface of the navigation map application, which can also be referred to as the navigation map application's display interface. If the user needs to use other applications at this time, such as by clicking the HOME button at the bottom of the terminal device's screen to return to the main screen, the navigation interface of the navigation map application, i.e., the navigation map application's display interface, continues to be displayed as the background of the terminal device's operating system, rather than running the navigation map application in the background. When the terminal device returns to the main screen, the user can see the navigation interface of the navigation map application. Alternatively, the user can click on the shortcut of the navigation map application to make the navigation interface of the navigation map application cover all other application shortcuts or icons, so that only the navigation interface of the navigation map application is displayed on the terminal device.
[0045] In summary, the application embedding method provided by this invention, after detecting that the terminal device has entered the target state, sets the display interface of the target application as the background of the terminal device's operating system; upon receiving a display operation instruction for the operation interface of the target application, it displays the operation interface of the target application for the user to operate on. Thus, the user does not need to switch the target application between foreground and background operation while using it, making operation convenient and improving the user experience.
[0046] In one embodiment, receiving a display operation instruction for the operation interface of the target application includes: detecting that a preset area is pressed and the pressing time is greater than a set time threshold; or, receiving a button instruction that a preset virtual button is clicked.
[0047] Understandably, when the main screen and secondary screen include shortcuts such as icons for applications installed on the terminal device, the area of the icon that does not overlap with the display interface of the target application can be used as the preset area. When the user presses the preset area with a finger or stylus, the terminal device detects that the preset area has been pressed and the pressing time is greater than a set time threshold, indicating that a display operation command for the target application's interface has been received. The time threshold can be set according to actual needs, such as 2 seconds or 3 seconds. Alternatively, a virtual button, such as a circular or square icon, can be displayed on the terminal device's screen. When the user clicks this icon, the terminal device receives a button command that triggers the preset virtual button. Thus, by promptly detecting whether a display operation command for the target application's interface has been received, the user experience can be further improved.
[0048] In one embodiment, the operating system is an Android system, and before receiving the key command that triggers the preset virtual key, the method further includes:
[0049] The display operation instructions of the operation interface bound to the target application are obtained through the Android Interface Definition Language interface of the terminal device screen, and the preset virtual buttons corresponding to the display operation instructions are displayed on the screen of the terminal device.
[0050] Here, by displaying the operation instructions of the operation interface bound to the target application on the screen of the terminal device as preset virtual buttons, the user can easily trigger the operation interface when needed, thus improving the ease of operation.
[0051] In one embodiment, it further includes:
[0052] Upon detecting that the set zoom-in virtual button has been triggered, a zoom-in command is generated, and the display interface of the target application is zoomed in relative to the screen of the terminal device according to the zoom-in command; and / or,
[0053] Upon detecting that the set virtual zoom-out button has been triggered, a zoom-out command is generated, and the display interface of the target application is zoomed out relative to the screen of the terminal device according to the zoom-out command.
[0054] Here, the zoom-in and zoom-out virtual buttons are displayed on the terminal device's screen and can be shown as icons or other methods. The zoom-in operation relative to the terminal device's screen, based on the zoom-in command, can involve zooming in on the target application's display interface relative to the terminal device's screen by a set magnification factor. This magnification factor can be set according to actual needs, such as 0.2x or 0.3x. Similarly, the zoom-out operation relative to the terminal device's screen, based on the zoom-out command, can involve shrinking the target application's display interface relative to the terminal device's screen by a set zoom-out factor. This zoom-out factor can be set according to actual needs, such as 0.1x or 0.2x. Thus, by adjusting the size of the target application's display interface relative to the terminal device's screen as needed, the user experience is further improved.
[0055] The technical solution of the aforementioned embodiment will be described in detail below with specific examples, taking a 3D navigation map as the target application and an Android system as the operating system. First, the Android system's Wallpaper Service is used to bind and connect to the 3D navigation map. Then, the 3D navigation map is rendered on the wallpaper in real time, and various operation commands of the 3D navigation map service are bound to it. These operation commands allow for dynamic interaction, enabling users to move, zoom in, or zoom out of the 3D navigation map, which remains on the background layer. Simultaneously, various custom operation windows float on the 3D navigation map's operation interface. Thus, by seamlessly embedding the navigation map into the Android system as a background layer, while other operations are overlaid on the navigation map, and because the operation interface interaction does not require switching between foreground and background navigation, users do not need to leave the navigation interface when changing weather, radio, or music playback settings.
[0056] Based on the same inventive concept as the foregoing embodiments, this embodiment of the invention provides a terminal device, such as... Figure 2 As shown, the terminal device includes: a processor 310 and a memory 311 for storing computer programs capable of running on the processor 310; wherein, Figure 2 The processor 310 shown in the diagram does not refer to a single processor 310, but rather to the positional relationship of the processor 310 relative to other devices. In practical applications, there can be one or more processors 310; similarly, Figure 2The memory 311 shown in the diagram has the same meaning, that is, it is only used to indicate the positional relationship of memory 311 relative to other devices. In practical applications, there can be one or more memories 311. When the processor 310 runs the computer program, it implements the application embedding method applied to the aforementioned terminal device.
[0057] The terminal device may also include at least one network interface 312. The various components in the terminal device are coupled together via a bus system 313. It is understood that the bus system 313 is used to implement communication between these components. In addition to a data bus, the bus system 313 also includes a power bus, a control bus, and a status signal bus. However, for clarity, in... Figure 2 The general designated all buses as Bus System 313.
[0058] The memory 311 can be volatile memory or non-volatile memory, or both. The non-volatile memory can be read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), ferromagnetic random access memory (FRAM), flash memory, magnetic surface memory, optical disc, or compact disc read-only memory (CD-ROM); the magnetic surface memory can be disk storage or magnetic tape storage. The volatile memory can be random access memory (RAM), which is used as an external cache. By way of example, but not limitation, many forms of RAM are available, such as Static Random Access Memory (SRAM), Synchronous Static Random Access Memory (SSRAM), Dynamic Random Access Memory (DRAM), Synchronous Dynamic Random Access Memory (SDRAM), Double Data Rate Synchronous Dynamic Random Access Memory (DDRSDRAM), Enhanced Synchronous Dynamic Random Access Memory (ESDRAM), SyncLink Dynamic Random Access Memory (SLDRAM), and Direct Rambus Random Access Memory (DRRAM).The memory 311 described in the embodiments of the present invention is intended to include, but is not limited to, these and any other suitable types of memory.
[0059] The memory 311 in this embodiment of the invention is used to store various types of data to support the operation of the terminal device. Examples of this data include: any computer programs used to operate on the terminal device, such as operating systems and applications; contact data; phonebook data; messages; pictures; videos, etc. The operating system includes various system programs, such as the framework layer, core library layer, driver layer, etc., used to implement various basic services and handle hardware-based tasks. Applications can include various applications, such as media players, browsers, etc., used to implement various application services. Here, the program implementing the method of this embodiment of the invention can be included in the application.
[0060] Based on the same inventive concept as the foregoing embodiments, this embodiment also provides a computer storage medium storing a computer program. The computer storage medium can be a magnetic random access memory (FRAM), a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), a flash memory, a magnetic surface memory, an optical disc, or a compact disc read-only memory (CD-ROM), etc.; it can also be various devices including one or any combination of the above-mentioned memories, such as mobile phones, computers, tablet devices, personal digital assistants, etc. When the computer program stored in the computer storage medium is executed by a processor, it implements the application embedding method applied to the aforementioned terminal device. For the specific steps implemented when the computer program is executed by the processor, please refer to [link to relevant documentation]. Figure 1 The description of the illustrated embodiments will not be repeated here.
[0061] The technical features of the above embodiments can be combined in any way. For the sake of brevity, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.
[0062] In this document, the terms “comprising,” “including,” or any other variations thereof are intended to cover non-exclusive inclusion, which includes not only the elements listed but also other elements not expressly listed.
[0063] The above description is merely a specific embodiment of the present invention, but the scope of protection of the present invention is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the technical scope disclosed in the present invention should be included within the scope of protection of the present invention. Therefore, the scope of protection of the present invention should be determined by the scope of the claims.
Claims
1. An application embedding method applied to a terminal device, characterized by, The application embedding method comprises: after detecting that the terminal device switches from a user interface of a target application back to a main screen interface or a secondary screen interface, setting a display interface of the target application to be displayed as a background of an operating system of the terminal device; after receiving a display operation instruction for an operation interface of the target application, displaying the operation interface of the target application for a user to operate on the operation interface of the target application; wherein the target application is a navigation map application, and the operation interface of the target application is a navigation interface of the navigation map application.
2. The method of claim 1, wherein, The setting of the display interface of the target application to be displayed as the background of the operating system of the terminal device comprises: creating at least one rendering environment object matching a screen size of the terminal device, the rendering environment object being used to display the background of the operating system; establishing a communication link between the rendering environment object and the target application; based on the communication link, rendering the display interface of the target application into the rendering environment object, so as to display the display interface of the target application as the background of the operating system of the terminal device.
3. The method of claim 1, wherein, The receiving of the display operation instruction for the operation interface of the target application comprises: detecting that a preset area is pressed and the pressing time is greater than a set time threshold; or receiving a key instruction that a preset virtual key is triggered.
4. The method of claim 3, wherein, Before the receiving of the key instruction that the preset virtual key is triggered, the operating system is an Android system, and the method further comprises: obtaining, through an Android Interface Definition Language (AIDL) interface of the screen of the terminal device, a display operation instruction of the operation interface bound with the target application, and displaying a preset virtual key corresponding to the display operation instruction on the screen of the terminal device.
5. The method of claim 2, wherein, The terminal device comprises a main screen interface and at least one secondary screen interface, the number of the rendering environment objects is the same as that of the screen interfaces of the terminal device, and the rendering of the display interface of the target application into the rendering environment object based on the communication link, so as to display the display interface of the target application as the background of the operating system of the terminal device, comprises: based on the communication link, rendering the display interface of the target application into the rendering environment object, so as to display the display interface of the target application as the background of the operating system of the terminal device in the main screen interface and each secondary screen interface for multi-screen scrolling display.
6. The method of claim 2, wherein, The creation of the at least one rendering environment object matching the screen size of the terminal device comprises: creating the at least one rendering environment object matching the screen size of the terminal device through an EGL (OpenGL ES) interface.
7. The method of claim 2, wherein the application embedding method is characterized by, The rendering of the display interface of the target application into the rendering environment object based on the communication link comprises: based on the communication link, rendering the display interface of the target application into the rendering environment object through OpenGL.
8. The method of claim 2, wherein the embedding method is used for, The method further comprises: after detecting that a set zoom-in virtual key is triggered, generating a zoom-in instruction, and performing a zoom-in operation on the display interface of the target application relative to the screen of the terminal device according to the zoom-in instruction; and / or, After detecting that the set reduced virtual button is triggered, a reduced instruction is generated, and a display interface of the target application is reduced relative to a screen of the terminal device according to the reduced instruction.
9. A terminal device, comprising: Comprise: a processor and a memory for storing a computer program capable of running on the processor, the processor runs the computer program, and the application embedding method of any one of claims 1-8 is implemented.
10. A computer storage medium, characterized in that, The computer program is stored, and the computer program is executed by the processor to implement the application embedding method of any one of claims 1-8.
Citation Information
Patent Citations
Application program interface display method and device
CN106383699A
Application control method and mobile terminal
CN107678642A
Interface processing method and equipment, storage medium and terminal
CN108491124A
A method and apparatus for switching a background image
CN109032721A
Wallpaper setting method and terminal device
CN109213549A