Interface display method, device, electronic device and readable storage medium
By receiving user input in the interface of the electronic device and displaying images and controls acquired by the application, the problem of fixed interface display mode in the prior art is solved, and flexible updates and efficient display of the interface are realized.
Patent Information
- Application Number
- CN202411831197.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-12-12
- Publication Date
- 2025-04-01
AI Technical Summary
The application interface display method of existing electronic devices is fixed, which cannot meet users' flexible interface needs.
By receiving user input in the case of a display interface, the images and controls obtained by the application are displayed, and the interface is updated according to the controls selected by the user.
It realizes automatic update of the interface according to user needs, and improves the flexibility and efficiency of the electronic device display interface information.
Smart Images

Figure CN119739311A_ABST
Abstract
Description
Technical Field
[0001] The present application belongs to the technical field of electronic equipment, and specifically relates to an interface display method, device, electronic equipment and readable storage medium. Background Art
[0002] With the advancement of technology and the popularization of electronic devices, common ways for users to record their lives and share information include taking real-time photos of their surroundings and taking screenshots of application interfaces displayed on electronic devices.
[0003] The current application interface is a fixed interface mode. For example, the background image of the application interface is a fixed image. When the user wants to change the background image of the application interface, he needs to enter the corresponding setting interface and select an image to set the image as the background image of the application interface. For another example, the display mode of the application interface is a fixed display mode, that is, each application interface is displayed to the user with a fixed interface effect.
[0004] However, in the above-mentioned method, since the display method of each application interface in the electronic device is fixed, it cannot meet the user's demand for interface display. In this way, the method of displaying the interface of the electronic device is not flexible enough. Summary of the invention
[0005] The purpose of the embodiments of the present application is to provide an interface display method, device, electronic device and readable storage medium, which can improve the flexibility and efficiency of electronic devices in displaying interface information.
[0006] In a first aspect, an embodiment of the present application provides an interface display method, the method comprising: while displaying a first interface, receiving a first input for a first application identifier; in response to the first input, displaying a first image and at least one control, the first image being an image acquired based on an application corresponding to the first application identifier; receiving a second input for a first control among the at least one control; and in response to the second input, updating the first interface based on the first image.
[0007] In a second aspect, an embodiment of the present application provides an interface display device, which includes: a receiving module, a display module, and a processing module. The receiving module is used to receive a first input to a first application identifier while displaying a first interface. The display module is used to display a first image and at least one control in response to the first input received by the receiving module, wherein the first image is an image acquired based on the application corresponding to the first application identifier. The receiving module is also used to receive a second input to a first control among the at least one control displayed by the display module. The processing module is used to update the first interface based on the first image displayed by the display module in response to the second input received by the receiving module.
[0008] In a third aspect, an embodiment of the present application provides an electronic device, which includes a processor and a memory, wherein the memory stores programs or instructions that can be run on the processor, and when the program or instructions are executed by the processor, the steps of the method described in the first aspect are implemented.
[0009] In a fourth aspect, an embodiment of the present application provides a readable storage medium, on which a program or instruction is stored, and when the program or instruction is executed by a processor, the steps of the method described in the first aspect are implemented.
[0010] In a fifth aspect, an embodiment of the present application provides a chip, comprising a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run a program or instruction to implement the method described in the first aspect.
[0011] In a sixth aspect, an embodiment of the present application provides a computer program product, which is stored in a storage medium and is executed by at least one processor to implement the method described in the first aspect.
[0012] In an embodiment of the present application, when displaying the first interface, a first input of a first application identifier is received, and in response to the first input, a first image and at least one control are displayed, the first image being an image obtained based on the application corresponding to the first application identifier, a second input of a first control in the at least one control is received, and in response to the second input, the first interface is updated based on the first image. In this solution, since when displaying the first interface, the user can directly select the first application identifier in the first interface to trigger the electronic device to display the first image obtained based on the application corresponding to the first application identifier, and the control corresponding to the interface update method selected by the user in the first interface, then the user can trigger the electronic device to update the first interface based on the first image by selecting the required first control, so as to realize the automatic combination of the first image corresponding to the first application identifier with the first interface according to the user's demand for interface update, and update the first interface accordingly, so that the displayed interface content meets the user's display demand for the interface in this way, and the user does not need to manually perform complex editing operations, so as to improve the flexibility and efficiency of the electronic device in displaying interface information. BRIEF DESCRIPTION OF THE DRAWINGS
[0013] Figure 1 This is one of the flow charts of the interface display method provided in the embodiment of the present application;
[0014] Figure 2 This is the second flowchart of the interface display method provided in the embodiment of the present application;
[0015] Figure 3This is one of the example schematic diagrams of updating the chat interface provided in the embodiment of the present application;
[0016] Figure 4 This is the third flowchart of the interface display method provided in the embodiment of the present application;
[0017] Figure 5 is a schematic diagram of an example of an interface for updating weather details provided in an embodiment of the present application;
[0018] Figure 6 This is the fourth flow chart of the interface display method provided in the embodiment of the present application;
[0019] Figure 7 This is the fifth flow chart of the interface display method provided in the embodiment of the present application;
[0020] Figure 8 is a schematic diagram of an example of an update memo interface provided in an embodiment of the present application;
[0021] Fig. 9 This is the sixth flowchart of the interface display method provided in the embodiment of the present application;
[0022] Fig.10 This is a schematic diagram of an example of an interface for updating contact details provided in an embodiment of the present application;
[0023] Fig.11 This is the seventh flowchart of the interface display method provided in the embodiment of the present application;
[0024] Fig.12 This is the eighth flow chart of the interface display method provided in the embodiment of the present application;
[0025] Fig.13 This is the second example schematic diagram of updating the chat interface provided in the embodiment of the present application;
[0026] Fig.14 is a schematic diagram of an interface display device provided in an embodiment of the present application;
[0027] Fig.15 is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application;
[0028] Fig.16 It is a schematic diagram of the hardware structure of the electronic device provided in the embodiment of the present application. DETAILED DESCRIPTION
[0029] The following will be combined with the drawings in the embodiments of the present application to clearly describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all the embodiments. All other embodiments obtained by ordinary technicians in this field based on the embodiments in the present application belong to the scope of protection of this application.
[0030] The terms "first", "second", etc. in the specification and claims of the present application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the terms used in this way are interchangeable where appropriate, so that the embodiments of the present application can be implemented in an order other than those illustrated or described herein, and the objects distinguished by "first", "second", etc. are generally of one type, and the number of objects is not limited. For example, the first object can be one or more. In addition, "and / or" in the specification and claims represents at least one of the connected objects, and the character " / " generally indicates that the objects associated with each other are in an "or" relationship.
[0031] The terms "at least one (item)", "at least one of" and the like in this application refer to any one, any two or a combination of more than two of the objects included therein. For example, at least one (item) of a, b, and c can be represented by: "a", "b", "c", "a and b", "a and c", "b and c" and "a, b and c", where a, b, and c can be single or multiple. Similarly, "at least two (items)" refers to two or more, and its meaning is similar to that of "at least one (item)".
[0032] The interface display method provided in the embodiment of the present application is described in detail below through specific embodiments and their application scenarios in conjunction with the accompanying drawings.
[0033] The embodiments of the present application can be applied to scenarios where users need to update and display interface information. For example, a user needs to set a real-time captured picture A as the background image of a chat interface, a user needs to update the interface content of a weather details interface in a weather application based on a real-time captured weather video B, a user needs to replace a picture D in a memo interface with a real-time captured picture C, a user needs to add an information tag F to indicate the address supplementary information of a contact E in the address book details interface, and a user needs to adjust the font size of a chat interface based on the character feature information in a real-time detected picture G.
[0034] The following is an illustrative description of the interface display method provided in the embodiments of the present application using some specific scenarios as examples.
[0035] Scenario 1: The user needs to set the real-time captured picture A as the background image of the chat interface.
[0036] The user opens a chat application, and the user's phone displays a chat interface with a friend. The user drags the camera application logo to the chat interface. The phone receives and responds to the first input of the user dragging the camera application logo to the chat interface, and can display a first image and five controls. The first image is a picture A taken by the user in real time through the camera application. The five controls are: update interface background control, update interface control, replace interface content control, interface supplementary description control, and adjust interface display parameter control. The user clicks to select the update interface background control. The phone receives and responds to the second input of the user clicking to select the update interface background control, and updates the chat interface based on picture A.
[0037] Scenario 2: The user needs to update the interface content of the weather details interface corresponding to the current area in the weather application based on the real-time weather video B.
[0038] The user opens the weather application, and the user's mobile phone displays the weather details interface corresponding to the current area. The interface content of the weather details interface shows that the weather condition in the user's current area is sunny, and displays background dynamic effects and weather data related to sunny days. The user drags the camera application logo to the weather details interface. The mobile phone receives and responds to the user's first input of dragging the camera application logo to the weather details interface, and can display a first image and five controls. The first image is video B recorded in real time by the user through the camera application. Video B can show that the weather condition in the user's current area is light rain. The five controls are: update interface background control, update interface control, replace interface content control, interface supplementary description control, and adjust interface display parameter control. The user clicks to select the update interface control. The mobile phone receives and responds to the user's second input of clicking to select the update interface control, and updates the weather details interface based on video B.
[0039] Scenario 3: The user needs to replace picture D on the memo interface with picture C taken in real time.
[0040] The user opens the memo application, and the user's mobile phone displays a memo interface in the memo application. The interface content of the memo interface includes picture D. The user drags the camera application logo to the memo interface. The mobile phone receives and responds to the user's first input of dragging the camera application logo to the memo interface, and can display a first image and five controls. The first image is a picture C taken by the user in real time through the camera application. The five controls are: update interface background control, update interface control, replace interface content control, interface supplementary description control, and adjust interface display parameter control. The user clicks to select the replacement interface content control. The mobile phone receives and responds to the user's second input of clicking to select the replacement interface content control, and updates the memo interface based on picture C.
[0041] Scenario 4: The user needs to add an information tag F to indicate the supplementary address information of contact E in the address book details interface.
[0042] The user opens the address book application, and the user's mobile phone displays the address book details interface of contact E. The interface content of the address book details interface includes a text description of the contact E's name, phone number and address. The user drags the camera application logo to the address book details interface. The mobile phone receives and responds to the user's first input of dragging the camera application logo to the address book details interface, and can display a first image and five controls. The first image is an image obtained by the user through the camera application for indicating supplementary description information of the interface content of the address book details interface. The five controls are: update interface background control, update interface control, replace interface content control, interface supplementary description control, and adjust interface display parameter control. The user clicks to select the interface supplementary description control. The mobile phone receives and responds to the user's second input of clicking to select the interface supplementary description control, and updates the address book details interface based on the image for indicating the supplementary description information.
[0043] Scenario 5: User needs to adjust the font size of the chat interface based on the character feature information in the real-time detected image G.
[0044] The user opens a chat application, and the user's phone displays a chat interface with a friend. The current font size of the interface content of the chat interface is 26 pixels. The user drags the camera application logo to the chat interface. The phone receives and responds to the first input of the user dragging the camera application logo to the chat interface, and can display a first image and five controls. The first image is a picture G detected by the user in real time through the camera application. The picture G contains an elderly person over 65 years old wearing reading glasses. The five controls are: update interface background control, update interface control, replace interface content control, interface supplementary description control, and adjust interface display parameter control. The user clicks to select the adjust interface display parameter control. The phone receives and responds to the second input of the user clicking to select the adjust interface display parameter control, and updates the chat interface based on the picture G.
[0045] It should be noted that the above-mentioned scenarios 1 to 5 are only illustrative examples of some scenarios in which the embodiments of the present application may be applied. In actual implementation, the embodiments of the present application can also be applied to more scenarios that require updating and displaying interface information in any possible way, and the embodiments of the present application are not limited here.
[0046] Based on the above scenario applied by the embodiment of the present application, the interface display method provided by the embodiment of the present application, when displaying the first interface, receives a first input of a first application identifier, and in response to the first input, displays a first image and at least one control, the first image is an image obtained based on the application corresponding to the first application identifier, receives a second input of a first control in the at least one control, and in response to the second input, updates the first interface based on the first image. In this scheme, since when displaying the first interface, the user can directly select the first application identifier in the first interface to trigger the electronic device to display the first image obtained based on the application corresponding to the first application identifier, and the control corresponding to the interface update mode selected by the user in the first interface, then the user can trigger the electronic device to update the first interface based on the first image by selecting the required first control, so as to realize the automatic combination of the first image corresponding to the first application identifier and the first interface according to the user's demand for interface update, and update the first interface accordingly, so that the displayed interface content meets the user's display demand for the interface in this way, and the user does not need to manually perform complex editing operations, so as to improve the flexibility and efficiency of the electronic device in displaying interface information.
[0047] The execution subject of the interface display method provided in the embodiment of the present application may be an interface display device, which may be an electronic device, or a functional module or functional entity in an electronic device. The technical solution provided in the embodiment of the present application is described below using an electronic device as an example.
[0048] Figure 1 FIG. 1 is a flow chart of an interface display method provided by an embodiment of the present application. Figure 1 As shown, the interface display method provided in the embodiment of the present application may include the following steps 201 to 204.
[0049] Step 201: When displaying a first interface, the electronic device receives a first input of a first application identifier.
[0050] In the embodiment of the present application, the first interface may be any interactive interface, such as a desktop interface or an application interface.
[0051] Exemplarily, the first interface may be a desktop interface, which includes interface information that allows updating, such as information in a component in the desktop, such as a weather component, which may include temperature, weather condition information, and the like.
[0052] As another example, the first interface may be an application interface, such as a chat application interface, a weather application interface, a memo application interface, an address book application interface, a browser application interface, or a camera application interface.
[0053] In an embodiment of the present application, the above-mentioned first application identifier can be the identifier of any application, for example: the identifier of a camera application, the identifier of a chat application, the identifier of a weather application, the identifier of a memo application, or the identifier of an address book application, etc.
[0054] Optionally, in the embodiment of the present application, when the first interface is a desktop interface or an application interface other than the camera application interface, the first application identifier may be the identifier of the camera application. When the first interface is the interface of the camera application, the first application identifier may be the identifier of the application other than the camera application.
[0055] It should be noted that the above identification may include at least one of an application name and an application icon.
[0056] In an embodiment of the present application, the first input is used to trigger the electronic device to display a first image and at least one control.
[0057] Optionally, in the embodiment of the present application, the first input may include but is not limited to any of the following: a user touch-inputs the first application identifier through a touch device such as a finger or a stylus, or a voice command input by the user, or a specific gesture input by the user, or other feasible input. The specific input may be determined according to actual use requirements and is not limited in the embodiment of the present application.
[0058] Optionally, in the embodiment of the present application, the touch input may be a single-click input, a double-click input, a drag input, or any number of click inputs, or may be a long-press input or a short-press input.
[0059] Optionally, in an embodiment of the present application, the above-mentioned specific gesture can be any one of a single-click gesture, a sliding gesture, a drag gesture, a pressure recognition gesture, a long press gesture, an area change gesture, a double-press gesture, and a double-click gesture.
[0060] Optionally, in an embodiment of the present application, the first input may specifically be an input in which the user drags the first application identifier to the first interface.
[0061] Exemplarily, in the case where the first interface is a desktop interface, the first input may be an input in which the user drags the first application identifier to a component on the desktop.
[0062] As another example, in the case where the first interface is an application interface, the first input may be an input in which the user slides on a sidebar of the screen and drags the first application logo displayed in the sidebar to the application interface.
[0063] Step 202: The electronic device displays a first image and at least one control in response to a first input.
[0064] In the embodiment of the present application, the first image is an image acquired based on the application corresponding to the first application identifier.
[0065] It should be noted that the first image may be in the form of a picture or a video.
[0066] Exemplarily, the first application identifier may be an identifier of a camera application, and the first image may be an image acquired based on the camera application. The first image may be a picture taken by the camera in real time or a video recorded by the camera in real time.
[0067] As another example, the first application identifier may be an identifier of a chat application, and the first image may be an image obtained based on the chat application. The first image may be a screenshot of a chat interface, and the chat interface includes at least one of image content and text content.
[0068] In the embodiment of the present application, each of the at least one control corresponds to an interface update method.
[0069] Optionally, in the embodiment of the present application, the at least one control mentioned above may be a default control of the electronic device or a control preset by the user.
[0070] In the embodiment of the present application, the above-mentioned control is used to indicate the method of updating the above-mentioned first interface based on the above-mentioned first image.
[0071] Optionally, in the embodiment of the present application, the above controls may include but are not limited to at least one of the following: update interface background control, update interface control, replace interface content control, interface supplementary description control, and adjust interface display parameter control. The specific control can be determined according to actual use requirements, and the embodiment of the present application does not limit this.
[0072] Exemplarily, the control may be an interface background update control, and the update interface background control may indicate that the method for updating the first interface may be: setting the first image as the background image of the first interface.
[0073] Exemplarily, the control may be an update interface control, and the update interface control may indicate that the method for updating the first interface is: updating the background image of the first interface based on the content description information of the first image or updating the interface content of the first interface.
[0074] Exemplarily, the control may be a replacement interface content control, and the replacement interface content control may indicate that the method for updating the first interface may be: using part or all of the content in the first image to replace the interface content of the first interface.
[0075] Exemplarily, the control may be an interface supplementary description control, and the interface supplementary description control may indicate that a method of updating the first interface may be: based on the first image, adding supplementary description information to the interface content of the first interface.
[0076] Exemplarily, the control may be an interface display parameter adjustment control, which may indicate that the method for updating the first interface is: adjusting display parameters of the interface content of the first interface based on content feature information in the first image.
[0077] Optionally, in the embodiment of the present application, the display position of the first image and at least one control can be any position in the first interface (for example, the top area or the bottom area of the first interface). The specific position can be determined according to actual use requirements, and the embodiment of the present application does not limit this.
[0078] Step 203: The electronic device receives a second input to a first control among at least one control.
[0079] In the embodiment of the present application, the above-mentioned first control can be any control selected and determined by the user from the above-mentioned at least one control.
[0080] In the embodiment of the present application, the second input is used to trigger the electronic device to update the first interface.
[0081] Optionally, in the embodiment of the present application, the second input may include but is not limited to any of the following: a user touches the first control through a touch device such as a finger or a stylus, or a voice command input by the user, or a specific gesture input by the user, or other feasible input. The specific input may be determined according to actual use requirements and is not limited in the embodiment of the present application.
[0082] Step 204: The electronic device updates the first interface based on the first image in response to the second input.
[0083] In the embodiment of the present application, the updating of the first interface may include at least one of updating the interface content of the first interface, updating the background image of the first interface, and updating the interface display parameters of the first interface. The interface display parameters refer to the display parameters of the interface content.
[0084] Exemplarily, taking the case where the first control is an update interface background control, the first image is a picture taken in real time based on a camera application, and the first interface is a chat interface, the electronic device sets the picture of the first image as the background image of the chat interface in response to the user's touch input to the update interface background control.
[0085] Exemplarily, taking the case where the first control is an update interface control, the first image is a video screen shot in real time based on a camera application, and the first interface is a weather details interface, the electronic device responds to the user's touch input to the update interface control, and updates the background image and interface content of the weather details interface based on the weather data information of the first image.
[0086] Exemplarily, taking the case where the first control is a replacement interface content control, the first image is a picture taken in real time based on a camera application, and the first interface is a memo interface, the electronic device responds to the user's touch input to the replacement interface content control and replaces the interface content of the memo interface with the picture of the first image.
[0087] Exemplarily, taking the case where the first control is an interface supplementary description control, the first image is a picture taken in real time based on a camera application, and the first interface is an address book details interface, the electronic device responds to the user's touch input to the interface supplementary description control by adding the picture of the first image to the interface content of the address book details interface for supplementing the interface content.
[0088] Exemplarily, taking the case where the first control is an interface display parameter adjustment control, the first image is a character picture detected in real time based on a camera application, and the first interface is a chat interface, the electronic device adjusts the font size of the interface content of the chat interface based on the character features included in the first image in response to the user's touch input to the interface display parameter adjustment control.
[0089] An embodiment of the present application provides an interface display method. When displaying a first interface, a user can directly select a first application identifier in the first interface to trigger the electronic device to display in the first interface a first image obtained based on an application corresponding to the first application identifier, and a control corresponding to an interface update method selected by the user. The user can then select the required first control to trigger the electronic device to update the first interface based on the first image. This automatically combines the first image corresponding to the first application identifier with the first interface according to the user's demand for interface update, and updates the first interface accordingly. In this way, the displayed interface content meets the user's demand for interface display. In addition, the user does not need to manually perform complex editing operations, thereby improving the flexibility and efficiency of the electronic device in displaying interface information.
[0090] Optionally, in the embodiment of the present application, the first control may be an update interface background control. Figure 1 ,like Figure 2 As shown, the above step 204 can be specifically implemented through the following step 204a.
[0091] Step 204a: The electronic device sets the first image as the background image of the first interface in response to the second input.
[0092] In an embodiment of the present application, when the above-mentioned first control is an update interface background control, the electronic device can set the above-mentioned first image as the background image of the above-mentioned first interface in response to the user's second input to the update interface background control to update the first interface, so as to realize the update of the first interface.
[0093] For example, taking the electronic device as a mobile phone, assuming that the first interface is a chat interface, the first application identifier is an identifier of a camera application, the first image is a picture taken in real time based on the camera application, and the first control is an update interface background control, such as Figure 3 As shown, the mobile phone displays a chat interface 30, a camera application logo 31, a picture 32 corresponding to the first image, an update interface background control 33, an update interface control 34, a replacement interface content control 35, an interface supplementary description control 36, and an adjustment interface display parameter control 37. The mobile phone responds to the user's touch input to the update interface background control 33, and sets the picture 32 corresponding to the first image as the background image of the chat interface 30.
[0094] In an embodiment of the present application, a user can make a second input to the update interface background control. The electronic device responds to the second input and automatically sets the first image as the background image of the first interface based on the first image. The user does not need to perform complex manual editing operations, thereby reducing the user's operation steps and time cost for triggering the setting of the interface background image, thereby improving the flexibility and efficiency of the electronic device for interface display and updating.
[0095] Optionally, in the embodiment of the present application, the first control may be an update interface control. Figure 1 ,like Figure 4 As shown, the above step 204 can be specifically implemented through the following steps 204b1 and 204b2.
[0096] Step 204b1: The electronic device generates a second image in response to the second input based on the content description information of the first image, and sets the second image as the background image of the first interface.
[0097] In an embodiment of the present application, when the above-mentioned first control is an update interface control, the electronic device can first analyze the content description information of the above-mentioned first image in response to the user's second input to the update interface control, and then generate a second image based on the content description information, and set the second image as the background image of the first interface to achieve the update of the first interface.
[0098] It is understandable that the content description information of the first image refers to the semantic information of the first image, that is, the meaning, significance or explanation contained in the first image, which goes beyond the underlying features of the image itself such as pixels and colors, and involves higher-level information such as objects, scenes, events in the image, and the relationship and context between them. For example: weather data information, traffic data information, road obstacle information, etc.
[0099] Optionally, in an embodiment of the present application, the electronic device may use image recognition technology and semantic analysis technology to obtain content description information of the first image.
[0100] It should be noted that the specific implementation method of using image recognition technology and semantic analysis technology to obtain the content description information of the first image can refer to the description of related technologies, and the embodiments of the present application will not elaborate on this.
[0101] Optionally, in the embodiment of the present application, the electronic device may use the text image technology to first extract key information from the content description information of the first image, and then generate the corresponding second image based on the key information. It should be noted that the text image technology refers to the technology of generating a corresponding image from a text description. The specific implementation method of generating the second image using the text image technology can refer to the description of the relevant technology, and the embodiment of the present application will not be described in detail.
[0102] Optionally, in an embodiment of the present application, the electronic device may analyze the interface content of the first interface, and then extract key information related to the interface content of the first interface from the content description information of the first image, and then generate the second image based on the key information. For example, the first interface is a weather details interface, and the weather details interface shows that the weather condition in the user's current area is sunny, and the first image is a video screen taken by the user in real time. The electronic device analyzes the content description information of the first image and finds that the weather condition in the user's current area is rainy. Based on the key information that the actual weather condition is rainy, the second image containing raindrops is generated.
[0103] For example, taking the electronic device as a mobile phone, assuming that the first interface is a weather details interface, the first application identifier is an identifier of a camera application, the first image is a video screen recorded in real time based on the camera application, and the first control is an update interface control, such as Figure 5As shown, the mobile phone displays a weather details interface 40, a camera application logo 31, a picture 42 corresponding to the first image (here a frame of the video screen is used to represent the video), an update interface background control 33, an update interface control 34, a replacement interface content control 35, an interface supplementary description control 36, and an adjustment interface display parameter control 37. The weather details interface 40 displays that the weather condition in the user's current area is sunny. The mobile phone analyzes and obtains the content description information of the picture 42 corresponding to the first image that the weather condition in the user's current area is rainy. In response to the user's touch input to the update interface control 34, the mobile phone generates a second image 43 related to a rainy background based on the content description information that the weather condition in the user's current area is rainy, and sets the second image 43 as the background image of the weather details interface 40, that is, updates the sunny background effect in the weather details interface 40 to a rainy background effect.
[0104] It should be noted that in an embodiment of the present application, the electronic device can also analyze the density of rain, raindrop size and raindrop speed based on the first image, that is, the rainy day video taken in real time by the camera application, and update the background image of the weather details interface accordingly.
[0105] Step 204b2: The electronic device updates the interface content of the first interface based on the content description information of the first image.
[0106] In the embodiment of the present application, in addition to updating the background image of the first interface, the electronic device also updates the interface content of the first interface, such as data information, based on the content description information of the first image.
[0107] For example, Figure 5 As shown, the mobile phone responds to the user's touch input on the update interface control 34, obtains the latest weather data based on the content description information that the weather condition in the user's current area is rainy, and accordingly updates the sunny data in the weather details interface 40 to rainy data.
[0108] In an embodiment of the present application, a user can make a second input to the update interface control. In response to the second input, the electronic device automatically updates the background image of the first interface to an image consistent with the content description information of the first image based on the first image, and updates the interface data information of the first interface accordingly. This eliminates the need for the user to manually perform complex editing operations, thereby reducing the number of operational steps and time cost for the user to trigger the update of the interface background image and data information, thereby improving the flexibility and efficiency of the electronic device for interface display and updating.
[0109] Optionally, in the embodiment of the present application, the first control is a replacement interface content control. Figure 1 ,like Figure 6As shown, the above step 204 can be specifically implemented through the following step 204c.
[0110] Step 204c: In response to the second input, the electronic device replaces the interface content of the first interface with part or all of the content in the first image.
[0111] Optionally, in an embodiment of the present application, the above-mentioned partial content may be content customized by the user.
[0112] In an embodiment of the present application, when the above-mentioned first control is a replacement interface content control, the electronic device responds to the user's second input to the replacement interface content control and uses part or all of the content in the first image to replace the interface content of the first interface to update the first interface.
[0113] Optionally, in an embodiment of the present application, the electronic device can receive and respond to the user's circle input or smear input on a partial area in the first image to determine the partial content customized by the user, so that the subsequent electronic device can replace the interface content of the first interface with the partial content corresponding to the partial area.
[0114] In the embodiment of the present application, the above-mentioned use of part or all of the content in the first image to replace the interface content of the first interface can be understood as using part or all of the content in the first image to cover the interface content of the first interface, and the part or all of the content becomes a part of the content in the first interface.
[0115] It should be noted that the specific implementation method of the electronic device using part or all of the content in the first image to replace the interface content of the first interface can be found in the specific description of the following embodiments, and the embodiments of this application will not be repeated here.
[0116] In an embodiment of the present application, a user can make a second input to the replacement interface content control, and the electronic device responds to the second input and automatically replaces part or all of the interface content of the first interface with part or all of the content in the first image based on the first image. This eliminates the need for the user to manually perform complex editing operations, thereby reducing the number of operational steps and time cost for the user to trigger the replacement of part or all of the interface content, thereby improving the flexibility and efficiency of the electronic device for interface display and updating.
[0117] Optionally, in the embodiment of the present application, combined with Figure 6 ,like Figure 7 As shown, the above step 204c can be specifically implemented through the following steps 204c1 to 204c3.
[0118] Step 204c1: The electronic device displays a content selection control in the first image in response to the second input.
[0119] In the embodiment of the present application, the above-mentioned content selection control is used to indicate the selection of part or all of the content in the above-mentioned first image.
[0120] Step 204c2: The electronic device receives a third input to the content selection control.
[0121] In the embodiment of the present application, the third input is an input of selecting part of the content or all of the content and dragging it to the first area of the first interface.
[0122] In the embodiment of the present application, the above-mentioned first area is a partial area or the entire area in the first interface, and the interface content in the partial area or the entire area is the interface content in the first interface that is replaced by the user's needs.
[0123] Step 204c3: In response to the third input, the electronic device replaces the interface content of the first area with part or all of the content.
[0124] For example, taking the electronic device as a mobile phone, assuming that the first interface is a memo interface, the first application identifier is an identifier of a camera application, the first image is a picture taken in real time by the camera application, and the first control is a replacement interface content control, such as Figure 8 As shown, the mobile phone displays a memo interface 50, a camera application logo 31, a picture 52 corresponding to the first image, an update interface background control 33, an update interface control 34, a replacement interface content control 35, an interface supplementary description control 36, and an adjustment interface display parameter control 37. The memo interface 50 includes a picture 53, and the picture 53 includes an area A54, an area B55, and an area C56. The mobile phone receives a second input from the user to replace the interface content control 35, and displays a content selection control (not shown in the figure) in the picture 52 corresponding to the first image. The user selects all the contents of the picture 52 and drags the entire picture 52 to the area B55 in the memo interface 50. The mobile phone receives and responds to the user's selection and dragging input, and uses the picture 52 corresponding to the first image to replace the interface content of the area B55.
[0125] For example, in combination Figure 8 After the mobile phone uses the picture 52 in the first image to replace the interface content of area B55, since the current interface content of area B55 (i.e., picture 52) is the replaced content, the user can input the picture 52, such as double-clicking to input, and the mobile phone can respond to the input, open the camera application to re-shoot, and use the re-shot image to replace the picture 52.
[0126] Exemplarily, taking the case where the first interface is a camera shooting interface, the first application identifier is an identifier of a chat application, the first image is a picture obtained based on the chat application, and the first control is a replacement interface content control, the electronic device receives and responds to the user's second input for the replacement interface content control, displays a content selection control in the first image, the user selects partial content or all of the content of the first image, and drags it to the camera shooting interface, the electronic device receives and responds to the selection and drag input, and can automatically lock the camera shooting screen on the target screen related to the partial content or all of the content, i.e., updates the camera shooting interface.
[0127] For example, the first interface is a camera recording interface, the first application identifier is an identifier of a chat application, the first image is a video screen obtained based on the chat application, and the first control is a replacement interface content control. The video screen corresponding to the first image is in a playback state, and the electronic device receives the user's second input for the replacement interface content control, displays a content selection control in the first image, and the user selects a partial element or all elements of the video screen in the first image and drags it to the camera recording interface. The electronic device responds to the selection and drag input and adds a partial element or all elements of the video screen in the camera recording interface. In this way, the recorded video obtained after the camera recording ends includes a partial element or all elements of the dynamically played video screen corresponding to the first image. Conversely, the user can also drag the elements in the camera recording interface to the video screen corresponding to the first image, so that the electronic device uses the video elements recorded in real time by the camera recording interface to replace the elements in the video screen in the first image, and finally the video recorded in real time by the camera recording interface will also be saved in the video screen corresponding to the first image.
[0128] It should be noted that in the process of replacing the video elements recorded in real time on the camera recording interface with partial elements or all elements of the video screen corresponding to the first image, the electronic device first parses the video file code stream corresponding to the first image, locks the data of the partial elements or all elements from the video file code stream, and then the electronic device passes this part of the data to the camera application through the underlying data channel, and the electronic device renders this part of the data into the camera recording interface through the camera application.
[0129] In an embodiment of the present application, a user can make a second input to replace the interface content control, and the electronic device responds to the second input by displaying a content selection control in the first image. The user then selects part or all of the content in the first image and drags it to the first area in the first interface. The electronic device responds to the selection and drag input and automatically replaces the interface content of the first area that the user needs to replace with part or all of the content in the first image. The user does not need to perform complex manual editing operations, thereby reducing the operation steps and time cost of the user triggering the replacement of part or all of the interface content, thereby improving the flexibility and efficiency of the electronic device for interface display and updating.
[0130] Optionally, in the embodiment of the present application, the first control is an interface supplementary description control. Figure 1 ,like Fig. 9 As shown, the above step 204 can be specifically implemented through the following steps 204d1 to 204d3.
[0131] Step 204d1: The electronic device updates the first image into an information tag in response to the second input.
[0132] In the embodiment of the present application, the above-mentioned information label can be in the form of an icon, a logo or a text.
[0133] In the embodiment of the present application, the above-mentioned updating of the first image to an information tag can be understood as displaying the first image in the form of an information tag, and the first image and the information tag have the same meaning. In this way, the first interface is more concise and clear, and the readability of the first interface is enhanced.
[0134] Step 204d2: The electronic device receives a fourth input.
[0135] In the embodiment of the present application, the fourth input is an input of dragging the information tag to the second area in the first interface.
[0136] In the embodiment of the present application, the second area is the area in the first interface where the interface content requiring additional explanation by the user is located.
[0137] Step 204d3: In response to the fourth input, the electronic device displays the information tag in the second area and associates the interface content of the second area with the information tag.
[0138] In the embodiment of the present application, the above-mentioned information label is used to indicate the supplementary description information of the interface content of the second area.
[0139] For example, taking the electronic device as a mobile phone, assuming that the first interface is the contact details interface, the first application identifier is the identifier of the camera application, the first image is a picture obtained based on the camera application, and the first control is an interface supplementary description control, such as Fig.10 As shown, the mobile phone displays an address book details interface 60, a camera application logo 31, a picture 62 corresponding to the first image, an update interface background control 33, an update interface control 34, a replacement interface content control 35, an interface supplementary description control 36, and an adjustment interface display parameter control 37. The address book details interface 60 is the address book details interface corresponding to the contact E. The address book details interface 60 includes a name area 63, a phone number area 64, and an address area 65. The address area 65 displays that the address of the contact E is a community A. The picture 62 corresponding to the first image is an appearance picture of the community A. The mobile phone receives a second input from the user to the interface supplementary description control 36, updates the picture 62 to an information label 66, and the user drags the information label 66 to the address area 65 in the address book details interface 60. The mobile phone receives and responds to the drag input, displays the information label 66 in the address area 65, and associates the address area 65 with the information label 66.
[0140] For example, in combination Fig.10 The user inputs the image identifier 66, such as a touch input, and the mobile phone can redisplay the image 62 in response to the touch input.
[0141] In an embodiment of the present application, a user can make a second input to the interface supplementary description control, and the electronic device receives and responds to the second input to update the first image to an information tag. The user then drags the information tag to the second area in the first interface. The electronic device responds to the dragging input and automatically adds supplementary description information to the interface content of the second area, that is, displays the information tag in the second area and associates the information tag with the interface content of the second area. The information tag is used to indicate detailed information of the supplementary description, without the user having to manually perform complex editing operations, thereby reducing the user's operating steps and time cost to trigger the supplementary description interface content, thereby improving the flexibility and efficiency of the electronic device for interface display and updating.
[0142] Optionally, in the embodiment of the present application, combined with Figure 1 ,like Fig.11 As shown, after the above step 204, the interface display method provided in the embodiment of the present application may further include the following steps 301 and 302.
[0143] Step 301: The electronic device receives a fifth input to a first object and a second object in an updated first interface.
[0144] In the embodiment of the present application, the first object is an object in the first image that is added to the first interface.
[0145] For example, in combination Figure 8, the first object may be a picture 52 in the first image added to the memo interface 50 .
[0146] In the embodiment of the present application, the second object is any other object in the interface content of the first interface except the first object.
[0147] For example, in combination Figure 8 The second object may be the interface content corresponding to the area C56 in the memo interface 50 .
[0148] In the embodiment of the present application, the fifth input is used to trigger the electronic device to adjust the display layout of the first object and the second object in the first interface.
[0149] Optionally, in the embodiment of the present application, the fifth input may include but is not limited to any of the following: a user touches the first object and the second object through a touch device such as a finger or a stylus, or a voice command input by the user, or a specific gesture input by the user, or other feasible input. The specific input may be determined according to actual use requirements and is not limited in the embodiment of the present application.
[0150] Step 302: The electronic device adjusts the display layout of the first object and the second object in the first interface in response to the fifth input.
[0151] Optionally, in the embodiment of the present application, the adjusting the display layout of the first object and the second object in the first interface may include: exchanging display positions of the first object and the second object in the first interface.
[0152] For example, in combination Figure 8 , the mobile phone can exchange the display positions of the interface contents corresponding to the picture 52 and the area C56.
[0153] In an embodiment of the present application, after updating the first interface, the user can continue to select the second object of the first interface and the first image to add to the first object of the first interface, triggering the electronic device to continue updating the first interface by adjusting the display layout of the first object and the second object selected by the user. The user does not need to manually perform complex editing operations, thereby reducing the operation steps and time cost of the user triggering the continuation of interface updates, thereby improving the flexibility and efficiency of the electronic device for interface display and updating.
[0154] Optionally, in an embodiment of the present application, the electronic device can also receive a sixth input for the first object and the second object in the updated first interface, and display a combined information control in response to the sixth input. The electronic device receives a seventh input for the combined information control and can generate a third image containing only the first object and the second object through a screenshot operation.
[0155] Optionally, in the embodiment of the present application, the first control is a control for adjusting interface display parameters. Figure 1 ,like Fig.12 As shown, the above step 204 can be specifically implemented through the following step 204e.
[0156] Step 204e: The electronic device adjusts display parameters of the interface content of the first interface based on the content feature information in the first image in response to the second input.
[0157] In the embodiment of the present application, the above display parameters include at least one of the following: font size, color mode, and theme content.
[0158] In the embodiment of the present application, the content feature information in the above-mentioned first image may include but is not limited to at least one of the following: character feature information and scene feature information.
[0159] Optionally, in an embodiment of the present application, the above-mentioned character feature information may include at least one of the following: character gender, character age, character identity, facial features, character clothing style, etc.
[0160] Optionally, in an embodiment of the present application, the above-mentioned scene feature information may include at least one of the following: ambient light intensity, ambient weather conditions, etc.
[0161] In an embodiment of the present application, when the above-mentioned first control is a control for adjusting interface display parameters, the electronic device responds to the user's second input to the control for adjusting interface display parameters, and adjusts the display parameters of the interface content of the first interface based on the content feature information in the first image to update the first interface.
[0162] Exemplarily, taking the case where the content characteristic information of the first image is character characteristic information, the electronic device can adjust the font size of the interface content of the first interface based on the character characteristic information. For example, if the character characteristic information is an elderly person over 65 years old wearing reading glasses, the electronic device can automatically adjust the font size of the interface content of the first interface from the current 26 pixels to 32 pixels.
[0163] As another example, taking the case where the content characteristic information of the first image is character characteristic information, the electronic device can adjust the theme content of the interface content of the first interface based on the character characteristic information. For example, if the character characteristic information is a student under the age of 18, the electronic device can automatically switch the theme content of the interface content of the first interface to youth mode.
[0164] As another example, taking the content characteristic information of the first image as scene characteristic information, the electronic device can adjust the color mode of the interface content of the first interface based on the scene characteristic information. For example, if the scene characteristic information is that the light in the surrounding environment is weak, the electronic device can automatically reduce the color brightness of the interface content of the first interface.
[0165] For example, taking the electronic device as a mobile phone, assuming that the first interface is a chat interface, the first application identifier is an identifier of a camera application, the first image is a picture detected by the camera application, and the first control is a control for adjusting interface display parameters, such as Fig.13 As shown, the mobile phone displays a chat interface 70, a camera application logo 31, a picture 72 corresponding to the first image, an update interface background control 33, an update interface control 34, a replacement interface content control 35, an interface supplementary description control 36, and an adjustment interface display parameter control 37. The mobile phone analyzes the content feature information of the picture 72 corresponding to the first image and obtains that the user currently operating the mobile phone is an elderly person over 65 years old who wears reading glasses. The mobile phone receives and responds to the user's touch input to the adjustment interface display parameter control 37. Based on the content feature information, the font size of the interface content of the chat interface 70 is automatically adjusted from the current 26 pixels to 32 pixels.
[0166] In an embodiment of the present application, a user can make a second input to the interface display parameter adjustment control. The electronic device responds to the second input, extracts content feature information of the first image based on the first image, and adjusts the display parameters of the interface content of the first interface accordingly according to the content feature information, so that the display effect of the interface content of the first interface is more in line with user needs, thereby enhancing the user experience. The user does not need to manually perform complex setting operations, and the operation steps and time cost of the user triggering the adjustment of the interface display parameters are reduced, thereby improving the flexibility and efficiency of the electronic device for interface display and updating.
[0167] For various scenarios to which the embodiments of the present application can be applied, combined with the various implementation schemes of the embodiments of the present application described above, specific examples are given below to illustrate the implementation process in various scenarios of the embodiments of the present application:
[0168] Example 1. In the above scenario 1: the user opens a chat application, and the user's mobile phone displays a chat interface with a friend. The chat interface currently has no background image. The user drags the camera application logo to the chat interface. The mobile phone receives and responds to the first input of the user dragging the camera application logo to the chat interface, and can display a first image and five controls. The first image is a picture A taken by the user in real time through the camera application. The five controls are: update interface background control, update interface control, replace interface content control, interface supplementary description control, and adjust interface display parameter control. The user clicks to select the update interface background control. The mobile phone receives and responds to the second input of the user clicking to select the update interface background control, and sets picture A as the background image of the chat interface to update the chat interface.
[0169] Example 2, in the above scenario 2: the user opens the weather application, and the user's mobile phone displays the weather details interface corresponding to the current area. The interface content of the weather details interface shows that the weather condition in the user's current area is sunny, and displays the background dynamic effects and weather data related to sunny days. The user drags the camera application logo to the weather details interface. The mobile phone receives and responds to the first input of the user dragging the camera application logo to the weather details interface, and can display a first image and five controls. The first image is a video B recorded in real time by the user through the camera application. Video B can show that the weather condition in the user's current area is light rain. The five controls are: Update interface background controls, update interface controls, replace interface content controls, interface supplementary description controls, adjust interface display parameter controls, the user clicks to select the update interface control, the mobile phone receives and responds to the second input of the user clicking to select the update interface control, the mobile phone extracts the content description information of video B, for example, the current weather condition is light rain, raindrop size and raindrop speed, based on the content description information, generates a second image related to light rain, and updates the background image in the weather details interface to the second image, that is, the background dynamic effect related to light rain, and can also display the raindrop size, and update the weather data to the latest rainy weather data to realize the update of the weather details interface.
[0170] Example 3. In the above scenario 3: the user opens the memo application, and the user's mobile phone displays a memo interface in the memo application. The interface content of the memo interface includes picture D. The user drags the camera application logo to the memo interface. The mobile phone receives and responds to the first input of the user dragging the camera application logo to the memo interface, and can display a first image and five controls. The first image is picture C taken by the user in real time through the camera application. The five controls are: update interface background control, update interface control, replace interface content control, interface supplementary description control, and adjust interface display parameter control. The user clicks to select the replacement interface content control. The mobile phone receives and responds to the second input of the user clicking to select the replacement interface content control, and displays a content selection control in picture C corresponding to the first image. The user can use the content selection control to select all the contents of picture C and drag all picture C to the area where picture D is located in the memo interface. The mobile phone receives and responds to the selection and drag input, uses picture C to replace picture D in the memo interface, so as to update the memo interface. In addition, after updating the memo interface, the user can also adjust the display position of picture C and other objects in the memo interface. The user can also double-click picture C again to trigger the phone to open the camera application to retake the picture to replace picture C.
[0171] Example 4. In the above scenario 4: the user opens the address book application, and the user's mobile phone displays the address book details interface of contact E. The interface content of the address book details interface includes the name, telephone number and address text description of contact E. The user drags the camera application logo to the address book details interface. The mobile phone receives and responds to the user's first input of dragging the camera application logo to the address book details interface, and can display a first image and five controls. The first image is a picture obtained by the user through the camera application for indicating the supplementary description information of the address. The five controls are: update interface background control, update interface control, replace interface content control, interface supplementary description control, and adjust interface display parameter control. The user clicks to select the interface supplementary description control. The mobile phone receives and responds to the user's second input of clicking to select the interface supplementary description control, and updates the picture corresponding to the first image to an information tag F. The user then drags the information tag F to the area corresponding to the address text description in the address book details interface. The mobile phone receives and responds to the dragging input, displays the information tag F in the area corresponding to the address text description, and associates the address text description content with the information tag F to implement the update of the address book details interface.
[0172] Example 5. In the above scenario 5: the user opens a chat application, and the user's mobile phone displays a chat interface with a friend. The current font size of the interface content of the chat interface is 26 pixels. The user drags the camera application logo to the chat interface. The mobile phone receives and responds to the first input of the user dragging the camera application logo to the chat interface, and can display a first image and five controls. The first image includes a picture G detected by the user in real time through the camera application. The picture G contains an old man over 65 years old who wears reading glasses. The five controls are: update interface background control, update interface control, replace interface content control, interface supplementary description control, and adjust interface display parameter control. The user clicks to select the adjust interface display parameter control. The mobile phone receives and responds to the second input of the user clicking to select the adjust interface display parameter control, and analyzes the content feature information of the picture G as follows: the user currently operating the mobile phone is an old man over 65 years old who wears reading glasses, and the font size of the interface content of the chat interface is adjusted to 32 pixels to update the chat interface.
[0173] Each of the above-mentioned method embodiments, or various possible implementation methods in each method embodiment can be executed separately, or any two or more of them can be executed in combination with each other. The specific implementation method can be determined according to actual usage requirements, and the embodiments of the present application are not limited to this.
[0174] The interface display method provided in the embodiment of the present application can be executed by an interface display device. In the embodiment of the present application, the interface display device provided in the embodiment of the present application is described by taking the interface display method executed by the interface display device as an example.
[0175] Fig.14 A possible structural diagram of an interface display device involved in some embodiments of the present application is shown. Fig.14 As shown, the interface display device 20 may include: a receiving module 21, a display module 22 and a processing module 23. The receiving module 21 is used to receive a first input to a first application identifier while displaying the first interface. The display module 22 is used to display a first image and at least one control in response to the first input received by the receiving module 21, wherein the first image is an image obtained based on the application corresponding to the first application identifier. The receiving module 21 is also used to receive a second input to a first control among at least one control displayed by the display module 22. The processing module 23 is used to update the first interface based on the first image displayed by the display module 22 in response to the second input received by the receiving module 21.
[0176] In a possible implementation, the first control is an update interface background control, and the processing module 23 is specifically configured to set the first image as the background image of the first interface.
[0177] In a possible implementation, the first control is an update interface control, and the processing module 23 is specifically used to generate a second image based on the content description information of the first image, and set the second image as the background image of the first interface; and, based on the content description information of the first image, update the interface content of the first interface.
[0178] In a possible implementation, the first control is a control for replacing interface content, and the processing module 23 is specifically configured to replace the interface content of the first interface with a portion or all of the content in the first image.
[0179] In a possible implementation, the display module 22 is further used to display a content selection control in the first image before the processing module 23 uses part or all of the content in the first image to replace the interface content of the first interface. The receiving module 21 is further used to receive a third input to the content selection control displayed by the display module 22, the third input being an input for selecting part or all of the content and dragging it to the first area of the first interface. The processing module 23 is specifically used to replace the interface content of the first area with the part or all of the content in response to the third input received by the receiving module 21.
[0180] In a possible implementation, the first control is an interface supplementary description control, and the processing module 23 is further used to update the first image to an information label before updating the first interface based on the first image. The receiving module 21 is also used to receive a fourth input, and the fourth input is an input for dragging the information label to the second area in the first interface. The processing module 23 is specifically used to display the information label in the second area in response to the fourth input received by the receiving module 21, and associate the interface content of the second area with the information label, and the information label is used to indicate the supplementary description information of the interface content of the second area.
[0181] In a possible implementation, the receiving module 21 is further used to receive a fifth input of a first object and a second object in the updated first interface after the processing module 23 updates the first interface based on the first image displayed by the display module 22 in response to the second input received by the receiving module 21. The first object is an object added to the first interface in the first image. The processing module 23 is further used to adjust the display layout of the first object and the second object in the first interface in response to the fifth input received by the receiving module 21.
[0182] In a possible implementation, the first control is a control for adjusting interface display parameters, and the processing module 23 is specifically used to adjust the display parameters of the interface content of the first interface based on the content feature information in the first image, and the display parameters include at least one of the following: font size, color mode, and theme content.
[0183] An embodiment of the present application provides an interface display device. When the interface display device displays a first interface, the user can directly select a first application identifier in the first interface to trigger the interface display device to display a first image obtained based on an application corresponding to the first application identifier, and a control corresponding to an interface update method selected by the user in the first interface. The user can then select the required first control to trigger the interface display device to update the first interface based on the first image. This enables the interface display device to automatically combine the first image corresponding to the first application identifier with the first interface and update the first interface accordingly based on the user's demand for interface update. In this way, the displayed interface content meets the user's demand for interface display. In addition, the user does not need to manually perform complex editing operations, thereby improving the flexibility and efficiency of the interface display device in displaying interface information.
[0184] The interface display device in the embodiment of the present application can be an electronic device, or a component in the electronic device, such as an integrated circuit or a chip. The electronic device can be a terminal, or other devices other than a terminal. Exemplarily, the electronic device can be a mobile phone, a tablet computer, a laptop computer, a PDA, a vehicle-mounted electronic device, a mobile Internet device (Mobile Internet Device, MID), an augmented reality (augmented reality, AR) / virtual reality (virtual reality, VR) device, a robot, a wearable device, an ultra-mobile personal computer (ultra-mobile personal computer, UMPC), a netbook or a personal digital assistant (personal digital assistant, PDA), etc., and can also be a server, a network attached storage (Network Attached Storage, NAS), a personal computer (personal computer, PC), a television (television, TV), a teller machine or a self-service machine, etc., which is not specifically limited in the embodiment of the present application.
[0185] The interface display device in the embodiment of the present application may be a device having an operating system. The operating system may be an Android operating system, an iOS operating system, or other possible operating systems, which are not specifically limited in the embodiment of the present application.
[0186] The interface display device provided in the embodiment of the present application can implement each process implemented in the above method embodiment, and will not be described again here to avoid repetition.
[0187] Alternatively, if Fig.15 As shown, an embodiment of the present application also provides an electronic device 1000, including a processor 1001 and a memory 1002, wherein the memory 1002 stores programs or instructions that can be executed on the processor 1001, and when the program or instructions are executed by the processor 1001, the various steps of the above-mentioned interface display method embodiment are implemented, and the same technical effect can be achieved. To avoid repetition, they are not repeated here.
[0188] It should be noted that the electronic devices in the embodiments of the present application include the mobile electronic devices and non-mobile electronic devices mentioned above.
[0189] Fig.16 A schematic diagram of the hardware structure of an electronic device to implement an embodiment of the present application.
[0190] The electronic device 100 includes but is not limited to components such as a radio frequency unit 101, a network module 102, an audio output unit 103, an input unit 104, a sensor 105, a display unit 106, a user input unit 107, an interface unit 108, a memory 109, and a processor 110.
[0191] Those skilled in the art will appreciate that the electronic device 100 may also include a power source (such as a battery) for supplying power to various components, and the power source may be logically connected to the processor 110 through a power management system, thereby implementing functions such as managing charging, discharging, and power consumption management through the power management system. Fig.16 The electronic device structure shown in the figure does not constitute a limitation on the electronic device. The electronic device may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently, which will not be described in detail here.
[0192] The user input unit 107 is used to receive a first input to a first application identifier while displaying the first interface. The display unit 106 is used to display a first image and at least one control in response to the first input, wherein the first image is an image obtained based on the application corresponding to the first application identifier. The user input unit 107 is also used to receive a second input to a first control among the at least one control. The processor 110 is used to update the first interface based on the first image in response to the second input.
[0193] Optionally, the first control is an update interface background control, and the processor 110 is specifically configured to set the first image as a background image of the first interface.
[0194] Optionally, the first control is an update interface control, and the processor 110 is specifically used to generate a second image based on the content description information of the first image, and set the second image as the background image of the first interface; and, based on the content description information of the first image, update the interface content of the first interface.
[0195] Optionally, the first control is a control for replacing interface content, and the processor 110 is specifically configured to replace interface content of the first interface with part or all of the content in the first image.
[0196] Optionally, the display unit 106 is further configured to display a content selection control in the first image before the processor 110 replaces the interface content of the first interface with part or all of the content in the first image. The user input unit 107 is further configured to receive a third input to the content selection control, the third input being an input for selecting part or all of the content and dragging it to the first area in the first interface. The processor 110 is specifically configured to replace the interface content of the first area with the part or all of the content in response to the third input.
[0197] Optionally, the first control is an interface supplementary description control, and the processor 110 is further used to update the first image to an information label before updating the first interface based on the first image. The user input unit 107 is also used to receive a fourth input, which is an input for dragging the information label to the second area in the first interface. The processor 110 is specifically used to display the information label in the second area in response to the fourth input, and associate the interface content of the second area with the information label, and the information label is used to indicate the supplementary description information of the interface content of the second area.
[0198] Optionally, the user input unit 107 is further configured to receive a fifth input of a first object and a second object in the updated first interface after the processor 110 updates the first interface based on the first image in response to the second input, wherein the first object is an object added to the first interface in the first image. The processor 110 is further configured to adjust a display layout of the first object and the second object in the first interface in response to the fifth input.
[0199] Optionally, the first control is a control for adjusting interface display parameters, and the processor 110 is specifically used to adjust the display parameters of the interface content of the first interface based on the content feature information in the first image, and the display parameters include at least one of the following: font size, color mode, and theme content.
[0200] An embodiment of the present application provides an electronic device. When the electronic device displays a first interface, the user can directly select a first application identifier in the first interface to trigger the electronic device to display in the first interface a first image obtained based on an application corresponding to the first application identifier, and a control corresponding to an interface update method selected by the user. The user can then select the required first control to trigger the electronic device to update the first interface based on the first image. This enables the electronic device to automatically combine the first image corresponding to the first application identifier with the first interface and update the first interface accordingly based on the user's demand for interface update. In this way, the displayed interface content meets the user's demand for interface display. In addition, the user does not need to manually perform complex editing operations, thereby improving the flexibility and efficiency of the electronic device in displaying interface information.
[0201] The electronic device provided in the embodiment of the present application can implement each process implemented in the above method embodiment, and can achieve the same technical effect. To avoid repetition, it is not repeated here. The beneficial effects of various implementations in this embodiment can be specifically referred to the beneficial effects of the corresponding implementations in the above method embodiment. To avoid repetition, it is not repeated here.
[0202] It should be understood that in the embodiment of the present application, the input unit 104 may include a graphics processor (Graphics Processing Unit, GPU) 1041 and a microphone 1042, and the graphics processor 1041 processes the image data of a static picture or video obtained by an image capture device (such as a camera) in a video capture mode or an image capture mode. The display unit 106 may include a display panel 1061, and the display panel 1061 may be configured in the form of a liquid crystal display, an organic light emitting diode, etc. The user input unit 107 includes a touch panel 1071 and at least one of other input devices 1072. The touch panel 1071 is also called a touch screen. The touch panel 1071 may include two parts: a touch detection device and a touch controller. Other input devices 1072 may include, but are not limited to, a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which will not be repeated here.
[0203] The memory 109 can be used to store software programs and various data. The memory 109 may mainly include a first storage area for storing programs or instructions and a second storage area for storing data, wherein the first storage area may store an operating system, an application program or instructions required for at least one function (such as a sound playback function, an image playback function, etc.), etc. In addition, the memory 109 may include a volatile memory or a non-volatile memory, or the memory 109 may include both volatile and non-volatile memories. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), a static random access memory (SRAM), a dynamic random access memory (DRAM), a synchronous dynamic random access memory (SDRAM), a double data rate synchronous dynamic random access memory (DDRSDRAM), an enhanced synchronous dynamic random access memory (ESDRAM), a synchronous link dynamic random access memory (SLDRAM) and a direct memory bus random access memory (DRRAM). The memory 109 in the embodiment of the present application includes but is not limited to these and any other suitable types of memory.
[0204] The processor 110 may include one or more processing units; optionally, the processor 110 integrates an application processor and a modem processor, wherein the application processor mainly processes operations related to an operating system, a user interface, and application programs, and the modem processor mainly processes wireless communication signals, such as a baseband processor. It is understandable that the modem processor may not be integrated into the processor 110.
[0205] An embodiment of the present application also provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, the various processes of the above-mentioned interface display method embodiment are implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.
[0206] The processor is the processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a computer read-only memory ROM, a random access memory RAM, a magnetic disk or an optical disk.
[0207] An embodiment of the present application further provides a chip, which includes a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the various processes of the above-mentioned interface display method embodiment, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.
[0208] It should be understood that the chip mentioned in the embodiments of the present application can also be called a system-level chip, a system chip, a chip system or a system-on-chip chip, etc.
[0209] An embodiment of the present application provides a computer program product, which is stored in a storage medium. The program product is executed by at least one processor to implement the various processes of the above-mentioned interface display method embodiment and can achieve the same technical effect. To avoid repetition, it will not be repeated here.
[0210] It should be noted that, in this article, the terms "comprise", "include" or any other variant thereof are intended to cover non-exclusive inclusion, so that the process, method, article or device including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise one..." do not exclude the presence of other identical elements in the process, method, article or device including the element. In addition, it should be pointed out that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in reverse order according to the functions involved, for example, the described method may be performed in an order different from that described, and various steps may also be added, omitted, or combined. In addition, the features described with reference to certain examples may be combined in other examples.
[0211] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM / RAM, a disk, or an optical disk), and includes a number of instructions for a terminal (which can be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods described in each embodiment of the present application.
[0212] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of the present application, ordinary technicians in this field can also make many forms without departing from the purpose of the present application and the scope of protection of the claims, all of which are within the protection of the present application.
Claims
1. An interface display method, characterized in that: include: In the case of displaying the first interface, receiving a first input of a first application identifier; In response to the first input, display a first image and at least one control, wherein the first image is an image obtained based on an application corresponding to the first application identifier; receiving a second input to a first control of the at least one control; In response to the second input, the first interface is updated based on the first image.
2. The method according to claim 1, characterized in that The first control is an update interface background control, and updating the first interface based on the first image includes: The first image is set as a background image of the first interface.
3. The method according to claim 1, characterized in that The first control is an update interface control, and updating the first interface based on the first image includes: Generate a second image based on the content description information of the first image, and set the second image as the background image of the first interface; Based on the content description information of the first image, the interface content of the first interface is updated.
4. The method according to claim 1, characterized in that: The first control is a replacement interface content control, and updating the first interface based on the first image includes: The interface content of the first interface is replaced with part or all of the content in the first image.
5. The method according to claim 4, characterized in that Before replacing the interface content of the first interface with part or all of the content in the first image, the method further includes: displaying a content selection control in the first image; receiving a third input to the content selection control, wherein the third input is an input for selecting a part of the content or the whole of the content and dragging the content to the first area in the first interface; The replacing the interface content of the first interface with part or all of the content in the first image includes: In response to the third input, the interface content of the first area is replaced by the partial content or the entire content.
6. The method according to claim 1, characterized in that The first control is an interface supplementary description control. Before updating the first interface based on the first image, the method further includes: Updating the first image to an information tag; receiving a fourth input, wherein the fourth input is an input of dragging the information tag to a second area in the first interface; The updating of the first interface based on the first image includes: In response to the fourth input, the information tag is displayed in the second area, and the interface content of the second area and the information tag are associated, and the information tag is used to indicate supplementary description information of the interface content of the second area.
7. The method according to any one of claims 1 to 6, characterized in that After updating the first interface based on the first image in response to the second input, the method further includes: receiving a fifth input of a first object and a second object in the updated first interface, wherein the first object is an object added to the first interface from the first image; In response to the fifth input, a display layout of the first object and the second object in the first interface is adjusted.
8. The method according to claim 1, characterized in that The first control is a control for adjusting interface display parameters, and updating the first interface based on the first image includes: Based on the content feature information in the first image, the display parameters of the interface content of the first interface are adjusted, and the display parameters include at least one of the following: font size, color mode, and theme content.
9. An interface display device, characterized in that: include: Receiving module, display module and processing module; The receiving module is used to receive a first input of a first application identifier when displaying the first interface; The display module is configured to display a first image and at least one control in response to a first input received by the receiving module, wherein the first image is an image obtained based on an application corresponding to the first application identifier; The receiving module is further configured to receive a second input of a first control among at least one control displayed by the display module; The processing module is configured to update the first interface based on the first image displayed by the display module in response to the second input received by the receiving module.
10. The device according to claim 9, characterized in that The first control is an update interface background control, and the processing module is specifically used to set the first image as the background image of the first interface.
11. The device according to claim 9, characterized in that The first control is an update interface control, and the processing module is specifically used to generate a second image based on the content description information of the first image, and set the second image as the background image of the first interface; and update the interface content of the first interface based on the content description information of the first image.
12. The device according to claim 9, characterized in that The first control is a control for replacing interface content, and the processing module is specifically configured to replace the interface content of the first interface with a portion or all of the content in the first image.
13. The device according to claim 12, characterized in that The display module is further configured to display a content selection control in the first image before the processing module replaces the interface content of the first interface with a part of the content or the whole of the content in the first image; The receiving module is further configured to receive a third input to the content selection control displayed by the display module, wherein the third input is an input for selecting the part of the content or the whole of the content and dragging the content to the first area in the first interface; The processing module is specifically configured to replace the interface content of the first area with the partial content or the entire content in response to the third input received by the receiving module.
14. The device according to claim 9, characterized in that The first control is an interface supplementary description control, and the processing module is further used for updating the first image into an information label before updating the first interface based on the first image; The receiving module is further used to receive a fourth input, where the fourth input is an input of dragging the information tag to the second area in the first interface; The processing module is specifically used to display the information tag in the second area in response to the fourth input received by the receiving module, and associate the interface content of the second area with the information tag, wherein the information tag is used to indicate supplementary description information of the interface content of the second area.
15. The device according to any one of claims 9 to 14, characterized in that The receiving module is further configured to receive a fifth input of a first object and a second object in the updated first interface after the processing module updates the first interface based on the first image displayed by the display module in response to the second input received by the receiving module, wherein the first object is an object added to the first interface from the first image; The processing module is further configured to adjust a display layout of the first object and the second object in the first interface in response to a fifth input received by the receiving module.
16. The device according to claim 9, characterized in that The first control is a control for adjusting interface display parameters. The processing module is specifically used to adjust the display parameters of the interface content of the first interface based on the content feature information in the first image. The display parameters include at least one of the following: font size, color mode, and theme content.
17. An electronic device, characterized in that: It comprises a processor and a memory, wherein the memory stores a program or instruction that can be run on the processor, and when the program or instruction is executed by the processor, the steps of the interface display method according to any one of claims 1 to 8 are implemented.
18. A computer-readable storage medium, characterized in that: The readable storage medium stores a program or instruction, and when the program or instruction is executed by a processor, the steps of the interface display method according to any one of claims 1 to 8 are implemented.