Method for starting application and electronic device

Abstract

A method for starting an application, which is applied to a foldable-screen device. The method comprises: in a first state, activating a first display area, and displaying a first interface in the first display area, the first interface being the operation interface of the foldable-screen device in the first state; when the foldable-screen device is unfolded from the first state to a second state, starting a first application; in the second state, activating a second display area, the size of the second display area being larger than that of the first display area; and displaying in the second display area a second interface and an application interface of the first application, the second interface containing display content of the first interface.

Description

Method for calling application and electronic device

[0001] This application claims priority to the Chinese patent application filed with the State Intellectual Property Office of China on September 18, 2023, with application number 2023112048265 and application name “A method and electronic device for invoking an application”, the entire contents of which are incorporated by reference into this application. Technical Field

[0002] The present application relates to the field of computer technology, and in particular to a method for calling an application and an electronic device. Background Art

[0003] In the application scenario of terminal devices, applications are usually launched manually by users, which is a tedious and time-consuming process. Therefore, a method for launching applications is needed to simplify the application launching steps and improve the operating experience of the terminal device.

[0004] Summary of the Invention

[0005] In order to solve the problem of how to simplify the application calling steps and improve the operating experience of the terminal device, the present application provides a method and electronic device for calling an application, and the present application also provides a computer-readable storage medium.

[0006] The embodiments of this application adopt the following technical solutions:

[0007] In a first aspect, the present application provides a method for calling an application, the method being applied to a foldable screen device, wherein the state of the foldable screen device includes at least a first state and a second state; the foldable screen device in the first state enters the second state after experiencing an unfolding event;

[0008] The method comprises:

[0009] In the first state, activating the first display area and using the first display area to display a first interface, where the first interface is the operating interface of the folding screen device in the first state;

[0010] When the foldable screen device is unfolded from the first state to enter the second state, calling up the first application;

[0011] In the second state, a second display area is activated, and a size of the second display area is larger than that of the first display area;

[0012] The second display area is used to display a second interface and an application interface of the first application, wherein the second interface includes the display content of the first interface.

[0013] According to the method of calling up an application in one embodiment of the present application, calling up a new application is triggered by the unfolding operation of the folding screen device, which can call up the application more quickly and improve the application calling efficiency of the folding screen device.

[0014] Because the second interface includes the display content of the first interface, after the foldable screen device enters the second state, the display content of the foldable screen device can achieve the display effect of the foldable screen device in the first state. On this basis, the foldable screen device triggers the call of the first application through the state change, and the new application can be automatically called without affecting the normal operation of the application / system before the state change.

[0015] Furthermore, because the second display area is larger than the first display area, when the foldable screen device transitions from the first state to the second state, the second display area in the second state can display more content than the first display area in the first state. In other words, displaying both the second interface and the first application's running interface in the second display area simultaneously does not result in a lack of display space and does not affect the user's visual experience.

[0016] In an implementation of the first aspect:

[0017] The size of the second interface is consistent with the size of the first interface;

[0018] and / or,

[0019] The display content of the second interface is consistent with the display content of the first interface;

[0020] and / or,

[0021] The display position of the first interface in the first display area does not change compared to the display position of the second interface in the second display area.

[0022] According to the above implementation method, before and after the folding screen device is unfolded, the visual effects of the content displayed in the first interface and the second interface are consistent, thereby avoiding affecting the user's visual experience.

[0023] Moreover, after the foldable screen device is unfolded, the foldable screen device can directly use the display screen rendering of the first interface as the display screen rendering of the second interface. The display screen rendering of the second interface does not require the display interface size adjustment, thereby reducing the processing consumption of the display screen rendering.

[0024] In an implementation of the first aspect, the application interface of the first application is displayed in an increased portion of the second display area, and the increased portion is an activated area increased relative to the first display area.

[0025] According to the above implementation method, after the folding screen device is unfolded, the application interface of the first application is displayed in the second display area, which will not cause a decrease in the display effect of the second interface, thereby avoiding affecting the user's visual experience.

[0026] In an implementation of the first aspect, when the foldable screen device is unfolded from the first state to enter the second state, before calling the first application, the method further includes:

[0027] After detecting an expansion event, it is identified whether the expansion event corresponds to expansion from the first state to the second state.

[0028] In an implementation of the first aspect, the state of the folding screen device further includes at least a third state; the folding screen device in the third state enters the first state after experiencing an unfolding event;

[0029] The method further comprises:

[0030] In the third state, activating the third display area and using the third display area to display a third interface, wherein the size of the third display area is smaller than the first display area, and the third interface is the operating interface of the folding screen device in the third state;

[0031] In the first state, the size of the third interface is expanded to generate the first interface.

[0032] According to the above implementation method, by confirming the state of the folding screen device before and after the expansion event, it is limited that the launch of the first application is triggered by expanding from the first state to the second state, thereby avoiding the expansion event from mistakenly triggering the launch of the first application.

[0033] In an implementation of the first aspect, before invoking the first application, the method further includes:

[0034] Determine whether the current application scenario requires calling the first application.

[0035] According to the above implementation method, when the expansion event triggers the application to be called up, it can be determined whether to call up the first application based on the current actual situation of the folding screen device, so that the calling up of the first application matches the current application scenario of the folding screen device, thereby improving the user experience.

[0036] In an implementation of the first aspect, determining whether the current application scenario requires invoking the first application includes:

[0037] Whether the first application needs to be called up is determined according to the pre-settings of the folding screen device, wherein when the folding screen device is set so that the unfolding operation does not trigger the application calling up, it is determined that the first application does not need to be called up.

[0038] In an implementation of the first aspect, determining whether the current application scenario requires invoking the first application includes:

[0039] Determine whether the first application needs to be called up based on the application running status and / or user operation of the folding screen device before the expansion event occurs.

[0040] In an implementation of the first aspect, determining whether the current application scenario requires invoking the first application includes:

[0041] It is determined whether the first application needs to be called up according to the expansion direction corresponding to the expansion event.

[0042] In an implementation of the first aspect, when the expansion direction is vertical, it is determined that the first application does not need to be called up.

[0043] In an implementation of the first aspect, the first application is an auxiliary application that provides auxiliary functions for display content of the second interface.

[0044] According to the above implementation, when the second interface and the application interface of the first application are displayed in the second display area at the same time, a better content display effect can be provided to the user.

[0045] According to the above implementation method, the unfolding operation of the folding screen device can be used to trigger the calling of the auxiliary application, and the increased display area after the folding screen device is unfolded can be used to implement the application auxiliary function of the auxiliary application, thereby improving the operating efficiency of the folding screen device.

[0046] In an implementation of the first aspect, before invoking the first application, the method further includes:

[0047] Set an application on the foldable screen device as the first application.

[0048] In an implementation of the first aspect, the first application is an artificial intelligence assistant. In an implementation of the first aspect, invoking the first application includes:

[0049] The operating parameters of the artificial intelligence assistant are configured according to the application scenario of the folding screen device before the expansion event, wherein the application interface of the artificial intelligence assistant in the second display area provides auxiliary functions corresponding to the display content of the second interface.

[0050] Artificial intelligence assistants generally require users to perform a specific startup operation to start, such as long pressing the power button to start a voice assistant. In contrast, this application automatically starts the artificial intelligence assistant when the folding screen device is unfolded. Furthermore, it is optional to judge the application scenario before unfolding (such as the type of application displayed before unfolding), and then determine which operations to start in the artificial intelligence assistant based on the judgment result. By starting the artificial intelligence assistant in this way, the artificial intelligence assistant can be pulled up with minimal perception, improving the auxiliary collaboration effectiveness of the artificial intelligence assistant.

[0051] In an implementation of the first aspect:

[0052] The method further includes, in the first state, running a second application, wherein the first interface is an application interface of the second application;

[0053] The calling up of the first application includes configuring the operating parameters of the artificial intelligence assistant according to the second application, wherein the application interface of the artificial intelligence assistant in the second display area provides auxiliary functions corresponding to the second application.

[0054] In an implementation of the first aspect, before invoking the first application, the method further includes:

[0055] An application is determined as the first application.

[0056] In an implementation of the first aspect, determining the application as the first application includes:

[0057] According to the application scenario of the folding screen device before the unfolding event, an application corresponding to the application scenario is selected as the first application.

[0058] In an implementation of the first aspect, determining the application as the first application includes:

[0059] An associated application of a second application is selected as the first application, wherein the second application is an application whose application interface is displayed in the first display area.

[0060] In an implementation of the first aspect, selecting an associated application of the second application as the first application includes:

[0061] An application is selected as the first application from multiple associated applications of the second application based on the operating status and / or user operation of the folding screen device before the expansion event.

[0062] In an implementation of the first aspect, the associated applications of the second application include a third application and a fourth application;

[0063] The associated application of the selected second application is the first application, including:

[0064] When the expansion direction of the expansion event is vertical, selecting the third application as the first application;

[0065] When the expansion direction of the expansion event is horizontal, the fourth application is selected as the first application.

[0066] In a second aspect, the present application provides an electronic device, comprising a memory for storing computer program instructions and a processor for executing computer program instructions, wherein when the computer program instructions are executed by the processor, the electronic device is triggered to execute the method steps described in the first aspect.

[0067] In a third aspect, the present application provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, which, when executed on a computer, enables the computer to execute the method described in the first aspect. BRIEF DESCRIPTION OF THE DRAWINGS

[0068] FIG1 is a schematic diagram showing the status of a folding screen device according to an embodiment of the present application;

[0069] FIG2 is a schematic diagram showing the status of a folding screen device according to an embodiment of the present application;

[0070] FIG3 is a schematic diagram showing the status of a folding screen device according to an embodiment of the present application;

[0071] FIG4 is a flow chart of a method according to an embodiment of the present application;

[0072] FIG5 is a schematic diagram showing the status of a folding screen device according to an embodiment of the present application;

[0073] FIG6 is a schematic diagram showing the status of a folding screen device according to an embodiment of the present application;

[0074] FIG7 is a flow chart of a method according to an embodiment of the present application;

[0075] FIG8 is a flowchart of a method according to an embodiment of the present application;

[0076] FIG9 is a schematic diagram showing the status of a folding screen device according to an embodiment of the present application;

[0077] FIG10 is a schematic diagram showing the status of a folding screen device according to an embodiment of the present application;

[0078] FIG11 is a flow chart of a method according to an embodiment of the present application;

[0079] FIG12 is a flow chart of a method according to an embodiment of the present application;

[0080] FIG13 is a schematic diagram showing the display effect of a folding screen device according to an embodiment of the present application;

[0081] FIG14 is a schematic diagram showing the display effect of a folding screen device according to an embodiment of the present application;

[0082] FIG15 is a schematic diagram showing the display effect of a folding screen device according to an embodiment of the present application;

[0083] FIG16 is a schematic diagram showing the display effect of a folding screen device according to an embodiment of the present application;

[0084] FIG17 is a schematic diagram showing the display effect of a folding screen device according to an embodiment of the present application;

[0085] FIG18 is a schematic diagram showing the display effect of a folding screen device according to an embodiment of the present application;

[0086] FIG19 is a flowchart of a method according to an embodiment of the present application;

[0087] FIG20 is a schematic diagram showing a system structure according to an embodiment of the present application;

[0088] FIG21 is a timing diagram of a process according to an embodiment of the present application;

[0089] FIG22 is a flowchart of a method according to an embodiment of the present application;

[0090] FIG23 is a schematic structural diagram of an electronic device according to an embodiment of the present application. DETAILED DESCRIPTION

[0091] To make the purpose, technical solutions, and advantages of this application more clear, the technical solutions of this application will be clearly and completely described below in conjunction with the specific embodiments of this application and the corresponding drawings. Obviously, the embodiments described are only part of the embodiments of this application, not all of them. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of this application.

[0092] The terms used in the implementation section of this application are only used to explain the specific embodiments of this application and are not intended to limit this application.

[0093] In order to solve the problem of how to simplify the application invocation steps and improve the operating experience of the terminal device, an embodiment of the present application proposes a method for invoking an application.

[0094] The method for calling up an application provided in an embodiment of the present application is applied to a foldable screen device. A foldable screen device is a device that can fold its display area. The foldable screen device includes at least one foldable display screen, or at least two display screens connected by a folding mechanism.

[0095] For example, Figure 1 shows a schematic diagram of the status of a folding screen device according to an embodiment of the present application.

[0096] As shown in Figure 1, foldable screen device 101 includes a display screen 102, which includes two display areas (103 and 104). The boundary between display areas 103 and 104 can be bent to allow foldable screen device 101 to be folded. In the folded state, the two display areas (103 and 104) of display screen 102 are back to back.

[0097] For another example, FIG2 shows a schematic diagram of the status of a folding screen device according to an embodiment of the present application.

[0098] As shown in Figure 2, the foldable screen device 111 includes a display screen 112 and a display screen 113, which are connected by a folding mechanism. The folding mechanism can be bent to allow the foldable screen device 111 to fold. In the folded state, the display screens 112 and 113 are back to back.

[0099] The method for invoking an application provided in the embodiments of the present application may be applicable to foldable screen devices including but not limited to foldable screen mobile phones, tablet computers, desktop computers, laptops, handheld computers, netbooks, as well as augmented reality (AR) / virtual reality (VR) devices, smart TVs, car equipment, portable game consoles, portable music players, and reader devices.

[0100] Furthermore, the state of the foldable screen device includes at least a first state, in which the foldable screen device is folded. For example, state 105 shown in FIG1 and state 115 shown in FIG2 are the first states.

[0101] The foldable screen device in the first state can be unfolded after experiencing an unfolding event and enter the second state. For example, state 106 shown in Figure 1 and state 116 shown in Figure 2 are the second states.

[0102] Specifically, the unfolding event can be triggered manually by the user. For example, the user manually unfolds the foldable screen device, or the user presses the screen unfold button. The unfolding event can also be triggered by the foldable screen device itself or another device. For example, an application installed on the foldable screen device issues a foldable screen unfolding command, or a device other than the foldable screen device issues a foldable screen unfolding command to the foldable screen device.

[0103] The implementation of the expansion event can be achieved manually by the user. For example, the user manually unfolds the folding screen device. The implementation of the expansion event can also be achieved by the folding screen device itself. For example, the folding screen device is internally installed with a motor and a transmission mechanism for expanding the folding screen device. After the expansion event is triggered, the motor drives the transmission mechanism to expand the display screen of the folding screen device to realize the expansion event. The implementation of the expansion event can also be achieved by other devices other than the folding screen device. For example, a display screen expansion component is installed on the folding screen device. After the expansion event is triggered, the folding screen expansion instruction is sent to the display screen expansion component. The display screen expansion component includes a motor and a transmission mechanism for expanding the folding screen device. The motor drives the transmission mechanism to expand the display screen of the folding screen device to realize the expansion event.

[0104] Furthermore, in the first state, the folding screen device activates the first display area for display. In the second state, the folding screen device activates the second display area for display, and the area of ​​the second display area is larger than the first display area.

[0105] In one embodiment, the second display area includes the first display area. That is, in the second state, the folding screen device adds an activated display area on the basis of activating the first display area.

[0106] For example, in state 105 (first state) shown in Figure 1, the folding screen device 101 activates display area 103 (first display area) for display; in state 106 (second state), the folding screen device 101 activates display area 103 and display area 104 for display (display area 103 and display area 104 are combined into a second display area).

[0107] For another example, in state 115 (first state) shown in Figure 2, the folding screen device 101 activates the entire display area (first display area) of the display screen 112 for display; in state 116 (second state), the folding screen device 101 activates the entire display area of ​​the display screen 112 and the entire display area of ​​the display screen 113 for display (the entire display area of ​​the display screen 112 and the entire display area of ​​the display screen 113 are combined into the second display area).

[0108] In another embodiment, the second display area does not include the first display area.

[0109] For example, Figure 3 shows a schematic diagram of the status of a folding screen device according to an embodiment of the present application.

[0110] As shown in Figure 3, foldable screen device 121 includes a display screen 122, which includes two display areas (123 and 124). The boundary between display areas 123 and 124 can be bent to allow foldable screen device 121 to be folded. In state 126 (the first state), the two display areas (123 and 124) of display screen 122 face each other.

[0111] The folding screen device 121 further includes a display screen 125 , which is constructed on the back of the display area 124 (the display screen 125 and the display area 124 are back to back).

[0112] In state 126 (first state), the folding screen device 121 activates the entire display area (first display area) of the display screen 125 for display; in state 127 (second state), the folding screen device 121 activates display area 123 and display area 124 for display (display area 123 and display area 124 are combined into the second display area).

[0113] Furthermore, in one embodiment, when the second display area does not include the first display area, in the second state, the folding screen device only activates the second display area (does not activate the first display area), or activates the first display area and the second display area at the same time.

[0114] For example, in state 127 (second state), the foldable screen device 121 activates only the display area 123 and the display area 124 for display, and does not activate the display screen 125. Alternatively, in state 127 (second state), the foldable screen device 121 activates the display area 123 and the display area 124 for display, and activates the entire display area (first display area) of the display screen 125 for display.

[0115] Furthermore, in the embodiment of the present application, when the foldable screen device is displaying an image, it uses the activated display area to display the image. For example, in state 105, when the foldable screen device 101 is displaying, the display area 103 is displaying an image, and the display area 104 is not displaying an image. For another example, in state 115, when the foldable screen device 111 is displaying, the display screen 112 is displaying an image, and the display screen 113 is not displaying an image.

[0116] However, in some application scenarios, when the display screen is displaying images, the inactive display area is not equivalent to the display area and does not display images. For example, in one embodiment, in state 105, when the foldable screen device 101 is displaying, the display area 103 displays the image of the application interface, and the display area 104 displays the image of the customized phone case screen. For another example, in state 115, when the foldable screen device 111 is displaying, the display screen 112 displays images, and the display screen 113 displays the image of the customized phone case screen.

[0117] In the method for launching an application proposed in an embodiment of the present application, the foldable screen device activates the first display area in a first state and displays content based on the first display area. When the foldable screen device transitions from the first state to the second state, the foldable screen device launches the first application and displays the application interface of the first application based on the second display area in the second state.

[0118] FIG4 is a flowchart of a method according to an embodiment of the present application.

[0119] In one embodiment, the folding screen device executes the following process as shown in FIG4 .

[0120] S400, the folding screen device enters a first state. When the folding screen device is in the first state, the folding screen device activates a first display area.

[0121] S401, the folding screen device uses the first display area to display the first interface.

[0122] Specifically, the first interface is the current operating interface of the foldable screen device. For example, in one embodiment, the first interface is the application interface of the application currently running on the foldable screen device. For another example, in another embodiment, the first interface is the system operating interface of the foldable screen device. For example, the system desktop or the system settings interface.

[0123] S402, monitor the state change of the folding screen device to determine whether the folding screen device is unfolded from the first state to enter the second state.

[0124] When the foldable screen device is not unfolded from the first state, return to S402.

[0125] When it is detected that the folding screen device is unfolded from the first state and enters the second state, execute S403.

[0126] S403: Start the first application.

[0127] S404, in the second state, the folding screen device activates the second display area, and uses the second display area to display the second interface and the running interface of the first application, wherein the second interface includes the display content of the first interface.

[0128] For example, as shown in Figure 1, in state 105 (first state), foldable screen device 101 runs a second application and displays the second application's interface on display area 103. When foldable screen device 101 enters state 106 (second state), foldable screen device 101 launches the first application while maintaining the second application. Furthermore, in state 106 (second state), the second application's interface is displayed on display area 103, while the first application's interface is displayed on display area 104.

[0129] For another example, as shown in Figure 1, in state 105 (first state), foldable screen device 101 enters the system setup process under user operation, and the system setup interface is displayed on display area 103. When foldable screen device 101 enters state 106 (second state), foldable screen device 101 calls up the first application. Furthermore, in state 106 (second state), the system setup interface is displayed on display area 103, and the application interface of the first application is displayed on display area 104.

[0130] According to the method of calling up an application in one embodiment of the present application, calling up a new application is triggered by the unfolding operation of the folding screen device, which can call up the application more quickly and improve the application calling efficiency of the folding screen device.

[0131] In S404, because the second interface includes the display content of the first interface, after the foldable screen device enters the second state, the display content of the foldable screen device can achieve the display effect of the foldable screen device in the first state. On this basis, the foldable screen device triggers the launch of the first application through the state change, and the new application can be automatically launched without affecting the normal operation of the application / system before the state change.

[0132] Furthermore, because the second display area is larger than the first display area, when the foldable screen device transitions from the first state to the second state, the second display area in the second state can display more content than the first display area in the first state. In other words, displaying both the second interface and the first application's running interface in the second display area simultaneously does not result in a lack of display space and does not affect the user's visual experience.

[0133] Furthermore, in one implementation of S404, after the foldable screen device enters the second state, the area of ​​the second interface is reduced compared to the first interface, thereby providing more display space for the first application. Alternatively, in another implementation of S404, after the foldable screen device enters the second state, the area of ​​the second interface is expanded compared to the first interface, thereby improving the display effect of the second interface.

[0134] Furthermore, in another implementation of S404, after the foldable screen device enters the second state, the second interface is consistent with the first interface. That is, the size of the second interface is consistent with the size of the first interface; the display content of the second interface is consistent with the display content of the first interface; and the display position of the first interface in the first display area does not change compared to the display position of the second interface in the second display area.

[0135] In this way, before and after the folding screen device is unfolded, the visual effects of the content displayed in the first interface and the second interface are consistent, thereby avoiding affecting the user's visual experience.

[0136] Moreover, after the foldable screen device is unfolded, the foldable screen device can directly use the display screen rendering of the first interface as the display screen rendering of the second interface. The display screen rendering of the second interface does not require the display interface size adjustment, thereby reducing the processing consumption of the display screen rendering.

[0137] Furthermore, in another implementation of S404, after the foldable screen device enters the second state, the second interface is partially consistent with the first interface. That is, the size of the second interface is consistent with the size of the first interface; and / or the displayed content of the second interface is consistent with the displayed content of the first interface; and / or the display position of the first interface in the first display area does not change compared to the display position of the second interface in the second display area.

[0138] Furthermore, in one implementation of S404, after the folding screen device enters the second state, the application interface of the first application is displayed in an increased portion of the second display area, and the increased portion is an activation area increased relative to the first display area.

[0139] For example, as shown in FIG1 , compared to the display area 103 activated in state 101 (first state), the additional portion of the display areas 103 and 104 activated in state 106 (second state) is display area 104. In state 106, display area 103 is used to display the second interface, and display area 104 is used to display the application interface of the first application.

[0140] In this way, after the folding screen device is unfolded, the application interface of the first application is displayed in the second display area, which will not cause a decrease in the display effect of the second interface, thereby avoiding affecting the user's visual experience.

[0141] In the usage scenario of a foldable screen device, after the foldable screen device is folded, it unfolds after experiencing an unfolding event. Therefore, in one embodiment, in S402, the state change of the foldable screen device is monitored by detecting whether there is an unfolding event.

[0142] Furthermore, when the foldable screen device can be folded multiple times, the foldable screen device can have more than two states (for example, a first state, a second state, and a third state).

[0143] For example, Figure 5 shows a schematic diagram of the status of a folding screen device according to an embodiment of the present application.

[0144] As shown in Figure 5, foldable screen device 501 includes a display screen 502, which includes three display areas (503, 504, and 505). The boundary between display areas 503 and 504 is bendable, and the boundary between display areas 504 and 505 is bendable, allowing foldable screen device 501 to be folded twice. Foldable screen device 501 has three states: state 511 (third state), state 512 (first state), and state 513 (second state).

[0145] As shown in Figure 5, in state 511, display areas 503 and 504 are back to back, and display areas 504 and 505 are face to face. In state 511, the folding screen device 501 activates the display area 503 for display.

[0146] In state 511, after the foldable screen device 501 experiences an unfolding event, it enters state 512. In state 512, display areas 503 and 504 are back-to-back, and the boundary between display areas 504 and 505 is unfolded. In state 512, the foldable screen device 501 activates display areas 504 and 505 for display.

[0147] In state 512, after experiencing an expansion event, foldable screen device 501 enters state 513. In state 513, the boundary between display areas 503 and 504 is expanded, and the boundary between display areas 504 and 505 is expanded. In state 513, foldable screen device 501 activates display areas 503, 504, and 505 for display.

[0148] For another example, FIG6 shows a schematic diagram of the status of a folding screen device according to an embodiment of the present application.

[0149] As shown in Figure 6, foldable screen device 601 includes a display screen 602, which includes three display areas (603, 604, and 605). The boundary between display areas 603 and 604 is bendable, and the boundary between display areas 604 and 605 is bendable, allowing foldable screen device 601 to be folded twice. Foldable screen device 601 has three states: state 611 (third state), state 612 (first state), and state 613 (second state).

[0150] As shown in Figure 6, in state 611, display areas 604 and 605 are back to back, and display areas 603 and 605 are facing back to back. In state 611, the folding screen device 601 activates display area 603 or 604 for display.

[0151] In state 611, the folding screen device 601 enters state 612 after experiencing an expansion event (the boundary between display areas 603 and 604 is expanded). In state 612, the display areas 604 and 605 are back to back, and the folding screen device 601 activates the display areas 603 and 604 for display.

[0152] In state 612, after experiencing an expansion event (the boundary between display areas 604 and 605 is expanded), foldable screen device 501 enters state 613. In state 613, the boundary between display areas 603 and 604 is expanded, and the boundary between display areas 604 and 605 is expanded. In state 613, foldable screen device 601 activates display areas 603, 604, and 605 for display.

[0153] Based on the embodiments shown in Figures 5 and 6, it can be concluded that when the folding screen device has more than two states, when the folding screen device detects an expansion event, the folding screen device does not necessarily expand from the first state to the second state, but may also expand from the third state to the first state.

[0154] Therefore, in one embodiment of the present application, when an expansion event is detected, it is necessary to identify whether the current expansion event is expansion from the first state to the second state.

[0155] FIG7 is a flowchart of a method according to an embodiment of the present application.

[0156] In one embodiment, the folding screen device executes the following process as shown in Figure 7.

[0157] S700, the folding screen device enters the third state. When the folding screen device is in the third state, the folding screen device activates the third display area.

[0158] Specifically, in one embodiment, the third state may refer to state 511 as shown in FIG. 5 , where the third display area is display area 503 ; or, the third state may refer to state 611 as shown in FIG. 6 , where the third display area is display area 603 or 604 .

[0159] S701, the folding screen device uses the third display area to display the third interface.

[0160] Specifically, the third interface is the current operating interface of the foldable screen device. For example, in one embodiment, the third interface is the application interface of the application currently running on the foldable screen device (for example, the application interface of the second application). For another example, in another embodiment, the third interface is the system operating interface of the foldable screen device. For example: the system desktop, the system settings interface.

[0161] S710: Detect an expansion event.

[0162] If no expansion event is detected, the process returns to S710 .

[0163] If an expansion event is detected, execute S711.

[0164] S711: Confirm the state change of the foldable screen device before and after the unfolding event.

[0165] If the foldable screen device is unfolded from the third state to the first state, execute S720.

[0166] S720: When the foldable screen device is in the first state, the foldable screen device activates the first display area and uses the first display area to display a first interface, wherein the first interface is an interface generated by expanding the area of ​​the third interface. (See S400 and S401)

[0167] Specifically, in one embodiment, the first state can refer to state 512 as shown in Figure 5, and the first display area is a combination of display areas 504 and 505; or, the first state can refer to state 612 as shown in Figure 6, and the first display area is a combination of display areas 603 and 604.

[0168] After S720 , the process returns to S710 .

[0169] If the foldable screen device is unfolded from the first state to the second state, execute S730.

[0170] S730: Start the first application. (See S403)

[0171] S731: When the foldable screen device is in the second state, the foldable screen device activates the second display area and uses the second display area to display the second interface and the running interface of the first application, wherein the second interface includes the display content of the first interface. (See S404)

[0172] Specifically, in one embodiment, the second state can refer to state 513 as shown in Figure 5, and the second display area is a combination of display areas 503, 504 and 505; or, the second state can refer to state 613 as shown in Figure 6, and the second display area is a combination of display areas 603, 604 and 605.

[0173] 5 , the folding screen device 501 activates the display area 503 for display in state 511. In state 511, the folding screen device 501 runs the second application, and the display area 503 displays the application interface (third interface) of the second application.

[0174] Folding screen device 501 undergoes an expansion event and expands from state 511 to state 512. Folding screen device 501 activates display areas 504 and 505 for display in state 512. Display areas 504 and 505 display the application interface of the second application (the first interface, which is the interface after the third interface is expanded).

[0175] Foldable screen device 501 undergoes an expansion event, expanding from state 512 to state 513. Foldable screen device 501 launches the first application. In state 513, foldable screen device 501 activates display areas 503, 504, and 505 for display. Display areas 503 and 504 display the application interface of the second application (a second interface, which is identical to the first interface). Display area 505 displays the application interface of the first application.

[0176] According to the method of the embodiment of the present application, by confirming the state of the folding screen device before and after the expansion event, it is limited that the invocation of the first application is triggered by expanding from the first state to the second state, thereby avoiding the expansion event from mistakenly triggering the invocation of the first application.

[0177] Furthermore, in the embodiment shown in Figure 4, when the foldable screen device is unfolded from the first state to the second state, the foldable screen device is triggered to call up the first application. However, in some application scenarios, when the foldable screen device is unfolded from the first state to the second state, it is not necessary to call up the first application.

[0178] Therefore, in one embodiment of the present application, when the display screen is unfolded from the first state and enters the second state, the folding screen device first needs to determine whether the current application scenario requires calling up the first application.

[0179] FIG8 is a flowchart of a method according to an embodiment of the present application.

[0180] In one embodiment, the folding screen device executes the following process as shown in Figure 8.

[0181] S800: The foldable screen device enters a first state. When the foldable screen device is in the first state, the foldable screen device activates the first display area. (See S400)

[0182] S801: The foldable screen device displays a first interface using a first display area. (See S401)

[0183] S810, monitor the state change of the folding screen device to determine whether the folding screen device is unfolded from the first state to enter the second state.

[0184] When the foldable screen device is not unfolded from the first state, return to S810.

[0185] When it is detected that the folding screen device is unfolded from the first state and enters the second state, execute S820.

[0186] S820: Confirm whether the first application needs to be activated.

[0187] If the first application needs to be called up, execute S830.

[0188] S830: Launch the first application. When the foldable screen device is in the second state, the foldable screen device activates the second display area and uses the second display area to display the second interface and the running interface of the first application. (See S403 and S404)

[0189] If the first application does not need to be called up, execute S840.

[0190] S840, when the folding screen device is in the second state, the folding screen device activates the second display area and displays the fourth interface in the second display area, wherein the fourth interface is an interface generated by enlarging the size of the first interface.

[0191] In one implementation of S820, whether the first application needs to be called up is confirmed based on the pre-settings of the folding screen device.

[0192] For example, in one embodiment, the folding screen device is configured to prohibit the unfolding operation from triggering the launch of an application. In S820, it is confirmed that the first application does not need to be launched.

[0193] In another implementation of S820, the folding screen device confirms whether it is necessary to call up the first application based on the system / application running status of the folding screen device and / or user operation before the folding screen device enters the second state.

[0194] For example, in the first state, the first interface is the system desktop, and the user operation is to slide the system desktop to view application icons. When the foldable screen device is unfolded from the first state to enter the second state, the foldable screen device determines that the unfolding operation is not required to trigger the call of a new application based on the system / application running state (displaying the system desktop) and the user operation (viewing application icons).

[0195] For example, in the first state, the foldable screen device runs a reading application (the second application), and the first interface is the application running interface of the reading application. The first application is a translation application. Before the foldable screen device is unfolded, the reading application displays text content (the first interface displays text content). After the user marks a text in the text displayed on the first interface and unfolds the foldable screen device, the foldable screen device unfolds from the first state to the second state.

[0196] The foldable screen device recognizes that the reading application displays text content before expansion, and the user has marked a text in the text displayed on the first interface. Therefore, the foldable screen device determines that the expansion operation triggers the call-up of the first application. The foldable screen device calls up the first application, displays the second interface in the second display area (the second interface is consistent with the first interface, and the second interface is the interface for displaying text content of the reading application) and the application interface of the first application, and translates the marked text in the second interface in the application interface of the first application.

[0197] For example, in the first state, the foldable screen device runs a reading application (the second application), and the first interface is the application running interface of the reading application. The first application is a translation application. Before the foldable screen device is unfolded, the reading application displays image content (the first interface displays image content). When the user is browsing the image content, the foldable screen device unfolds, and the foldable screen device unfolds from the first state to the second state.

[0198] The foldable device recognizes that the reading app displays image content before expansion (no text requiring translation). Therefore, the foldable device determines that the expansion operation does not trigger the launch of the first app. The foldable device enlarges the first interface to generate a third interface (enlarging the image displayed by the reading app) and displays the third interface in the second display area.

[0199] Furthermore, when the folding screen device is unfolded, the unfolding direction of the folding screen device is different depending on the placement direction of the folding screen device (the hand-holding direction of the folding screen device).

[0200] As shown in Figure 1, the foldable screen device is unfolded from state 105 to state 106, which is horizontal unfolding. As shown in Figure 1, the foldable screen device is unfolded from state 115 to state 116, which is horizontal unfolding. As shown in Figure 3, the foldable screen device is unfolded from state 105 to state 106, which is horizontal unfolding.

[0201] As shown in Figure 5, the foldable screen device is unfolded from state 511 to state 512, and from state 512 to state 513, which is horizontal unfolding. As shown in Figure 6, the foldable screen device is unfolded from state 611 to state 612, and from state 612 to state 613, which is horizontal unfolding.

[0202] FIG9 is a schematic diagram showing the status of a folding screen device according to an embodiment of the present application.

[0203] As shown in FIG9 , the folding screen device 101 shown in FIG1 is rotated 90 degrees.

[0204] When the connection between the display areas 103 and 104 is bent, the foldable screen device 101 enters state 105a. In state 105a, the foldable screen device 101 experiences an unfolding event and enters state 106a.

[0205] The folding screen device 101 is unfolded from state 105a to state 106a, which is vertical unfolding.

[0206] FIG10 is a schematic diagram showing the status of a folding screen device according to an embodiment of the present application.

[0207] As shown in FIG10 , the folding screen device 501 shown in FIG5 is rotated 90 degrees.

[0208] In state 511a, display areas 503 and 504 are back to back, and display areas 504 and 505 are face to face.

[0209] In state 511a, the foldable screen device 501 enters state 512a after experiencing an unfolding event. In state 512a, the display areas 503 and 504 are back to back, and the boundary between the display areas 504 and 505 is unfolded.

[0210] In state 512a, the folding screen device 501 enters state 513a after experiencing an unfolding event. In state 513a, the boundary between display areas 503 and 504 is unfolded, and the boundary between display areas 504 and 505 is unfolded.

[0211] The folding screen device 501 is unfolded from state 511a to state 512a, and then from state 512a to state 513a, which is vertical unfolding.

[0212] In another implementation of S820, the folding screen device identifies the expansion direction and determines whether the first application needs to be called up according to the expansion direction.

[0213] For example, in one embodiment, when the foldable screen device identifies that the current expansion event is a horizontal expansion, it determines that the first application needs to be launched; when the foldable screen device identifies that the current expansion event is a vertical expansion, it determines that the first application does not need to be launched. Alternatively, in another embodiment, when the foldable screen device identifies that the current expansion event is a horizontal expansion, it determines that the first application does not need to be launched; when the foldable screen device identifies that the current expansion event is a vertical expansion, it determines that the first application needs to be launched.

[0214] FIG11 is a flowchart of a method according to an embodiment of the present application.

[0215] In one embodiment, the folding screen device executes the following process as shown in Figure 11.

[0216] S1100: The foldable screen device enters a third state. When the foldable screen device is in the third state, the foldable screen device activates the third display area. (See S700)

[0217] S1101: The foldable screen device displays a third interface using a third display area. (See S701)

[0218] S1110 , detecting an expansion event.

[0219] If no expansion event is detected, the process returns to S1110 .

[0220] If an expansion event is detected, execute S1111.

[0221] S1111, confirm the change in the folding screen device state before and after the unfolding event.

[0222] If the foldable screen device is unfolded from the third state to the first state, execute S1120.

[0223] S1120: When the foldable screen device is in the first state, the foldable screen device activates the first display area and uses the first display area to display a first interface, wherein the first interface is an interface generated by expanding the area of ​​the third interface. (See S720)

[0224] After S1120 , return to S1110 .

[0225] If the foldable screen device is unfolded from the first state to the second state, execute S1130.

[0226] S1130: Identify the unfolding direction according to the placement direction of the folding screen device before the unfolding event.

[0227] If the expansion direction is vertical, execute S1131.

[0228] S1131, when the folding screen device is in the second state, the folding screen device activates the second display area and uses the second display area to display the fourth interface, wherein the fourth interface is an interface generated by expanding the area of ​​the first interface.

[0229] If the expansion direction is horizontal, execute S1132.

[0230] S1132: Start the first application. (See S730)

[0231] S1133: When the foldable screen device is in the second state, the foldable screen device activates the second display area and uses the second display area to display the second interface and the running interface of the first application, wherein the second interface includes the display content of the first interface. (See S404)

[0232] According to the method of the embodiment of the present application, when the expansion event triggers the application to be called up, it can be determined whether to call up the first application based on the current actual situation of the folding screen device, so that the calling up of the first application matches the current application scenario of the folding screen device, thereby improving the user experience.

[0233] Furthermore, in one embodiment, the first application is an auxiliary application that can provide auxiliary functions for the display content of the first interface (second interface), so that when the second interface and the application interface of the first application are displayed in the second display area at the same time, a better content display effect can be provided to the user.

[0234] For example, in the first state, the foldable screen device enters the system settings process (the first interface is the system settings interface). The first application is a system help application. When the second interface (the second interface contains the content of the first interface and is also the system settings interface) and the application interface of the first application are displayed simultaneously in the second display area, the user can understand the operating process of the system settings based on the first application, thereby assisting the user in performing system settings on the second interface.

[0235] For another example, in the first state, the foldable screen device runs a second application, and the first interface is the application running interface of the second application. The first application is an auxiliary application for the second application. For example, the second application is a reading application and the first application is a note-taking application. When the application interface of the second application and the application interface of the first application are displayed simultaneously in the second display area, the user can record the content that needs to be saved in the content displayed by the second application in the first application. For another example, the second application is a reading application and the first application is a translation application. When the application interface of the second application and the application interface of the first application are displayed simultaneously in the second display area, the user can translate the text in the content displayed by the second application in the first application.

[0236] According to the method of calling up an application in one embodiment of the present application, the unfolding operation of the folding screen device can be used to trigger the calling up of an auxiliary application, and the increased display area after the folding screen device is unfolded can be used to implement the application auxiliary function of the auxiliary application, thereby improving the operating efficiency of the folding screen device.

[0237] Furthermore, in one embodiment, an application on the foldable screen device is pre-set as the first application. When the first application needs to be called up, the first application is directly called up according to the pre-set settings of the foldable screen device. For example, an application is set as the first application in the system default settings, or an application is set as the first application through user-defined settings.

[0238] For example, in one embodiment, a system help application is set as the first application, and when the foldable screen device is unfolded from the first state to the second state, the system help application is called up. For another example, in one embodiment, a translation application is set as the first application, and when the foldable screen device is unfolded from the first state to the second state, the translation application is called up.

[0239] As artificial intelligence (AI) technology is increasingly used in terminal devices, AI assistants can provide targeted auxiliary functions for a variety of different applications. Therefore, in one embodiment, the AI ​​assistant is used as the invocation object and is set as the first application.

[0240] In the application scenario of the AI ​​assistant, the AI ​​assistant can provide targeted auxiliary functions based on the current application scenario requirements. In one embodiment, when calling up the AI ​​assistant, the operating parameters of the AI ​​assistant are configured according to the current application scenario so that the application interface of the AI ​​assistant displayed in the second display area can provide auxiliary functions corresponding to the display content of the second interface.

[0241] Specifically, in one embodiment, the foldable screen device runs a second application in the first state and uses the first display area to display the application interface (first interface) of the second application. When the foldable screen device unfolds from the first state to the second state, the foldable screen device calls up the AI ​​assistant and configures the operating parameters of the AI ​​assistant according to the second application, so that the AI ​​assistant can provide auxiliary functions corresponding to the second application (in the second state, the application interface displayed by the AI ​​assistant in the second display area can provide auxiliary functions corresponding to the second application).

[0242] FIG12 is a flowchart of a method according to an embodiment of the present application.

[0243] In one embodiment, the folding screen device executes the following process as shown in Figure 12.

[0244] S1200: The foldable screen device enters a third state. When the foldable screen device is in the third state, the foldable screen device activates the third display area. (See S700)

[0245] S1201: The foldable screen device runs a second application and uses a third display area to display a third interface, which is the application interface of the second application. (See S701)

[0246] S1210: Detect an expansion event.

[0247] If no expansion event is detected, the process returns to S1210 .

[0248] If an expansion event is detected, execute S1211.

[0249] S1211, confirm the change in the folding screen device state before and after the unfolding event.

[0250] If the foldable screen device is unfolded from the third state to the first state, execute S1220.

[0251] S1220: When the foldable screen device is in the first state, the foldable screen device activates the first display area and uses the first display area to display a first interface, wherein the first interface is an interface generated by expanding the area of ​​the third interface, and the first interface is an application interface of the second application. (See S720)

[0252] After S1220 , return to S1210 .

[0253] If the foldable screen device is unfolded from the first state to the second state, execute S1230.

[0254] S1230: Identify the expansion direction.

[0255] If the expansion direction is vertical, execute S1231.

[0256] S1231, when the folding screen device is in the second state, the folding screen device activates the second display area and uses the second display area to display the fourth interface, wherein the fourth interface is an interface generated by expanding the area of ​​the first interface, and the fourth interface is the application interface of the second application.

[0257] If the expansion direction is horizontal, execute S1232.

[0258] S1232: Start the AI ​​assistant and configure the operating parameters of the AI ​​assistant according to the second application.

[0259] S1233: When the foldable screen device is in the second state, the foldable screen device activates the second display area and uses the second display area to display the second interface and the running interface of the AI ​​assistant, wherein the second interface is consistent with the first interface, and the running interface of the AI ​​assistant provides auxiliary functions for the second application. (See S404)

[0260] Take the second application as a camera application as an example.

[0261] FIG13 is a schematic diagram showing the display effect of a folding screen device according to an embodiment of the present application.

[0262] The display screen of the foldable screen device includes three display areas (1301, 1302 and 1303).

[0263] When the foldable screen device is in the first state, the foldable screen device activates the first display area, which is the combination of display areas 1301 and 1302. In the first state, the foldable screen device runs the camera application and displays the application interface of the camera application in display areas 1301 and 1302. The display effect is shown in 1311.

[0264] The foldable screen device unfolds from the first state to the second state. In the second state, the foldable screen device activates the second display area, which is a combination of display areas 1301, 1302 and 1303.

[0265] Since the foldable screen device unfolds in a horizontal direction from the first state to the second state, the foldable screen device activates the AI ​​assistant. In the process of activating the AI ​​assistant, the foldable screen device configures the operating parameters of the AI ​​assistant according to the camera application.

[0266] When the display screen is expanded horizontally from the first state to the second state, display areas 1301 and 1302 display the application interface of the camera application (consistent with 1411 ), and display area 1303 displays the application interface of the AI ​​assistant. The display effect is shown in 1312 .

[0267] The application interface of the AI ​​assistant is an AI-assisted photo editing interface that matches the camera application. In the AI-assisted photo editing interface, the AI ​​assistant analyzes the photos displayed in the display areas 1301 and 1302 and provides several types of photo editing and beautification preview effects.

[0268] FIG14 is a schematic diagram showing the display effect of a folding screen device according to an embodiment of the present application.

[0269] The display screen of the foldable screen device includes three display areas (1401, 1402 and 1403).

[0270] When the foldable screen device is in the first state, the foldable screen device activates the first display area, which is a combination of display areas 1401 and 1402. In the first state, the foldable screen device runs a camera application, and displays the application interface of the camera application in display areas 1401 and 1402, with the display effect shown in 1411.

[0271] The foldable screen device unfolds from the first state to the second state. In the second state, the foldable screen device activates the second display area, which is a combination of display areas 1401, 1402 and 1403.

[0272] Since the unfolding direction of the folding screen device from the first state to the second state is vertical, the folding screen device does not call up the AI ​​assistant, but instead expands the area of ​​the application interface of the camera application to display more application content of the camera application.

[0273] When the display screen is expanded vertically from the first state to the second state, display areas 1401, 1402, and 1403 display the application interface of the camera application, and the display effect is shown in 1412. Compared with 1411, in 1412, a camera parameter setting interface is added to the application interface of the camera application.

[0274] Take the second application as a document editing application as an example.

[0275] Figure 15 is a schematic diagram showing the display effect of a folding screen device according to an embodiment of the present application.

[0276] The display screen of the foldable screen device includes three display areas (1501, 1502 and 1503).

[0277] When the foldable screen device is in the first state, the foldable screen device activates the first display area, which is the combination of display areas 1501 and 1502. In the first state, the foldable screen device runs the camera application and displays the application interface of the document editing application in display areas 1501 and 1502, as shown in 1511.

[0278] The foldable screen device unfolds from the first state to the second state. In the second state, the foldable screen device activates the second display area, which is a combination of display areas 1501, 1502 and 1503.

[0279] Since the foldable screen device is unfolded in a horizontal direction from the first state to the second state, the foldable screen device activates the AI ​​assistant. In addition, during the activation of the AI ​​assistant, the foldable screen device configures the operating parameters of the AI ​​assistant according to the document editing application.

[0280] When the display screen is expanded horizontally from the first state to the second state, display areas 1501 and 1502 display the application interface of the document editing application (consistent with 1511 ), and display area 1503 displays the application interface of the AI ​​assistant. The display effect is shown in 1512 .

[0281] The AI ​​assistant's application interface is an AI search-related resource interface that matches the document editing application. In the AI ​​search-related resource interface, the AI ​​assistant analyzes the document content displayed in display areas 1501 and 1502 and provides related resources (for example, providing biological illustrations for the currently edited biological note document).

[0282] Figure 16 is a schematic diagram showing the display effect of a folding screen device according to an embodiment of the present application.

[0283] The display screen of the foldable screen device includes three display areas (1601, 1602 and 1603).

[0284] When the foldable screen device is in the first state, the foldable screen device activates the first display area, which is the combination of display areas 1601 and 1602. In the first state, the foldable screen device runs a document editing application, and the application interface of the document editing application is displayed in display areas 1601 and 1602, with the display effect shown in 1611.

[0285] The foldable screen device unfolds from the first state to the second state. In the second state, the foldable screen device activates the second display area, which is a combination of display areas 1601, 1602 and 1603.

[0286] Since the unfolding direction of the folding screen device from the first state to the second state is vertical, the folding screen device does not call up the AI ​​assistant, but instead expands the area of ​​the application interface of the document editing application to display more application content of the document editing application.

[0287] When the display screen is expanded vertically from the first state to the second state, display areas 1601, 1602, and 1603 display the application interface of the document editing application, as shown in 1612. Compared to 1611, in 1612, a document editing parameter setting interface (e.g., document style, layout, etc.) is added to the application interface of the document editing application.

[0288] Take the second application as a drawing application as an example.

[0289] Figure 17 is a schematic diagram of the display effect of a folding screen device according to an embodiment of the present application.

[0290] The display screen of the foldable screen device includes three display areas (1701, 1702 and 1703).

[0291] When the foldable screen device is in the first state, the foldable screen device activates the first display area, which is the combination of display areas 1701 and 1702. In the first state, the foldable screen device runs a drawing application, and the application interface of the drawing application is displayed in display areas 1701 and 1702, and the display effect is shown in 1711.

[0292] The foldable screen device unfolds from the first state to the second state. In the second state, the foldable screen device activates the second display area, which is a combination of display areas 1701, 1702 and 1703.

[0293] Since the foldable screen device is unfolded in a horizontal direction from the first state to the second state, the foldable screen device activates the AI ​​assistant. In addition, during the activation of the AI ​​assistant, the foldable screen device configures the operating parameters of the AI ​​assistant according to the drawing application.

[0294] When the display screen is expanded horizontally from the first state to the second state, display areas 1701 and 1702 display the application interface of the drawing application (consistent with 1711 ), and display area 1703 displays the application interface of the AI ​​assistant. The display effect is shown in 1712 .

[0295] The AI ​​assistant's application interface is an AI-assisted drawing interface that matches the drawing application. In the AI-assisted drawing interface, the AI ​​assistant analyzes the drawing content displayed in display areas 1701 and 1702 and provides an AI-assisted drawing preview (for example, generating a variety of different styles of pictures based on the screen for selection).

[0296] Figure 18 is a schematic diagram showing the display effect of a folding screen device according to an embodiment of the present application.

[0297] The display screen of the foldable screen device includes three display areas (1801, 1802 and 1803).

[0298] When the foldable screen device is in the first state, the foldable screen device activates the first display area, which is the combination of display areas 1801 and 1802. In the first state, the foldable screen device runs a drawing application, and the application interface of the drawing application is displayed in display areas 1801 and 1802, with the display effect shown in 1811.

[0299] The foldable screen device unfolds from the first state to the second state. In the second state, the foldable screen device activates the second display area, which is a combination of display areas 1801, 1802 and 1803.

[0300] Since the unfolding direction of the foldable screen device from the first state to the second state is vertical, the foldable screen device does not call up the AI ​​assistant, but instead expands the area of ​​the application interface of the drawing application to display more application content of the drawing application.

[0301] When the display screen is expanded vertically from the first state to the second state, display areas 1801, 1802, and 1803 display the application interface of the drawing application, as shown in 1812. Compared to 1811, in 1812, a toolbar interface (e.g., brush style, color settings) is added to the application interface of the drawing application.

[0302] Furthermore, in one embodiment, the AI ​​assistant is activated based on the Activity Manager Service (AMS) and the AI ​​assistant service.

[0303] Specifically, FIG19 shows a flow chart of a method according to an embodiment of the present application.

[0304] In one embodiment, the foldable screen device executes the following process as shown in Figure 19 to activate the AI ​​assistant.

[0305] S1900, the folding screen device is in a first state, and the folding screen device runs a second application.

[0306] When the user unfolds the folding screen device (the folding screen device enters the second state), the folding screen device executes the following process.

[0307] S1910: An expansion event is detected.

[0308] S1911, send a display screen expansion message to the AMS to notify the AMS that the display screen configuration has changed (the display screen has been expanded).

[0309] S1920: The AMS calls back the second application.

[0310] S1921: Determine whether to start the AI ​​assistant.

[0311] If the AI ​​assistant does not need to be started, execute S1930.

[0312] S1930: Display the second application in full screen on the expanded display screen.

[0313] If you need to start the AI ​​assistant, execute S1940.

[0314] S1940: Obtain AI-assisted parameters corresponding to the second application and confirm whether the parameters are abnormal.

[0315] If the parameters are abnormal, execute S1950.

[0316] S1950: The second application starts the associated AI assistant, and the AI ​​assistant maintains the default interface (the relevant parameters in the AI ​​assistant service use the default settings).

[0317] If the parameters are normal, go to S1960.

[0318] S1960, AMS split screen starts the association interface.

[0319] S1961, based on the returned AI assistance parameters, register the relevant parameters in the AI ​​assistant service.

[0320] S1962, based on the AI ​​assistant service, the second application starts the AI ​​assistant, and the AI ​​assistant presents a corresponding interface according to the application scenario.

[0321] According to the method of one embodiment of the present application, by registering the AI ​​assistance parameters corresponding to the second application in the AI ​​assistant service, after startup, the AI ​​assistant can present the corresponding auxiliary interface according to the application scenario of the currently running second application, thereby improving the auxiliary collaboration capability of the AI ​​assistant and improving the operating efficiency of the folding screen device using AI technology.

[0322] FIG20 is a schematic diagram showing a system structure according to an embodiment of the present application.

[0323] As shown in Figure 20, the system of the folding screen device includes an application layer 2010, a framework layer 2020, a device driver layer 2030 and a system kernel layer 2040.

[0324] The application layer 2010 is used to run applications, for example, the second application 2011 (the second application can be a camera application, a text editing application, a picture editing application, etc.), the AI ​​assistant 2012 (the first application).

[0325] The framework layer 2020 includes a configuration management system 2021 , an AI assistant service 2022 , and an activity management service (ActivityManagerService, AMS) 2023 .

[0326] FIG. 21 is a timing diagram of a process according to an embodiment of the present application.

[0327] In one embodiment, the folding screen device of the system shown in FIG. 20 executes the following process shown in FIG. 21 to activate the AI ​​assistant.

[0328] S2100, the display screen is in the first state, and the folding screen device runs the second application 2011.

[0329] When the user unfolds the display screen (second state), the folding screen device executes the following process.

[0330] S2030 , after detecting the expansion event, the config management system 1021 notifies the AMS 2023 that the display configuration has changed (the display has been expanded).

[0331] S2040 , AMS 1023 calls back the second application 2011 to notify the second application 2011 of the display configuration change.

[0332] S2041, the second application 2011 determines whether the AI ​​assistant needs to be started, and the determination result is returned to AMS2023.

[0333] If you need to start the AI ​​assistant, execute S2030.

[0334] S2130, AMS2023 calls back the second application 2011 to obtain AI auxiliary parameters.

[0335] S2131, the second application 2011 returns the AI ​​assisted parameters to the AMS 2023.

[0336] S2140, AMS2023 registers the relevant parameters in the AI ​​assistant service 2022 based on the returned AI auxiliary parameters.

[0337] S2150, AMS2023 starts AI assistant 2012 in split screen (displaying the application interface of the second application 2011 and the application interface of AI assistant 2012).

[0338] Furthermore, in another embodiment, a certain application is not pre-selected as the first application, but an application is selected as the first application when the first application needs to be called up.

[0339] FIG22 is a flowchart of a method according to an embodiment of the present application.

[0340] In one embodiment, the folding screen device executes the following process as shown in Figure 22.

[0341] S2200, the folding screen device enters the third state. When the folding screen device is in the third state, the folding screen device activates the third display area.

[0342] S2201, the folding screen device uses the third display area to display the third interface.

[0343] S2210, detecting an expansion event.

[0344] If no expansion event is detected, return to S2210.

[0345] If an expansion event is detected, execute S2211.

[0346] S2211, confirm the change in the folding screen device state before and after the unfolding event.

[0347] If the foldable screen device is unfolded from the third state to the first state, execute S2220.

[0348] S2220, when the folding screen device is in the first state, the folding screen device activates the first display area and uses the first display area to display the first interface, wherein the first interface is an interface generated by expanding the area of ​​the third interface.

[0349] After S2220, return to S2210.

[0350] If the foldable screen device is unfolded from the first state to the second state, execute S2230.

[0351] S2230, identifying the expansion direction.

[0352] If the expansion direction is vertical, execute S2231.

[0353] S2231, when the folding screen device is in the second state, the folding screen device activates the second display area and uses the second display area to display the fourth interface, wherein the fourth interface is an interface generated by expanding the area of ​​the first interface.

[0354] If the expansion direction is horizontal, execute S2232.

[0355] S2232, determine the application to be the first application.

[0356] S2233, start the first application.

[0357] S2234, when the folding screen device is in the second state, the folding screen device activates the second display area, and uses the second display area to display the second interface and the running interface of the first application, wherein the second interface includes the display content of the first interface.

[0358] Specifically, in one implementation of S2232, a correspondence between different application scenarios and auxiliary applications is established in advance. In S2232, the corresponding application is selected as the first application based on the application scenario of the folding screen device before the unfolding event.

[0359] For example, in the first state, the foldable screen device enters the system settings process (the first interface is the system settings interface). When the foldable screen device is unfolded from the first state to the second state, the system help application is selected as the first application based on the application scenario of the foldable screen device before the unfolding event (the system settings application scenario).

[0360] For example, in the first state, the foldable screen device runs a document reading application to enter the document reading process (the first interface is the document reading interface). When the foldable screen device is unfolded from the first state and enters the second state, the translation application is selected as the first application based on the document reading application scenario.

[0361] Specifically, in another implementation of S2232, an associated application of the application (second application) whose application interface is displayed in the first display area before the expansion event is selected as the first application. In one embodiment, the associated application of the second application includes an AI assistant.

[0362] Furthermore, in some application scenarios, there may be multiple associated applications for the second application. In one implementation of S2232, the folding screen device selects one application from the multiple associated applications of the second application as the first application.

[0363] Specifically, in one embodiment, the folding screen device determines the first application that needs to be called up based on the application / system running status and / or user operation before the expansion event.

[0364] For example, the second application is a reading application, and the applications associated with the second application are a translation application and a note application.

[0365] Assume that in the first state, the foldable screen device runs the second application and displays text and image content in the first display area. After the user marks a section of text in the displayed text by sliding his finger, the foldable screen device is unfolded, triggering an unfold event.

[0366] The foldable device recognizes that the second application displays text and images in the first display area before the unfolding event, and the user marks a section of text by sliding a finger. Therefore, when the foldable device unfolds from the first state to the second state, the foldable device selects the translation application as the first application. In the second state, the second display area displays the application interfaces of the reading application and the translation application, and the translation application's application interface translates the user-marked text.

[0367] Assume that in the first state, the foldable screen device runs a second application and displays text and image content in the first display area. The user selects a piece of text and image in the displayed content using a frame selection method and then unfolds the foldable screen device, triggering an unfold event.

[0368] Before the foldable device recognizes the expansion event, the second application displays text and image content in the first display area, and the user selects a section of text and / or image using a frame selection method. Therefore, when the foldable device expands from the first state to the second state, the foldable device selects the note-taking application as the first application. In the second state, the second display area displays the application interfaces of the reading application and the note-taking application, and the text and image selected by the user are recorded and saved in the application interface of the note-taking application.

[0369] Assume that in the first state, the foldable screen device runs the second application and displays text + picture content in the first display area. When the user browses the text + picture content, the foldable screen device is unfolded, triggering the unfold event (without marking any content).

[0370] Before the foldable device recognizes the expansion event, the second application displays text and image content in the first display area, and the user has not selected any text and / or image. Therefore, when the foldable device expands from the first state to the second state, the foldable device does not select any application as the first application (does not call up the first application), but instead expands the application interface of the second application, thereby magnifying the text and image content displayed by the second application.

[0371] Specifically, in another embodiment, the folding screen device determines the first application that needs to be called up based on the unfolding direction.

[0372] For example, the second application is a reading application, and the applications associated with the second application are a translation application and a note application.

[0373] Assume that in the first state, the foldable screen device runs the second application and displays text and image content in the first display area. The user unfolds the foldable screen device horizontally, triggering an unfold event.

[0374] The foldable device detects that the device is unfolded in landscape orientation. Therefore, when the device unfolds from the first state to the second state, it selects the translation app as the first application. In the second state, the second display area displays the reading app and the translation app's interface, and the translation app's interface translates the text marked by the user.

[0375] Assume that in the first state, the foldable screen device runs the second application and displays text and image content in the first display area. The user unfolds the foldable screen device vertically, triggering an unfold event.

[0376] The foldable screen device recognizes that the unfolded orientation is portrait. Therefore, when the foldable screen device unfolds from the first state to the second state, the foldable screen device selects the note-taking app as the first application. In the second state, the second display area displays the application interfaces of the reading application and the note-taking app, and the text and images selected by the user are recorded and saved in the note-taking app interface.

[0377] In the description of the embodiments of the present application, for the convenience of description, the device is described as being divided into various modules according to their functions. The division of each module is merely a division of logical functions. When implementing the embodiments of the present application, the functions of each module can be implemented in the same or multiple software and / or hardware.

[0378] Specifically, the device proposed in the embodiment of the present application can be fully or partially integrated into a physical entity during actual implementation, or it can be physically separated. And these modules can all be implemented in the form of software calling through processing elements; or they can all be implemented in the form of hardware; or some modules can be implemented in the form of software calling through processing elements, and some modules can be implemented in the form of hardware. For example, the detection module can be a separately established processing element, or it can be integrated in a chip of an electronic device. The implementation of other modules is similar. In addition, these modules can be fully or partially integrated together, or they can be implemented independently. During the implementation process, each step of the above method or each of the above modules can be completed by the hardware integrated logic circuit in the processor element or the instructions in the form of software.

[0379] For example, the above modules may be one or more integrated circuits configured to implement the above methods, such as one or more application-specific integrated circuits (ASICs), one or more digital signal processors (DSPs), or one or more field programmable gate arrays (FPGAs). For another example, these modules may be integrated together and implemented in the form of a system-on-a-chip (SOC).

[0380] An embodiment of the present application further provides an electronic device.

[0381] FIG23 is a schematic structural diagram of an electronic device according to an embodiment of the present application.

[0382] As shown in Figure 23, the electronic device 2300 includes a memory 2302 for storing computer program instructions and a processor 2301 for executing program instructions, wherein, when the computer program instructions are executed by the processor 2301, the electronic device 2300 is triggered to execute the method steps described in the embodiment of the present application.

[0383] Specifically, in one embodiment of the present application, the above-mentioned one or more computer programs are stored in the above-mentioned memory 2302, and the above-mentioned one or more computer programs include instructions. When the above-mentioned instructions are executed by the above-mentioned electronic device 2300, the above-mentioned electronic device 2300 executes the method steps described in the embodiment of the present application.

[0384] It is understood that the structural description of the electronic device 2300 in the embodiment of the present application does not constitute a specific limitation on the electronic device 2300. In other embodiments of the present application, the electronic device 2300 may include other components besides the processor 2301 and the memory 2302.

[0385] The processor 2301 may be a device on a chip (SOC), and the processor 2301 may include a central processing unit (CPU), and may further include other types of processors.

[0386] The processor involved in processor 2301 may include, for example, a CPU, a DSP, a microcontroller, or a digital signal processor, and may also include a GPU, an embedded neural network processor (NPU), and an image signal processor (ISP). The processor may also include necessary hardware accelerators or logic processing hardware circuits, such as ASICs, or one or more integrated circuits for controlling the execution of the program of the technical solution of this application. In addition, the processor may have the function of operating one or more software programs, and the software programs may be stored in a storage medium.

[0387] The processor 2301 may include one or more processing units. For example, the processor may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Different processing units may be independent components or integrated into one or more processors. In some embodiments, the electronic device 2300 may also include one or more processors 2301. The controller may generate an operation control signal based on the instruction opcode and the timing signal to complete the control of instruction fetching and execution.

[0388] In some embodiments, the processor 2301 may include one or more interfaces. The interfaces may include an inter-integrated circuit (I2C) interface, an integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a SIM card interface, and / or a USB interface, etc. Among them, the USB interface is an interface that complies with the USB standard specification, and specifically can be a Mini USB interface, a Micro USB interface, a USB Type C interface, etc. The USB interface can be used to connect a charger to charge the electronic device, and can also be used to transmit data between the electronic device and peripheral devices.

[0389] Electronic device 2300 may also include an external memory interface for connecting an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device. The external memory card communicates with processor 2301 via the external memory interface to implement data storage. For example, files such as music and videos can be stored on the external memory card.

[0390] Memory 2302 may include a code storage area and a data storage area. The code storage area may store an operating system. The data storage area may store data generated during the use of electronic device 2300. Furthermore, memory 2302 may include high-speed random access memory and non-volatile memory, such as one or more disk storage components, flash memory components, and universal flash storage (UFS).

[0391] The memory 2302 may be a read-only memory (ROM), other types of static storage devices that can store static information and instructions, a random access memory (RAM) or other types of dynamic storage devices that can store information and instructions, or an electrically erasable programmable read-only memory (EEPROM), a compact disc read-only memory (CD-ROM) or other optical disc storage, optical disc storage (including compact discs, laser discs, optical discs, digital versatile discs, Blu-ray discs, etc.), a magnetic disk storage medium or other magnetic storage device, or any computer-readable medium that can be used to carry or store desired program code in the form of instructions or data structures and can be accessed by a computer.

[0392] The processor 2301 and the memory 2302 may be combined into one processing device, or more commonly, they may be independent components.

[0393] Furthermore, the devices, apparatuses, and modules described in the embodiments of the present application may be implemented by computer chips or entities, or by products having certain functions.

[0394] Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, apparatus, or computer program products. Thus, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware. Furthermore, the present invention may take the form of a computer program product implemented on one or more computer-usable storage media containing computer-usable program code.

[0395] In the several embodiments provided in this application, if any function is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this application, or the part that contributes to the prior art, or part of the technical solution, can be embodied in the form of a software product, which is stored in a storage medium and includes a number of instructions for enabling a computer device (which can be a personal computer, server, or network device, etc.) to perform all or part of the steps of the method described in each embodiment of this application.

[0396] Specifically, an embodiment of the present application further provides a computer-readable storage medium, which stores a computer program. When the computer-readable storage medium is run on a computer, the computer executes the method provided in the embodiment of the present application.

[0397] An embodiment of the present application further provides a computer program product, which includes a computer program. When the computer program product is run on a computer, it enables the computer to execute the method provided in the embodiment of the present application.

[0398] The embodiment description in this application is described with reference to the flow chart and / or block diagram according to the method, equipment (device) and computer program product of embodiment of the present application.It should be understood that each flow process and / or box in the flow chart and / or block diagram and the combination of the flow process and / or box in the flow chart and / or block diagram can be realized by computer program instructions.These computer program instructions can be provided to the processor of general-purpose computer, special-purpose computer, embedded processing machine or other programmable data processing equipment to produce a machine, so that the instruction executed by the processor of computer or other programmable data processing equipment produces the device for realizing the function specified in one flow chart flow chart or multiple flow charts and / or one block or multiple blocks of block diagram.

[0399] These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce a product including an instruction device that implements the functions specified in one or more processes in the flowchart and / or one or more boxes in the block diagram.

[0400] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, so that the instructions executed on the computer or other programmable device provide steps for implementing the functions specified in one or more processes in the flowchart and / or one or more boxes in the block diagram.

[0401] It should also be noted that, in the embodiments of the present application, "at least one" refers to one or more, and "more than one" refers to two or more. "And / or" describes the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can represent the existence of A alone, the existence of A and B at the same time, and the existence of B alone. Among them, A and B can be singular or plural. The character " / " generally indicates that the previous and subsequent associated objects are in an "or" relationship. "At least one of the following" and similar expressions refer to any combination of these items, including any combination of single or plural items. For example, at least one of a, b and c can represent: a, b, c, a and b, a and c, b and c or a and b and c, where a, b, c can be single or multiple.

[0402] In the embodiments of the present application, the terms "comprises," "includes," or any other variations thereof are intended to encompass non-exclusive inclusion, such that a process, method, commodity, or apparatus comprising a series of elements includes not only those elements but also other elements not explicitly listed, or elements inherent to such process, method, commodity, or apparatus. In the absence of further limitations, an element defined by the phrase "comprising a ..." does not preclude the presence of additional identical elements in the process, method, commodity, or apparatus comprising the element.

[0403] The present application may be described in the general context of computer-executable instructions executed by a computer, such as program modules. Generally, program modules include routines, programs, objects, components, data structures, etc. that perform specific tasks or implement specific abstract data types. The present application may also be practiced in distributed computing environments where tasks are performed by remote processing devices connected through a communications network. In a distributed computing environment, program modules may be located in local and remote computer storage media, including storage devices.

[0404] The various embodiments in this application are described in a progressive manner. Similar parts between the various embodiments can be referred to in conjunction with each other. Each embodiment focuses on the differences from other embodiments. In particular, the device embodiments are generally similar to the method embodiments, so the description is relatively simple. For relevant parts, refer to the partial description of the method embodiments.

[0405] Those skilled in the art will appreciate that the various units and algorithm steps described in the embodiments of the present application can be implemented using a combination of electronic hardware, computer software, and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professionals and technicians can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0406] Those skilled in the art will clearly understand that, for the convenience and brevity of description, the specific working processes of the above-described devices, apparatuses and units can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0407] The above description is merely a specific embodiment of the present application. Any person skilled in the art may easily conceive of variations or substitutions within the technical scope disclosed in this application, and such variations or substitutions shall be within the scope of protection of this application. The scope of protection of this application shall be subject to the scope of protection of the claims.

Claims

1. A method for calling an application, characterized in that: The method is applied to a folding screen device, and the state of the folding screen device includes at least a first state and a second state; The folding screen device in the first state enters the second state after experiencing an unfolding event; The method comprises: In the first state, activating the first display area, using the first display area to display a first interface, where the first interface is an operating interface of the folding screen device in the first state; When the folding screen device is unfolded from the first state to enter the second state, calling up the first application; In the second state, a second display area is activated, and a size of the second display area is larger than that of the first display area; The second display area is used to display a second interface and an application interface of the first application, wherein the second interface includes display content of the first interface.

2. The method according to claim 1, characterized in that: The size of the second interface is consistent with the size of the first interface; and / or, The display content of the second interface is consistent with the display content of the first interface; and / or, The display position of the first interface in the first display area does not change compared to the display position of the second interface in the second display area.

3. The method according to claim 1 or 2, characterized in that: The application interface of the first application is displayed in an increased portion of the second display area, and the increased portion is an activated area increased relative to the first display area.

4. The method according to any one of claims 1 to 3, characterized in that When the folding screen device is unfolded from the first state and enters the second state, before calling up the first application, the method further includes: After detecting an expansion event, identifying whether the expansion event corresponds to expansion from the first state to the second state.

5. The method according to claim 4, characterized in that The state of the folding screen device also includes at least a third state; the folding screen device in the third state enters the first state after experiencing an unfolding event; The method further comprises: In the third state, activating the third display area, using the third display area to display a third interface, wherein the size of the third display area is smaller than the first display area, and the third interface is the operating interface of the folding screen device in the third state; In the first state, the size of the third interface is expanded to generate the first interface.

6. The method according to any one of claims 1 to 5, characterized in that Before calling up the first application, the method further includes: Determine whether the current application scenario requires calling the first application.

7. The method according to claim 6, characterized in that The determining whether the current application scenario needs to call up the first application includes: Whether the first application needs to be launched is determined according to the pre-settings of the folding screen device, wherein when the folding screen device is set so that the unfolding operation does not trigger the launching of the application, it is determined that the first application does not need to be launched.

8. The method according to claim 6, characterized in that The determining whether the current application scenario needs to call up the first application includes: Determine whether the first application needs to be called up based on the application running status and / or user operation of the folding screen device before the expansion event occurs.

9. The method according to claim 6, characterized in that The determining whether the current application scenario needs to call up the first application includes: It is determined whether the first application needs to be called up according to the expansion direction corresponding to the expansion event.

10. The method according to claim 9, characterized in that When the expansion direction is vertical, it is determined that the first application does not need to be called up.

11. The method according to any one of claims 1 to 10, characterized in that The first application is an auxiliary application that provides auxiliary functions for the display content of the second interface.

12. The method according to any one of claims 1 to 11, characterized in that Before calling up the first application, the method further includes: Set an application on the foldable screen device as the first application.

13. The method according to claim 12, characterized in that The first application is an artificial intelligence assistant.

14. The method according to claim 13, characterized in that The calling up the first application includes: The operating parameters of the artificial intelligence assistant are configured according to the application scenario of the folding screen device before the expansion event, wherein the application interface of the artificial intelligence assistant in the second display area provides auxiliary functions corresponding to the display content of the second interface.

15. The method according to claim 14, characterized in that: The method further includes, in the first state, running a second application, wherein the first interface is an application interface of the second application; The calling up of the first application includes configuring the operating parameters of the artificial intelligence assistant according to the second application, wherein the application interface of the artificial intelligence assistant in the second display area provides auxiliary functions corresponding to the second application.

16. The method according to any one of claims 1 to 11, characterized in that Before calling up the first application, the method further includes: An application is determined as the first application.

17. The method according to claim 16, characterized in that The determining of the application as the first application includes: According to the application scenario of the folding screen device before the unfolding event, an application corresponding to the application scenario is selected as the first application.

18. The method according to claim 16, characterized in that The determining of the application as the first application includes: An associated application of a second application is selected as the first application, wherein the second application is an application that displays an application interface in the first display area.

19. The method according to claim 18, characterized in that The selecting the associated application of the second application as the first application includes: According to the running state of the folding screen device and / or the user operation before the unfolding event, an application is selected from multiple associated applications of the second application as the first application.

20. The method according to claim 18, characterized in that The associated applications of the second application include a third application and a fourth application; The selecting the associated application of the second application as the first application includes: When the expansion direction of the expansion event is vertical, selecting the third application as the first application; When the expansion direction of the expansion event is horizontal, the fourth application is selected as the first application.

21. An electronic device, characterized in that: The electronic device comprises a memory for storing computer program instructions and a processor for executing the computer program instructions, wherein when the computer program instructions are executed by the processor, the electronic device is triggered to execute the method steps as described in any one of claims 1-20.

22. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, which, when executed on a computer, enables the computer to execute the method according to any one of claims 1 to 20.

Images