Interaction method, intelligent terminal and storage medium

Abstract

The invention provides an interaction method, an intelligent terminal and a storage medium, and the method comprises the steps: collecting first state information when the intelligent terminal is in a folded state and an outer screen displays a first interface; in response to the first operation, collecting second attitude data; and determining or generating a second interface based on the first state information and the second posture data, and displaying the second interface on the outer screen. The first state information is collected when the intelligent terminal is in the folded state and the first interface is displayed on the outer screen, the display interface in the outer screen is switched based on the change of the posture data of the intelligent terminal in response to overturning of the intelligent terminal by a user, the problem that an interaction mode of the intelligent terminal is complex in operation in the related technology is solved, and then the user experience is improved.

Description

Technical Field

[0001] The present application relates to the field of electronic information technology, and in particular to an interaction method, an intelligent terminal and a storage medium. Background Art

[0002] The existing interaction methods of smart terminals mainly include touch operation-based interaction method, air gesture-based interaction method and voice interaction method.

[0003] In the process of conceiving and implementing this application, the inventors found that there are at least the following problems: The interactive method based on touch operation is suitable for most application scenarios, but the operation requirements of this method are complex. The interactive method based on air gestures has high hardware requirements for smart terminals during implementation, and the success rate of interaction is not high. The operation requirements of the voice interaction method are high during implementation, and the probability of misoperation is high, which to a certain extent leads to high power consumption of smart terminals.

[0004] Therefore, how to simplify the interaction mode of smart terminals has become an urgent problem to be solved.

[0005] It should be understood that the preceding description is intended to provide general background information and does not necessarily constitute prior art. Summary of the invention

[0006] In response to the above technical problems, the present application provides an interactive method, a smart terminal and a storage medium, so that the user can switch the display interface of the external screen by flipping the smart terminal with a folding function, and the operation is simple and convenient.

[0007] The present application provides an interaction method, which can be applied to a smart terminal, and the method includes:

[0008] S10: When the smart terminal is in a folded state and the outer screen displays a first interface, collecting first state information;

[0009] S20: In response to the first operation, collecting second posture data;

[0010] S30: Determine or generate a second interface based on the first state information and the second posture data, and display the second interface on the external screen.

[0011] Optionally, the intelligent terminal includes an interface switching relationship table of at least one application; the interface switching relationship table includes at least one posture change direction, an angle threshold corresponding to each of the posture change directions, and an application to be switched corresponding to each of the posture change directions, and S30 includes:

[0012] Determine the interface switching relationship table corresponding to the first application as the target relationship table;

[0013] determining or generating posture change data based on the first posture data and the second posture data;

[0014] When there is a target posture change direction in the target relationship table, determining an angle threshold corresponding to the target posture change direction as a target threshold;

[0015] When the posture change angle is not less than the target threshold, determining the application to be switched corresponding to the target posture change direction as the second application;

[0016] Determine that an application interface of the second application is the second interface, and display the second interface on the external screen.

[0017] Optionally, determining the application interface of the second application as the second interface includes:

[0018] When the second application is different from the first application, starting the second application;

[0019] The startup animation of the second application is displayed on the external screen, and the second interface is determined or generated as the startup interface of the second application.

[0020] Optionally, the interface switching relationship table also includes an interface to be displayed corresponding to each posture change direction;

[0021] The determining the application interface of the second application as the second interface also includes:

[0022] When the second application is the same as the first application, determining a corresponding interface animation according to the direction of the target posture change, and displaying it on an external screen;

[0023] A target interface to be displayed corresponding to the target posture change direction is determined in the target relationship table, and the second interface is determined or generated based on the target interface to be displayed.

[0024] Optionally, the first state information includes first position information of a controlled object in the first application;

[0025] The determining or generating the second interface based on the target interface to be displayed includes:

[0026] Determine or generate second position information of the controlled object based on the posture change data and the first position information;

[0027] The second interface is determined or generated according to the second position information and the target interface to be displayed.

[0028] Optionally, the external screen includes a first area; the first area has a display function;

[0029] After determining or generating the second position information of the controlled object based on the posture change data and the first position information, the method further includes:

[0030] When the second position information is located in the first area, determining a first area animation corresponding to the first area;

[0031] The first area animation is displayed through the external screen.

[0032] Optionally, the external screen includes a first area, and the first area does not have a display function;

[0033] After determining or generating the second position information of the controlled object based on the posture change data and the first position information, the method further includes:

[0034] When the second location information is within the first area, acquiring third location information of the first area;

[0035] Determining fifth position information of the controlled object based on the posture change data, the first position information and the third position information;

[0036] Determine a second area animation corresponding to the first area, and display the second area animation through the external screen;

[0037] The second interface is determined or generated according to the fifth position information and the target interface to be displayed.

[0038] Optionally, after determining that the angle threshold corresponding to the target posture change direction is the target threshold, the method further includes:

[0039] Determining or generating prompt information when the posture change angle exceeds a first angle threshold, and displaying the prompt information through the external screen;

[0040] In response to the user's second operation on the prompt information, a third interface is determined or generated according to the second operation, and the third interface is displayed through the external screen.

[0041] Optionally, in response to the user's second operation on the prompt information, determining or generating a third interface according to the second operation, and displaying the third interface through the external screen includes:

[0042] In response to a second operation of the user on the prompt information, determining instruction information of the second operation;

[0043] When the indication information indicates a switching interface, the steps of determining the application to be switched corresponding to the target posture change direction as the second application and subsequent steps are performed.

[0044] Optionally, after determining or generating the posture change data based on the first posture data and the second posture data, the method further includes:

[0045] When the posture change angle is less than the target threshold corresponding to the target posture change direction in the target relationship table, determining or generating that the second interface is the same as the first interface;

[0046] The second interface is displayed on the external screen.

[0047] Optionally, after determining or generating the posture change data based on the first posture data and the second posture data, the method further includes:

[0048] When the target posture change direction does not exist in the target relationship table, determining or generating that the second interface is the same as the first interface;

[0049] The second interface is displayed on the external screen.

[0050] The present application also provides an interactive device, which can be applied to a smart terminal, including:

[0051] A first display module, configured to collect first status information when the smart terminal is in a folded state and the outer screen displays a first interface;

[0052] A data collection module, configured to collect second posture data in response to the first operation;

[0053] A second display module is configured to determine or generate a second interface based on the first state information and the second posture data, and display the second interface on the external screen.

[0054] The present application also provides a smart terminal, including: a non-foldable external screen, a memory, and a processor, wherein an interactive program is stored in the memory, and when the interactive program is executed by the processor, the steps of the above method are implemented.

[0055] The present application also provides a computer storage medium, wherein the computer storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the above method are implemented.

[0056] As described above, the interaction method of the present application can be applied to a smart terminal, including: when the smart terminal is in a folded state and the external screen displays a first interface, collecting first state information; in response to a first operation, collecting second posture data; determining or generating a second interface based on the first state information and the second posture data, and displaying the second interface on the external screen. Through the above technical solution, in response to a user flipping the smart terminal, the display interface switching function of the external screen can be realized based on the change of the posture data of the smart terminal, thereby solving the problem of complex operation of the interaction mode of the smart terminal in the related technology, thereby improving the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0057] The drawings herein are incorporated into the specification and constitute a part of the specification, illustrate embodiments consistent with the present application, and are used together with the specification to explain the principles of the present application. In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for use in the description of the embodiments are briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without creative labor.

[0058] Figure 1 A schematic diagram of the hardware structure of a folding screen mobile phone for implementing each embodiment of the present application;

[0059] Figure 2 A communication network system architecture diagram provided for an embodiment of the present application;

[0060] Figure 3 This is an application scenario diagram of an interaction method provided in an embodiment of the present application;

[0061] Figure 4 is another application scenario diagram of an interaction method provided in an embodiment of the present application;

[0062] Figure 5 is a flowchart of an interaction method according to the first embodiment;

[0063] Figure 6 is a schematic diagram of posture data according to the first embodiment;

[0064] Figure 7 is a schematic diagram of an application of an interaction method according to the first embodiment;

[0065] Figure 8 is a flow chart of step S30 in an interaction method according to the second embodiment;

[0066] Fig. 9 is another application schematic diagram of an interaction method according to the second embodiment;

[0067] Fig.10 is a flowchart of step S305 in an interactive method according to the third embodiment;

[0068] Fig.11 is another application schematic diagram of an interaction method according to the third embodiment;

[0069] Fig.12 is another flowchart diagram of step S30 in an interaction method according to the fourth embodiment;

[0070] Fig.13 It is a schematic structural diagram of an interaction device according to the fifth embodiment.

[0071] The realization of the purpose, functional features and advantages of this application will be further described in conjunction with the embodiments and with reference to the accompanying drawings. The above-mentioned drawings have shown clear embodiments of this application, which will be described in more detail later. These drawings and textual descriptions are not intended to limit the scope of the concept of this application in any way, but to illustrate the concept of this application to those skilled in the art by referring to specific embodiments. DETAILED DESCRIPTION

[0072] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The implementations described in the following exemplary embodiments do not represent all implementations consistent with the present application. Instead, they are merely examples of devices and methods consistent with some aspects of the present application as detailed in the appended claims.

[0073] It should be noted that, in this article, the terms "include", "comprises" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the sentence "includes a ..." does not exclude the existence of other identical elements in the process, method, article or device including the element. In addition, components, features, and elements with the same name in different embodiments of the present application may have the same meaning or different meanings, and their specific meanings need to be determined by their explanation in the specific embodiment or further combined with the context of the specific embodiment.

[0074] It should be understood that, although the terms first, second, third, etc. may be used to describe various information in this article, these information should not be limited to these terms. These terms are only used to distinguish the same type of information from each other. For example, without departing from the scope of this article, the first information may also be referred to as the second information, and similarly, the second information may also be referred to as the first information. Depending on the context, the word "if" as used herein can be interpreted as "at the time of" or "when" or "in response to determination". Furthermore, as used in this article, the singular forms "one", "one" and "the" are intended to also include plural forms, unless there is an opposite indication in the context. It should be further understood that the terms "comprising" and "including" indicate that there are the described features, steps, operations, elements, components, projects, kinds, and / or groups, but do not exclude the existence, occurrence or addition of one or more other features, steps, operations, elements, components, projects, kinds, and / or groups. The terms "or", "and / or", "including at least one of the following" etc. used in this application can be interpreted as inclusive, or mean any one or any combination. For example, “comprising at least one of the following: A, B, C” means “any of the following: A; B; C; A and B; A and C; B and C; A and B and C”, and for another example, “A, B or C” or “A, B and / or C” means “any of the following: A; B; C; A and B; A and C; B and C; A and B and C”. An exception to this definition will only occur when a combination of elements, functions, steps or operations are inherently mutually exclusive in some manner.

[0075] It should be understood that, although the various steps in the flowchart in the embodiment of the present application are displayed in sequence according to the indication of the arrows, these steps are not necessarily performed in sequence according to the order indicated by the arrows. Unless there is a clear explanation in this article, the execution of these steps does not have a strict order restriction, and it can be performed in other orders. Moreover, at least a portion of the steps in the figure may include a plurality of sub-steps or a plurality of stages, and these sub-steps or stages are not necessarily performed at the same time, but can be performed at different times, and their execution order is not necessarily performed in sequence, but can be performed in turn or alternately with other steps or at least a portion of the sub-steps or stages of other steps.

[0076] As used herein, the words "if" and "if" may be interpreted as "at the time of" or "when" or "in response to determining" or "in response to detecting", depending on the context. Similarly, the phrases "if it is determined" or "if (stated condition or event) is detected" may be interpreted as "when it is determined" or "in response to determining" or "when detecting (stated condition or event)" or "in response to detecting (stated condition or event)", depending on the context.

[0077] It should be noted that, in this article, step codes such as S10, S20, S30 are used for the purpose of expressing the corresponding content more clearly and concisely, and do not constitute a substantial limitation on the sequence. When implementing the step, those skilled in the art may execute S20 first and then S10, etc., but these should all be within the scope of protection of this application.

[0078] It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0079] In the subsequent description, the suffixes such as "module", "component" or "unit" used to represent elements are only used to facilitate the description of the present application, and have no specific meanings. Therefore, "module", "component" or "unit" can be used in a mixed manner.

[0080] The smart terminal may be implemented in various forms. For example, the smart terminal described in the present application may include electronic devices such as foldable screen mobile phones with folding functions, candy-bar mobile phones, tablet computers, laptop computers, PDAs, portable media players (PMPs), navigation devices, wearable devices, smart bracelets, pedometers, etc.

[0081] The subsequent description will take a foldable screen mobile phone as an example. Those skilled in the art will understand that, in addition to components specifically used for mobile purposes, the construction according to the implementation of the present application can also be applied to fixed type terminals.

[0082] See also Figure 1 , which is a schematic diagram of the hardware structure of a folding screen mobile phone for implementing various embodiments of the present application. The folding screen mobile phone 100 may include: RF (Radio Frequency) unit 101, WiFi module 102, audio output unit 103, A / V (audio / video) input unit 104, sensor 105, display unit 106, user input unit 107, interface unit 108, memory 109, processor 110, and power supply 111. Those skilled in the art can understand that Figure 1 The foldable screen mobile phone structure shown in does not constitute a limitation on the foldable screen mobile phone. The foldable screen mobile phone may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently.

[0083] Combine the following Figure 1 A detailed introduction to the various components of foldable screen mobile phones:

[0084] The radio frequency unit 101 can be used for receiving and sending signals during information transmission or communication. Specifically, after receiving the downlink information of the base station, it is sent to the processor 110 for processing; in addition, the uplink data is sent to the base station. Generally, the radio frequency unit 101 includes but is not limited to an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, etc. In addition, the radio frequency unit 101 can also communicate with the network and other devices through wireless communication. The above-mentioned wireless communications can use any communication standard or protocol, including but not limited to GSM (Global System of Mobile communication), GPRS (General Packet Radio Service), CDMA2000 (Code Division Multiple Access 2000), WCDMA (Wideband Code Division Multiple Access), TD-SCDMA (Time Division-Synchronous Code Division Multiple Access), FDD-LTE (Frequency Division Duplexing-Long Term Evolution), TDD-LTE (Time Division Duplexing-Long Term Evolution), 5G and 6G, etc.

[0085] WiFi is a short-range wireless transmission technology. The foldable screen mobile phone can help users send and receive emails, browse web pages and access streaming media through the WiFi module 102. It provides users with wireless broadband Internet access. Figure 1 A WiFi module 102 is shown, but it is understandable that it is not a necessary component of the foldable screen mobile phone and can be omitted as needed without changing the essence of the invention.

[0086] The audio output unit 103 can convert the audio data received by the RF unit 101 or the WiFi module 102 or stored in the memory 109 into an audio signal and output it as sound when the foldable screen mobile phone 100 is in a call signal receiving mode, a call mode, a recording mode, a voice recognition mode, a broadcast receiving mode, etc. Moreover, the audio output unit 103 can also provide audio output related to a specific function performed by the foldable screen mobile phone 100 (for example, a call signal receiving sound, a message receiving sound, etc.). The audio output unit 103 may include a speaker, a buzzer, and the like.

[0087] The A / V input unit 104 is used to receive audio or video signals. The A / V input unit 104 may include a graphics processor (GPU) 1041 and a microphone 1042, and the graphics processor 1041 processes the image data of a static picture or video obtained by an image capture device (such as a camera) in a video capture mode or an image capture mode. The processed image frame can be displayed on the display unit 106. The image frame processed by the graphics processor 1041 can be stored in the memory 109 (or other storage medium) or sent via the radio frequency unit 101 or the WiFi module 102. The microphone 1042 can receive sound (audio data) via the microphone 1042 in a telephone call mode, a recording mode, a voice recognition mode, and other operating modes, and can process such sound into audio data. The processed audio (voice) data can be converted into a format output that can be sent to a mobile communication base station via the radio frequency unit 101 in the case of a telephone call mode. The microphone 1042 can implement various types of noise elimination (or suppression) algorithms to eliminate (or suppress) noise or interference generated in the process of receiving and sending audio signals.

[0088] The foldable screen mobile phone 100 also includes at least one sensor 105, such as a light sensor, a gyroscope and other sensors. Optionally, the light sensor includes an ambient light sensor and a proximity sensor. Optionally, the ambient light sensor can adjust the brightness of the display panel 1061 and / or the display panel 1062 according to the brightness of the ambient light. The proximity sensor can turn off the display panel 1061, the display panel 1062 and / or the backlight when the foldable screen mobile phone 100 is moved to the ear. As a kind of motion sensor, the accelerometer sensor can detect the magnitude of acceleration in all directions (generally three axes), and can detect the magnitude and direction of gravity when stationary. It can be used for applications that identify the posture of the mobile phone (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), vibration recognition related functions (such as pedometer, tapping), etc.; Optionally, the gyroscope can measure the rotation speed and direction of the foldable electronic device, including angular velocity and angle. As for other sensors such as fingerprint sensors, pressure sensors, iris sensors, molecular sensors, barometers, hygrometers, thermometers, infrared sensors, etc. that can also be configured on the mobile phone, they will not be repeated here.

[0089] The display unit 106 is used to display information input by the user or information provided to the user. The display unit 106 may include a foldable display panel 1061 and a non-foldable display panel 1062. The display panel 1061 and / or the display panel 1062 may be configured in the form of a liquid crystal display (LCD), an organic light-emitting diode (OLED), or the like.

[0090] The user input unit 107 can be used to receive input digital or character information, and to generate key signal input related to the user settings and function control of the folding screen mobile phone 100. Optionally, the user input unit 107 may include a touch panel 1071 and other input devices 1072. The touch panel 1071, also known as a touch screen, can collect the user's touch operation on or near it (such as the user's operation on the touch panel 1071 or near the touch panel 1071 using any suitable object or accessory such as a finger, stylus, etc.), and drive the corresponding connection device according to a pre-set program. The touch panel 1071 may include two parts: a touch detection device and a touch controller. Optionally, the touch detection device detects the user's touch orientation, detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts it into the touch point coordinates, and then sends it to the processor 110, and can receive and execute commands sent by the processor 110. In addition, the touch panel 1071 can be implemented in various types such as resistive, capacitive, infrared, and surface acoustic waves. In addition to the touch panel 1071, the user input unit 107 may further include other input devices 1072. Optionally, the other input devices 1072 may include but are not limited to at least one of a physical keyboard, a function key (such as a volume control key, a switch key, etc.), a trackball, a mouse, a joystick, etc., which are not specifically limited here.

[0091] Optionally, the touch panel 1071 may cover the display panel 1061 and / or the display panel 1062. When the touch panel 1071 detects a touch operation on or near it, it is transmitted to the processor 110 to determine the type of the touch event. Then, the processor 110 provides corresponding visual output on the display panel 1061 and / or the display panel 1062 according to the type of the touch event. Figure 1 In the figure, the touch panel 1071 and the display panel 1061 and / or the display panel 1062 are all used as independent components to realize the input and output functions of the foldable screen mobile phone. However, in some embodiments, the touch panel 1071 can be integrated with the display panel 1061 and / or the display panel 1062 to realize the input and output functions of the foldable screen mobile phone, which is not limited here.

[0092] The interface unit 108 is used as an interface through which at least one external device can be connected to the folding screen mobile phone 100. For example, the external device may include a wired or wireless headset port, an external power supply (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device with an identification module, an audio input / output (I / O) port, a video I / O port, a headphone port, etc. The interface unit 108 can be used to receive input (e.g., data information, power, etc.) from an external device and transmit the received input to one or more elements in the folding screen mobile phone 100 or can be used to transmit data between the folding screen mobile phone 100 and an external device.

[0093] The memory 109 can be used to store software programs and various data. The memory 109 can mainly include a program storage area and a data storage area. Optionally, the program storage area can store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc.; the data storage area can store data created according to the use of the mobile phone (such as audio data, a phone book, etc.), etc. In addition, the memory 109 can include a high-speed random access memory, and can also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other volatile solid-state storage devices.

[0094] The processor 110 is the control center of the foldable screen mobile phone. It uses various interfaces and lines to connect the various parts of the entire foldable screen mobile phone. By running or executing software programs and / or modules stored in the memory 109, and calling the data stored in the memory 109, it executes various functions of the foldable screen mobile phone and processes data, thereby monitoring the foldable screen mobile phone as a whole. The processor 110 may include one or more processing units; preferably, the processor 110 may integrate an application processor and a modem processor. Optionally, the application processor mainly processes the operating system, user interface, and application programs, and the modem processor mainly processes wireless communications. It is understandable that the above-mentioned modem processor may not be integrated into the processor 110.

[0095] The foldable screen mobile phone 100 may also include a power supply 111 (such as a battery) for supplying power to various components. Preferably, the power supply 111 may be logically connected to the processor 110 through a power management system, thereby implementing functions such as charging, discharging, and power consumption management through the power management system.

[0096] although Figure 1 Not shown, the foldable screen mobile phone 100 may also include a Bluetooth module, etc., which will not be elaborated here.

[0097] To facilitate understanding of the embodiments of the present application, the communication network system on which the folding screen mobile phone of the present application is based is described below.

[0098] See also Figure 2 , Figure 2 A communication network system architecture diagram is provided for an embodiment of the present application, wherein the communication network system is an LTE system of universal mobile communication technology, and the LTE system includes a UE (User Equipment) 201, an E-UTRAN (Evolved UMTS Terrestrial Radio Access Network) 202, an EPC (Evolved Packet Core) 203 and an operator's IP service 204, which are connected in sequence for communication.

[0099] Optionally, UE201 may be the above-mentioned terminal 100, which will not be described in detail here.

[0100] E-UTRAN 202 includes eNodeB 2021 and other eNodeBs 2022 , etc. Optionally, eNodeB 2021 may be connected to other eNodeBs 2022 via a backhaul (eg, an X2 interface), and eNodeB 2021 is connected to EPC 203 , and eNodeB 2021 may provide UE 201 with access to EPC 203 .

[0101] EPC203 may include MME (Mobility Management Entity) 2031, HSS (Home Subscriber Server) 2032, other MMEs 2033, SGW (Serving Gate Way) 2034, PGW (PDN Gate Way) 2035 and PCRF (Policy and Charging Rules Function) 2036, etc. Optionally, MME 2031 is a control node that processes signaling between UE 201 and EPC 203, and provides bearer and connection management. HSS 2032 is used to provide some registers to manage functions such as home location register (not shown in the figure), and store some user-specific information such as service features and data rates. All user data can be sent through SGW2034, PGW2035 can provide IP address allocation and other functions for UE 201, PCRF2036 is the policy and charging control policy decision point for service data flow and IP bearer resources, which selects and provides available policy and charging control decisions for the policy and charging execution function unit (not shown in the figure).

[0102] The IP service 204 may include the Internet, an intranet, an IMS (IP Multimedia Subsystem) or other IP services.

[0103] Although the above introduction takes the LTE system as an example, those skilled in the art should know that the present application is not only applicable to the LTE system, but also to other wireless communication systems, such as GSM, CDMA2000, WCDMA, TD-SCDMA, 5G and future new network systems (such as 6G), etc., without limitation here.

[0104] Based on the above-mentioned folding screen mobile phone hardware structure and communication network system, various embodiments of the present application are proposed.

[0105] In some embodiments, users can interact with the smart terminal through touch-based interaction, air gesture-based interaction, voice interaction, etc. However, the above interaction methods have problems such as complex operation requirements, low interaction success rate, or high probability of misoperation, which makes the interaction efficiency of the smart terminal low and affects the user experience.

[0106] In order to solve the above technical problems, an embodiment of the present application provides an interaction method, which can be applied to a smart terminal having a folding display screen. The folding display screen includes but is not limited to a horizontal folding display screen and a vertical folding display screen, and may include multiple screens. When the smart terminal is in a folded state and the external screen displays a first interface, first state information is collected, and in response to the user flipping the smart terminal to collect second posture data, the display interface of the external screen is switched based on the first state information and the second posture data. In the above method, in response to the user flipping the smart terminal, the smart terminal can switch the display interface of the external screen based on the change of posture data, which is simple to operate and improves the efficiency of interaction.

[0107] Let's take a vertical folding screen mobile phone as an example. Figure 3 , introduce the application scenarios of this application.

[0108] Figure 3 A schematic diagram of an application scenario provided by an embodiment of the present application. Figure 3 The foldable screen mobile phone includes an unfolded state and a folded state. The foldable screen mobile phone is provided with a foldable display screen 301 and a non-foldable outer screen 302.

[0109] In the folded state, the foldable electronic device displays the application interface 3021 of the first application (for the sake of convenience, hereinafter referred to as the first interface) through the external screen 302. When the user flips the foldable screen mobile phone, the foldable screen mobile phone tilts along the horizontal axis (or vertical axis, depth axis), that is, the foldable screen mobile phone produces a change in posture data during the flipping process, and the display interface of the external screen 302 of the foldable screen mobile phone is switched to the second interface 3022, wherein the second interface 3022 is used to display the application interface of the second application, and the second application may include the first application. In this way, in response to the first operation of the user flipping the foldable screen electronic device, the foldable screen electronic device can flexibly switch the display interface of the external screen, which is simple to operate and improves the interaction efficiency of the foldable screen mobile phone.

[0110] The following still takes the vertical folding screen mobile phone as an example. Figure 4 , further introduces the application scenarios of this application.

[0111] See also Figure 4 In the folded state, the foldable screen mobile phone displays the first interface 401 through the external screen. After the user flips the foldable screen mobile phone, the state of the foldable screen mobile phone changes to state 402. At this time, in order to facilitate viewing of the switched second interface, there is a possibility that the user flips the foldable screen mobile phone back to the original spatial position, causing the state of the foldable electronic device to change to state 403.

[0112] Based on this, the maximum difference between the second posture data collected during the process of the user flipping the folding screen mobile phone (such as the posture data in state 402) and the first posture data collected before the user flips the folding screen mobile phone (such as the posture data in state 401) is set as the data basis for realizing the interaction.

[0113] The technical solutions shown in the present application are described in detail through specific embodiments. Optionally, the following embodiments may exist alone or in combination with each other, and the same or similar contents will not be described repeatedly in different embodiments.

[0114] First embodiment

[0115] Figure 5 A flowchart of an interactive method provided in an embodiment of the present application. Figure 5 , the method may include:

[0116] S10: When the smart terminal is in a folded state and the outer screen displays a first interface, first state information is collected; optionally, the first state information includes first posture data of the smart terminal and a first application corresponding to the first interface.

[0117] Optionally, multiple applications are installed in the smart terminal, and each application has at least one application interface. When the smart terminal is in a folded state, the application interface of the first application, that is, the first interface, can be displayed through the external screen. The first state information includes but is not limited to the first posture data of the smart terminal and the first application. Among them, the first application is used to indicate the application in the foreground running state when the smart terminal is in a folded state.

[0118] Optionally, the first posture data of the intelligent terminal can be collected by a gyroscope. It should be understood that the posture data collected by the gyroscope includes angular velocity data, angle data and rotation axis information.

[0119] Figure 6 , a schematic diagram of posture data is provided as an example.

[0120] See also Figure 6 The attitude data collected by the gyroscope includes multiple directions (such as up, down, left, right, front, and back) and corresponding angular velocity information (such as deflection angle and pitch angle).

[0121] Optionally, the external screen in the smart terminal may be a touch screen.

[0122] S20: In response to the first operation, collecting second posture data.

[0123] Optionally, in response to a first operation of the user flipping over the smart terminal, the smart terminal detects a change in the posture data and collects second posture data of the smart terminal.

[0124] Optionally, the second posture data may indicate all posture data from when the posture data is monitored to when the posture data tends to be stable.

[0125] S30: Determine or generate a second interface based on the first state information and the second posture data, and display the second interface on the external screen.

[0126] Optionally, the second interface includes an application interface of a second application; and the second application includes the first application.

[0127] Optionally, under the first operation of the user flipping the smart terminal, when the smart terminal detects that the posture data has changed, there is a certain difference between the collected first posture data and the second posture data, and the corresponding second application and the application interface of the second application are determined according to the difference between the first posture data and the second posture data, and displayed as the second interface through the external screen. Optionally, the second application includes the first application.

[0128] Take the smart terminal as a vertical folding screen mobile phone, and the first application as a desktop application as an example. Figure 7 An exemplary application diagram illustrating the interaction method.

[0129] See also Figure 7 In the folded state, the foldable screen mobile phone displays a first interface through the external screen, the first interface is a first application interface 701 of the desktop application, and the first application interface 701 includes application icons such as time bar, call, album, camera, etc.). The foldable screen mobile phone collects first state information, including the first application and the first posture data.

[0130] The user can flip the foldable screen phone upward and / or backward (first operation) to switch the interface displayed on the outer screen of the foldable screen phone; after receiving the first operation, the foldable screen phone collects the second posture data according to the first operation. Based on the first posture data and the second posture data, the second interface is determined to be the second application interface 702 of the desktop application, and the second application interface 702 includes a time bar and an information notification window.

[0131] Optionally, the intelligent terminal determines the first operation in response to changes in the posture data monitored by the gyroscope, and correspondingly collects the second posture data.

[0132] Optionally, the first operation includes operations such as flipping up, flipping down, flipping right, flipping left, flipping forward, and flipping backward. The corresponding gyroscope can monitor posture data including posture changes in directions such as up, down, left, right, forward, and backward. This application does not make any specific limitations on this.

[0133] The embodiment of the present application provides an interactive method, which collects first state information when the smart terminal is in a folded state and displays a first interface through an external screen, collects corresponding second posture data in response to a first operation of a user flipping the smart terminal, determines the application interface of a second application as a second interface based on the first state information and the second posture data, and displays it through the external screen. In the above method, when the user flips the smart terminal, the smart terminal can flexibly switch the display interface of the external screen, which is simple to operate and improves the interactive efficiency of the smart terminal.

[0134] Second embodiment

[0135] Optionally, the intelligent terminal includes an interface switching relationship table of at least one application; the interface switching relationship table includes at least one posture change direction, an angle threshold corresponding to each of the posture change directions, and an application to be switched corresponding to each of the posture change directions.

[0136] Optionally, the interface switching relationship table of the application can be represented by Table 1:

[0137] Table 1 Interface switching relationship table

[0138]

[0139] It can be seen from Table 1 that the application ID of the application is 001. The application interface switching relationship table includes 4 posture change directions, each posture change direction has a corresponding angle threshold and a corresponding application to be switched.

[0140] It is understandable that, in the interface switching relationship of the same application, the angle thresholds corresponding to the directions of posture change may be the same or different. The applications to be switched corresponding to the directions of posture change may be the same or different. The posture change directions included in the interface switching relationship table of each application may be the same or different. The posture change directions, angle thresholds, and applications to be switched in each interface switching relationship table may be specifically set according to actual conditions.

[0141] exist Figure 5 Based on the embodiment shown, the following Figure 8 , further illustrating the above interaction method.

[0142] Figure 8 This is a flow chart of step S30 of another interactive method provided in an embodiment of the present application. Figure 8 , step S30 in the method may include:

[0143] S301, determining that the interface switching relationship table corresponding to the first application is a target relationship table;

[0144] S302, determining or generating posture change data based on the first posture data and the second posture data;

[0145] Optionally, the posture change data includes a target posture change direction and a posture change angle;

[0146] S303, when there is a target posture change direction in the target relationship table, determining an angle threshold corresponding to the target posture change direction as a target threshold;

[0147] S304, when the posture change angle is not less than the target threshold, determining the application to be switched corresponding to the target posture change direction as the second application;

[0148] S305: Determine that the application interface of the second application is the second interface, and display the second interface on the external screen.

[0149] Optionally, in the interface relationship tables of each application, the interface switching relationship table corresponding to the first application is determined as the target relationship table.

[0150] Exemplarily, the first state information includes an application ID of the first application. In the interface relationship table of each application, the interface switching relationship table corresponding to the application ID of the first application is matched as the target relationship table.

[0151] Optionally, based on the first posture data and the second posture data, the target posture change direction and posture change angle are calculated.

[0152] Optionally, the target posture change direction is used to indicate the deflection direction of the second posture data relative to the first posture data, and the posture change angle is used to indicate the angular deviation of the second posture data relative to the first posture data in the target posture change direction.

[0153] Optionally, the target posture change direction includes: upward, downward, rightward, leftward, forward, backward, etc. The interval value of the posture change data is [0,90).

[0154] Optionally, when there is a target posture change direction in the target relationship table, an angle threshold corresponding to the target posture change direction in the target relationship table is determined as the target threshold.

[0155] Optionally, when the posture change angle is not less than the target threshold, it is determined that the interface switching condition is met, and the application to be switched corresponding to the target posture change direction in the target relationship table is determined as the second application.

[0156] Optionally, the application interface of the second application is determined as the second interface, and the second interface is displayed through the external screen.

[0157] In some embodiments, determining that the application interface of the second application is the second interface includes:

[0158] When the second application is different from the first application, starting the second application;

[0159] The startup animation of the second application is displayed on the external screen, and the second interface is determined or generated as the startup interface of the second application.

[0160] Optionally, when the first application is different from the second application, the second application needs to be started because the second application is in a non-foreground running state (including a background running state and an exit state).

[0161] Optionally, during the process of starting the second application, the startup animation of the second application is displayed through the external screen, and the second interface is determined as the startup interface of the second application, so that when the startup of the second application is completed, the application interface of the second application is displayed through the external screen.

[0162] Optionally, during the process of starting the second application, the first application is updated to a background running state or an exit state.

[0163] As an example but not limitation, during the display of any at least one animation, animation sound effects and / or vibrations may be played accordingly.

[0164] Next, take the smart terminal as a vertical folding screen mobile phone, and the first application as a camera application as an example. Fig. 9 Another application diagram exemplarily illustrating the interaction method.

[0165] See also Fig. 9 In the folded state, the foldable screen mobile phone displays a first interface through the external screen, and the first interface is a preview interface 901 of the camera application. The foldable screen mobile phone collects first state information, including a first application and a first posture data.

[0166] The user can switch the interface displayed on the external screen of the foldable screen phone by flipping the foldable screen phone to the left (first operation); after receiving the first operation, the foldable screen phone collects the second posture data according to the first operation. Based on the first posture data and the second posture data, the second application is determined to be an album application, the album application is started, and the startup animation 902 of the album application is displayed on the external screen. When the album application is started, the second interface is determined to be the picture display interface 903 of the album application, and the picture display interface 903 includes multiple pictures, and the picture display interface 903 is displayed on the external screen.

[0167] In some embodiments, after determining or generating the posture change data based on the first posture data and the second posture data, step S30 further includes:

[0168] When the posture change angle is less than the target threshold corresponding to the target posture change direction in the target relationship table, determining or generating that the second interface is the same as the first interface;

[0169] The second interface is displayed on the external screen.

[0170] Optionally, when the posture change angle is less than the target threshold value corresponding to the target posture change direction in the target relationship table, it indicates that the first operation does not meet the interface switching condition. That is, after the first operation, the second interface of the smart terminal is the same as the first interface, and the second interface (also referred to as the first interface) is displayed through the external screen.

[0171] In some embodiments, after determining or generating the posture change data based on the first posture data and the second posture data, step S30 further includes:

[0172] When the target posture change direction does not exist in the target relationship table, determining or generating that the second interface is the same as the first interface;

[0173] The second interface is displayed on the external screen.

[0174] Optionally, when there is no target posture change direction in the target relationship table, it indicates that the first operation does not meet the interface switching condition. That is, after the first operation, the second interface of the smart terminal is the same as the first interface, and the second interface (also referred to as the first interface) is displayed through the external screen.

[0175] The embodiment of the present application determines not to switch the display interface of the external screen and still displays the first interface in response to the first operation and determines that the posture change data does not meet the corresponding conditions, without additionally performing operations such as determining the application to be switched, thereby reducing power consumption.

[0176] Third embodiment

[0177] Optionally, the interface switching relationship table also includes an interface to be displayed corresponding to each posture change direction.

[0178] Optionally, the interface switching relationship table of the application can be represented by Table 2:

[0179] Table 2 Interface switching relationship table

[0180]

[0181] Among them, interface to be displayed: 001-1 represents interface 1 of application 001, interface to be displayed: 001-2 identifies interface 2 of application 001; interface to be displayed: 003-1 represents interface 1 of application 003, and interface to be displayed: 002-1 represents interface 1 of application 002.

[0182] It can be seen from Table 2 that the same application has different interfaces to be displayed in different posture change directions. Each interface to be displayed is associated with an application to be switched.

[0183] Fig.10 This is an example flow chart of step S305 in an interactive method provided in an embodiment of the present application. Fig.10 The method step S305 further includes:

[0184] S3051: When the second application is the same as the first application, determining a corresponding interface animation according to the target posture change direction, and displaying it on an external screen;

[0185] Optionally, the interface animation includes at least one of an upward sliding animation, a downward sliding animation, a left sliding animation, a right sliding animation, a rotation animation, a zooming animation, and a jumping animation;

[0186] S3052: Determine in the target relationship table a target interface to be displayed that corresponds to the target posture change direction, and determine or generate the second interface based on the target interface to be displayed.

[0187] Optionally, when the second application is the same as the first application, a corresponding animation may be determined according to the target posture change direction, and the corresponding animation may be displayed on the external screen.

[0188] Optionally, the animation includes but is not limited to at least one of an upward sliding animation, a downward sliding animation, a left sliding animation, a right sliding animation, a rotation animation, a zooming animation, and a jumping animation.

[0189] It can be understood that when the animation is displayed in the external screen, the animation generally indicates the effect of sliding in a two-dimensional space.

[0190] As an example but not limitation, the animation may also include a sliding effect in a three-dimensional space, and the corresponding animation also includes a forward sliding animation and a backward sliding animation.

[0191] Optionally, the first state information further includes first position information of a controlled object in the first application.

[0192] Optionally, while the first application is running in the foreground, in response to a third operation of the user on the application interface of the first application on the external screen, a controlled object in the first application is selected to perform corresponding control.

[0193] Optionally, the controlled object may include a window, a control (such as a button, etc.), or an area in the first application. The third operation may include an operation of the user on the first interface in the external screen output through an external input device, or may be a touch operation of the user directly on the first interface in the external screen. The third operation may be a click operation or a drag operation.

[0194] Optionally, the to-be-displayed interface corresponding to the target posture change direction is determined in the target relationship table as the target to-be-displayed interface, and the second interface is determined based on the target to-be-displayed interface.

[0195] In some embodiments, determining or generating the second interface based on the target interface to be displayed includes:

[0196] Determine or generate second position information of the controlled object based on the posture change data and the first position information;

[0197] The second interface is determined or generated according to the second position information and the target interface to be displayed.

[0198] Optionally, when the first interface includes a controlled object of the first application, and in the target relationship table, the interface to be displayed corresponding to the target posture change direction and the first interface are the same application interface of the first application, it is determined that there is no need to switch the application interface of the first application in the external screen, and the controlled object in the first application should be controlled.

[0199] Optionally, in response to a first operation of flipping the smart terminal by the user, second position information of the controlled object is calculated based on a target posture change direction and a posture change angle in the posture change data and first position information of the controlled object.

[0200] Optionally, the first position information is used to indicate the relative position of the controlled object in the first interface, and the second position information is used to indicate the relative position of the controlled object in the second interface.

[0201] Optionally, a corresponding second interface is determined based on the second position information of the controlled object and the first interface, so as to display in the second interface displayed on the external screen: the controlled object after the position change after the first operation.

[0202] Optionally, the external screen includes a first area; the first area has a display function;

[0203] After determining or generating the second position information of the controlled object based on the posture change data and the first position information, the method further includes:

[0204] When the second position information is located in the first area, determining a first area animation corresponding to the first area;

[0205] The first area animation is displayed through the external screen.

[0206] Optionally, the first area animation includes at least one of a scrolling animation, a fade-in animation, and a fade-out animation.

[0207] Optionally, when the external screen includes a first area and the first area has a display function, it is indicated that the controlled object can be displayed normally in the first area.

[0208] Optionally, when the second position information is located in the first area, a first area animation corresponding to the first area is determined, and the first area animation is displayed through an external screen; optionally, the first area animation is used to represent the animation effect of the controlled object from the first position information to the second position information in the first area, and the first area animation is but not limited to at least one of a scrolling animation, a fade-in animation, and a fade-out animation.

[0209] As an example but not limitation, the first area includes an area where a hardware device is located, an area where a preset control is located, or an area where a preset window is located. For example, the first area is an area where a camera, a flash, a microphone, a receiver, or a display light is located. Alternatively, the first area is a dialog window display area. Alternatively, the first area is an area where a "mouse" control is located.

[0210] Optionally, the external screen includes a first area; the first area does not have a display function;

[0211] After determining or generating the second position information of the controlled object based on the posture change data and the first position information, the method further includes:

[0212] When the second location information is within the first area, acquiring third location information of the first area;

[0213] Based on the posture change data, the first position information and the third position information, fifth position information of the controlled object is determined.

[0214] Optionally, the fifth location information is located within the first area or outside the first area;

[0215] A second area animation corresponding to the first area is determined, and the second area animation is displayed through the external screen.

[0216] Optionally, the second area animation includes at least one of a fade-out animation, a dissolve animation, and a folding animation;

[0217] The second interface is determined or generated according to the fifth position information and the target interface to be displayed.

[0218] Optionally, when the external screen includes the first area, and the first area does not have a display function, it is indicated that the controlled object cannot be normally displayed in the first area.

[0219] Optionally, when the second position information is located in the first area, it is determined that the controlled object cannot be displayed normally, the third position information of the first area is obtained, and the fifth position information of the controlled object is determined based on the posture change data, the first position information and the third position information. When the fifth position information is located in the first area, it is determined that the controlled object still cannot be displayed normally. When the fifth position information is not located in the first area, the controlled object can be displayed normally.

[0220] Optionally, a second area animation corresponding to the first area is determined and displayed through an external screen; when the fifth position information is located in the first area, the second area animation is used to represent the animation of the disappearance process of the controlled object from the first position information to the fifth position information.

[0221] Optionally, when the fifth position information is not located in the first area, the second area animation is used to represent the process animation of the controlled object from the first position information to the fifth position information.

[0222] Optionally, the second area animation includes but is not limited to at least one of a fade-out animation, a dissolve animation, and a folding animation.

[0223] Optionally, the second interface is determined according to the fifth position information and the target interface to be displayed. The second interface is the same as the first application corresponding to the first interface, and the position of the controlled object in the second interface is different from the position of the controlled object in the first interface.

[0224] Optionally, when the fifth position information is located in the first area, the second interface does not include the controlled object.

[0225] Optionally, the first area has a display function;

[0226] After determining or generating the second position information of the controlled object based on the posture change data and the first position information, the method further includes:

[0227] When the second position information is not located in the first area, the second interface is determined or generated according to the second position information and the target interface to be displayed.

[0228] Optionally, the external screen includes a first area, and the first area has a display function, indicating that the controlled object can be displayed normally in the first area.

[0229] Optionally, when the second position information is not located in the first area, the second interface is determined directly according to the second position information and the target interface to be displayed, without acquiring the third position information of the first area.

[0230] Optionally, the first area does not have a display function;

[0231] After determining or generating the second position information of the controlled object based on the posture change data and the first position information, the method further includes:

[0232] When the second position information is not located in the first area, the second interface is determined or generated according to the second position information and the target interface to be displayed.

[0233] Optionally, the external screen includes a first area, and the first area does not have a display function, indicating that the controlled object cannot be displayed normally in the first area.

[0234] Optionally, when the second position information is not located in the first area, the second interface is determined directly according to the second position information and the target interface to be displayed, without acquiring the third position information of the first area.

[0235] In the following, the smart terminal is a vertical folding screen mobile phone, the first application is a game application, and the outer screen includes a first area where two cameras and preset controls (including 111, 112, 113, and 114) are located as an example. Fig.11 A schematic diagram exemplarily illustrating another application of the interaction method.

[0236] See also Fig.11 The outer screen includes a first area where two cameras are located. When the folding screen mobile phone is in the folded state, the first interface is displayed through the outer screen. The first interface is an application interface 1101 of a game application. The controlled object in the application interface 1101 is a small ball 1102. The folding screen mobile phone collects first state information, including a first application and first posture data. Optionally, the first area does not have a display function.

[0237] The user can flip the foldable screen mobile phone upward (or downward, left, right) (first operation) to change the position of the controlled object, the small ball 1102, in the external screen display interface of the foldable screen mobile phone.

[0238] After the folding screen mobile phone receives the first operation, the second posture data is collected according to the first operation. Based on the first posture data and the second posture data, it is determined that the second application is still a game application, and the second interface is still an application interface of the game application. The second position information of the ball is further determined based on the posture change data and the first position information of the ball.

[0239] It should be understood that as the user continues to flip the folding screen phone, the second position information of the ball 1102 keeps changing, and the position of the corresponding ball displayed on the external screen keeps changing.

[0240] When the second position information of the ball 1102 is within the first area, the ball 1102 changes its motion trajectory through the second area animation based on the third position information of the first area, and moves to the corresponding position according to the fifth position information. See the external screen switching from displaying the application interface 1101 of the game application to displaying the application interface 1103 and the application interface 1104 of the game application.

[0241] When the second position information of the ball 1102 is not located in the first area, the ball 1102 changes its motion trajectory through interface animation based on the second position information, and moves to the corresponding position according to the second position information. See the external screen switching from displaying the application interface 1101 of the game application to displaying the application interface 1105 and the application interface 1106 of the game application.

[0242] The embodiment of the present application collects first posture data, first application, and first position information of the controlled object in the first application when the smart terminal is in a folded state and the external screen displays the first interface. And in response to the first operation of the user flipping the smart terminal, the second posture data of the smart terminal is collected. The second position information of the controlled object is determined based on the first state information and the second position information, so as to facilitate the display of the position of the controlled object in the first application after the first operation through the external screen, simplify the user operation, and improve the fun and efficiency of the interaction.

[0243] Fourth embodiment

[0244] exist Figure 5 Based on the embodiment shown below, combined with Fig.12 , further illustrating the above interaction method.

[0245] Fig.12 This is another example flow chart of step S30 in an interactive method provided in an embodiment of the present application. Fig.12 In S303, the method step S30 further includes the following steps:

[0246] S306: Determine or generate prompt information when the posture change angle exceeds a first angle threshold, and display the prompt information through the external screen.

[0247] Optionally, the first angle threshold is greater than the target threshold.

[0248] Optionally, when the posture change angle exceeds a first angle threshold, a prompt message is generated and displayed on an external screen to prompt the user that the flip angle of the first operation exceeds the first angle threshold, and to obtain indication information on whether the user needs to continue the interface switching operation.

[0249] Optionally, the first angle threshold is greater than the target threshold.

[0250] Exemplarily, the target threshold is 20°, and the corresponding first angle threshold is set to 55°.

[0251] As another example, the target threshold is 30°, and the corresponding first angle threshold is set to 70°.

[0252] S307: In response to a second operation of the user on the prompt information, determine or generate a third interface according to the second operation, and display the third interface through the external screen.

[0253] Optionally, a second operation of the user on the prompt information in the external screen is received, the instruction information of the second operation is determined to determine the corresponding third interface, and the third interface is displayed through the external screen. Optionally, the third interface includes the first interface or the second interface.

[0254] Optionally, the third operation includes an operation of the user on the first interface on the external screen through an external input device, or may be a touch operation of the user directly on the first interface on the external screen.

[0255] Optionally, the third operation includes a click operation or a drag operation.

[0256] In some embodiments, step S307 of the method includes:

[0257] In response to a second operation of the user on the prompt information, determining instruction information of the second operation;

[0258] When the indication information indicates a switching interface, the steps of determining the application to be switched corresponding to the target posture change direction as the second application and subsequent steps are performed.

[0259] Optionally, the third interface is the same as the second interface.

[0260] Optionally, a second operation of the user on the prompt information on the external screen is received, and in response to the second operation of the user on the prompt information, indication information of the second operation is determined.

[0261] Optionally, the prompt information includes switching the interface or not switching the interface.

[0262] Optionally, when the instruction information of the second operation indicates switching the interface, it is determined that the display interface of the external screen needs to be switched, and step S304 and subsequent steps are executed.

[0263] Optionally, when the instruction information of the second operation indicates switching interfaces, the third interface is the same as the second interface.

[0264] In some embodiments, step S307 of the method further includes:

[0265] When the instruction information indicates not to switch interfaces, determining that the third interface is the same as the first interface;

[0266] The third interface is displayed through the external screen.

[0267] Optionally, the third interface is the same as the first interface.

[0268] Optionally, when the indication information of the second operation indicates not to switch the interface, it is determined not to switch the display interface of the external screen, that is, after the first operation and the second operation, the external screen display interface is the same as the first interface, and the third interface (also called the first interface) is displayed through the external screen.

[0269] The embodiment of the present application determines or generates prompt information when the posture change angle exceeds the first angle threshold, and performs a corresponding operation based on the instruction information of the second operation performed by the user, such as switching the external screen display interface or not switching the external screen display interface, thereby reducing the probability of misoperation and improving the interactive stability of the smart terminal.

[0270] The above examples are only reference examples. In order to avoid redundancy, they are not listed one by one here. In actual development or application, they can be flexibly combined according to actual needs, but any combination belongs to the technical solution of this application and is covered within the scope of protection of this application.

[0271] Fifth embodiment

[0272] Fig.13This is a schematic diagram of the structure of an interactive device provided in an embodiment of the present application. The interactive device 13 is applied to a smart terminal. Fig.13 The interactive device 13 includes a first display module 131, a data acquisition module 132, and a second display module 133, wherein:

[0273] The first display module 131 is used to collect first status information when the smart terminal is in a folded state and the outer screen displays a first interface;

[0274] Optionally, the first state information includes first posture data of the smart terminal and a first application corresponding to the first interface;

[0275] A data collection module 132, configured to collect second posture data in response to the first operation;

[0276] The second display module 133 is used to determine or generate a second interface based on the first state information and the second posture data, and display the second interface on the external screen.

[0277] Optionally, the second interface includes an application interface of a second application; and the second application includes the first application.

[0278] Optionally, the intelligent terminal includes an interface switching relationship table of at least one application; the interface switching relationship table includes at least one posture change direction, an angle threshold corresponding to each posture change direction, and an application to be switched corresponding to each posture change direction;

[0279] The second display module includes:

[0280] A relationship table determination unit, used to determine the interface switching relationship table corresponding to the first application as a target relationship table;

[0281] a posture data determining unit, configured to determine or generate posture change data based on the first posture data and the second posture data;

[0282] Wherein, the posture change data includes the target posture change direction and posture change angle;

[0283] A target threshold determination unit, configured to determine, when there is a target posture change direction in the target relationship table, an angle threshold corresponding to the target posture change direction as the target threshold;

[0284] an application switching unit, configured to determine the application to be switched corresponding to the target posture change direction as the second application when the posture change angle is not less than the target threshold;

[0285] The first interface display unit is used to determine the application interface of the second application as the second interface, and display the second interface on the external screen.

[0286] Optionally, the interface display unit includes:

[0287] an application launching subunit, configured to launch the second application when the second application is different from the first application;

[0288] A startup animation display unit is used to display the startup animation of the second application through the external screen, and determine or generate the second interface as the startup interface of the second application.

[0289] Optionally, the interface switching relationship table also includes an interface to be displayed corresponding to each posture change direction;

[0290] The first interface display unit also includes:

[0291] An animation determination subunit, used for determining a corresponding interface animation according to a change direction of the target posture when the second application is the same as the first application, and displaying the animation on an external screen;

[0292] Optionally, the interface animation includes at least one of an upward sliding animation, a downward sliding animation, a left sliding animation, a right sliding animation, a rotation animation, a zooming animation, and a jumping animation;

[0293] The interface determination subunit is used to determine the target interface to be displayed corresponding to the target posture change direction in the target relationship table, and determine or generate the second interface based on the target interface to be displayed.

[0294] Optionally, the first state information further includes first position information of a controlled object in the first application;

[0295] The interface determination subunit is used to:

[0296] Determine or generate second position information of the controlled object based on the posture change data and the first position information;

[0297] The second interface is determined or generated according to the second position information and the target interface to be displayed.

[0298] Optionally, the external screen includes a first area; the first area has a display function;

[0299] The interface determination subunit is also used to:

[0300] When the second position information is located in the first area, determining a first area animation corresponding to the first area;

[0301] The first area animation is displayed through the external screen; optionally, the first area animation includes at least one of a scrolling animation, a fade-in animation, and a fade-out animation.

[0302] Optionally, the external screen includes a first area; the first area does not have a display function;

[0303] The interface determination subunit is also used to:

[0304] When the second location information is within the first area, acquiring third location information of the first area;

[0305] Determining fifth position information of the controlled object based on the posture change data, the first position information and the third position information;

[0306] Optionally, the fifth location information is located within the first area or outside the first area;

[0307] Determine a second area animation corresponding to the first area, and display the second area animation through the external screen;

[0308] Optionally, the second area animation includes at least one of a fade-out animation, a dissolve animation, and a folding animation;

[0309] The second interface is determined or generated according to the fifth position information and the target interface to be displayed.

[0310] Optionally, the second display module further includes:

[0311] a prompt unit, configured to determine or generate prompt information when the posture change angle exceeds a first angle threshold, and display the prompt information through the external screen; optionally, the first angle threshold is greater than the target threshold;

[0312] An information receiving unit is used to respond to the user's second operation on the prompt information, determine or generate a third interface according to the second operation, and display the third interface through the external screen.

[0313] Optionally, the information receiving unit is used to:

[0314] In response to a second operation of the user on the prompt information, determining instruction information of the second operation;

[0315] When the indication information indicates a switching interface, the steps of determining the application to be switched corresponding to the target posture change direction as the second application and subsequent steps are performed.

[0316] Optionally, the third interface is the same as the second interface.

[0317] Optionally, the second display module further includes:

[0318] A first interface determination unit, configured to determine or generate that the second interface is the same as the first interface when the posture change angle is less than a target threshold value corresponding to the target posture change direction in the target relationship table;

[0319] A second interface display unit is used to display the second interface on the external screen.

[0320] Optionally, the second display module further includes:

[0321] A second interface determination unit, configured to determine or generate that the second interface is the same as the first interface when the target posture change direction does not exist in the target relationship table;

[0322] A second interface display unit is used to display the second interface on the external screen.

[0323] The interactive device provided in this embodiment can be used to execute the technical solution of the above method embodiment. Its implementation principle and technical effects are similar and will not be described in detail in this embodiment.

[0324] The present application also provides a smart terminal, which includes a non-foldable external screen, a memory, and a processor. The memory stores an interactive program, and when the interactive program is executed by the processor, the steps of the interactive method in any of the above embodiments are implemented.

[0325] The present application also provides a computer-readable storage medium, on which an interactive program is stored. When the interactive program is executed by a processor, the steps of the interactive method in any of the above embodiments are implemented.

[0326] In the embodiments of the smart terminal and computer-readable storage medium provided in the present application, all technical features of any of the above-mentioned interaction method embodiments may be included, and the expanded and explained contents of the specification are basically the same as those of the embodiments of the above-mentioned methods, and will not be repeated here.

[0327] The embodiment of the present application further provides a computer program product, which includes a computer program code. When the computer program code runs on a computer, the computer executes the methods in the above various possible implementation modes.

[0328] An embodiment of the present application also provides a chip, including a memory and a processor, the memory is used to store a computer program, and the processor is used to call and run the computer program from the memory, so that a device equipped with the chip executes the methods in various possible implementation modes as described above.

[0329] It is understood that the above scenarios are only examples and do not constitute a limitation on the application scenarios of the technical solutions provided in the embodiments of the present application. The technical solutions of the present application can also be applied to other scenarios. For example, it is known to those skilled in the art that with the evolution of the system architecture and the emergence of new business scenarios, the technical solutions provided in the embodiments of the present application are also applicable to similar technical problems.

[0330] The serial numbers of the above-mentioned embodiments of the present application are for description only and do not represent the advantages or disadvantages of the embodiments.

[0331] The steps in the method of the embodiment of the present application can be adjusted in order, combined and deleted according to actual needs.

[0332] The units in the device of the embodiment of the present application can be merged, divided and deleted according to actual needs.

[0333] In the present application, the same or similar terminology concepts, technical solutions and / or application scenario descriptions are generally described in detail only the first time they appear. When they appear again later, they are generally not repeated for the sake of brevity. When understanding the technical solutions and other contents of the present application, for the same or similar terminology concepts, technical solutions and / or application scenario descriptions that are not described in detail later, reference can be made to the previous related detailed descriptions.

[0334] In the present application, the description of each embodiment has its own emphasis. For parts that are not described or recorded in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0335] The various technical features of the technical solution of the present application can be arbitrarily combined. In order to make the description concise, not all possible combinations of the various technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of the present application.

[0336] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) as above, and includes a number of instructions for a terminal device (which can be a mobile phone, a computer, a server, a controlled terminal, or a network device, etc.) to execute the method of each embodiment of the present application.

[0337] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When loading and executing computer program instructions on a computer, the process or function according to the embodiment of the present application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. The computer instructions can be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions can be transmitted from a website site, a computer, a server or a data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line) or wireless (e.g., infrared, wireless, microwave, etc.) mode to another website site, computer, server or data center. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server, a data center, etc. that contains one or more available media integrated. The available medium can be a magnetic medium, (e.g., a floppy disk, a storage disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state storage disk Solid State Disk (SSD)), etc.

[0338] The above are only preferred embodiments of the present application, and are not intended to limit the patent scope of the present application. Any equivalent structure or equivalent process transformation made using the contents of the present application specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present application.

Claims

1. An interactive method, characterized in that: The method comprises: S10: When the smart terminal is in a folded state and the outer screen displays a first interface, collecting first state information; S20: In response to the first operation, collecting second posture data; S30: Determine or generate a second interface based on the first state information and the second posture data, and display the second interface on the external screen.

2. The method according to claim 1, characterized in that The intelligent terminal includes an interface switching relationship table of at least one application; the interface switching relationship table includes at least one posture change direction, an angle threshold corresponding to each posture change direction, and an application to be switched corresponding to each posture change direction, and S30 includes: Determine the interface switching relationship table corresponding to the first application as the target relationship table; determining or generating posture change data based on the first posture data and the second posture data; When there is a target posture change direction in the target relationship table, determining an angle threshold corresponding to the target posture change direction as a target threshold; When the posture change angle is not less than the target threshold, determining the application to be switched corresponding to the target posture change direction as the second application; Determine that an application interface of the second application is the second interface, and display the second interface on the external screen.

3. The method according to claim 2, characterized in that The determining that the application interface of the second application is the second interface includes: When the second application is different from the first application, starting the second application; Displaying a startup animation of a second application on the external screen, determining or generating the second interface as a startup interface of the second application; and / or, The interface switching relationship table also includes an interface to be displayed corresponding to each posture change direction; The determining the application interface of the second application as the second interface also includes: When the second application is the same as the first application, determining a corresponding interface animation according to the target posture change direction, and displaying it on an external screen; A target interface to be displayed corresponding to the target posture change direction is determined in the target relationship table, and the second interface is determined or generated based on the target interface to be displayed.

4. The method according to claim 3, characterized in that The first state information includes first position information of a controlled object in the first application; The determining or generating the second interface based on the target interface to be displayed includes: Determine or generate second position information of the controlled object based on the posture change data and the first position information; The second interface is determined or generated according to the second position information and the target interface to be displayed.

5. The method according to claim 4, characterized in that The external screen includes a first area; the first area has a display function; After determining or generating the second position information of the controlled object based on the posture change data and the first position information, the method further includes: When the second position information is located in the first area, determining a first area animation corresponding to the first area; The first area animation is displayed through the external screen.

6. The method according to claim 4, characterized in that The external screen includes a first area, and the first area does not have a display function; After determining or generating the second position information of the controlled object based on the posture change data and the first position information, the method further includes: When the second location information is within the first area, acquiring third location information of the first area; Determining fifth position information of the controlled object based on the posture change data, the first position information and the third position information; Determine a second area animation corresponding to the first area, and display the second area animation through the external screen; The second interface is determined or generated according to the fifth position information and the target interface to be displayed.

7. The method according to any one of claims 2 to 6, characterized in that After determining that the angle threshold corresponding to the target posture change direction is the target threshold, the method further includes: Determining or generating prompt information when the posture change angle exceeds a first angle threshold, and displaying the prompt information through the external screen; In response to a second operation of the user on the prompt information, determining or generating a third interface according to the second operation, and displaying the third interface through the external screen; and / or, After determining or generating the posture change data based on the first posture data and the second posture data, the method further includes: When the posture change angle is less than the target threshold corresponding to the target posture change direction in the target relationship table, determining or generating that the second interface is the same as the first interface; Displaying the second interface on the external screen; and / or, When the target posture change direction does not exist in the target relationship table, determining or generating that the second interface is the same as the first interface; The second interface is displayed on the external screen.

8. The method according to claim 7, characterized in that In response to the user's second operation on the prompt information, determining or generating a third interface according to the second operation, and displaying the third interface through the external screen, includes: In response to a second operation of the user on the prompt information, determining instruction information of the second operation; When the indication information indicates a switching interface, the steps of determining the application to be switched corresponding to the target posture change direction as the second application and subsequent steps are performed.

9. An intelligent terminal, characterized in that: The smart terminal includes: a non-foldable external screen, a memory, and a processor, wherein an interactive program is stored in the memory, and when the interactive program is executed by the processor, the steps of the interactive method according to any one of claims 1 to 8 are implemented.

10. A readable storage medium, characterized in that: The readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the interaction method according to any one of claims 1 to 8 are implemented.

Images